-- Logs begin at Tue 2022-08-23 09:53:41 UTC, end at Tue 2022-08-23 12:24:24 UTC. -- Aug 23 10:26:13.386033 n-d-847009-13 systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 10:26:13.393308 n-d-847009-13 devstack@n-api.service[106450]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 10:26:13 2022] *** Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: nodename: n-d-847009-13 Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: machine: x86_64 Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: clock source: unix Aug 23 10:26:13.395279 n-d-847009-13 devstack@n-api.service[106450]: pcre jit disabled Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: detected number of CPU cores: 4 Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: current working directory: / Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: detected binary path: /usr/bin/uwsgi-core Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: your processes number limit is 47680 Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: your memory page size is 4096 bytes Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: detected max file descriptor number: 2048 Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: lock engine: pthread robust mutexes Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: thunder lock: enabled Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 10:26:13.396425 n-d-847009-13 devstack@n-api.service[106450]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 10:26:13.435909 n-d-847009-13 devstack@n-api.service[106450]: Python main interpreter initialized at 0x564a6532e9c0 Aug 23 10:26:13.435909 n-d-847009-13 devstack@n-api.service[106450]: python threads support enabled Aug 23 10:26:13.435909 n-d-847009-13 devstack@n-api.service[106450]: your server socket listen backlog is limited to 100 connections Aug 23 10:26:13.435909 n-d-847009-13 devstack@n-api.service[106450]: your mercy for graceful operations on workers is 90 seconds Aug 23 10:26:13.436328 n-d-847009-13 devstack@n-api.service[106450]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 10:26:13.436405 n-d-847009-13 devstack@n-api.service[106450]: *** Operational MODE: preforking *** Aug 23 10:26:13.436618 n-d-847009-13 devstack@n-api.service[106450]: *** uWSGI is running in multiple interpreter mode *** Aug 23 10:26:13.436618 n-d-847009-13 devstack@n-api.service[106450]: spawned uWSGI master process (pid: 106450) Aug 23 10:26:13.436857 n-d-847009-13 systemd[1]: Started Devstack devstack@n-api.service. Aug 23 10:26:13.438300 n-d-847009-13 devstack@n-api.service[106450]: spawned uWSGI worker 1 (pid: 106451, cores: 1) Aug 23 10:26:13.440770 n-d-847009-13 devstack@n-api.service[106450]: spawned uWSGI worker 2 (pid: 106452, cores: 1) Aug 23 10:26:13.440770 n-d-847009-13 devstack@n-api.service[106450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 10:26:14.101808 n-d-847009-13 devstack@n-api.service[106452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 10:26:14.112515 n-d-847009-13 devstack@n-api.service[106451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 10:26:15.198168 n-d-847009-13 devstack@n-api.service[106452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:26:15.198168 n-d-847009-13 devstack@n-api.service[106452]: from cryptography.utils import int_from_bytes Aug 23 10:26:15.198762 n-d-847009-13 devstack@n-api.service[106452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:26:15.198762 n-d-847009-13 devstack@n-api.service[106452]: from cryptography.utils import int_from_bytes Aug 23 10:26:15.254887 n-d-847009-13 devstack@n-api.service[106451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:26:15.254887 n-d-847009-13 devstack@n-api.service[106451]: from cryptography.utils import int_from_bytes Aug 23 10:26:15.255494 n-d-847009-13 devstack@n-api.service[106451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:26:15.255494 n-d-847009-13 devstack@n-api.service[106451]: from cryptography.utils import int_from_bytes Aug 23 10:26:17.715390 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 10:26:17.715955 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 10:26:17.716158 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 10:26:17.716525 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 10:26:17.716801 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 10:26:17.717196 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.717526 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.717852 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.718172 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.718506 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.718820 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.719142 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.719551 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.719885 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.720150 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.720468 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.720826 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-13 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.721157 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.721465 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.721780 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.722100 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.722408 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.722731 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.723039 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.723532 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.724700 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.725140 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.725486 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.725800 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.726119 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.726426 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.726752 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.727065 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.727369 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 10:26:17.728004 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.728183 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 10:26:17.728384 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.728384 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-13 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.728708 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 10:26:17.728904 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.729141 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 10:26:17.729321 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.729474 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 10:26:17.729661 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.729894 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730100 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730253 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730409 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730535 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730701 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730825 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.730989 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731126 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731250 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731372 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731493 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731629 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731629 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.731889 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732018 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732154 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732278 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732411 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732535 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732656 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732798 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-13 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.732923 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733073 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733213 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733350 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733474 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733610 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733741 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.733945 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734080 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734205 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734334 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734334 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734575 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734791 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.734927 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735059 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735194 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735341 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735466 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735589 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735773 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.735908 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736048 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736183 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736317 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736440 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736562 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736695 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736848 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.736981 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737105 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737228 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737351 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737485 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737608 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737731 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.737918 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738054 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738232 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738360 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-13 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738540 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738667 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738845 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.738989 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.739162 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.739400 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.740129 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.740340 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.740565 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.740731 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.740886 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741010 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741158 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741299 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741516 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741655 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741804 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.741938 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.742115 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.742243 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.742451 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.742580 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.742769 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.742895 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.743078 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.743205 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.743375 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.743515 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.743690 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.743818 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744025 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744159 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744293 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744429 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744593 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744723 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.744919 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745046 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745182 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745308 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745462 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745590 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745782 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.745917 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.746080 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.746466 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.746649 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.746789 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.746922 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747055 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747180 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747304 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747425 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747591 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747737 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.747864 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748036 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748171 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748343 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748471 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748650 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748848 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.748984 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.749108 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.749269 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.749408 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.749574 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.749703 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.749878 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750012 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750173 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750296 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750471 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750606 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750776 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.750910 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.751092 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.751226 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.751398 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.751524 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.751706 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.751833 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752011 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752147 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752314 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752484 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752620 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752767 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.752948 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.753089 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.753255 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.753383 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.753561 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.753689 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.753880 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.754016 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.754219 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.754355 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.754479 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.754614 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.754776 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.755498 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.755638 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.755933 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.755933 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756174 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756297 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756431 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756564 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756696 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756860 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.756984 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757126 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757253 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757376 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757505 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757628 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757751 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.757883 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758007 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758129 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758251 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758387 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758511 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758642 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758767 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.758896 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759029 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759154 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759277 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759442 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759571 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759762 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.759890 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.760084 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.760328 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.760468 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.760592 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.760722 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.760878 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.761015 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.761150 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.761276 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.761397 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.761595 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.761724 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.761914 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.762054 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.762219 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.762346 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.762524 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.762651 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.762827 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.762972 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.763129 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.763266 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.763449 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.763577 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.763753 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.763889 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.764054 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.764182 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.764389 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.764517 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.764663 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.764846 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.764982 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.765106 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.765292 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.765428 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.765597 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.765726 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.765901 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.766022 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.766216 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.766343 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.766512 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.766640 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.766815 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.766951 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.767129 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.767256 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.767432 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.767569 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.767734 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.767868 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.768034 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.768162 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.768335 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.768464 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.768636 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.768788 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.768962 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.769100 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.769261 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.769390 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.769561 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.769695 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.769855 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.769991 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.770173 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.770341 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.770523 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.770658 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.770910 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.771125 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.771351 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.771550 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.771688 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.771820 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.771945 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.772081 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:26:17.772206 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.772328 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.772458 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.772581 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.772792 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.772943 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.773103 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.773239 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.773419 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.773546 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.773735 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.773872 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.774050 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.774190 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.774435 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.774574 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.774708 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.774830 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775006 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775143 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775322 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775451 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775642 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775779 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.775956 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.776085 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.776267 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.776395 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.776580 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.776709 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.776916 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777046 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777226 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777355 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777534 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777663 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777845 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.777973 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.778153 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.778290 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.778469 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.778597 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.778795 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.778929 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.779105 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.779248 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.779412 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.779539 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.779734 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.779868 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780046 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780183 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780364 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780497 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780663 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780852 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.780980 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.781115 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.781302 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.781433 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.781608 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.781742 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.781949 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782077 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782227 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782355 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782557 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782685 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782870 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.782997 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.783192 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.783318 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.783499 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.783637 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.783807 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.783934 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.784115 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.784243 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.784425 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.784630 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.784796 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.784923 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785047 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785169 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785360 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785506 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785676 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785803 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.785989 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.786645 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.786857 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787078 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787285 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787436 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787562 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787687 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787810 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.787944 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.788105 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.788232 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.788410 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.788538 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.788715 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.788890 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789047 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789176 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789350 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789487 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789653 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789795 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.789957 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790087 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790265 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790393 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790568 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790720 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790856 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.790989 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.791162 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.791290 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.791468 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.791598 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.791772 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.791901 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.792075 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.792202 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.792388 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.792517 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.792697 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.792847 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793025 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793165 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793327 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793456 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793632 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793759 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.793941 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.794077 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.794262 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.794390 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.794567 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.794776 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.794904 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795028 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795152 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795274 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795466 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795602 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795775 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.795911 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.796084 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.796211 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.796394 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.796530 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.796716 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.796895 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.797050 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.797179 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.797360 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.797489 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.797692 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.797820 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798018 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798147 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798320 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798455 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798645 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798773 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.798965 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.799092 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.799275 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.799401 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.799574 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.799701 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.799881 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800009 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800185 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800313 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800519 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800664 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800802 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.800943 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.801103 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.801245 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.801403 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.801531 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.801704 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.802431 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.802633 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.802895 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.803106 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.803325 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.803456 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.803651 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.803909 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.804079 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.804209 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.804333 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.804490 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.804618 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.804875 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805028 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805144 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805267 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805458 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805587 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805774 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.805903 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.806102 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.806229 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.806417 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.806554 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.806736 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.806870 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807044 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807170 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807359 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807493 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807668 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807805 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.807980 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.808109 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.808289 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.808416 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.808600 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.808727 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.808945 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.809070 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.809254 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.809381 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.809567 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.809696 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.809877 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810005 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810185 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810331 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810491 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810654 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810804 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.810925 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.811166 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.811301 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.811476 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.811603 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.811788 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.811917 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.812096 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.812300 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.812428 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.812551 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.812726 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.812918 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.813045 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.813178 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.813353 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.813480 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.813691 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.813825 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814018 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814148 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814327 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814454 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814638 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814767 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.814961 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.815112 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.815265 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.815387 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.815571 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.815708 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.815878 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.816150 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.816297 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.816485 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.816630 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.816847 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.816989 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.817116 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.817239 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.817403 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.817555 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.817771 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.817981 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818139 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818139 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818375 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818498 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818631 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818755 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.818877 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819009 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819134 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819305 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819441 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819612 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819739 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.819918 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820043 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820222 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820358 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820524 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820691 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820837 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.820961 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.821154 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.821283 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.821461 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.821588 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.821766 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.821894 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822066 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822195 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822377 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822504 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822684 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822810 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.822985 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.823111 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.823291 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.823418 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.823596 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.823724 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.823905 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.824034 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.824210 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.824336 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.824528 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.824811 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.824955 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.825169 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.825297 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.825454 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.825580 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.825773 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.825902 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826080 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826207 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826381 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826509 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826682 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826810 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.826985 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.827113 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.827325 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.827452 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.827633 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.827775 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.827936 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.828064 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.828249 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.828376 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.828554 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.828690 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.828885 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829023 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829193 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829319 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829498 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829634 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829802 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.829929 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.830115 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.830244 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.830421 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.830551 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.830757 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.830896 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831022 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831141 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831323 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831452 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831630 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831757 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.831930 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.832057 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.832242 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.832372 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.832545 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.832671 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.832876 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.833184 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.833421 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.833631 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.833808 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.833937 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834061 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834194 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834319 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834451 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834576 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834700 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.834824 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835038 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835184 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835378 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835499 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835662 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835789 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.835980 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.836109 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.836283 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.836408 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.836609 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.836769 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.836952 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837080 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837258 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837394 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837605 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837741 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837875 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.837999 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.838154 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.838281 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.838456 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.838591 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.838765 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.838892 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839064 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839190 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839366 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839492 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839667 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839803 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.839967 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.840094 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.840263 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.840397 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.840564 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.840698 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.840908 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841032 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841168 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841300 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841468 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841596 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841767 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.841893 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842075 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842212 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842375 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842511 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842677 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842802 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.842987 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.843122 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.843285 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.843409 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.843584 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.843711 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.843885 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844026 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844186 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844321 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844490 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844626 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844821 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.844964 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.845134 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.845262 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.845466 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.845603 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.845759 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.845888 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846062 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846198 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846364 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846492 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846668 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846795 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.846968 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.847096 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.847266 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.847393 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.847565 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.847720 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.847868 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.848002 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.848168 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.848310 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.848474 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.848611 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.849595 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.849788 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.849935 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850072 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850206 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850330 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850454 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850578 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850701 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.850834 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851017 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851144 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851267 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851402 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851526 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851665 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851797 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.851922 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852045 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852168 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852291 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852424 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852583 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852718 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.852860 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853023 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853164 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853333 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853460 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853638 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853777 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.853950 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854086 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854249 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854387 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854548 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854674 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854846 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.854983 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.855153 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.855279 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.855459 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.855667 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.855795 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.855929 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.856054 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.856177 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.856354 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.856482 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.856654 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.856828 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857076 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857205 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857328 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857451 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857592 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857733 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857858 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.857983 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.858139 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.858265 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.858458 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.858588 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.858771 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.858898 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859069 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859198 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859376 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859508 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859675 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859810 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.859974 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.860103 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.860273 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.860402 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.860577 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.860706 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.860897 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861076 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861205 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861328 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861485 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861613 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861782 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.861923 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.862079 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.862208 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.862397 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.862525 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.862703 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.862844 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863002 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863131 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863306 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863433 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863605 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863742 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.863942 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.864070 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.864262 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.865009 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.865318 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.865525 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.865696 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.865892 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866019 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866143 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866278 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866412 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866537 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866670 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866794 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.866947 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.867087 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.867257 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.867393 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.867668 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.867792 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.867981 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.868122 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.868291 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.868426 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.868594 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.868721 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.868919 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869047 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869219 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869348 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869534 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869668 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869841 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.869969 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.870143 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.870269 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.870461 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.870589 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.870781 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.870911 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.871363 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.871516 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.871673 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.871814 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.871980 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.872110 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.872289 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.872417 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.872596 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.872762 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.872941 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.873070 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.873247 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.873373 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.873554 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.873697 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.873892 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874024 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874208 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874334 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874514 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874651 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874820 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.874947 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.875124 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.875253 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.875432 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.875570 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.875740 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.875883 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876081 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876217 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876358 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876530 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876658 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876867 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.876996 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.877197 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.877338 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.877523 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.877651 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.877831 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.877959 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.878131 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.878269 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.878446 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.878572 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.878758 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.878887 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.879083 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.879225 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.879411 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.879539 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.879721 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.879850 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.880052 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.880249 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.880459 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.880627 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.880785 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.880913 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.881059 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.881208 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.881337 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.881651 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.881787 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.881912 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882046 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882214 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882350 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882523 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882660 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882823 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.882961 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.883122 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.883260 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.883428 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.883647 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.883785 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.883919 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884044 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884179 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884312 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884437 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884609 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884784 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.884952 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.885083 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.885253 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.885382 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.885570 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.885698 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.885960 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886098 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886280 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886416 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886555 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886680 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886863 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.886999 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.887187 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.887324 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.887493 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.887631 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.887816 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.887946 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.888131 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.888260 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.888449 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.888589 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.888764 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.888910 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.889078 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.889207 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.889385 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.889524 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.889705 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.889835 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890008 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890136 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890315 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890453 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890621 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890784 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.890910 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891041 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891223 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891361 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891528 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891655 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891837 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.891967 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.892154 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.892284 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.892496 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.892623 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.892855 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.892985 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.893183 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.893321 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.893504 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.893633 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.893894 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894034 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894175 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894300 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894433 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894567 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894694 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894817 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.894985 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.895115 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.895288 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.895424 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.895628 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.895849 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.896060 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.896268 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.896435 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.896571 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.896698 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.896900 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897036 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897162 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897293 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897427 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897552 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897685 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897813 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.897926 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898048 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898172 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898328 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898466 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898630 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898758 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.898935 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.899063 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.899241 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.899371 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.899582 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.899720 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.899889 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900018 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900211 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900340 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900515 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900643 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900841 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.900983 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.901148 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.901278 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.901473 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.901639 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.901773 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.901886 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.902087 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.902216 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.902399 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.902532 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.902713 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.902850 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903020 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903148 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903328 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903455 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903642 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903780 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.903998 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.904145 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.904270 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.904393 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.904577 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.904821 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.904952 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.905115 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.905244 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.905432 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.905560 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.905745 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.905883 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906057 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906185 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906358 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906499 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906664 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906793 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.906964 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.907093 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.907264 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.907402 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.907564 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.907692 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.907873 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908001 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908171 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908311 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908490 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908625 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908817 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.908958 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.909120 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.909261 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.909420 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.909549 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.909721 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.909848 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910059 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910196 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910360 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910488 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910684 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910812 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.910990 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.911702 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.911870 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.912066 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.912283 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.912507 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.912655 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.912865 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.912995 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913119 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913243 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913382 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913510 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913634 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913757 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.913881 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914005 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914225 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914355 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914484 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914611 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914735 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.914868 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.915025 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.915155 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.915342 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.915672 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.915808 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.915998 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.916129 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.916312 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.916443 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.916627 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.916778 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.916964 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.917065 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.917276 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.917376 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.917585 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.917795 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.917897 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.918116 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.918259 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.918452 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.918581 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.918773 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.918909 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.919096 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.919224 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.919410 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.919538 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.919729 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.919858 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.920060 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.920188 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.920368 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.920496 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.920675 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.920865 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921012 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921140 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921323 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921469 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921631 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921799 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.921962 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.922097 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.922261 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.922397 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.922567 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.922701 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.922878 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.923005 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.923187 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.923315 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.923493 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.923718 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.923848 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.924068 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.924231 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.924425 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.924553 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.924677 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.924820 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925011 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925158 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925323 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925452 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925634 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925762 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.925955 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.926098 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.926271 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.926400 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.926582 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.926718 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.927639 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.927862 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928075 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928211 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928336 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928461 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928595 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928722 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.928909 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929037 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929143 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929326 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929467 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929651 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929781 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.929971 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.930099 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.930282 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.930411 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.930597 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.930732 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.930907 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931045 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931210 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931347 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931514 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931644 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931844 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.931984 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.932123 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.932248 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.932409 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.932539 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.932714 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.932861 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933050 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933179 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933354 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933482 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933667 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933795 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.933972 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.934110 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.934285 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.934502 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.934619 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.934849 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.934952 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.935165 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.935273 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.935488 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.935596 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.935790 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.935895 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.936111 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.936219 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.936414 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.936513 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.936762 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.936862 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937060 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937149 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937365 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937453 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937675 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937765 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.937982 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.938072 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.938293 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.938392 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.938589 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.938845 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.938935 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.939185 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.939282 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.939484 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.939575 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.939791 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.939888 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.940090 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.940180 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.940415 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.940513 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.940717 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.940845 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941039 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941137 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941341 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941430 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941658 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941748 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.941959 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.942057 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.942263 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.942436 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.942617 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.942820 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943024 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943205 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943205 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943453 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943583 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943708 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943832 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.943967 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.944093 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.944217 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.944386 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.944523 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.944781 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.944931 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945067 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945201 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945326 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945451 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945621 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945752 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.945940 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.946069 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.946281 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.946408 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.946593 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.946722 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.946902 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947032 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947219 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947348 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947525 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947654 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947836 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.947967 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.948144 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.948285 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.948454 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.948584 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.948795 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.949032 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.949178 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.949373 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.949503 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.949695 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.949825 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950013 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950140 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950351 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950479 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950659 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950788 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.950964 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.951103 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.951272 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.951400 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.951595 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.951725 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.951906 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952088 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952216 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952341 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952511 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952667 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952843 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.952986 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.953153 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.953282 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.953469 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.953597 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.953781 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.953910 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.954091 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.954220 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.954401 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.954530 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.954781 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.954920 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955045 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955170 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955304 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955431 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955604 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955743 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.955911 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956041 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956223 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956367 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956537 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956673 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956869 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.956991 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.957255 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.957392 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.957510 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.957617 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.957778 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.957894 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.958130 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.958416 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.958570 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.959027 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.959452 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.959895 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.960107 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.960286 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.960444 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.960601 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.960803 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.960961 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.961151 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.961308 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.961461 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.961623 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.961780 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.961932 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.962162 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.962318 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.963241 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.963422 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.963594 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.963777 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.963951 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.964123 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.964293 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.964473 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.964642 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.964887 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.965158 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.965333 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.965557 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.965746 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.966051 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.966249 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.966433 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.966613 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.966802 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.966993 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.967189 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.967369 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.967538 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.967703 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.967871 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.968039 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.968039 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.968375 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.968375 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.968697 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.968897 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.969086 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.969258 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.969426 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.969594 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.969775 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.969945 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.970126 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.970286 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.970435 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.970595 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.970747 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.970907 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.971082 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.971238 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.971388 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.971541 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.971692 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.971842 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.972003 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.972227 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.972396 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.972558 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.972710 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.972901 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.973064 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.973217 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.973368 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.973519 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.974202 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.974374 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.974525 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.974678 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.974828 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.974980 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.975150 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.975409 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.975576 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.975730 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.975894 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976081 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976221 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976342 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976462 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976580 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976698 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976910 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.976910 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977153 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977275 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977403 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977523 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977641 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977777 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.977897 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978015 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978132 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978250 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978377 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978509 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978637 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978757 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978876 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.978995 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979129 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979249 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979379 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979500 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979500 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979719 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979719 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979952 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.979952 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980169 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980169 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980408 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980538 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 10:26:17.980659 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980659 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980659 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980659 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.980659 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.981244 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.981244 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.981464 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.981749 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.982066 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.982382 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.982693 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.983024 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.983334 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.983642 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.983950 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.984259 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.984571 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.984915 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.985224 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.985534 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.985946 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.986241 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.986568 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.986894 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.987202 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.987529 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.987850 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.988198 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.988508 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.988873 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.989204 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.989547 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.989860 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.990164 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:26:17.990407 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 10:26:18.139049 n-d-847009-13 devstack@n-api.service[106452]: INFO dbcounter [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Registered counter for database nova_api Aug 23 10:26:18.147736 n-d-847009-13 devstack@n-api.service[106451]: INFO dbcounter [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Registered counter for database nova_api Aug 23 10:26:18.159554 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.166990 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writer thread running {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.167988 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_db.sqlalchemy.engines [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.174437 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writer thread running {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.222804 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.context [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=106452) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 10:26:18.227363 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:26:18.227846 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:26:18.229473 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:26:18.230210 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:26:18.230551 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.context [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=106451) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 10:26:18.230688 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:26:18.232686 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:26:18.234408 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_concurrency.lockutils [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:26:18.234751 n-d-847009-13 devstack@n-api.service[106452]: INFO dbcounter [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Registered counter for database nova_cell0 Aug 23 10:26:18.234892 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_concurrency.lockutils [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:26:18.236456 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_concurrency.lockutils [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:26:18.237184 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_concurrency.lockutils [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:26:18.237626 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_concurrency.lockutils [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:26:18.239704 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_concurrency.lockutils [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:26:18.240279 n-d-847009-13 devstack@n-api.service[106452]: INFO dbcounter [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Registered counter for database nova_cell1 Aug 23 10:26:18.241688 n-d-847009-13 devstack@n-api.service[106451]: INFO dbcounter [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Registered counter for database nova_cell0 Aug 23 10:26:18.247402 n-d-847009-13 devstack@n-api.service[106451]: INFO dbcounter [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Registered counter for database nova_cell1 Aug 23 10:26:18.248463 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.249785 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.256397 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_db.sqlalchemy.engines [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.257668 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writer thread running {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.257804 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_db.sqlalchemy.engines [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.258019 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writer thread running {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.264517 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writer thread running {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.265991 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writer thread running {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.403743 n-d-847009-13 devstack@n-api.service[106452]: INFO dbcounter [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Registered counter for database nova_cell0 Aug 23 10:26:18.412300 n-d-847009-13 devstack@n-api.service[106451]: INFO dbcounter [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Registered counter for database nova_cell0 Aug 23 10:26:18.413193 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_db.sqlalchemy.engines [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.417651 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writer thread running {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.420798 n-d-847009-13 devstack@n-api.service[106451]: DEBUG oslo_db.sqlalchemy.engines [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:26:18.425077 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writer thread running {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:26:18.764159 n-d-847009-13 devstack@n-api.service[106452]: WARNING keystonemiddleware.auth_token [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:26:18.764705 n-d-847009-13 devstack@n-api.service[106451]: WARNING keystonemiddleware.auth_token [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:26:18.772037 n-d-847009-13 devstack@n-api.service[106452]: WARNING keystonemiddleware.auth_token [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:26:18.772238 n-d-847009-13 devstack@n-api.service[106451]: WARNING keystonemiddleware.auth_token [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:26:19.120211 n-d-847009-13 devstack@n-api.service[106451]: WARNING keystonemiddleware.auth_token [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:26:19.121789 n-d-847009-13 devstack@n-api.service[106452]: WARNING keystonemiddleware.auth_token [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:26:19.126433 n-d-847009-13 devstack@n-api.service[106451]: WARNING keystonemiddleware.auth_token [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:26:19.127743 n-d-847009-13 devstack@n-api.service[106452]: WARNING keystonemiddleware.auth_token [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:26:19.132381 n-d-847009-13 devstack@n-api.service[106451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a6532e9c0 pid: 106451 (default app) Aug 23 10:26:19.133690 n-d-847009-13 devstack@n-api.service[106452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a6532e9c0 pid: 106452 (default app) Aug 23 10:26:19.134492 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:26:19.135684 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-eb343c8c-bf80-4c3b-87d3-f4444b5f71a4 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Aug 23 10:26:19.136100 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Tue Aug 23 10:26:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:38.732177 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:38.733617 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002179 Aug 23 10:27:38.734135 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 1/2] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:38.747022 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_api:SELECT=3 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:38.747914 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_cell1:SELECT=3 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:38.749148 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_cell0:SELECT=3 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:38.750026 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:39.614469 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-f5fd9282-89f6-4e65-a746-f2fd846753ab admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:39.647801 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-f5fd9282-89f6-4e65-a746-f2fd846753ab admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906545 Aug 23 10:27:39.648578 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 10:27:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:27:42.022891 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:42.023903 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-f8b19540-fbd7-4336-bec5-ac23b9ed9efa None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 23 10:27:42.028854 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 2/4] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:42.481379 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-da0bf67e-59c7-4533-9aa6-00cc5cf076c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "swap": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:42.503061 n-d-847009-13 devstack@n-api.service[106451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:27:42.503061 n-d-847009-13 devstack@n-api.service[106451]: warnings.warn(msg) Aug 23 10:27:42.530747 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-da0bf67e-59c7-4533-9aa6-00cc5cf076c8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499970 Aug 23 10:27:42.531329 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 3/5] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:27:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:27:42.546281 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_api:SELECT=3 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:42.547520 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_cell1:SELECT=3 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:42.548446 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_cell0:SELECT=3 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:42.550180 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:27:42.756011 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b760104b-4779-4280-9fda-04774320881c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:42.760665 n-d-847009-13 devstack@n-api.service[106452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:27:42.760665 n-d-847009-13 devstack@n-api.service[106452]: warnings.warn(msg) Aug 23 10:27:42.829570 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b760104b-4779-4280-9fda-04774320881c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288693 Aug 23 10:27:42.831270 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 3/6] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 23 10:27:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:27:45.274130 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-da0bf67e-59c7-4533-9aa6-00cc5cf076c8 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:45.275160 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-da0bf67e-59c7-4533-9aa6-00cc5cf076c8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 23 10:27:45.275827 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 4/7] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:46.026777 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-93504608-0f4a-4433-96cb-b5b973092778 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d1", "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:46.047621 n-d-847009-13 devstack@n-api.service[106452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:27:46.047621 n-d-847009-13 devstack@n-api.service[106452]: warnings.warn(msg) Aug 23 10:27:46.072199 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-93504608-0f4a-4433-96cb-b5b973092778 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.789781 Aug 23 10:27:46.077363 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 4/8] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:27:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:27:46.085594 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-168dd8dd-e7da-4c09-8c8f-7290f8e51648 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:46.088600 n-d-847009-13 devstack@n-api.service[106451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:27:46.088600 n-d-847009-13 devstack@n-api.service[106451]: warnings.warn(msg) Aug 23 10:27:46.126875 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-168dd8dd-e7da-4c09-8c8f-7290f8e51648 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044827 Aug 23 10:27:46.128272 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 5/9] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 23 10:27:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:27:48.880268 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-93504608-0f4a-4433-96cb-b5b973092778 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:48.882181 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-93504608-0f4a-4433-96cb-b5b973092778 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002716 Aug 23 10:27:48.883277 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 5/10] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:49.371103 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-4d3c6dda-32c6-4da2-a371-34bc2746ad50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "id": "d2"}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:49.397604 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-4d3c6dda-32c6-4da2-a371-34bc2746ad50 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506567 Aug 23 10:27:49.411414 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 6/11] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:27:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:27:49.412612 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-16c189ea-4ffb-4dcb-959c-6a5dfb089dbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:49.445132 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-16c189ea-4ffb-4dcb-959c-6a5dfb089dbe admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037539 Aug 23 10:27:49.454980 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 6/12] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 23 10:27:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:27:52.072982 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-4d3c6dda-32c6-4da2-a371-34bc2746ad50 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:52.074132 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-4d3c6dda-32c6-4da2-a371-34bc2746ad50 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Aug 23 10:27:52.074752 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 7/13] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:52.506937 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-9e3849ea-8617-459c-897c-a17ad1647066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:52.527725 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-9e3849ea-8617-459c-897c-a17ad1647066 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446683 Aug 23 10:27:52.528342 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 7/14] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:27:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:27:52.540780 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-b671b8d9-f5d3-435c-9b36-c77a13780f32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:52.565922 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-b671b8d9-f5d3-435c-9b36-c77a13780f32 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028848 Aug 23 10:27:52.566508 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 8/15] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 23 10:27:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:27:54.995201 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-9e3849ea-8617-459c-897c-a17ad1647066 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:54.996607 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-9e3849ea-8617-459c-897c-a17ad1647066 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Aug 23 10:27:54.997304 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 8/16] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:55.543066 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-3b02e287-1102-4230-b69d-75a829080d9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "ram": 4096}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:55.575062 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-3b02e287-1102-4230-b69d-75a829080d9c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.571616 Aug 23 10:27:55.576110 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 9/17] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:27:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:27:55.588426 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-9db08b34-a2bd-474f-823d-1f86d3995e48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:27:55.617647 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-9db08b34-a2bd-474f-823d-1f86d3995e48 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032841 Aug 23 10:27:55.618939 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 9/18] 10.222.0.78 () {64 vars in 1336 bytes} [Tue Aug 23 10:27:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:27:58.037615 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-3b02e287-1102-4230-b69d-75a829080d9c admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:58.038621 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-3b02e287-1102-4230-b69d-75a829080d9c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 23 10:27:58.049987 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 10/19] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:27:58.523278 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-e226ce8a-244a-4176-a2e8-df2bf3eb2bca admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:27:58.554306 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-e226ce8a-244a-4176-a2e8-df2bf3eb2bca admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.508844 Aug 23 10:27:58.565854 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 10/20] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 10:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:28:00.969093 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-3b02e287-1102-4230-b69d-75a829080d9c admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:00.970196 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-3b02e287-1102-4230-b69d-75a829080d9c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 23 10:28:00.970623 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 11/21] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:01.415928 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-4c388a45-09ea-4772-a258-f2e7d44c6cda admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:01.435203 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-4c388a45-09ea-4772-a258-f2e7d44c6cda admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457752 Aug 23 10:28:01.435762 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 11/22] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:28:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:01.448728 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-a96bd66a-753c-49a1-bfac-fcb2adaf7279 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:01.474672 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-a96bd66a-753c-49a1-bfac-fcb2adaf7279 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029934 Aug 23 10:28:01.475429 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 12/23] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 23 10:28:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:28:03.941071 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-4c388a45-09ea-4772-a258-f2e7d44c6cda admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:03.942817 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-4c388a45-09ea-4772-a258-f2e7d44c6cda admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003355 Aug 23 10:28:03.943380 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 12/24] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:04.416125 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-70f7f75c-450e-4095-958f-acb48c10755e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:04.446539 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-70f7f75c-450e-4095-958f-acb48c10755e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.495611 Aug 23 10:28:04.447699 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 13/25] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:28:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:04.475386 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-764f97f9-1eb8-4062-9dff-f01f088306b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:04.513238 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-764f97f9-1eb8-4062-9dff-f01f088306b0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046307 Aug 23 10:28:04.513948 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 13/26] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 23 10:28:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:28:06.981689 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-70f7f75c-450e-4095-958f-acb48c10755e admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:06.982715 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-70f7f75c-450e-4095-958f-acb48c10755e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 23 10:28:06.983127 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 14/27] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:28:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:07.395995 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-bf613b7c-ba62-44dd-96d0-dbd60187deb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:07.415389 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-bf613b7c-ba62-44dd-96d0-dbd60187deb1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.425314 Aug 23 10:28:07.416038 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 14/28] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:28:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 10:28:07.429860 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-c34ac3e7-8457-49cb-a113-4c936982966b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:07.454177 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-c34ac3e7-8457-49cb-a113-4c936982966b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028011 Aug 23 10:28:07.455558 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 15/29] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 23 10:28:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:28:09.832984 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-bf613b7c-ba62-44dd-96d0-dbd60187deb1 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:09.834616 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-bf613b7c-ba62-44dd-96d0-dbd60187deb1 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Aug 23 10:28:09.835171 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 15/30] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:10.255595 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-9293edcd-c2e6-4487-b38e-88ac056f5399 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "id": "4", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:10.261379 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:28:10.276809 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-9293edcd-c2e6-4487-b38e-88ac056f5399 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.435663 Aug 23 10:28:10.277372 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 16/31] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:28:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:10.290022 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-c41aa2b1-c629-4fab-ac88-3a596f893d3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:10.318895 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-c41aa2b1-c629-4fab-ac88-3a596f893d3b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032589 Aug 23 10:28:10.320007 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 16/32] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 23 10:28:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:28:12.728116 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-9293edcd-c2e6-4487-b38e-88ac056f5399 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:12.729978 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-9293edcd-c2e6-4487-b38e-88ac056f5399 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002304 Aug 23 10:28:12.730634 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 17/33] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:13.217990 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-8291a3c9-3dd6-41e1-9df1-35f465e08567 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "name": "m1.xlarge"}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:13.225333 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:28:13.244249 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-8291a3c9-3dd6-41e1-9df1-35f465e08567 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.503980 Aug 23 10:28:13.244826 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 17/34] 10.222.0.78 () {64 vars in 1283 bytes} [Tue Aug 23 10:28:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:13.258080 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-15d59695-a90e-4c86-9d5e-b6f2fc846d21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:13.286687 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-15d59695-a90e-4c86-9d5e-b6f2fc846d21 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032764 Aug 23 10:28:13.287282 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 18/35] 10.222.0.78 () {64 vars in 1333 bytes} [Tue Aug 23 10:28:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:28:36.502687 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-8291a3c9-3dd6-41e1-9df1-35f465e08567 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:36.503641 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-8291a3c9-3dd6-41e1-9df1-35f465e08567 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Aug 23 10:28:36.504037 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 18/36] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:36.514803 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:28:36.896561 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-c8c4fa44-feab-4540-87f1-0d0732823ee6 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:36.914558 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-c8c4fa44-feab-4540-87f1-0d0732823ee6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404168 Aug 23 10:28:36.915096 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 19/37] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 10:28:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:28:37.996582 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-8291a3c9-3dd6-41e1-9df1-35f465e08567 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:37.997612 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-8291a3c9-3dd6-41e1-9df1-35f465e08567 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 23 10:28:37.998011 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 19/38] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:38.549753 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-f364519a-9e67-40ee-b40b-e05e963b417f admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:38.555649 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.wsgi [None req-f364519a-9e67-40ee-b40b-e05e963b417f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-f364519a-9e67-40ee-b40b-e05e963b417f admin admin] Request method failure captured: Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Accept: application/json Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Accept-Encoding: gzip, deflate Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Connection: keep-alive Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Content-Length: 0 Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Host: 10.222.0.78 Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Openstack-Api-Version: compute 2.90 Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: Openstack-System-Scope: None Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: User-Agent: python-novaclient Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Auth-Token: gAAAAABjBKvV-bZv8PimBjg_RUVaBDQJJX1cQrwl7xr0IlOy_n-xblm-0X4pQC001X27QuMVpeP-8Ns5I5KVLstSI7ZOiYMNuEulK1bKVNhYZkPYnKLleWUL10GzvFMqLBjaJSq-xEQLH9R2h6JZe5szU84KhXMQNCIeKHETFLm816BwswpxcX8 Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Domain-Id: None Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Domain-Name: None Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Identity-Status: Confirmed Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Is-Admin-Project: True Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Domain-Id: default Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Domain-Name: Default Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Name: admin Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Role: member,reader,admin Aug 23 10:28:38.559041 n-d-847009-13 devstack@n-api.service[106451]: X-Roles: member,reader,admin Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_738d4206fa7a424aaef8d566757934fd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}] Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant: admin Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant-Name: admin Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-User: admin Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-User-Domain-Id: default Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-User-Domain-Name: Default Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-User-Id: 217f98c1148b46e3b85569f00e2400b9 Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: X-User-Name: admin Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: method: > Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: exception: Flavor 42 could not be found. Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: action_args: {'id': '42'} Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:28:38.560646 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:38.561801 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.563606 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-f364519a-9e67-40ee-b40b-e05e963b417f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:28:38.565647 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-f364519a-9e67-40ee-b40b-e05e963b417f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397973 Aug 23 10:28:38.565647 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:28:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:28:38.572231 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b7975fd1-e442-4573-ba5a-3ba0a403e093 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:38.595666 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b7975fd1-e442-4573-ba5a-3ba0a403e093 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027139 Aug 23 10:28:38.597079 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 20/40] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 23 10:28:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:28:38.622137 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-472e03be-9093-4074-9587-64f43d24837c admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:38.646862 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-472e03be-9093-4074-9587-64f43d24837c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028605 Aug 23 10:28:38.647411 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 21/41] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 23 10:28:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:28:38.656782 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b660f064-c268-44fa-a015-c9bdcd3e9186 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:38.663086 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.wsgi [None req-b660f064-c268-44fa-a015-c9bdcd3e9186 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b660f064-c268-44fa-a015-c9bdcd3e9186 admin admin] Request method failure captured: Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Accept: application/json Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Accept-Encoding: gzip, deflate Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Connection: keep-alive Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Content-Length: 0 Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Host: 10.222.0.78 Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Openstack-Api-Version: compute 2.90 Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: Openstack-System-Scope: None Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: User-Agent: python-novaclient Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Auth-Token: gAAAAABjBKvV-bZv8PimBjg_RUVaBDQJJX1cQrwl7xr0IlOy_n-xblm-0X4pQC001X27QuMVpeP-8Ns5I5KVLstSI7ZOiYMNuEulK1bKVNhYZkPYnKLleWUL10GzvFMqLBjaJSq-xEQLH9R2h6JZe5szU84KhXMQNCIeKHETFLm816BwswpxcX8 Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Domain-Id: None Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Domain-Name: None Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Identity-Status: Confirmed Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Is-Admin-Project: True Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Domain-Id: default Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Domain-Name: Default Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Name: admin Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Role: member,reader,admin Aug 23 10:28:38.666407 n-d-847009-13 devstack@n-api.service[106452]: X-Roles: member,reader,admin Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_738d4206fa7a424aaef8d566757934fd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}] Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant: admin Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant-Name: admin Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-User: admin Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-User-Domain-Id: default Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-User-Domain-Name: Default Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-User-Id: 217f98c1148b46e3b85569f00e2400b9 Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: X-User-Name: admin Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: method: > Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: exception: Flavor 42 could not be found. Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: action_args: {'id': '42'} Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:28:38.667956 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:38.669016 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:38.670428 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b660f064-c268-44fa-a015-c9bdcd3e9186 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:28:38.671663 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b660f064-c268-44fa-a015-c9bdcd3e9186 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014692 Aug 23 10:28:38.671663 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 21/42] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:28:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:28:39.668305 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-472e03be-9093-4074-9587-64f43d24837c admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:39.669450 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-472e03be-9093-4074-9587-64f43d24837c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 23 10:28:39.669851 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 22/43] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:40.199905 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-df4bb1d0-ce4e-449f-ada1-d02ae058a21e admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:40.205209 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.wsgi [None req-df4bb1d0-ce4e-449f-ada1-d02ae058a21e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-df4bb1d0-ce4e-449f-ada1-d02ae058a21e admin admin] Request method failure captured: Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Accept: application/json Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Accept-Encoding: gzip, deflate Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Connection: keep-alive Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Content-Length: 0 Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Host: 10.222.0.78 Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Openstack-Api-Version: compute 2.90 Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: Openstack-System-Scope: None Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: User-Agent: python-novaclient Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Auth-Token: gAAAAABjBKvX7VTQuoyQhndQSdZuczbSHCFbN1YlBAQAWMq4KuULsBEtqrDmfULxZwZAtWjU5MZj3mfyKG4yjVVTPU6X29OHOPzasn6oPx1bifFWIrSSgRVq8M5KwLayDoTdI64N_Q4wLt71yU2KgvaRSbhqWVq33pCOvaAFn-3iqp8PbhIXWzc Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Domain-Id: None Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Domain-Name: None Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Identity-Status: Confirmed Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Is-Admin-Project: True Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Domain-Id: default Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Domain-Name: Default Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Name: admin Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Role: member,reader,admin Aug 23 10:28:40.207876 n-d-847009-13 devstack@n-api.service[106452]: X-Roles: member,reader,admin Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_738d4206fa7a424aaef8d566757934fd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}] Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant: admin Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant-Name: admin Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-User: admin Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-User-Domain-Id: default Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-User-Domain-Name: Default Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-User-Id: 217f98c1148b46e3b85569f00e2400b9 Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: X-User-Name: admin Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: method: > Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: exception: Flavor 84 could not be found. Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: action_args: {'id': '84'} Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:28:40.209517 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:40.210516 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.211809 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-df4bb1d0-ce4e-449f-ada1-d02ae058a21e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:28:40.213113 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-df4bb1d0-ce4e-449f-ada1-d02ae058a21e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399058 Aug 23 10:28:40.213113 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 22/44] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:28:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:28:40.218904 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-23e516e9-9005-440b-b27b-21a9f677da0d admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:40.241108 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-23e516e9-9005-440b-b27b-21a9f677da0d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025701 Aug 23 10:28:40.241696 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 23/45] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 23 10:28:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:28:40.251594 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b0dce2dc-a49e-4907-b093-d1dfdb450625 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:40.267686 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b0dce2dc-a49e-4907-b093-d1dfdb450625 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019699 Aug 23 10:28:40.269478 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 23/46] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 23 10:28:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:28:40.278738 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-5e129ae3-7c6d-4184-8d6e-31aa01c5dcd2 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:40.284026 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.wsgi [None req-5e129ae3-7c6d-4184-8d6e-31aa01c5dcd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-5e129ae3-7c6d-4184-8d6e-31aa01c5dcd2 admin admin] Request method failure captured: Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Accept: application/json Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Accept-Encoding: gzip, deflate Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Connection: keep-alive Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Content-Length: 0 Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Host: 10.222.0.78 Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Openstack-Api-Version: compute 2.90 Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: Openstack-System-Scope: None Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: User-Agent: python-novaclient Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Auth-Token: gAAAAABjBKvX7VTQuoyQhndQSdZuczbSHCFbN1YlBAQAWMq4KuULsBEtqrDmfULxZwZAtWjU5MZj3mfyKG4yjVVTPU6X29OHOPzasn6oPx1bifFWIrSSgRVq8M5KwLayDoTdI64N_Q4wLt71yU2KgvaRSbhqWVq33pCOvaAFn-3iqp8PbhIXWzc Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Domain-Id: None Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Domain-Name: None Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Identity-Status: Confirmed Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Is-Admin-Project: True Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Domain-Id: default Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Domain-Name: Default Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Name: admin Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Role: member,reader,admin Aug 23 10:28:40.285551 n-d-847009-13 devstack@n-api.service[106451]: X-Roles: member,reader,admin Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_738d4206fa7a424aaef8d566757934fd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}] Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant: admin Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant-Name: admin Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-User: admin Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-User-Domain-Id: default Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-User-Domain-Name: Default Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-User-Id: 217f98c1148b46e3b85569f00e2400b9 Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: X-User-Name: admin Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: method: > Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: exception: Flavor 84 could not be found. Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: action_args: {'id': '84'} Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:28:40.287130 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:40.288238 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:40.289578 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-5e129ae3-7c6d-4184-8d6e-31aa01c5dcd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:28:40.290814 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-5e129ae3-7c6d-4184-8d6e-31aa01c5dcd2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011726 Aug 23 10:28:40.290814 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 24/47] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:28:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:28:41.261789 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b0dce2dc-a49e-4907-b093-d1dfdb450625 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:41.262828 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b0dce2dc-a49e-4907-b093-d1dfdb450625 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 23 10:28:41.263272 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 24/48] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:41.820046 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-652422be-b6c3-4bc2-aee8-f8cd5e3d3ccc admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:41.826105 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.wsgi [None req-652422be-b6c3-4bc2-aee8-f8cd5e3d3ccc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-652422be-b6c3-4bc2-aee8-f8cd5e3d3ccc admin admin] Request method failure captured: Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Accept: application/json Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Accept-Encoding: gzip, deflate Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Connection: keep-alive Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Content-Length: 0 Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Host: 10.222.0.78 Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Openstack-Api-Version: compute 2.90 Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: Openstack-System-Scope: None Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: User-Agent: python-novaclient Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Auth-Token: gAAAAABjBKvZn26rQsqqpLjW4A5DXBIAwyyF2PJyuwg8haYrUSshA0xMTUcZSZIlYRPqfHYYtld74ugk9Wxs7pNgWB2s54nMCgp4Mo2zsPXiz5KdSf5F7onkXHz2NhWaevR7-eLG91ZtehzN36DKQRI41A66n_eOWqWdQNMoLhF55xtEonN1gTk Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Domain-Id: None Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Domain-Name: None Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Identity-Status: Confirmed Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Is-Admin-Project: True Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Domain-Id: default Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Domain-Name: Default Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Project-Name: admin Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Role: member,reader,admin Aug 23 10:28:41.827599 n-d-847009-13 devstack@n-api.service[106451]: X-Roles: member,reader,admin Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_738d4206fa7a424aaef8d566757934fd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}] Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant: admin Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-Tenant-Name: admin Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-User: admin Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-User-Domain-Id: default Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-User-Domain-Name: Default Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-User-Id: 217f98c1148b46e3b85569f00e2400b9 Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: X-User-Name: admin Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: method: > Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: exception: Flavor 451 could not be found. Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: action_args: {'id': '451'} Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:28:41.829096 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:41.829913 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.831007 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-652422be-b6c3-4bc2-aee8-f8cd5e3d3ccc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:28:41.832244 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-652422be-b6c3-4bc2-aee8-f8cd5e3d3ccc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.428935 Aug 23 10:28:41.832244 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 25/49] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:28:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:28:41.842063 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b55c245c-c222-4c8d-9d7a-4f252c597fa9 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:41.857492 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b55c245c-c222-4c8d-9d7a-4f252c597fa9 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019886 Aug 23 10:28:41.858046 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 25/50] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 23 10:28:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:28:41.868616 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:41.883963 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018912 Aug 23 10:28:41.884495 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 26/51] 10.222.0.78 () {60 vars in 1210 bytes} [Tue Aug 23 10:28:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:28:41.893660 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-57d959ee-dffb-4249-857d-d755c7d2aefe admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:41.898960 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.wsgi [None req-57d959ee-dffb-4249-857d-d755c7d2aefe admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-57d959ee-dffb-4249-857d-d755c7d2aefe admin admin] Request method failure captured: Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Accept: application/json Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Accept-Encoding: gzip, deflate Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Connection: keep-alive Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Content-Length: 0 Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Host: 10.222.0.78 Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Openstack-Api-Version: compute 2.90 Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: Openstack-System-Scope: None Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: User-Agent: python-novaclient Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Auth-Token: gAAAAABjBKvZn26rQsqqpLjW4A5DXBIAwyyF2PJyuwg8haYrUSshA0xMTUcZSZIlYRPqfHYYtld74ugk9Wxs7pNgWB2s54nMCgp4Mo2zsPXiz5KdSf5F7onkXHz2NhWaevR7-eLG91ZtehzN36DKQRI41A66n_eOWqWdQNMoLhF55xtEonN1gTk Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Domain-Id: None Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Domain-Name: None Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Identity-Status: Confirmed Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Is-Admin-Project: True Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Domain-Id: default Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Domain-Name: Default Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Project-Name: admin Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Role: member,reader,admin Aug 23 10:28:41.900456 n-d-847009-13 devstack@n-api.service[106452]: X-Roles: member,reader,admin Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_738d4206fa7a424aaef8d566757934fd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/738d4206fa7a424aaef8d566757934fd"}]}] Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant: admin Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant-Id: 738d4206fa7a424aaef8d566757934fd Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-Tenant-Name: admin Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-User: admin Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-User-Domain-Id: default Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-User-Domain-Name: Default Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-User-Id: 217f98c1148b46e3b85569f00e2400b9 Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: X-User-Name: admin Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: method: > Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: exception: Flavor 451 could not be found. Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: action_args: {'id': '451'} Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:28:41.902087 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:41.903175 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: ERROR nova.api.openstack.wsgi Aug 23 10:28:41.904442 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-57d959ee-dffb-4249-857d-d755c7d2aefe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:28:41.905769 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-57d959ee-dffb-4249-857d-d755c7d2aefe admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011774 Aug 23 10:28:41.905769 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 26/52] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:28:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 10:28:42.884068 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:42.885214 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 23 10:28:42.885615 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 27/53] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:43.416862 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-d96a19f6-82f0-4bff-bd87-02333bc753ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:43.436454 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-d96a19f6-82f0-4bff-bd87-02333bc753ed admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.410882 Aug 23 10:28:43.437030 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 27/54] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 23 10:28:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:44.404161 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:44.405217 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 23 10:28:44.405636 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 28/55] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:44.933975 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-dda77659-988f-4965-a528-593bda2d48f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:44.952562 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-dda77659-988f-4965-a528-593bda2d48f9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406219 Aug 23 10:28:44.953147 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 28/56] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 23 10:28:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 10:28:45.935821 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:45.936893 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 23 10:28:45.937318 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 29/57] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:46.464873 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-e0c3c230-0583-43c9-a323-7cb46cc1ac4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:46.485661 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-e0c3c230-0583-43c9-a323-7cb46cc1ac4f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.410582 Aug 23 10:28:46.486267 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 29/58] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 23 10:28:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:47.464341 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:47.465403 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 23 10:28:47.465792 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 30/59] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:47.997124 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-45e0eb2f-1139-46a0-accb-803d23638f96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:28:48.015188 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-45e0eb2f-1139-46a0-accb-803d23638f96 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408581 Aug 23 10:28:48.015717 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 30/60] 10.222.0.78 () {64 vars in 1235 bytes} [Tue Aug 23 10:28:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:28:49.000184 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:49.001271 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 23 10:28:49.001673 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 31/61] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:28:49.538133 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-8bf4d259-5567-4371-aebf-83eed9bd1701 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:28:49.559115 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-8bf4d259-5567-4371-aebf-83eed9bd1701 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.416353 Aug 23 10:28:49.559657 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 31/62] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Aug 23 10:28:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:29:43.246792 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:29:43.248080 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-e062b2d5-a689-408a-a892-33e97896c499 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Aug 23 10:29:43.248522 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 32/63] 10.222.0.78 () {54 vars in 931 bytes} [Tue Aug 23 10:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:29:43.259709 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:29:43.656730 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-7b032113-91bf-4beb-9b4e-4bcf62dca004 admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:29:43.677291 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-7b032113-91bf-4beb-9b4e-4bcf62dca004 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422133 Aug 23 10:29:43.677816 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 32/64] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 10:29:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:29:43.698744 n-d-847009-13 devstack@n-api.service[106451]: DEBUG dbcounter [-] [106451] Writing DB stats nova_api:SELECT=14 {{(pid=106451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:29:43.702746 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-31a7204f-3f61-4ed3-8301-b73dff6d9e52 admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:29:43.711166 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-31a7204f-3f61-4ed3-8301-b73dff6d9e52 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013823 Aug 23 10:29:43.711690 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 33/65] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Aug 23 10:29:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:29:43.723851 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-7aef8067-abf4-4ee5-9cef-46e177ae322d admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:29:43.731336 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-7aef8067-abf4-4ee5-9cef-46e177ae322d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011703 Aug 23 10:29:43.731835 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 33/66] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Aug 23 10:29:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:29:43.742969 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-605281ce-a2a3-427b-bf4d-65e9803a15bd admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:29:43.751683 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-605281ce-a2a3-427b-bf4d-65e9803a15bd admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012124 Aug 23 10:29:43.752141 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 34/67] 10.222.0.78 () {60 vars in 1286 bytes} [Tue Aug 23 10:29:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:29:43.763360 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-6f7cf987-1a43-4b43-8337-3746c32c3bac admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:29:43.771795 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-6f7cf987-1a43-4b43-8337-3746c32c3bac admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011921 Aug 23 10:29:43.772307 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 34/68] 10.222.0.78 () {60 vars in 1283 bytes} [Tue Aug 23 10:29:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:35:11.884259 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-605281ce-a2a3-427b-bf4d-65e9803a15bd admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:35:11.885303 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-605281ce-a2a3-427b-bf4d-65e9803a15bd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 23 10:35:11.885698 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 35/69] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:35:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:35:12.031726 n-d-847009-13 devstack@n-api.service[106452]: DEBUG dbcounter [-] [106452] Writing DB stats nova_api:SELECT=6 {{(pid=106452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:35:12.176273 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:35:12.178677 n-d-847009-13 devstack@n-api.service[106452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:35:12.178677 n-d-847009-13 devstack@n-api.service[106452]: warnings.warn(msg) Aug 23 10:35:12.179849 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:35:12.180332 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:35:12.180791 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:35:12.181517 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:35:12.181967 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:35:12.182397 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:35:12.224579 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-b26ba036-2fd0-43ff-942f-86d5ee92c53d admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1220 microversion: 2.90 time: 0.194344 Aug 23 10:35:12.225186 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 35/70] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:35:12 2022] GET /compute/v2.1/os-services => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:35:13.062853 n-d-847009-13 devstack@n-api.service[106451]: DEBUG nova.api.openstack.wsgi [None req-605281ce-a2a3-427b-bf4d-65e9803a15bd admin admin] Calling method '>' {{(pid=106451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:35:13.063927 n-d-847009-13 devstack@n-api.service[106451]: INFO nova.api.openstack.requestlog [None req-605281ce-a2a3-427b-bf4d-65e9803a15bd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 23 10:35:13.064335 n-d-847009-13 devstack@n-api.service[106451]: [pid: 106451|app: 0|req: 36/71] 10.222.0.78 () {56 vars in 1074 bytes} [Tue Aug 23 10:35:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:35:13.266509 n-d-847009-13 devstack@n-api.service[106452]: DEBUG nova.api.openstack.wsgi [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Calling method '>' {{(pid=106452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:35:13.269455 n-d-847009-13 devstack@n-api.service[106452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:35:13.269455 n-d-847009-13 devstack@n-api.service[106452]: warnings.warn(msg) Aug 23 10:35:13.270615 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:35:13.271037 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:35:13.271500 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:35:13.272729 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:35:13.273288 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:35:13.273715 n-d-847009-13 devstack@n-api.service[106452]: DEBUG oslo_concurrency.lockutils [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:35:13.296341 n-d-847009-13 devstack@n-api.service[106452]: INFO nova.api.openstack.requestlog [None req-0338cfbc-db39-4771-8d3c-9e4401fdb8db admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1220 microversion: 2.90 time: 0.091943 Aug 23 10:35:13.296934 n-d-847009-13 devstack@n-api.service[106452]: [pid: 106452|app: 0|req: 36/72] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:35:13 2022] GET /compute/v2.1/os-services => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:35:59.527618 n-d-847009-13 devstack@n-api.service[106450]: Tue Aug 23 10:35:59 2022 - graceful shutdown triggered... Aug 23 10:35:59.527740 n-d-847009-13 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 10:35:59.528729 n-d-847009-13 devstack@n-api.service[106451]: Gracefully killing worker 1 (pid: 106451)... Aug 23 10:35:59.529195 n-d-847009-13 devstack@n-api.service[106452]: Gracefully killing worker 2 (pid: 106452)... Aug 23 10:36:00.529527 n-d-847009-13 devstack@n-api.service[106450]: worker 1 buried after 1 seconds Aug 23 10:36:00.529954 n-d-847009-13 devstack@n-api.service[106450]: worker 2 buried after 1 seconds Aug 23 10:36:00.529954 n-d-847009-13 devstack@n-api.service[106450]: goodbye to uWSGI. Aug 23 10:36:00.531196 n-d-847009-13 systemd[1]: devstack@n-api.service: Succeeded. Aug 23 10:36:00.531758 n-d-847009-13 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 10:36:00.534661 n-d-847009-13 systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 10:36:00.552156 n-d-847009-13 devstack@n-api.service[128849]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 10:36:00 2022] *** Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: nodename: n-d-847009-13 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: machine: x86_64 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: clock source: unix Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: pcre jit disabled Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: detected number of CPU cores: 4 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: current working directory: / Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: detected binary path: /usr/bin/uwsgi-core Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: your processes number limit is 47680 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: your memory page size is 4096 bytes Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: detected max file descriptor number: 2048 Aug 23 10:36:00.580976 n-d-847009-13 devstack@n-api.service[128849]: lock engine: pthread robust mutexes Aug 23 10:36:00.582628 n-d-847009-13 devstack@n-api.service[128849]: thunder lock: enabled Aug 23 10:36:00.582628 n-d-847009-13 devstack@n-api.service[128849]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 10:36:00.582628 n-d-847009-13 devstack@n-api.service[128849]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 10:36:00.622610 n-d-847009-13 devstack@n-api.service[128849]: Python main interpreter initialized at 0x56290939b9c0 Aug 23 10:36:00.622610 n-d-847009-13 devstack@n-api.service[128849]: python threads support enabled Aug 23 10:36:00.622610 n-d-847009-13 devstack@n-api.service[128849]: your server socket listen backlog is limited to 100 connections Aug 23 10:36:00.622610 n-d-847009-13 devstack@n-api.service[128849]: your mercy for graceful operations on workers is 90 seconds Aug 23 10:36:00.623033 n-d-847009-13 devstack@n-api.service[128849]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 10:36:00.623033 n-d-847009-13 devstack@n-api.service[128849]: *** Operational MODE: preforking *** Aug 23 10:36:00.623286 n-d-847009-13 devstack@n-api.service[128849]: *** uWSGI is running in multiple interpreter mode *** Aug 23 10:36:00.623286 n-d-847009-13 devstack@n-api.service[128849]: spawned uWSGI master process (pid: 128849) Aug 23 10:36:00.623493 n-d-847009-13 systemd[1]: Started Devstack devstack@n-api.service. Aug 23 10:36:00.624903 n-d-847009-13 devstack@n-api.service[128849]: spawned uWSGI worker 1 (pid: 128859, cores: 1) Aug 23 10:36:00.624903 n-d-847009-13 devstack@n-api.service[128849]: spawned uWSGI worker 2 (pid: 128860, cores: 1) Aug 23 10:36:00.624903 n-d-847009-13 devstack@n-api.service[128849]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 10:36:01.297545 n-d-847009-13 devstack@n-api.service[128860]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 10:36:01.312429 n-d-847009-13 devstack@n-api.service[128859]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 10:36:02.478016 n-d-847009-13 devstack@n-api.service[128860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:36:02.478016 n-d-847009-13 devstack@n-api.service[128860]: from cryptography.utils import int_from_bytes Aug 23 10:36:02.478718 n-d-847009-13 devstack@n-api.service[128860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:36:02.478718 n-d-847009-13 devstack@n-api.service[128860]: from cryptography.utils import int_from_bytes Aug 23 10:36:02.543443 n-d-847009-13 devstack@n-api.service[128859]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:36:02.543443 n-d-847009-13 devstack@n-api.service[128859]: from cryptography.utils import int_from_bytes Aug 23 10:36:02.544086 n-d-847009-13 devstack@n-api.service[128859]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 10:36:02.544086 n-d-847009-13 devstack@n-api.service[128859]: from cryptography.utils import int_from_bytes Aug 23 10:36:04.927049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 10:36:04.927736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 10:36:04.927865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 10:36:04.928223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 10:36:04.928483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 10:36:04.928908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.929248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.929623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.929907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.930414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.930738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.931073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.931408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.931748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.932017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.932342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.932674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-13 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.933035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.933356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.933677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.934010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.934324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.934656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.934970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.935484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.935942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.936258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.936730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.936955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.937271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.937591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.937921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.938237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.938576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.938894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.939315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-13 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.939644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.939965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.940288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.940721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.941068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.942032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.942374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.942726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.943049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.943386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.943717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.944054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.944376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.944688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.945034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.945354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.945680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.945997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.946311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.946569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.946901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.947236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.947557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.947889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.948153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.948414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.948780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.949102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.949423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.949739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.950055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.950371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.950688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.951002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.951315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.951631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.951958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.952281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.952612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.952960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.953289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.953712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.953970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.954290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.954647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.954973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.955294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.955623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.955955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.956270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.956587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.956996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.957332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.957686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.958006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.958266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.958581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.958896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.959224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.959542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.959858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.960173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.960482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.960826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.961147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.961467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.961783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.962099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.962414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.962730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.963045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.963359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.964033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.964033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.964311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.964628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.964971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.965286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.965614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.965930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.966243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.966576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.966896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.967211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.967536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.967852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.968170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.968498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.968832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.969150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.969477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.969792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.970115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.970424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.970740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.971110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.971374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.971696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.972004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.972312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.972712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.973069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.973393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.973910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.974229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.974560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:04.974916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.975258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.975615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.975943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.976284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.976627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.976986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.977313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.977635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.977971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.978299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.978619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.978940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.979269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.979593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.979932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.980259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.980586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.980939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.981262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.981590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.981929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.982258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.982578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.982931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.983287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.983613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.983951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.984287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.984611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.984963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.985284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.985616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.985961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.986284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.986610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.986931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.987261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.987577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.987897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.989155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.989660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.989992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.990320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.990646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.990973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.991298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.991619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.991941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.992258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.992572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.992914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.993236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.993548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.993902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.994233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.994551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.994899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.995216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.995539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.995861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.996182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.996497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.996844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.997167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.997490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.997821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.998140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.998456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.998788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.999101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.999415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:04.999740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.000059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.000377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.000976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.001299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.001632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.001953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.002272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.002616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.002954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.003269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.003604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.004610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.004964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.005469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.005956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.006443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.006922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.007391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.007883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.008349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.008851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.009345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.009823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.010142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.010484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.010802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.011120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.011457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.011754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.012112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.012431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.012810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.013309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.013487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.013947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.014313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.014847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.015242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.015795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.016122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.016451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.016802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.017129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.017465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.017789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.018122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.018442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.018770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.019084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.019512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.019977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.020324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.020649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.021009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.021333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.021656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.021975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.022293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.022610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.022931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.023254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.023573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.023899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.024216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.024460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 10:36:05.024932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.025024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 10:36:05.025123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.025209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.025298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 10:36:05.025499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.025660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 10:36:05.025825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.025979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 10:36:05.026161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.026293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.026504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.026631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.026820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.026961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.027139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.027288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.027474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.027771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.027875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.028077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.028176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.028407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.028499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.028724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.028912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.029068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.029170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.029349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.029442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.029678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.029770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.030086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.030268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-847009-13 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.030366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.030622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.030945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.031188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.031288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.031530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.031666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.031862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.031953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.032182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.032264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.032513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.032608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.033041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.033222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.033222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.033521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.033521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.033806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.033967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.034122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.034282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.034425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.034527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.034870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.034971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.035077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.035247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.035392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.035579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.035708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.035906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.036062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.036237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.036380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.036640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.036776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.036972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.037356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.037468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.038410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.038545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-847009-13 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.038635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.038733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.038826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.038919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.039003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.039093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.039187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.039271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.039362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.039453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.039538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.039632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.039768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.040072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.040184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.040318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.040422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.040633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.040762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.041039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.041147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.041374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.041476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.041693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.041803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.042015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.042117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.042335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.042436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.042650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.042752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.042969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.043069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.043296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.043407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.043609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.043882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.043975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.044169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.044262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.044487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.044590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.044847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.044958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.045188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.045296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.045515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.045636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.045804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.045906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.046064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.046175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.046362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.046516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.046690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.046835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.047024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.047197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.047330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.047474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.047625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.047786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.047939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.048108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.048254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.048424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.048568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.048794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.048892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.049073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.049209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.049390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.049532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.049702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.049858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.050015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.050188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.050327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.050504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.051201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.051372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.051475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.051793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.051945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.052106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.052199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.052418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.052514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.052762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.052882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.053089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.053212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.053403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.053533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.053715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.053861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.054027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.054189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.054378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.054506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.054692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.054823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.055042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.055133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.055384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.055476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.055738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.055845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.056060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.056227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.056331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.056436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.056639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.056783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.056992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.057087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.057325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.057549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.057644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.057803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.057943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.058044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.058256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.058355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.058565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.058657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.058878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.058977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.059210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.059316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.059512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.059605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.059828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.059932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.060139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.060231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.060452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.060551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.060811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.060908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.061104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.061204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.061421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.061514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.061732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.061823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.062044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.062149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.062369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.062488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.062684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.062842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.062987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.063088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.063297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.063400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.063612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.063781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.063934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.064086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.064246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.064387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.064537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.064687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.064856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.064996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.065171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.065316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.065470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.065617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.065783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.065927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.066116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.067400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.067765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.068176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.068354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.068494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.068640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.068982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.069301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.069437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.069626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.069862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.069999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.070279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.070499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.070644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.070904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.071051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.071221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.071488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.071634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.071839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.072052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.072189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.072456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.072614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.072807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.073032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.073171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.073425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.073541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.073762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.073876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.074099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.074196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.074385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.074493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.074701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.074836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.075016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.075193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.075329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.075590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.075691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.075921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.076014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.076248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.076348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.076612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 10:36:05.076711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.076985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.077091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.077322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.077427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.077722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.077856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.077949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.078037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.078279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.078389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.078598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.078913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.079005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.079720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.079828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.079925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.080990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.081523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.081523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.081706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.081790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.081988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.083710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.084958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.085976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.086106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.086234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.086376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.086518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.086701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.086850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.087091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.087243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.087388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.087518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.087668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.087939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.088073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.088227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.088428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.088562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.088711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.088961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.089092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.089240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.089371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.089507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.089707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.089877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.090940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.091086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.091241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.091383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.091566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.091708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.091889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.092064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.092199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.092381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.092619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.092806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.092956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.093098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.093273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.093415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.093592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.093726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.093906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.094986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.095127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.095265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.095439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.095586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.095751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.095897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.096080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.096256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.096387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.096525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.096708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.096871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.097109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.097242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.097430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.097597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.097990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.098133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.098316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.098472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.098663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.098809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.098962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.099159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.099293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.099421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.099564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.099743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.099884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.100073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.100206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.100392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.100536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.100729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.100912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.101069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.101210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.101392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.101538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.101720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.101861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.102041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.102175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.102363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.102511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.102686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.102820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.103008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.103149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.103334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.103475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.103749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.103890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.104019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.104148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.104422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.104565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.104696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.104866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.105918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.106059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.106231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.106373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.106551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.106676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.106912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.107937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.108215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.108342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.108497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.108620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.108854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.108989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.109989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.110109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.110312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.110432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.110758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.110894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.111004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.111121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.111358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.111486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.111786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.111925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.112044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.112154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.112316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.112439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.112622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.112768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.113042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.113720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.113879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.114026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.114327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.114637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.114786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.114918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.115897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.116082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.116215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.116353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.116534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.116696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.116896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.117979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.118262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.118403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.118541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.118670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.118824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.119892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.120914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.121996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.122126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.122290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.122467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.122598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.122762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.122904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.123078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.123289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.123431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.123560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.123723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.123864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.124052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.124194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.124378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.124521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.124835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.124979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.125117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.125256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.125651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.125801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.125940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.126070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.126207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.126399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.126534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.126737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.126870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.127109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.127260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.127430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.127565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.127744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.127886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.128058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.128374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.128518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.128651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.129620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.129620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.129973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.130119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.130257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.130413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.130596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.130783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.130976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.131676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.131834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.131973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.132093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.132212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.132461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.132601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.132762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.132899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.133970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.134158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.134288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.134474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.134600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.134841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.134970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.135123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.135250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.135440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.135560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.135757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.135877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.136073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.136193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.136392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.136518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.136789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.136917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.137064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.137182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.137383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.137517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.137831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.138155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.138508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.138790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.139113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.139435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.139771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.140111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.140441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.140784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.140994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.141134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.141420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.141538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.141974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.142094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.142299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.142419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.142643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.142868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.143001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.143295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.143442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.143624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.143871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.144010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.144277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.144434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.144654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.145034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.145254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.145489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.145637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.145779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.146078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.146297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.146440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.146721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.146860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.147043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.147285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.147429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.147680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.147812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.148296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.148442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.148766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.148913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.149054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.149291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.149424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.149653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.149965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.150097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.150286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.150495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.150644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.150929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.151248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.151397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.151575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.151916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.152075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.152221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.152351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.152481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.152829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.152978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.153152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.153375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.153510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.153779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.154093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.154301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.154531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.154737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.154959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.155196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.155578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.155789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.155992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.156207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.156430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.156647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.156647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.157136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.157346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.157571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.157791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.157791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.158199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.158418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.158637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.159260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.159260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.159659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.159899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.159899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.160629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.160941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.161157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.161531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.161757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.161976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.162368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.162572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.162572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.162933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.163148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.163148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.163148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.163645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.164385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.164540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.164699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.164903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.165100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.165283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.165479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.165836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.166023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.166023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.166442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.166640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.166784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.166924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.167968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.168901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.169841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.169970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.169970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.169970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.169970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.170672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.170672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.170923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.171060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.171060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.171396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.171678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.171815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.172035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.172388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.172582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.172729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.173026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.173168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.173313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.173813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.173955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.174273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.174590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.175032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.175177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.175355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.175554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.176350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.176558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.176979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.177496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.177641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.177784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.178007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.178141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.178408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.178646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.178794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.179058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.179373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.179506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.179819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.180054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.180371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.180679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.181019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.182983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.183198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.183500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.183817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.184131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.184474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.184833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.185033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.185169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.185391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.185704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.186152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.186447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.186634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.186950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.187261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.187577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.187980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.188191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.189054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.189054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.189324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.189621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.189856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.190180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.190513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.190833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.191162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.192251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.192547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.192720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.193085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.193236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.193378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.193638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.193772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.193991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.194159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.194316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.194639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.194785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.194959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.195175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.195399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.195620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.195922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.196153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.196363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.196570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.196870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.197078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.197449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.197662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.197873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.197873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.198275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.198474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.198693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.198913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.199127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.199352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.199800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.199800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.200196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.200413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.200413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.201115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.201324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.201524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.201524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.201934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.202178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.202178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.203732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.203951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.204876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.205690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.205690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.205690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 10:36:05.207767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.208281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.208904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.209918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.210422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.211178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.211551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.212108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.212843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.213378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.214249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.215161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.215667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.216177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.216686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.217207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.217791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.218283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.218772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.219635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.220599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.221343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.221712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.222437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.224446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.224446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.225121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.225622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.226110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.226612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.227096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.227634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.228199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.228760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.229249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.229813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.230439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.230937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.231536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.232038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.232611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.233306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.233929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.234364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.234855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.235369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.235875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.236382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.236914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.237434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.237937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.239069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.239724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.240218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.240876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.241383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.241982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.242548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.243408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.243677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.244248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.244786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.245291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.245782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.246400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.246890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.247385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.247899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.248383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.249051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.249465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.249952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.250845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.251265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.252005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.252574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.253056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.253686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.255345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.255847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.256361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.256941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.257448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.258067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.259523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.259523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.259940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.260355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.261035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.261473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.262077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.262558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.263103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.263856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.264240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.264867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.265342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.265943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.266437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.266922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.268685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.268685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.269158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.269714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.270115 n-d-847009-13 devstack@n-api.service[128860]: INFO dbcounter [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Registered counter for database nova_api Aug 23 10:36:05.270345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.270857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.271455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.271955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.272541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.275736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.275736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.275736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.275736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.275736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.276781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.277142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.277641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.278165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.278773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.280786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.280786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.280786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.281040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.281460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.282024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.282598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.283152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.283727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.284301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.285035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.286460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.286460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.286900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.287615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.288152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.288901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.289549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.290194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.290886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.291465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.291592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.292200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.292940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.293533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.294196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.294804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.295427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.296073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.296811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.297455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.298140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.298341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writer thread running {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.298895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.299578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.300233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.301554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.302252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.302932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.303609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.304497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.305145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.305804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.306458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.307048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.307673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.308324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.309011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.329573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.331038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.332094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.333625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.334623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.334623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.334623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.334623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.334623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.334623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.335306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.335538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.336099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.336641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.339931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.340487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.341209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.341695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.342266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.344376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.344376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.344376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.344376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.344928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.345450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.346034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.346595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.347173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.348984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.349575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.350139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.350746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.351374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.352016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.352473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.353368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.354050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.355007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.355603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.356221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.356816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.357389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.357976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.358554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.359160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.359729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.360292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.360840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.361590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.362138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.362643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.363335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.364454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.365094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.365681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.366753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.367293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.367887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.368569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.369946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.369946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.370363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.370794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.371206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.371683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.372106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.372553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.372999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.373405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.373814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.373992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.context [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=128860) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 10:36:05.374300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.374763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.375292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.375977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.376437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.376937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.377373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.377806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.378246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.378837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.379473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.379851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:05.380055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.380272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:05.380558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.381047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.381851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.382389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.382864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:05.382959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.383428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.384074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:05.384240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.384502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.384660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:05.385009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.385516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.385936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.386384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.386806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.387220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.387593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:05.387743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.388112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.388520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.389012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.389426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.390094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.390362 n-d-847009-13 devstack@n-api.service[128860]: INFO dbcounter [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Registered counter for database nova_cell0 Aug 23 10:36:05.390612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.391030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.391520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.391951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.392495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.392884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.393365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.393802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.394286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.394813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.395262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.395819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.396375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.396698 n-d-847009-13 devstack@n-api.service[128860]: INFO dbcounter [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Registered counter for database nova_cell1 Aug 23 10:36:05.396818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.397189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.397574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.397961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.398343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.398769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.399221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.399671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.400127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.400551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.401063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.401505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.401899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.402307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.402797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.403202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.406943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.407107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.407242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.407242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.408071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.408703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.408889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.409316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.409896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.410913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.411288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.411642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.411983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.413114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.413249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.414235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.414235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.414953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.415504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.415955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.416327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.416977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.417456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.417896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.418411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.418864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.419055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writer thread running {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.419360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.419782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.420193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.420594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.421069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.421635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.422269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.422596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.422972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.423299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.423734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.424058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.424443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.424837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.425050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writer thread running {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.425140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.425451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.426408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.426732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.427208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.427565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.427830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.428145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.428459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.428826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.429174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.429502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.429835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.430155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.430486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.430806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.431137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.431468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.431800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.432119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.432457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.432863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.433188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.433506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.433827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.434144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.434462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.434778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.435114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.435429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.435759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.436080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.436405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.436725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.437061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.437395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.437765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.438104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.438866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.438866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.439091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.439411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.439725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.440042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.440364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.440683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.441044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.441424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.441745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.442077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.443144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.443144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.443144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.443632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.443750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.444031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.444348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.444660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 10:36:05.444965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 10:36:05.510092 n-d-847009-13 devstack@n-api.service[128859]: INFO dbcounter [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Registered counter for database nova_api Aug 23 10:36:05.541469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_db.sqlalchemy.engines [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.554586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writer thread running {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.574021 n-d-847009-13 devstack@n-api.service[128860]: INFO dbcounter [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Registered counter for database nova_cell0 Aug 23 10:36:05.581762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_db.sqlalchemy.engines [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.586641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writer thread running {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.622436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.context [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=128859) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 10:36:05.626779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:05.627303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:05.628945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:05.629804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:05.630234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:05.632250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:05.634387 n-d-847009-13 devstack@n-api.service[128859]: INFO dbcounter [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Registered counter for database nova_cell0 Aug 23 10:36:05.638564 n-d-847009-13 devstack@n-api.service[128859]: INFO dbcounter [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Registered counter for database nova_cell1 Aug 23 10:36:05.646498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_db.sqlalchemy.engines [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.648808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_db.sqlalchemy.engines [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.655838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writer thread running {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.657224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writer thread running {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.806701 n-d-847009-13 devstack@n-api.service[128859]: INFO dbcounter [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Registered counter for database nova_cell0 Aug 23 10:36:05.813234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_db.sqlalchemy.engines [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 10:36:05.817742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writer thread running {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 10:36:05.915828 n-d-847009-13 devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:36:05.923173 n-d-847009-13 devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:36:06.144867 n-d-847009-13 devstack@n-api.service[128859]: WARNING keystonemiddleware.auth_token [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:36:06.152450 n-d-847009-13 devstack@n-api.service[128859]: WARNING keystonemiddleware.auth_token [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:36:06.267499 n-d-847009-13 devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:36:06.273650 n-d-847009-13 devstack@n-api.service[128860]: WARNING keystonemiddleware.auth_token [None req-069822fe-d2a7-425f-84d5-410ac369d90c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:36:06.278949 n-d-847009-13 devstack@n-api.service[128860]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56290939b9c0 pid: 128860 (default app) Aug 23 10:36:06.513934 n-d-847009-13 devstack@n-api.service[128859]: WARNING keystonemiddleware.auth_token [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 10:36:06.521053 n-d-847009-13 devstack@n-api.service[128859]: WARNING keystonemiddleware.auth_token [None req-b89d0e3a-24d6-44ac-bcf8-39666583f92e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 10:36:06.526302 n-d-847009-13 devstack@n-api.service[128859]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56290939b9c0 pid: 128859 (default app) Aug 23 10:36:45.498400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:45.499698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:45.501051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:45.501827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:46.172850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:46.174311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:46.175567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:46.176575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:46.711124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Calling method '.version_select at 0x7fdc9f620550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:46.715472 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:46.715472 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:46.721728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=128860) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 23 10:36:46.723628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:46.724272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:46.724884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:46.756205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:46.756939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:46.757527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:46.775567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:46.776481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:46.777137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:46.786601 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99887df0-36ac-499e-b005-bfab89ad345e tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.297666 Aug 23 10:36:46.787513 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1208 bytes} [Tue Aug 23 10:36:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:36:47.188336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cf9945e-7dcf-4a86-be09-23b23b6d5232 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-681317761", "id": 1045756147, "os-flavor-access:is_public": "False"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:47.209002 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:47.209002 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:47.242912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cf9945e-7dcf-4a86-be09-23b23b6d5232 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.454173 Aug 23 10:36:47.243529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2/2] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:36:46 2022] POST /compute/v2.1/flavors => generated 430 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:47.248136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76bd19b6-eacc-4efe-bcf0-3c7f868d2fd9 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-441006316"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:47.250969 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:47.250969 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:47.252230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-76bd19b6-eacc-4efe-bcf0-3c7f868d2fd9 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Generated uuid 15023786-6c9e-4bb8-af13-6c3a69711600 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:36:47.325703 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76bd19b6-eacc-4efe-bcf0-3c7f868d2fd9 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.080884 Aug 23 10:36:47.334387 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3/3] 10.222.0.78 () {62 vars in 1205 bytes} [Tue Aug 23 10:36:47 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:47.522767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e804a7d-6a8e-4881-9c69-c4bd21cb25a9 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-484081877", "ram": 512, "vcpus": 1, "disk": 10, "id": 745266451, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:47.551057 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:47.551057 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:47.586088 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e804a7d-6a8e-4881-9c69-c4bd21cb25a9 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.422157 Aug 23 10:36:47.587371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1/4] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:36:46 2022] POST /compute/v2.1/flavors => generated 412 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:47.592457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d882814f-d8d0-40ed-9473-e5bc6aa14f1f tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "71d689a17bb24cccb11aee7686131687"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:47.595227 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:47.595227 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:47.709092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '.version_select at 0x7fdc9f3e54c0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:47.710231 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:47.710231 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:47.711304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:47.711838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:47.712276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:47.729744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:47.730233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:47.730668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:47.741223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:47.741784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:47.742199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:47.748826 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-190ed92c-b2aa-4756-b62d-8cb83a1f01a0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.418138 Aug 23 10:36:47.757547 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4/5] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 23 10:36:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:47.765483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4af110b-17f5-4087-ac03-b775c0ed03b7 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1036772760"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:47.845900 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:47.845900 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:47.892414 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4af110b-17f5-4087-ac03-b775c0ed03b7 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.132913 Aug 23 10:36:47.894050 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 5/6] 10.222.0.78 () {62 vars in 1210 bytes} [Tue Aug 23 10:36:47 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:47.917122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d882814f-d8d0-40ed-9473-e5bc6aa14f1f tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1045756147/action" status: 200 len: 97 microversion: 2.1 time: 0.328277 Aug 23 10:36:47.918015 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2/7] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Aug 23 10:36:47 2022] POST /compute/v2.1/flavors/1045756147/action => generated 97 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:48.063043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edcbd0b5-02c4-417b-993f-fce7607b6ced tempest-AZAdminNegativeTestJSON-1442701326 tempest-AZAdminNegativeTestJSON-1442701326-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:48.063812 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:48.063812 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:48.064664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-edcbd0b5-02c4-417b-993f-fce7607b6ced tempest-AZAdminNegativeTestJSON-1442701326 tempest-AZAdminNegativeTestJSON-1442701326-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '65101bbe04134292b1aa64e694d6ce2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ae0397341744cd3b24c7a6e10aa971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edcbd0b5-02c4-417b-993f-fce7607b6ced tempest-AZAdminNegativeTestJSON-1442701326 tempest-AZAdminNegativeTestJSON-1442701326-project] Request method failure captured: Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK28SHTjLwk50phw6vXo0TK3hvcDJIM9ma3q9NwjavOjdbi-ER8vgU8e0ob93oijdWc3OKoIayBKSgEs-0JgzsCJHWj7rvSg8xn3UnPAk20ofUk3Eu7bS0i55wEp6YIgL4ryhIPmO4i6RqaVc93z-q9JN07Lx1-EXzZUUZLQi5Qh0s0 Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4ae0397341744cd3b24c7a6e10aa971f Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1442701326 Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:36:48.068638 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ae0397341744cd3b24c7a6e10aa971f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ae0397341744cd3b24c7a6e10aa971f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ae0397341744cd3b24c7a6e10aa971f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ae0397341744cd3b24c7a6e10aa971f"}]}] Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AZAdminNegativeTestJSON-1442701326 Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4ae0397341744cd3b24c7a6e10aa971f Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1442701326 Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AZAdminNegativeTestJSON-1442701326-project Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 65101bbe04134292b1aa64e694d6ce2f Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AZAdminNegativeTestJSON-1442701326-project Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 23 10:36:48.069988 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:36:48.070945 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.072103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edcbd0b5-02c4-417b-993f-fce7607b6ced tempest-AZAdminNegativeTestJSON-1442701326 tempest-AZAdminNegativeTestJSON-1442701326-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:48.075859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edcbd0b5-02c4-417b-993f-fce7607b6ced tempest-AZAdminNegativeTestJSON-1442701326 tempest-AZAdminNegativeTestJSON-1442701326-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.175097 Aug 23 10:36:48.075859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 6/8] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 10:36:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:36:48.079644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0943fdc-8ed6-495f-9e9a-edd985130d96 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:48.084535 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:48.084535 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:48.114369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-123c87be-e843-4083-ad99-597724c2e128 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1018961364", "ram": 512, "vcpus": 1, "disk": 10, "id": 338764463, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:48.141779 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0943fdc-8ed6-495f-9e9a-edd985130d96 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069050 Aug 23 10:36:48.142837 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 7/9] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Aug 23 10:36:48 2022] POST /compute/v2.1/flavors/745266451/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:48.148282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-123c87be-e843-4083-ad99-597724c2e128 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.228215 Aug 23 10:36:48.149145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3/10] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:36:47 2022] POST /compute/v2.1/flavors => generated 413 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:48.154341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb0df6ac-f967-4a5c-80ec-ef655a77c848 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:48.158953 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:48.158953 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:48.186852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb0df6ac-f967-4a5c-80ec-ef655a77c848 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.036179 Aug 23 10:36:48.187762 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4/11] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:36:48 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:48.408708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-805b4e97-573d-484e-9c02-d3723aa849bc tempest-FlavorsAccessTestJSON-2070126104 tempest-FlavorsAccessTestJSON-2070126104-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:48.445578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-805b4e97-573d-484e-9c02-d3723aa849bc tempest-FlavorsAccessTestJSON-2070126104 tempest-FlavorsAccessTestJSON-2070126104-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.256610 Aug 23 10:36:48.445856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25daf516-6512-4042-a10b-20b069b88921 tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2002760481", "id": 590453426, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:48.446475 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 5/12] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:36:48 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:48.449670 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:48.449670 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:48.473163 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25daf516-6512-4042-a10b-20b069b88921 tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.324996 Aug 23 10:36:48.473757 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 8/13] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:36:48 2022] POST /compute/v2.1/flavors => generated 446 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:48.618296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f90e40f0-92c0-4b9e-903d-b79226f168a8 tempest-FlavorsExtraSpecsTestJSON-378680456 tempest-FlavorsExtraSpecsTestJSON-378680456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:48.636994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f90e40f0-92c0-4b9e-903d-b79226f168a8 tempest-FlavorsExtraSpecsTestJSON-378680456 tempest-FlavorsExtraSpecsTestJSON-378680456-project] 10.222.0.78 "GET /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.189427 Aug 23 10:36:48.637569 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 6/14] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Aug 23 10:36:48 2022] GET /compute/v2.1/flavors/745266451/os-extra_specs => generated 66 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:48.648600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f9ccd9e-c225-4850-9b77-ea6628a1c67c tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:48.651684 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:48.651684 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:48.660214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f9f6e72-bb06-429d-abbc-5fe580cb920e tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:48.685749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9f9f6e72-bb06-429d-abbc-5fe580cb920e tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] HTTP exception thrown: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f9f6e72-bb06-429d-abbc-5fe580cb920e tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Request method failure captured: Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/flavors/338764463/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK29Wpxi1I8GvnY6Q-H8MIBe8iLnQbWc1ZVYKfEqBVSGCjdmm6NbZ8ZOaJcGp7WnQPEBUlqPC37uDgBZF8RYcDRjWH_6SrvEBfyZQb6IfvATvoRIF7XpCI_icPuRNNh7ZbVbMe1A91FtOAbhC7E99TjBYroCgObr4XJgK-bKr8UEIa4 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:36:48.687435 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c019c4b2e6147bebe9dc8101f706d45", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}] Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 51be400fa0834bda9f330c34a485293a Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:36:48.688781 n-d-847009-13 devstack@n-api.service[128860]: exception: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'flavor_id': '338764463', 'id': 'hw:cpu_thread_policy'} Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:48.689481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f9f6e72-bb06-429d-abbc-5fe580cb920e tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Returning 404 to user: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:48.690744 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f9f6e72-bb06-429d-abbc-5fe580cb920e tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] 10.222.0.78 "GET /compute/v2.1/flavors/338764463/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.214284 Aug 23 10:36:48.694922 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 9/15] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:36:48 2022] GET /compute/v2.1/flavors/338764463/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:36:48.699753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf83e071-c1ca-4d02-aa94-45fd6818aef7 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "71d689a17bb24cccb11aee7686131687"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:48.702335 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:48.702335 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:48.704525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f9ccd9e-c225-4850-9b77-ea6628a1c67c tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:48.707247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f9ccd9e-c225-4850-9b77-ea6628a1c67c tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:48.707902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f9ccd9e-c225-4850-9b77-ea6628a1c67c tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:48.896110 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf83e071-c1ca-4d02-aa94-45fd6818aef7 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1045756147/action" status: 200 len: 21 microversion: 2.1 time: 0.200006 Aug 23 10:36:48.898540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 10/16] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Aug 23 10:36:48 2022] POST /compute/v2.1/flavors/1045756147/action => generated 21 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.056654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7327910e-34f1-49d3-990a-ae2d71a10941 tempest-FlavorsV255TestJSON-951077933 tempest-FlavorsV255TestJSON-951077933-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.066688 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7327910e-34f1-49d3-990a-ae2d71a10941 tempest-FlavorsV255TestJSON-951077933 tempest-FlavorsV255TestJSON-951077933-project] 10.222.0.78 "GET /compute/v2.1/flavors/590453426" status: 200 len: 446 microversion: 2.55 time: 0.166558 Aug 23 10:36:49.075301 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 11/17] 10.222.0.78 () {60 vars in 1196 bytes} [Tue Aug 23 10:36:48 2022] GET /compute/v2.1/flavors/590453426 => generated 446 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:49.075301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65092d4f-9a99-49ac-b28a-6a620cd6f336 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.099535 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65092d4f-9a99-49ac-b28a-6a620cd6f336 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030009 Aug 23 10:36:49.104593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 12/18] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/flavors/745266451/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.105844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c4ffa27-e31e-410e-a154-6d838649a3bc tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.109459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3c4ffa27-e31e-410e-a154-6d838649a3bc tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '51be400fa0834bda9f330c34a485293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c019c4b2e6147bebe9dc8101f706d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c4ffa27-e31e-410e-a154-6d838649a3bc tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Request method failure captured: Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/flavors/338764463/os-extra_specs HTTP/1.1 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 66 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK29Wpxi1I8GvnY6Q-H8MIBe8iLnQbWc1ZVYKfEqBVSGCjdmm6NbZ8ZOaJcGp7WnQPEBUlqPC37uDgBZF8RYcDRjWH_6SrvEBfyZQb6IfvATvoRIF7XpCI_icPuRNNh7ZbVbMe1A91FtOAbhC7E99TjBYroCgObr4XJgK-bKr8UEIa4 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:36:49.111551 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c019c4b2e6147bebe9dc8101f706d45", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}] Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 51be400fa0834bda9f330c34a485293a Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 23 10:36:49.113730 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'flavor_id': '338764463', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:36:49.114564 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 23 10:36:49.115956 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.117250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c4ffa27-e31e-410e-a154-6d838649a3bc tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:49.117250 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c4ffa27-e31e-410e-a154-6d838649a3bc tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] 10.222.0.78 "POST /compute/v2.1/flavors/338764463/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.012057 Aug 23 10:36:49.117250 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 13/19] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/flavors/338764463/os-extra_specs => generated 124 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:36:49.122756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad4d5e9c-d7d4-4ed0-8200-e9e1236c434b tempest-FlavorsAccessTestJSON-2070126104 tempest-FlavorsAccessTestJSON-2070126104-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.128606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f9ccd9e-c225-4850-9b77-ea6628a1c67c tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 0.489211 Aug 23 10:36:49.129546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 7/20] 10.222.0.78 () {62 vars in 1232 bytes} [Tue Aug 23 10:36:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:49.134783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e93e98c3-06ff-4cc9-a1cb-203a768fdaad tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9f961c10>, body: {"flavor": {"description": "new"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.148275 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.148275 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:49.166154 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad4d5e9c-d7d4-4ed0-8200-e9e1236c434b tempest-FlavorsAccessTestJSON-2070126104 tempest-FlavorsAccessTestJSON-2070126104-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6211 microversion: 2.1 time: 0.050492 Aug 23 10:36:49.166758 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 14/21] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/detail => generated 6211 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:49.171797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a27733ec-a9ff-4815-b5c8-56f52ea5f1b6 tempest-FlavorsExtraSpecsTestJSON-378680456 tempest-FlavorsExtraSpecsTestJSON-378680456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.190702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e93e98c3-06ff-4cc9-a1cb-203a768fdaad tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/590453426" status: 200 len: 447 microversion: 2.55 time: 0.059636 Aug 23 10:36:49.192120 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 8/22] 10.222.0.78 () {62 vars in 1216 bytes} [Tue Aug 23 10:36:49 2022] PUT /compute/v2.1/flavors/590453426 => generated 447 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:49.195944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6f1532f-d9b4-4cdc-bea7-4587a83d87ab tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.196761 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a27733ec-a9ff-4815-b5c8-56f52ea5f1b6 tempest-FlavorsExtraSpecsTestJSON-378680456 tempest-FlavorsExtraSpecsTestJSON-378680456-project] 10.222.0.78 "GET /compute/v2.1/flavors/745266451/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.028904 Aug 23 10:36:49.197632 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 15/23] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/745266451/os-extra_specs/hw:numa_nodes => generated 22 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.202045 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.202045 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:49.207684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b407209d-faa5-4d7e-8369-ead2f368b943 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.217136 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.217136 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:49.236963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b407209d-faa5-4d7e-8369-ead2f368b943 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:49.238026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b407209d-faa5-4d7e-8369-ead2f368b943 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:49.238714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b407209d-faa5-4d7e-8369-ead2f368b943 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:49.253565 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6f1532f-d9b4-4cdc-bea7-4587a83d87ab tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/338764463/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061068 Aug 23 10:36:49.255003 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 9/24] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/flavors/338764463/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.261271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b58358b-eeb0-4368-ad8a-b64d7e1dec15 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.262605 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.262605 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:49.295962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b58358b-eeb0-4368-ad8a-b64d7e1dec15 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1045756147" status: 202 len: 0 microversion: 2.1 time: 0.039612 Aug 23 10:36:49.300940 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 10/25] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/flavors/1045756147 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:36:49.307017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3064b5f-0f39-4b7d-990b-b9659cbe742c tempest-FlavorsV255TestJSON-951077933 tempest-FlavorsV255TestJSON-951077933-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.333544 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3064b5f-0f39-4b7d-990b-b9659cbe742c tempest-FlavorsV255TestJSON-951077933 tempest-FlavorsV255TestJSON-951077933-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6569 microversion: 2.55 time: 0.031201 Aug 23 10:36:49.334134 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 11/26] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/detail => generated 6569 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:36:49.339097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bdd43e99-e71c-40e3-a948-6ceaa9f2a63c tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.368202 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bdd43e99-e71c-40e3-a948-6ceaa9f2a63c tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032738 Aug 23 10:36:49.369302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 12/27] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/flavors/745266451/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.374984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d69b2b45-cff3-43b0-994f-4d9367c8b308 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.376209 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.376209 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:49.377403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d69b2b45-cff3-43b0-994f-4d9367c8b308 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '51be400fa0834bda9f330c34a485293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c019c4b2e6147bebe9dc8101f706d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d69b2b45-cff3-43b0-994f-4d9367c8b308 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Request method failure captured: Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK29Wpxi1I8GvnY6Q-H8MIBe8iLnQbWc1ZVYKfEqBVSGCjdmm6NbZ8ZOaJcGp7WnQPEBUlqPC37uDgBZF8RYcDRjWH_6SrvEBfyZQb6IfvATvoRIF7XpCI_icPuRNNh7ZbVbMe1A91FtOAbhC7E99TjBYroCgObr4XJgK-bKr8UEIa4 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:36:49.381115 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c019c4b2e6147bebe9dc8101f706d45", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}] Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 51be400fa0834bda9f330c34a485293a Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:36:49.382210 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'flavor_id': '338764463', 'id': 'hw:numa_nodes'} Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:36:49.382757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 23 10:36:49.383699 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.387709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d69b2b45-cff3-43b0-994f-4d9367c8b308 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:49.388485 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d69b2b45-cff3-43b0-994f-4d9367c8b308 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] 10.222.0.78 "DELETE /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017812 Aug 23 10:36:49.389190 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 13/28] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:36:49.400006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5213c71-4f15-4ca1-9345-f3e21fe29303 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.438665 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5213c71-4f15-4ca1-9345-f3e21fe29303 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6211 microversion: 2.1 time: 0.048348 Aug 23 10:36:49.439616 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 14/29] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/detail => generated 6211 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:49.449876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-498f623e-bdcf-49e2-871b-47dfdcc0908a tempest-FlavorsV255TestJSON-951077933 tempest-FlavorsV255TestJSON-951077933-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.481637 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-498f623e-bdcf-49e2-871b-47dfdcc0908a tempest-FlavorsV255TestJSON-951077933 tempest-FlavorsV255TestJSON-951077933-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3653 microversion: 2.55 time: 0.040592 Aug 23 10:36:49.482577 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 15/30] 10.222.0.78 () {60 vars in 1166 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors => generated 3653 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:36:49.486940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfe81d4b-d50b-433a-9518-9746ca7c4e48 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.495685 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfe81d4b-d50b-433a-9518-9746ca7c4e48 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011977 Aug 23 10:36:49.496502 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 16/31] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/745266451/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.502431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f98ed36d-8195-4cf6-ad94-2b5129ae365e tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.528024 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f98ed36d-8195-4cf6-ad94-2b5129ae365e tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/338764463/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030094 Aug 23 10:36:49.529014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 17/32] 10.222.0.78 () {60 vars in 1221 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/flavors/338764463/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.537888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-95aa13ff-1c2e-4840-b5ed-10b6c9e357a8 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-399471170", "id": 176837143, "os-flavor-access:is_public": "False"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.540900 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.540900 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:49.558764 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-95aa13ff-1c2e-4840-b5ed-10b6c9e357a8 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.028418 Aug 23 10:36:49.560206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 18/33] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/flavors => generated 427 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:49.568196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ffb1d908-0e46-485e-bae0-a0460fcded63 tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.595076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ffb1d908-0e46-485e-bae0-a0460fcded63 tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/590453426" status: 202 len: 0 microversion: 2.55 time: 0.033433 Aug 23 10:36:49.596185 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 19/34] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/flavors/590453426 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:36:49.602748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f5221918-794a-4747-be8a-9c0cbde5f98a tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.605587 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.605587 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:49.624232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:SAVEPOINT=8,nova_api:RELEASE=7,nova_api:DELETE=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:49.628725 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b407209d-faa5-4d7e-8369-ead2f368b943 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.424348 Aug 23 10:36:49.629481 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 16/35] 10.222.0.78 () {62 vars in 1232 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:36:49.636517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1dd0122-8870-41f5-be35-5c0668d52d58 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.639545 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.639545 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:49.640719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1dd0122-8870-41f5-be35-5c0668d52d58 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '51be400fa0834bda9f330c34a485293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c019c4b2e6147bebe9dc8101f706d45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1dd0122-8870-41f5-be35-5c0668d52d58 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Request method failure captured: Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 22 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK29Wpxi1I8GvnY6Q-H8MIBe8iLnQbWc1ZVYKfEqBVSGCjdmm6NbZ8ZOaJcGp7WnQPEBUlqPC37uDgBZF8RYcDRjWH_6SrvEBfyZQb6IfvATvoRIF7XpCI_icPuRNNh7ZbVbMe1A91FtOAbhC7E99TjBYroCgObr4XJgK-bKr8UEIa4 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:36:49.644201 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c019c4b2e6147bebe9dc8101f706d45", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c019c4b2e6147bebe9dc8101f706d45"}]}] Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c019c4b2e6147bebe9dc8101f706d45 Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 51be400fa0834bda9f330c34a485293a Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: {"hw:numa_nodes": "1"} Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:36:49.645320 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'flavor_id': '338764463', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:36:49.646190 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 23 10:36:49.647134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.649178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1dd0122-8870-41f5-be35-5c0668d52d58 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:49.650183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1dd0122-8870-41f5-be35-5c0668d52d58 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629 tempest-FlavorsExtraSpecsNegativeTestJSON-348993629-project] 10.222.0.78 "PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019185 Aug 23 10:36:49.650763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 17/36] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:36:49 2022] PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:36:49.656592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a176203-16cd-4c4e-8bdb-e1d7bd175277 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.657004 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f5221918-794a-4747-be8a-9c0cbde5f98a tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/745266451/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.059001 Aug 23 10:36:49.657386 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.657386 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:49.657611 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 20/37] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:36:49 2022] PUT /compute/v2.1/flavors/745266451/os-extra_specs/hw:numa_nodes => generated 22 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.666443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-556af501-ca09-4efb-84cd-9463dbc4d587 tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.672127 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a176203-16cd-4c4e-8bdb-e1d7bd175277 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/176837143/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.019725 Aug 23 10:36:49.676869 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 18/38] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/176837143/os-flavor-access => generated 21 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.678034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88f6239b-5100-454d-9e64-cc1a1a049e51 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.679122 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.679122 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:49.706045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-556af501-ca09-4efb-84cd-9463dbc4d587 tempest-FlavorsV255TestJSON-2137267936 tempest-FlavorsV255TestJSON-2137267936-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6132 microversion: 2.55 time: 0.046548 Aug 23 10:36:49.706604 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88f6239b-5100-454d-9e64-cc1a1a049e51 tempest-AggregatesAdminTestV241-433152267 tempest-AggregatesAdminTestV241-433152267-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.032375 Aug 23 10:36:49.716981 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 21/39] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/detail => generated 6132 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:36:49.717281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 19/40] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:49.717392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0059ade-d288-45e7-88a3-8a30421285a5 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.732596 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c0059ade-d288-45e7-88a3-8a30421285a5 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] HTTP exception thrown: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0059ade-d288-45e7-88a3-8a30421285a5 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Request method failure captured: Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/flavors/338764463/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK2_8n0SegPOhLllxOMS6gys-Szp4MMCs7Q_3Z0aOlZbOsHwNXPaK4A6yeh-VbPSCeEfXgA4dL8SSFyi28h_XyalUEHo2E-W2fc7iIhEgdW1EtAPxvWilgNkD84gsMmW2H81_LaRcA2DWhv1Eo3mtqEQbnBlkbk3rWS50xhACbr7aAA Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 88106790c2b7484b95f304cc8db1ad12 Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:36:49.734089 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/88106790c2b7484b95f304cc8db1ad12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_88106790c2b7484b95f304cc8db1ad12", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88106790c2b7484b95f304cc8db1ad12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88106790c2b7484b95f304cc8db1ad12"}]}] Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 88106790c2b7484b95f304cc8db1ad12 Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 5132265e8e834fa68cbf807cba4087b6 Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:36:49.735248 n-d-847009-13 devstack@n-api.service[128859]: exception: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'flavor_id': '338764463', 'id': 'hw:cpu_thread_policy'} Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.735843 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0059ade-d288-45e7-88a3-8a30421285a5 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Returning 404 to user: Flavor 338764463 has no extra specs with key hw:cpu_thread_policy. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:49.738191 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0059ade-d288-45e7-88a3-8a30421285a5 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/338764463/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.027189 Aug 23 10:36:49.744706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d80b9632-9140-4c7a-a6f8-13963a1142e7 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.752466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 22/41] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/flavors/338764463/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:36:49.765655 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d80b9632-9140-4c7a-a6f8-13963a1142e7 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056867 Aug 23 10:36:49.771706 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 20/42] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/745266451/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:49.773505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74b0bd49-cc6e-4045-8316-e89f163db2f7 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.778344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17e3e32e-355e-47ca-8d67-59dcab0001d2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1895173843", "name": "tempest-test_aggregate-814861925"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.824482 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74b0bd49-cc6e-4045-8316-e89f163db2f7 tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/176837143" status: 202 len: 0 microversion: 2.1 time: 0.070543 Aug 23 10:36:49.828430 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 23/43] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/flavors/176837143 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:36:49.833438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47e0feaa-9ded-4085-89c3-5cdccf43ebe8 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.837501 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-47e0feaa-9ded-4085-89c3-5cdccf43ebe8 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47e0feaa-9ded-4085-89c3-5cdccf43ebe8 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Request method failure captured: Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 27 Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK2_8n0SegPOhLllxOMS6gys-Szp4MMCs7Q_3Z0aOlZbOsHwNXPaK4A6yeh-VbPSCeEfXgA4dL8SSFyi28h_XyalUEHo2E-W2fc7iIhEgdW1EtAPxvWilgNkD84gsMmW2H81_LaRcA2DWhv1Eo3mtqEQbnBlkbk3rWS50xhACbr7aAA Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 88106790c2b7484b95f304cc8db1ad12 Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:36:49.840702 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/88106790c2b7484b95f304cc8db1ad12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_88106790c2b7484b95f304cc8db1ad12", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88106790c2b7484b95f304cc8db1ad12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88106790c2b7484b95f304cc8db1ad12"}]}] Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 88106790c2b7484b95f304cc8db1ad12 Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 5132265e8e834fa68cbf807cba4087b6 Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: {"hw:cpu_policy": "shared"} Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:36:49.841795 n-d-847009-13 devstack@n-api.service[128859]: exception: Request body and URI mismatch Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'flavor_id': '338764463', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.842519 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.843537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:36:49.843537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:36:49.843537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 23 10:36:49.843537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.850870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47e0feaa-9ded-4085-89c3-5cdccf43ebe8 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:49.854442 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.854442 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:49.854442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-17e3e32e-355e-47ca-8d67-59dcab0001d2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid 06679249-214d-4c77-92be-86a8ebd6c7f1 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:36:49.856355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47e0feaa-9ded-4085-89c3-5cdccf43ebe8 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.026773 Aug 23 10:36:49.858820 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 24/44] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:36:49 2022] PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:36:49.870031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a644ad6f-c1f9-42c0-a75e-37810bcd3e78 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.915084 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17e3e32e-355e-47ca-8d67-59dcab0001d2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.140671 Aug 23 10:36:49.917291 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 21/45] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Aug 23 10:36:49 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:49.923707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edf802d1-5fd8-40a5-b2e7-ca1a61dc2d2f tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.938156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a644ad6f-c1f9-42c0-a75e-37810bcd3e78 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/745266451/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.077972 Aug 23 10:36:49.944404 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 25/46] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 10:36:49 2022] DELETE /compute/v2.1/flavors/745266451/os-extra_specs/hw:numa_nodes => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:36:49.964287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-849331a2-ec2d-4595-857d-f5d8e9d5ac7e tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-849331a2-ec2d-4595-857d-f5d8e9d5ac7e tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Request method failure captured: Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 49 Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK2_8n0SegPOhLllxOMS6gys-Szp4MMCs7Q_3Z0aOlZbOsHwNXPaK4A6yeh-VbPSCeEfXgA4dL8SSFyi28h_XyalUEHo2E-W2fc7iIhEgdW1EtAPxvWilgNkD84gsMmW2H81_LaRcA2DWhv1Eo3mtqEQbnBlkbk3rWS50xhACbr7aAA Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 88106790c2b7484b95f304cc8db1ad12 Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:36:49.972527 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/88106790c2b7484b95f304cc8db1ad12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_88106790c2b7484b95f304cc8db1ad12", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88106790c2b7484b95f304cc8db1ad12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88106790c2b7484b95f304cc8db1ad12"}]}] Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 88106790c2b7484b95f304cc8db1ad12 Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 5132265e8e834fa68cbf807cba4087b6 Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 23 10:36:49.973747 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'flavor_id': '338764463', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance: Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 23 10:36:49.974446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.975565 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:36:49.976730 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:36:49.976730 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:36:49.976730 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:36:49.976730 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:36:49.976730 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 10:36:49.976730 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:36:49.983789 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edf802d1-5fd8-40a5-b2e7-ca1a61dc2d2f tempest-FlavorsAccessTestJSON-977849468 tempest-FlavorsAccessTestJSON-977849468-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5796 microversion: 2.1 time: 0.064944 Aug 23 10:36:49.985095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 22/47] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/flavors/detail => generated 5796 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:49.992499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b68f4c2-cfd5-4e2c-b9f9-d7ece6368d82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:49.995634 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:49.995634 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:50.017256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-849331a2-ec2d-4595-857d-f5d8e9d5ac7e tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:36:50.017595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b68f4c2-cfd5-4e2c-b9f9-d7ece6368d82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.031004 Aug 23 10:36:50.018210 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-849331a2-ec2d-4595-857d-f5d8e9d5ac7e tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.072127 Aug 23 10:36:50.019310 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 26/48] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:36:49 2022] PUT /compute/v2.1/flavors/338764463/os-extra_specs/hw:numa_nodes => generated 117 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:36:50.024230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c019a210-1a7b-4a57-8fa3-4a6fbc2c4e1d tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:50.025617 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 23/49] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:36:49 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:50.040312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dff7c5d-fca5-41e7-8198-5fea5c36aafa tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:50.041618 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:50.041618 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:50.068656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:36:50.078887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c019a210-1a7b-4a57-8fa3-4a6fbc2c4e1d tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/745266451/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.058134 Aug 23 10:36:50.083510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 27/50] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 10:36:50 2022] DELETE /compute/v2.1/flavors/745266451/os-extra_specs/hw:cpu_policy => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:36:50.092314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54fefcec-df0a-4b4e-b1d7-ed2727b08d46 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:50.103489 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:50.103489 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:36:50.114379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7dff7c5d-fca5-41e7-8198-5fea5c36aafa tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/338764463" status: 202 len: 0 microversion: 2.1 time: 0.087254 Aug 23 10:36:50.119022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 24/51] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:36:50 2022] DELETE /compute/v2.1/flavors/338764463 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:36:50.125105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54fefcec-df0a-4b4e-b1d7-ed2727b08d46 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:50.128088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54fefcec-df0a-4b4e-b1d7-ed2727b08d46 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:50.130837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-703a7376-a178-4d4f-96ee-169820932823 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:50.131615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54fefcec-df0a-4b4e-b1d7-ed2727b08d46 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:50.148662 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-703a7376-a178-4d4f-96ee-169820932823 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/745266451/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028266 Aug 23 10:36:50.153309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 25/52] 10.222.0.78 () {58 vars in 1200 bytes} [Tue Aug 23 10:36:50 2022] GET /compute/v2.1/flavors/745266451/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:36:50.175845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2fc98297-7136-450a-b56b-de5b3a2c30c7 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:50.231430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2fc98297-7136-450a-b56b-de5b3a2c30c7 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556 tempest-FlavorsExtraSpecsNegativeTestJSON-938375556-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.072710 Aug 23 10:36:50.232977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 26/53] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:36:50 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:50.245927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c1ce94b-b079-4021-a1f3-7cc2148ef2e6 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:50.301883 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c1ce94b-b079-4021-a1f3-7cc2148ef2e6 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/745266451" status: 202 len: 0 microversion: 2.1 time: 0.065974 Aug 23 10:36:50.303110 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 27/54] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:36:50 2022] DELETE /compute/v2.1/flavors/745266451 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:36:50.314348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06df635b-57c9-4924-beb1-53e4d1d52185 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:50.348929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06df635b-57c9-4924-beb1-53e4d1d52185 tempest-FlavorsExtraSpecsTestJSON-803405812 tempest-FlavorsExtraSpecsTestJSON-803405812-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040632 Aug 23 10:36:50.363900 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 28/55] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:36:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:50.483555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54fefcec-df0a-4b4e-b1d7-ed2727b08d46 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.397612 Aug 23 10:36:50.484904 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 28/56] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:36:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:36:51.740833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-857516029", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "availability_zone": "tempest-test_az-1895173843"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:36:51.764771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:51.768475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:51.780682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:51.782765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:51.784365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:51.785401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:53.780135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:36:54.378436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:36:54.379256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:36:54.379920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:36:54.380620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:36:54.381241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:36:54.409561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:54.413378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:54.414044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:54.415248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:54.415922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:54.416573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:54.497470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Getting quotas for project fd71c4c4e9af4306904d19b723b78447. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:36:54.507056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Getting quotas for user 9f26f2a3e5d74b13b987c36ff3e4cc1c and project fd71c4c4e9af4306904d19b723b78447. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:36:54.537674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:36:54.541984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:36:54.623353 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d25e72d-1855-4176-b831-dfd9cff2a46a tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.443860 Aug 23 10:36:54.626759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 29/57] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:36:54.639072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bacde03a-6fe0-4c61-865e-9c7c6baee5c2 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:54.640157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bacde03a-6fe0-4c61-865e-9c7c6baee5c2 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:36:56.697017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bacde03a-6fe0-4c61-865e-9c7c6baee5c2 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:56.716898 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bacde03a-6fe0-4c61-865e-9c7c6baee5c2 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1242 microversion: 2.1 time: 2.083407 Aug 23 10:36:56.717906 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 29/58] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:36:54 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1242 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:57.739580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:57.741455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:36:57.765600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:57.766256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:57.766715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:57.767436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:57.768073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:57.769142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:58.023597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:58.060789 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed9546a2-7c56-439c-b138-d1ae4314a4f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1308 microversion: 2.1 time: 0.325301 Aug 23 10:36:58.062068 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 30/59] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:36:57 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1308 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:36:59.086332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:59.089195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:36:59.103791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:59.105652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:59.106503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:59.109691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:59.110492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:59.115092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:59.464645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:36:59.511493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fa9acf1b-fa40-4198-b2eb-0bd7aea0793f tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1296 microversion: 2.1 time: 0.429925 Aug 23 10:36:59.512993 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 30/60] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:36:59 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1296 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:36:59.945447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Calling method '.version_select at 0x7fdc9d981b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:36:59.948871 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:36:59.948871 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:36:59.951447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:59.953379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:59.955166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:36:59.965044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:36:59.966005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:36:59.969818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:00.073747 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfb0b653-e01d-498e-ad83-5013434a7483 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.870291 Aug 23 10:37:00.075017 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 31/61] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Aug 23 10:36:59 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:00.536378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:00.537046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:00.575036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:00.577483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:00.578105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:00.580509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:00.582349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:00.585047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:01.105360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.118072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99f1ae99-2745-4a3f-bfdd-47dc101c4105 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.587622 Aug 23 10:37:01.137761 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 32/62] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:00 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:01.230057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efd9b02c-4ea2-4383-ac54-3c35b5a5120f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Calling method '.version_select at 0x7fdc9da084c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.235121 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.235121 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:01.240782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-efd9b02c-4ea2-4383-ac54-3c35b5a5120f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '397f44af958c46d698d6ca516739224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6972077d60040e7bdb974d5f8391e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efd9b02c-4ea2-4383-ac54-3c35b5a5120f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Request method failure captured: Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Hf_96JrPE8SmYFlgbhe3X_dyiV0JmOQaw8G5-XKhwFO-pmaXlmaEv1yqIcvhAwa_xFp_w3OxiD9k6AnyJ7lFa-gzNxaxn7G8CF2tWVsVhjsbkwEvXZIKAJx7_aClIyZm39P8Q3e_QN_C51-lIm17CyviYCkUTDqUxvi7roo3u-gc Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:01.247843 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6972077d60040e7bdb974d5f8391e2e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}] Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 397f44af958c46d698d6ca516739224e Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: action_args: {} Aug 23 10:37:01.249242 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.250123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 23 10:37:01.251562 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.254857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efd9b02c-4ea2-4383-ac54-3c35b5a5120f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.258954 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efd9b02c-4ea2-4383-ac54-3c35b5a5120f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 1.172247 Aug 23 10:37:01.259715 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 31/63] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Aug 23 10:37:00 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 1174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:01.273101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c485455-3395-4656-bc89-5d94cb7cb63c tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Calling method '.version_select at 0x7fdc9d952670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.274534 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.274534 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:01.277253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c485455-3395-4656-bc89-5d94cb7cb63c tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '397f44af958c46d698d6ca516739224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6972077d60040e7bdb974d5f8391e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c485455-3395-4656-bc89-5d94cb7cb63c tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Request method failure captured: Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hosts/n-d-847009-13/reboot HTTP/1.1 Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Hf_96JrPE8SmYFlgbhe3X_dyiV0JmOQaw8G5-XKhwFO-pmaXlmaEv1yqIcvhAwa_xFp_w3OxiD9k6AnyJ7lFa-gzNxaxn7G8CF2tWVsVhjsbkwEvXZIKAJx7_aClIyZm39P8Q3e_QN_C51-lIm17CyviYCkUTDqUxvi7roo3u-gc Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:01.285939 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6972077d60040e7bdb974d5f8391e2e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}] Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 397f44af958c46d698d6ca516739224e Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-d-847009-13'} Aug 23 10:37:01.287398 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.288084 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 23 10:37:01.289099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.291469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c485455-3395-4656-bc89-5d94cb7cb63c tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.293326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c485455-3395-4656-bc89-5d94cb7cb63c tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-847009-13/reboot" status: 403 len: 111 microversion: 2.1 time: 0.025503 Aug 23 10:37:01.305472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8b9f3b1-9ad5-460b-9941-1b4d51c5b8a7 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Calling method '.version_select at 0x7fdc9db26f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.306835 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.306835 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:01.310732 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 33/64] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/n-d-847009-13/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:01.329056 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a8b9f3b1-9ad5-460b-9941-1b4d51c5b8a7 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8b9f3b1-9ad5-460b-9941-1b4d51c5b8a7 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:01.337202 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'nonexistent_hostname'} Aug 23 10:37:01.338576 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:01.339341 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 23 10:37:01.340637 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.341673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.348537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8b9f3b1-9ad5-460b-9941-1b4d51c5b8a7 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.349421 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a8b9f3b1-9ad5-460b-9941-1b4d51c5b8a7 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.049124 Aug 23 10:37:01.354546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:01.363711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01423f63-90e1-4def-ab8b-724da2d4e64f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Calling method '.version_select at 0x7fdc9d91b0d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.365407 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.365407 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:01.368854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-01423f63-90e1-4def-ab8b-724da2d4e64f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '397f44af958c46d698d6ca516739224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6972077d60040e7bdb974d5f8391e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01423f63-90e1-4def-ab8b-724da2d4e64f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Request method failure captured: Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hosts/n-d-847009-13 HTTP/1.1 Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Hf_96JrPE8SmYFlgbhe3X_dyiV0JmOQaw8G5-XKhwFO-pmaXlmaEv1yqIcvhAwa_xFp_w3OxiD9k6AnyJ7lFa-gzNxaxn7G8CF2tWVsVhjsbkwEvXZIKAJx7_aClIyZm39P8Q3e_QN_C51-lIm17CyviYCkUTDqUxvi7roo3u-gc Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:01.373901 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6972077d60040e7bdb974d5f8391e2e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}] Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 397f44af958c46d698d6ca516739224e Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-d-847009-13'} Aug 23 10:37:01.375042 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.375987 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 23 10:37:01.376949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.378407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01423f63-90e1-4def-ab8b-724da2d4e64f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.378407 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-01423f63-90e1-4def-ab8b-724da2d4e64f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-847009-13" status: 403 len: 109 microversion: 2.1 time: 0.017649 Aug 23 10:37:01.386663 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 34/66] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/n-d-847009-13 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:01.390647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28833995-b49e-49dc-bd6a-e58c781004b9 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Calling method '.version_select at 0x7fdc9d8ca310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.391892 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.391892 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:01.402641 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-28833995-b49e-49dc-bd6a-e58c781004b9 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28833995-b49e-49dc-bd6a-e58c781004b9 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:01.404549 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'nonexistent_hostname'} Aug 23 10:37:01.405669 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.406334 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.407253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.410738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28833995-b49e-49dc-bd6a-e58c781004b9 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.411583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28833995-b49e-49dc-bd6a-e58c781004b9 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025236 Aug 23 10:37:01.412152 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:01.429765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa6ef000-d4c2-4b60-aefa-c908ed2aba5f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Calling method '.version_select at 0x7fdc9d91bee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.429765 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.429765 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:01.429765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa6ef000-d4c2-4b60-aefa-c908ed2aba5f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '397f44af958c46d698d6ca516739224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6972077d60040e7bdb974d5f8391e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa6ef000-d4c2-4b60-aefa-c908ed2aba5f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Request method failure captured: Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hosts/n-d-847009-13/shutdown HTTP/1.1 Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Hf_96JrPE8SmYFlgbhe3X_dyiV0JmOQaw8G5-XKhwFO-pmaXlmaEv1yqIcvhAwa_xFp_w3OxiD9k6AnyJ7lFa-gzNxaxn7G8CF2tWVsVhjsbkwEvXZIKAJx7_aClIyZm39P8Q3e_QN_C51-lIm17CyviYCkUTDqUxvi7roo3u-gc Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:01.433404 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6972077d60040e7bdb974d5f8391e2e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}] Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 397f44af958c46d698d6ca516739224e Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-d-847009-13'} Aug 23 10:37:01.434832 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.435573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 23 10:37:01.436794 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.444817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa6ef000-d4c2-4b60-aefa-c908ed2aba5f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.446138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa6ef000-d4c2-4b60-aefa-c908ed2aba5f tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-847009-13/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.026706 Aug 23 10:37:01.459090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc970f00-31d0-4eb0-9355-81c255775155 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Calling method '.version_select at 0x7fdc9d8f5ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.460525 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.460525 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:01.462010 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 35/68] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/n-d-847009-13/shutdown => generated 113 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:01.482728 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-fc970f00-31d0-4eb0-9355-81c255775155 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc970f00-31d0-4eb0-9355-81c255775155 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:01.493232 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'nonexistent_hostname'} Aug 23 10:37:01.494580 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:01.495272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 23 10:37:01.496211 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.501021 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.510339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc970f00-31d0-4eb0-9355-81c255775155 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.511508 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc970f00-31d0-4eb0-9355-81c255775155 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.058524 Aug 23 10:37:01.513568 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 34/69] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:37:01.526756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1521ddb0-a2f9-4302-afa4-862e30141cef tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Calling method '.version_select at 0x7fdc9d952ca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.528165 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.528165 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:01.529542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1521ddb0-a2f9-4302-afa4-862e30141cef tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '397f44af958c46d698d6ca516739224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6972077d60040e7bdb974d5f8391e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1521ddb0-a2f9-4302-afa4-862e30141cef tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Request method failure captured: Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hosts/n-d-847009-13/startup HTTP/1.1 Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Hf_96JrPE8SmYFlgbhe3X_dyiV0JmOQaw8G5-XKhwFO-pmaXlmaEv1yqIcvhAwa_xFp_w3OxiD9k6AnyJ7lFa-gzNxaxn7G8CF2tWVsVhjsbkwEvXZIKAJx7_aClIyZm39P8Q3e_QN_C51-lIm17CyviYCkUTDqUxvi7roo3u-gc Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:01.532330 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6972077d60040e7bdb974d5f8391e2e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}] Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 397f44af958c46d698d6ca516739224e Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-d-847009-13'} Aug 23 10:37:01.533519 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.534859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 23 10:37:01.536024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.537072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1521ddb0-a2f9-4302-afa4-862e30141cef tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.537072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1521ddb0-a2f9-4302-afa4-862e30141cef tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-847009-13/startup" status: 403 len: 110 microversion: 2.1 time: 0.013195 Aug 23 10:37:01.539656 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 36/70] 10.222.0.78 () {58 vars in 1194 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/n-d-847009-13/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:01.545456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66043087-8c7d-41de-9347-8fada889413c tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Calling method '.version_select at 0x7fdc9db46430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:01.546259 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.546259 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:01.557938 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-66043087-8c7d-41de-9347-8fada889413c tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66043087-8c7d-41de-9347-8fada889413c tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:01.564168 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'nonexistent_hostname'} Aug 23 10:37:01.565990 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:01.566984 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 23 10:37:01.567921 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.570400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.572501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66043087-8c7d-41de-9347-8fada889413c tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.573708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66043087-8c7d-41de-9347-8fada889413c tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.032862 Aug 23 10:37:01.575102 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Aug 23 10:37:01 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:01.585542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dbab741-6ff7-4376-822e-b8541f6f023a tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d981d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dbab741-6ff7-4376-822e-b8541f6f023a tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/os-hosts/n-d-847009-13 HTTP/1.1 Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 51 Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:01.592025 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: {"status": "enable", "maintenance_mode": "invalid"} Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.593835 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-d-847009-13', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'disable', Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'Enable', Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'Disable', Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance: Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.594551 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.595996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.598981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.598981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:37:01.598981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:37:01.598981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.598981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.600908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dbab741-6ff7-4376-822e-b8541f6f023a tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.602126 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7dbab741-6ff7-4376-822e-b8541f6f023a tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-847009-13" status: 400 len: 199 microversion: 2.1 time: 0.021052 Aug 23 10:37:01.607947 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:37:01 2022] PUT /compute/v2.1/os-hosts/n-d-847009-13 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:37:01.613839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01d17dfb-db99-4b26-b74d-cee36ca14cea tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d8caee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01d17dfb-db99-4b26-b74d-cee36ca14cea tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/os-hosts/n-d-847009-13 HTTP/1.1 Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 51 Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:01.618273 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: {"status": "invalid", "maintenance_mode": "enable"} Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.619552 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'n-d-847009-13', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'disable', Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'Enable', Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'Disable', Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance: Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.620363 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.621645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01d17dfb-db99-4b26-b74d-cee36ca14cea tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01d17dfb-db99-4b26-b74d-cee36ca14cea tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-847009-13" status: 400 len: 189 microversion: 2.1 time: 0.011181 Aug 23 10:37:01.623156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 36/73] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:37:01 2022] PUT /compute/v2.1/os-hosts/n-d-847009-13 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:37:01.649381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a300514b-fc3c-4110-9855-93076d1e409d tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Action: 'update', calling method: .version_select at 0x7fdc9d952ee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:01.661809 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:01.661809 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:01.668001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a300514b-fc3c-4110-9855-93076d1e409d tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '397f44af958c46d698d6ca516739224e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6972077d60040e7bdb974d5f8391e2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a300514b-fc3c-4110-9855-93076d1e409d tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Request method failure captured: Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/os-hosts/n-d-847009-13 HTTP/1.1 Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 50 Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Hf_96JrPE8SmYFlgbhe3X_dyiV0JmOQaw8G5-XKhwFO-pmaXlmaEv1yqIcvhAwa_xFp_w3OxiD9k6AnyJ7lFa-gzNxaxn7G8CF2tWVsVhjsbkwEvXZIKAJx7_aClIyZm39P8Q3e_QN_C51-lIm17CyviYCkUTDqUxvi7roo3u-gc Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:01.673334 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6972077d60040e7bdb974d5f8391e2e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6972077d60040e7bdb974d5f8391e2e"}]}] Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f6972077d60040e7bdb974d5f8391e2e Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1512012744 Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 397f44af958c46d698d6ca516739224e Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1512012744-project Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: {"status": "enable", "maintenance_mode": "enable"} Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 23 10:37:01.674427 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-d-847009-13', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.676151 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 23 10:37:01.677162 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.678288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a300514b-fc3c-4110-9855-93076d1e409d tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.681864 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a300514b-fc3c-4110-9855-93076d1e409d tempest-HostsAdminNegativeTestJSON-1512012744 tempest-HostsAdminNegativeTestJSON-1512012744-project] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-847009-13" status: 403 len: 111 microversion: 2.1 time: 0.047303 Aug 23 10:37:01.682709 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:37:01 2022] PUT /compute/v2.1/os-hosts/n-d-847009-13 => generated 111 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:01.693822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf2cc0c3-40df-4ee9-8f1e-df1d14d70810 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d8f5e50>, body: {"status": null, "maintenance_mode": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf2cc0c3-40df-4ee9-8f1e-df1d14d70810 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/os-hosts/n-d-847009-13 HTTP/1.1 Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 42 Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:01.702884 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: {"status": null, "maintenance_mode": null} Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 23 10:37:01.704042 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'n-d-847009-13', 'body': {'status': None, 'maintenance_mode': None}} Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'disable', Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'Enable', Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'Disable', Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance: Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi None Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.704803 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.707646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.709468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:37:01.709468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:37:01.709468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 23 10:37:01.709468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.709468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf2cc0c3-40df-4ee9-8f1e-df1d14d70810 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.709468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf2cc0c3-40df-4ee9-8f1e-df1d14d70810 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-847009-13" status: 400 len: 127 microversion: 2.1 time: 0.015969 Aug 23 10:37:01.716876 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 37/75] 10.222.0.78 () {60 vars in 1190 bytes} [Tue Aug 23 10:37:01 2022] PUT /compute/v2.1/os-hosts/n-d-847009-13 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:37:01.721007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-531ad0e9-b5f9-4188-99d9-b3c49f731c87 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d8cf430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:01.731376 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.hosts [None req-531ad0e9-b5f9-4188-99d9-b3c49f731c87 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Enabling host nonexistent_hostname. Aug 23 10:37:01.762926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-531ad0e9-b5f9-4188-99d9-b3c49f731c87 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-531ad0e9-b5f9-4188-99d9-b3c49f731c87 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Request method failure captured: Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 50 Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3LEcimHrfaU_pB1bo5qI43DEb4mUnhrA-yhh-cpWBJT6ARpm-KmFpnlofVNjQ5dJFH3DNM65cHtwtLfLMmPBh6-9ADHNEnXEbhJKdcQxKBJUeVWQFUTE_mJvjdlmMytrCeKulhQaDAikfCBenVREk_8QJBNSNSFdbLDad3xpyu7pY Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:01.790117 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4ff1893a053f431087a1dd23ec0d6a4e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4ff1893a053f431087a1dd23ec0d6a4e"}]}] Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4ff1893a053f431087a1dd23ec0d6a4e Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-102720598 Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 99115e5595294af69ddc76904f5e3dcc Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HostsAdminNegativeTestJSON-102720598-project-admin Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: {"status": "enable", "maintenance_mode": "enable"} Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.791384 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:01.792139 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:01.793104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:01.796288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-531ad0e9-b5f9-4188-99d9-b3c49f731c87 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:01.797812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-531ad0e9-b5f9-4188-99d9-b3c49f731c87 tempest-HostsAdminNegativeTestJSON-102720598 tempest-HostsAdminNegativeTestJSON-102720598-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.076655 Aug 23 10:37:01.803897 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1211 bytes} [Tue Aug 23 10:37:01 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:02.144072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:02.145002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:02.165176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:02.166227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:02.168506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:02.169684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:02.171469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:02.173180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:02.597046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:02.615982 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d3c93e5-fd6a-4439-a082-20b17859910e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.475908 Aug 23 10:37:02.616602 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 38/77] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:02 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:03.640991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:03.641803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:03.667832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:03.668251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:03.668667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:03.669440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:03.669899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:03.670380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:04.331572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:04.340696 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb95e34c-29e5-4799-bd74-b157603a66dd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.704998 Aug 23 10:37:04.361326 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 40/78] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:03 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:04.874896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:04.878356 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:04.878356 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:04.884245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:04.884792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:04.885242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:04.885994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:04.886457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:04.886890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:04.997703 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33497ca4-d639-45cf-8ef1-b12ea5a87c5a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 404 microversion: 2.1 time: 1.186774 Aug 23 10:37:05.006258 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 39/79] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:37:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 404 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:05.258153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:05.375019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:05.376071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:05.386124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:05.390068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:05.392826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:05.393966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:05.400475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:05.403439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:06.114820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9d7af160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:06.120066 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:06.120066 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:06.123191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:06.123689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:06.130703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:06.130841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:06.134400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:06.134553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:06.280546 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e290621-867f-4f5e-882b-179da72e6231 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 1.028177 Aug 23 10:37:06.292995 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 41/80] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Aug 23 10:37:05 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:06.631918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-325825c1-cee1-4cd9-b8b6-c47c06dc9970 tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-751819064", "id": 1872397040, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:06.637353 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:06.637353 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:06.680148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-325825c1-cee1-4cd9-b8b6-c47c06dc9970 tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.385872 Aug 23 10:37:06.684921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 42/81] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:37:06 2022] POST /compute/v2.1/flavors => generated 467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:06.716158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:06.775458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:06.801016 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-904e69c1-bb24-4f41-93c0-abe13e5f00f7 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 1.434933 Aug 23 10:37:06.822165 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 40/82] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:05 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:06.859557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9d867700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:06.874932 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:06.874932 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:06.882535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:06.883799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:06.885279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:06.887336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:06.888375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:06.890285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:06.942669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c36d63-b983-4569-ab0f-f01d56bd7aa2", "tag": "bce8cf8e-7517-4e90-9b74-7607b14dde39"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:06.984019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:06.995571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:06.996284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.027157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80a4e241-b13f-4246-8255-40b4b448dc78 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.200247 Aug 23 10:37:07.028609 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 41/83] 10.222.0.78 () {58 vars in 1139 bytes} [Tue Aug 23 10:37:06 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:07.081297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Creating event network-changed:bce8cf8e-7517-4e90-9b74-7607b14dde39 for instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 on n-h1-847009-13 Aug 23 10:37:07.082052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:37:07.087764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2eeb85f4-8c2a-43ac-a9bb-16f3f02000ea req-230a1801-2f9c-400d-8df1-b26b379b224f service nova] Acquired lock "compute-rpcapi-router" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:37:07.090771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.091487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.094354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.095391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.097787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.098809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.138234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.rpcapi [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 10:37:07.140580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] Releasing lock "compute-rpcapi-router" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:37:07.227545 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-546ff768-33ac-421e-ae91-ab6eb66d1561 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.531572 Aug 23 10:37:07.231591 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 43/84] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:07.617281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9da18940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:07.618119 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:07.618119 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:07.627415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=128859) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 23 10:37:07.633605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.634216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.635842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.673286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.676504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.677196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.699838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.700680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.701164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.718181 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba25e8e6-094d-4a8e-9aa7-794b270f88c1 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.686274 Aug 23 10:37:07.729742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 42/85] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:07.741988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9da18f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:07.745957 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:07.745957 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:07.748457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.749340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.753211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.755391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.756846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.757636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.774895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab509026-0ff2-4160-98c8-18df2ec28d17 tempest-FlavorsV261TestJSON-977242421 tempest-FlavorsV261TestJSON-977242421-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:07.798299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab509026-0ff2-4160-98c8-18df2ec28d17 tempest-FlavorsV261TestJSON-977242421 tempest-FlavorsV261TestJSON-977242421-project] 10.222.0.78 "GET /compute/v2.1/flavors/1872397040" status: 200 len: 467 microversion: 2.61 time: 0.561787 Aug 23 10:37:07.818876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 44/86] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Aug 23 10:37:07 2022] GET /compute/v2.1/flavors/1872397040 => generated 467 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:07.827948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a595ffe3-32fe-48cf-99fe-45efb50ddac6 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.096824 Aug 23 10:37:07.830410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 43/87] 10.222.0.78 () {58 vars in 1145 bytes} [Tue Aug 23 10:37:07 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:37:07.837099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d7afdc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:07.841876 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:07.841876 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:07.845242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.846655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7bc3711-ef57-432c-b9e3-238f4d7eb9c3 tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:07.847467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.849168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.851729 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:07.851729 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:07.941617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:07.942209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:07.943439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:07.945367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7bc3711-ef57-432c-b9e3-238f4d7eb9c3 tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/1872397040" status: 200 len: 468 microversion: 2.61 time: 0.112388 Aug 23 10:37:07.955021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 44/88] 10.222.0.78 () {62 vars in 1219 bytes} [Tue Aug 23 10:37:07 2022] PUT /compute/v2.1/flavors/1872397040 => generated 468 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:07.983410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:07.996600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:08.006306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.012957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.012957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.032088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.032604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.033067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.033813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.034887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.035332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.043728 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-927e6bd7-4bbc-4fdd-a021-5f03432a1124 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.223564 Aug 23 10:37:08.053662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 45/89] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 23 10:37:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:08.481112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-368856a2-ebc2-42fe-9d79-68dd4e699aea tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-763223556", "id": 607613125, "os-flavor-access:is_public": "False"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:08.484593 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:08.484593 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:08.519579 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-368856a2-ebc2-42fe-9d79-68dd4e699aea tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.464042 Aug 23 10:37:08.521032 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 46/90] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:08 2022] POST /compute/v2.1/flavors => generated 435 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:08.526433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cce2433-1588-4cb0-924c-37522fbca1d2 tempest-FlavorsV261TestJSON-977242421 tempest-FlavorsV261TestJSON-977242421-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:08.558359 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cce2433-1588-4cb0-924c-37522fbca1d2 tempest-FlavorsV261TestJSON-977242421 tempest-FlavorsV261TestJSON-977242421-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.035963 Aug 23 10:37:08.559646 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 47/91] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:37:08 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:37:08.597563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d8cff70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:08.598770 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:08.598770 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:08.600158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.600841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.601491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.619324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.619814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.620530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.644727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.646007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.646634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.654626 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e31e0d9-7dc9-4ccd-8df7-9ba94a2bf049 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.093693 Aug 23 10:37:08.655825 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 48/92] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:08.661852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91626b3e-6051-48f2-b08d-434b1e61d9ae tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:08.665580 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:08.665580 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:08.794296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:08.804468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e7a273b-a9cf-4709-be3d-8f80e10289b9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.836455 Aug 23 10:37:08.808020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 45/93] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:07 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:08.832949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20a5d204-00cf-4adf-a699-a927d9a4cf8d tempest-FlavorsV261TestJSON-977242421 tempest-FlavorsV261TestJSON-977242421-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:08.884199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20a5d204-00cf-4adf-a699-a927d9a4cf8d tempest-FlavorsV261TestJSON-977242421 tempest-FlavorsV261TestJSON-977242421-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.071826 Aug 23 10:37:08.885302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 46/94] 10.222.0.78 () {60 vars in 1166 bytes} [Tue Aug 23 10:37:08 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:37:08.897582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d867670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:08.898551 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:08.898551 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:08.899538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.900042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.900490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.966313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:08.966859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:08.967299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:08.981730 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e3618b9-ef41-47af-8f0a-2f5ef2dd1155 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.094521 Aug 23 10:37:08.983016 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 47/95] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:08.989547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91626b3e-6051-48f2-b08d-434b1e61d9ae tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/607613125/action" status: 200 len: 96 microversion: 2.1 time: 0.331875 Aug 23 10:37:08.990505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0db06432-9212-472d-a525-a407d52eab54 tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:08.991468 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:08.991468 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:08.993188 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 49/96] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Aug 23 10:37:08 2022] POST /compute/v2.1/flavors/607613125/action => generated 96 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:37:09.010905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d662053-63c4-4fa0-bf3c-a34f34ba1696 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d7af8b0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.011779 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.011779 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:09.014292 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0db06432-9212-472d-a525-a407d52eab54 tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1872397040" status: 202 len: 0 microversion: 2.61 time: 0.029623 Aug 23 10:37:09.015439 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 48/97] 10.222.0.78 () {60 vars in 1202 bytes} [Tue Aug 23 10:37:08 2022] DELETE /compute/v2.1/flavors/1872397040 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:09.022079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8578ae3a-987c-45ef-997b-8886b70990d3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:09.024871 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.024871 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:09.031387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d662053-63c4-4fa0-bf3c-a34f34ba1696 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.033567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d662053-63c4-4fa0-bf3c-a34f34ba1696 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.034497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d662053-63c4-4fa0-bf3c-a34f34ba1696 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.083871 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d662053-63c4-4fa0-bf3c-a34f34ba1696 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.088010 Aug 23 10:37:09.085322 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 50/98] 10.222.0.78 () {58 vars in 1179 bytes} [Tue Aug 23 10:37:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:09.090604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0bb7703-3ee6-465b-9572-a4760fb40f9a tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.135587 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0bb7703-3ee6-465b-9572-a4760fb40f9a tempest-FlavorsV261TestJSON-1505231194 tempest-FlavorsV261TestJSON-1505231194-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.048777 Aug 23 10:37:09.141191 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 51/99] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:37:09 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:37:09.151464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d7bf040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.152262 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.152262 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:09.156637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.159798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.160306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.199880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.201254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.201705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.265790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.266021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.266410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.287388 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6e4b6d8-850b-4f35-9160-6f21d7e83b99 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.145026 Aug 23 10:37:09.295816 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 52/100] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:09.309831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d7afe50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.310621 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.310621 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:09.311741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.317329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.317892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.363897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.367685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.368200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.387047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5af9f30f-8346-42b3-9516-c2f9665fa830 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.089213 Aug 23 10:37:09.387668 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 53/101] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:09.408811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d7afc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.409657 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.409657 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:09.410867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.411354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.411790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.449640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.450021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.450517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.457386 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-685424d3-ddaf-47d0-bbc2-4d893ba20f7d tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 759 microversion: 2.1 time: 0.056637 Aug 23 10:37:09.469413 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 54/102] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:09 2022] GET /compute/v2.1/os-hypervisors/2 => generated 759 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:09.477229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Calling method '.version_select at 0x7fdc9d7afb80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.478026 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.478026 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:09.480103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.480969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.482557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.499231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.500385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.501033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.521942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.522671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.523251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.557719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:RELEASE=2,nova_api:SELECT=87,nova_api:DELETE=8,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:09.570356 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-8578ae3a-987c-45ef-997b-8886b70990d3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project ea1b123de1164fd1b34c08ae69a65471 combination. Aug 23 10:37:09.578060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c13da33c-b7ab-4c36-ba12-19f4ed2e7280 tempest-HypervisorAdminTestJSON-1102480728 tempest-HypervisorAdminTestJSON-1102480728-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.109298 Aug 23 10:37:09.589356 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 55/103] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Aug 23 10:37:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8578ae3a-987c-45ef-997b-8886b70990d3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Request method failure captured: Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/flavors/607613125/action HTTP/1.1 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 67 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3SO4F3WlfEvG_e2wuDiNEedtR2zZm8D3udPEfdodx06F0_22lTLMeOE-FmlZAz8XVuzEnQLCxogQHrekCO-gyAVnoGgEzxoGag18ZQVBAYjQtfKs5II_Cb6k7znBr48ae5ffAHuoEI9lzqcguI33_wbVe5TQLabkvFLuNreRLNr48 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: af9535aa46ad4b3b9410cc6c9b59c1a6 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:09.622704 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af9535aa46ad4b3b9410cc6c9b59c1a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}] Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: af9535aa46ad4b3b9410cc6c9b59c1a6 Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4048f80ca68a49dc8dd131f4aa01d7ab Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: {"addTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} Aug 23 10:37:09.624185 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: exception: Flavor access already exists for flavor 21 and project ea1b123de1164fd1b34c08ae69a65471 combination. Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '607613125', 'body': {'addTenantAccess': {'tenant': 'ea1b123de1164fd1b34c08ae69a65471'}}} Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result.read() Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 10:37:09.625645 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-ea1b123de1164fd1b34c08ae69a65471' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi session.flush() Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 10:37:09.626789 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 10:37:09.628223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 10:37:09.629288 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result.read() Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-ea1b123de1164fd1b34c08ae69a65471' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 23, 10, 37, 9, 559634), 'updated_at': None, 'flavor_id': 21, 'project_id': 'ea1b123de1164fd1b34c08ae69a65471'}] Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:09.630347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project ea1b123de1164fd1b34c08ae69a65471 combination. Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:09.633586 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project ea1b123de1164fd1b34c08ae69a65471 combination. Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:09.634847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:09.636050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project ea1b123de1164fd1b34c08ae69a65471 combination. Aug 23 10:37:09.636050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:09.636050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8578ae3a-987c-45ef-997b-8886b70990d3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project ea1b123de1164fd1b34c08ae69a65471 combination. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:09.636670 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8578ae3a-987c-45ef-997b-8886b70990d3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/607613125/action" status: 409 len: 152 microversion: 2.1 time: 0.616588 Aug 23 10:37:09.644957 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 49/104] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Aug 23 10:37:09 2022] POST /compute/v2.1/flavors/607613125/action => generated 152 bytes in 629 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:09.656419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-409f7c3d-ab2e-4b3b-b5b6-a50a51ebf928 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:09.660686 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:09.660686 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:09.832481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:09.833165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:09.858834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.864027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.866664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:09.867421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:09.867903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:09.873418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:10.374395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-409f7c3d-ab2e-4b3b-b5b6-a50a51ebf928 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/607613125/action" status: 200 len: 21 microversion: 2.1 time: 0.723095 Aug 23 10:37:10.382551 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 56/105] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Aug 23 10:37:09 2022] POST /compute/v2.1/flavors/607613125/action => generated 21 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:37:10.398407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58965f82-85a4-41fd-8add-74d25ef03fd3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:10.399216 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:10.399216 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:10.406993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:10.449449 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58965f82-85a4-41fd-8add-74d25ef03fd3 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/607613125" status: 202 len: 0 microversion: 2.1 time: 0.065377 Aug 23 10:37:10.453287 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 57/106] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:37:10 2022] DELETE /compute/v2.1/flavors/607613125 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:10.482255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddcdb5c5-7969-46e7-b4b1-55e70feae65a tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:10.539354 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddcdb5c5-7969-46e7-b4b1-55e70feae65a tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080207 Aug 23 10:37:10.553314 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 58/107] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:10.645861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:10.669238 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b0358ef-5d57-4c01-a1a5-c9081b40d919 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.842432 Aug 23 10:37:10.682826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 50/108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:09 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:10.691897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10d5a797-de34-4265-aeb6-67ffe7d1b9bd tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1910769788", "id": 1891296948, "os-flavor-access:is_public": "True"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:10.695380 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:10.695380 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:10.739986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10d5a797-de34-4265-aeb6-67ffe7d1b9bd tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.055886 Aug 23 10:37:10.741687 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 51/109] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:10 2022] POST /compute/v2.1/flavors => generated 438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:10.757040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f6d96c9-8fe8-40ab-86af-50742a756741 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:10.758614 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:10.758614 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:10.769338 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-9f6d96c9-8fe8-40ab-86af-50742a756741 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f6d96c9-8fe8-40ab-86af-50742a756741 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Request method failure captured: Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/flavors/1891296948/os-flavor-access HTTP/1.1 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3SO4F3WlfEvG_e2wuDiNEedtR2zZm8D3udPEfdodx06F0_22lTLMeOE-FmlZAz8XVuzEnQLCxogQHrekCO-gyAVnoGgEzxoGag18ZQVBAYjQtfKs5II_Cb6k7znBr48ae5ffAHuoEI9lzqcguI33_wbVe5TQLabkvFLuNreRLNr48 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: af9535aa46ad4b3b9410cc6c9b59c1a6 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:10.772042 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af9535aa46ad4b3b9410cc6c9b59c1a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}] Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: af9535aa46ad4b3b9410cc6c9b59c1a6 Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4048f80ca68a49dc8dd131f4aa01d7ab Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: exception: Access list not available for public flavors. Aug 23 10:37:10.773751 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'flavor_id': '1891296948'} Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 23 10:37:10.774733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:10.784119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f6d96c9-8fe8-40ab-86af-50742a756741 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:10.785697 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f6d96c9-8fe8-40ab-86af-50742a756741 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1891296948/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035726 Aug 23 10:37:10.786909 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 52/110] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Aug 23 10:37:10 2022] GET /compute/v2.1/flavors/1891296948/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:10.798205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-043374d4-11f4-43ec-817b-a6eeeb967f9a tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:10.799411 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:10.799411 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:10.823479 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-043374d4-11f4-43ec-817b-a6eeeb967f9a tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1891296948" status: 202 len: 0 microversion: 2.1 time: 0.030581 Aug 23 10:37:10.826961 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 53/111] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:37:10 2022] DELETE /compute/v2.1/flavors/1891296948 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:10.841258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3ea6936-3efd-4f53-bfb5-c397d2858e4d tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:10.883117 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3ea6936-3efd-4f53-bfb5-c397d2858e4d tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054943 Aug 23 10:37:10.883713 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 54/112] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:10.905704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3537a483-fc61-4ca4-979a-20343421d7a4 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-729986545", "id": 905934073, "os-flavor-access:is_public": "False"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:10.969734 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3537a483-fc61-4ca4-979a-20343421d7a4 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.068188 Aug 23 10:37:10.973828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 55/113] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:10 2022] POST /compute/v2.1/flavors => generated 435 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:11.347658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca88dd01-37cf-4213-945a-2ff8a28d3531 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:11.370615 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca88dd01-37cf-4213-945a-2ff8a28d3531 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.828069 Aug 23 10:37:11.371398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 59/114] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:37:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:11.407007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa957b6b-3af7-4ea7-b589-6927eadf6c60 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:11.410722 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:11.410722 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:11.412661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa957b6b-3af7-4ea7-b589-6927eadf6c60 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '6f8f2ecc1f62449b98f94330ea731ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1b123de1164fd1b34c08ae69a65471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa957b6b-3af7-4ea7-b589-6927eadf6c60 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Request method failure captured: Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/flavors/905934073/action HTTP/1.1 Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 67 Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3NYlaao5MgD1j8nlIvc2fTW3hV6qhcYPwZZVTbFmPfkUHNwFNK3dp_eQWKgh3OBOcpxz7xGUVXP3cRgRuOpNdfSgoDEbjC3r0kdSFg3-CNCSoHCqTupWP1L7_dy7WCGe_6liHK4r_TcXF7HrFhLfls0X5isiEsxJG5CI2m_bQLbok Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ea1b123de1164fd1b34c08ae69a65471 Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-379264457 Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:11.415189 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea1b123de1164fd1b34c08ae69a65471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea1b123de1164fd1b34c08ae69a65471", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea1b123de1164fd1b34c08ae69a65471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea1b123de1164fd1b34c08ae69a65471"}]}] Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-379264457 Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ea1b123de1164fd1b34c08ae69a65471 Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-379264457 Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsAccessNegativeTestJSON-379264457-project Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6f8f2ecc1f62449b98f94330ea731ad8 Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-379264457-project Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: {"addTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} Aug 23 10:37:11.416958 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '905934073', 'body': {'addTenantAccess': {'tenant': 'ea1b123de1164fd1b34c08ae69a65471'}}} Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:11.417905 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 23 10:37:11.419276 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:11.421652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa957b6b-3af7-4ea7-b589-6927eadf6c60 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:11.422761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa957b6b-3af7-4ea7-b589-6927eadf6c60 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] 10.222.0.78 "POST /compute/v2.1/flavors/905934073/action" status: 403 len: 130 microversion: 2.1 time: 0.438794 Aug 23 10:37:11.423767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 56/115] 10.222.0.78 () {60 vars in 1197 bytes} [Tue Aug 23 10:37:10 2022] POST /compute/v2.1/flavors/905934073/action => generated 130 bytes in 443 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:37:11.437167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64a1f462-0a7a-4a63-8b44-c5354f607573 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:11.466759 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64a1f462-0a7a-4a63-8b44-c5354f607573 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/905934073" status: 202 len: 0 microversion: 2.1 time: 0.036151 Aug 23 10:37:11.468114 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 57/116] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:37:11 2022] DELETE /compute/v2.1/flavors/905934073 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:37:11.478676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b35a5e5-3206-4ed6-aaab-a644482fd481 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:11.510209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b35a5e5-3206-4ed6-aaab-a644482fd481 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037355 Aug 23 10:37:11.513610 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 58/117] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:11.537911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52a263b8-5297-4798-bee5-c77b991317d7 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-75237125", "id": 1697601372, "os-flavor-access:is_public": "False"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:11.575612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52a263b8-5297-4798-bee5-c77b991317d7 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.045623 Aug 23 10:37:11.579222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 59/118] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:11 2022] POST /compute/v2.1/flavors => generated 437 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:11.593871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3beccfb4-cdb3-4f4d-8b43-c71fb5c8a934 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:11.617369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26561a60-882a-405f-85ad-cb5a65892981 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-285179205", "id": 672356926, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:11.629566 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:11.629566 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:11.660491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26561a60-882a-405f-85ad-cb5a65892981 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.275573 Aug 23 10:37:11.661127 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 60/119] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:11 2022] POST /compute/v2.1/flavors => generated 421 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:11.672480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1091e499-b35e-4bd1-871f-c5df1b0e80c8 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:11.705210 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1091e499-b35e-4bd1-871f-c5df1b0e80c8 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.036351 Aug 23 10:37:11.706837 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 61/120] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Aug 23 10:37:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:37:11.719071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:11.719845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:11.734780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:11.735268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:11.735828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:11.736411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:11.741714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:11.742246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:11.942263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:11.953615 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6a37788-1e5f-4d1b-9365-005d4b58bc38 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.245038 Aug 23 10:37:11.954337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 62/121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:11 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:11.960781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe0a523a-61b2-4bec-a66d-50d33a390210 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-698678470", "id": 131333572, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:11.967690 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:11.967690 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:12.008021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe0a523a-61b2-4bec-a66d-50d33a390210 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.048475 Aug 23 10:37:12.009169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 63/122] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:11 2022] POST /compute/v2.1/flavors => generated 421 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:12.025205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28b60da1-0a77-48cd-816b-a3edcc601bb7 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:12.038567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28b60da1-0a77-48cd-816b-a3edcc601bb7 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019654 Aug 23 10:37:12.039313 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 64/123] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Aug 23 10:37:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:37:12.053448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa4adb72-d183-45ca-a71e-4cbd766188bf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Action: 'create', calling method: .version_select at 0x7fdc9d73b0d0>, body: {"keypair": {"name": "tempest-keypair-1949485104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9jQRC/UTSTIcMsHWzqm0w7zj1vlZogCnnYtmTFdOrzwmkmfM8SrIuutXjG3F+EnqFvkT53djs6N7yqViUXjzFSPm0sr9VKTE/MVzw5fB0fOukUp6PRDfgmqkMXYUoDzA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:12.118316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa4adb72-d183-45ca-a71e-4cbd766188bf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Getting quotas for project fb96481a39404b0f91e81ea0183698b9. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:12.122796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa4adb72-d183-45ca-a71e-4cbd766188bf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Getting quotas for user da8a7b6ac53d4b9cbac1d2ab7f48fc4c and project fb96481a39404b0f91e81ea0183698b9. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:12.123514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3beccfb4-cdb3-4f4d-8b43-c71fb5c8a934 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1697601372/action" status: 200 len: 97 microversion: 2.1 time: 0.534426 Aug 23 10:37:12.131382 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 60/124] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Aug 23 10:37:11 2022] POST /compute/v2.1/flavors/1697601372/action => generated 97 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:37:12.139089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d84289d-7488-44ae-a7c8-4041e45fbc08 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:12.145465 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:12.145465 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:12.147420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d84289d-7488-44ae-a7c8-4041e45fbc08 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '6f8f2ecc1f62449b98f94330ea731ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea1b123de1164fd1b34c08ae69a65471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d84289d-7488-44ae-a7c8-4041e45fbc08 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Request method failure captured: Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/flavors/1697601372/action HTTP/1.1 Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 70 Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3NYlaao5MgD1j8nlIvc2fTW3hV6qhcYPwZZVTbFmPfkUHNwFNK3dp_eQWKgh3OBOcpxz7xGUVXP3cRgRuOpNdfSgoDEbjC3r0kdSFg3-CNCSoHCqTupWP1L7_dy7WCGe_6liHK4r_TcXF7HrFhLfls0X5isiEsxJG5CI2m_bQLbok Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ea1b123de1164fd1b34c08ae69a65471 Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-379264457 Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:12.153193 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea1b123de1164fd1b34c08ae69a65471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea1b123de1164fd1b34c08ae69a65471", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea1b123de1164fd1b34c08ae69a65471"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea1b123de1164fd1b34c08ae69a65471"}]}] Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-379264457 Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ea1b123de1164fd1b34c08ae69a65471 Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-379264457 Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsAccessNegativeTestJSON-379264457-project Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6f8f2ecc1f62449b98f94330ea731ad8 Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-379264457-project Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: {"removeTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} Aug 23 10:37:12.154606 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1697601372', 'body': {'removeTenantAccess': {'tenant': 'ea1b123de1164fd1b34c08ae69a65471'}}} Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can( Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:12.155400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 23 10:37:12.156698 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:12.160586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d84289d-7488-44ae-a7c8-4041e45fbc08 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:12.163677 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d84289d-7488-44ae-a7c8-4041e45fbc08 tempest-FlavorsAccessNegativeTestJSON-379264457 tempest-FlavorsAccessNegativeTestJSON-379264457-project] 10.222.0.78 "POST /compute/v2.1/flavors/1697601372/action" status: 403 len: 133 microversion: 2.1 time: 0.030784 Aug 23 10:37:12.170005 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 61/125] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Aug 23 10:37:12 2022] POST /compute/v2.1/flavors/1697601372/action => generated 133 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:12.176937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa4adb72-d183-45ca-a71e-4cbd766188bf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128410 Aug 23 10:37:12.177504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 65/126] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:37:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:12.187201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba76dc7b-a6e6-4ac3-b3fd-c20f490ab696 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ea1b123de1164fd1b34c08ae69a65471"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:12.980088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:12.980908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:12.988916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:12.993897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:12.994865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:13.001226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:13.001226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:13.006198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:13.307945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba76dc7b-a6e6-4ac3-b3fd-c20f490ab696 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1697601372/action" status: 200 len: 21 microversion: 2.1 time: 1.136708 Aug 23 10:37:13.317025 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 62/127] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Aug 23 10:37:12 2022] POST /compute/v2.1/flavors/1697601372/action => generated 21 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:37:13.322576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-991a8214-8361-4f06-9493-8142700163db tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:13.381323 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-991a8214-8361-4f06-9493-8142700163db tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1697601372" status: 202 len: 0 microversion: 2.1 time: 0.062107 Aug 23 10:37:13.382020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 63/128] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:37:13 2022] DELETE /compute/v2.1/flavors/1697601372 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:13.391673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a592106-1bac-4147-bdd3-e74ba1954f9c tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:13.399228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:13.413211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a770d49a-d816-4c2c-a786-45fb0c3ba59e tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.442303 Aug 23 10:37:13.417835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 66/129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:12 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:13.436935 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a592106-1bac-4147-bdd3-e74ba1954f9c tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.049459 Aug 23 10:37:13.437983 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 64/130] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:13 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:13.460058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d9483a5-5e5b-4b01-beea-5680766413ff tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-119715020", "id": 2101360293, "os-flavor-access:is_public": "False"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:13.465006 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:13.465006 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:13.507980 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d9483a5-5e5b-4b01-beea-5680766413ff tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.052560 Aug 23 10:37:13.519254 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 67/131] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:13 2022] POST /compute/v2.1/flavors => generated 438 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:13.522583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c64729d5-5232-4ef1-ab26-011bda41f0c8 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b183ea6703649ae97eebd79637f783a"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:13.939298 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c64729d5-5232-4ef1-ab26-011bda41f0c8 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] HTTP exception thrown: Flavor access not found for 27 / 2b183ea6703649ae97eebd79637f783a combination. Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c64729d5-5232-4ef1-ab26-011bda41f0c8 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Request method failure captured: Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/flavors/2101360293/action HTTP/1.1 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 70 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3SO4F3WlfEvG_e2wuDiNEedtR2zZm8D3udPEfdodx06F0_22lTLMeOE-FmlZAz8XVuzEnQLCxogQHrekCO-gyAVnoGgEzxoGag18ZQVBAYjQtfKs5II_Cb6k7znBr48ae5ffAHuoEI9lzqcguI33_wbVe5TQLabkvFLuNreRLNr48 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: af9535aa46ad4b3b9410cc6c9b59c1a6 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:13.941486 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af9535aa46ad4b3b9410cc6c9b59c1a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af9535aa46ad4b3b9410cc6c9b59c1a6"}]}] Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: af9535aa46ad4b3b9410cc6c9b59c1a6 Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518 Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4048f80ca68a49dc8dd131f4aa01d7ab Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: {"removeTenantAccess": {"tenant": "2b183ea6703649ae97eebd79637f783a"}} Aug 23 10:37:13.942898 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: exception: Flavor access not found for 27 / 2b183ea6703649ae97eebd79637f783a combination. Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2101360293', 'body': {'removeTenantAccess': {'tenant': '2b183ea6703649ae97eebd79637f783a'}}} Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 23 10:37:13.943775 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 27 / 2b183ea6703649ae97eebd79637f783a combination. Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 27 / 2b183ea6703649ae97eebd79637f783a combination. Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:13.945069 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:13.946444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:13.946444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:13.946444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:13.946444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:13.946444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 27 / 2b183ea6703649ae97eebd79637f783a combination. Aug 23 10:37:13.946444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:13.947427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c64729d5-5232-4ef1-ab26-011bda41f0c8 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Returning 404 to user: Flavor access not found for 27 / 2b183ea6703649ae97eebd79637f783a combination. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:13.948404 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c64729d5-5232-4ef1-ab26-011bda41f0c8 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/2101360293/action" status: 404 len: 124 microversion: 2.1 time: 0.430947 Aug 23 10:37:13.949064 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 65/132] 10.222.0.78 () {60 vars in 1200 bytes} [Tue Aug 23 10:37:13 2022] POST /compute/v2.1/flavors/2101360293/action => generated 124 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:37:13.965790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71f1fd42-b8ea-4a2d-b97e-beb06b3edcc2 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:13.966663 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:13.966663 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:14.026475 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71f1fd42-b8ea-4a2d-b97e-beb06b3edcc2 tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2101360293" status: 202 len: 0 microversion: 2.1 time: 0.072533 Aug 23 10:37:14.030285 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 68/133] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:37:13 2022] DELETE /compute/v2.1/flavors/2101360293 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:14.035566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90ac80f2-e50e-4fdd-9e3e-5194758d0c2a tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:14.076769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90ac80f2-e50e-4fdd-9e3e-5194758d0c2a tempest-FlavorsAccessNegativeTestJSON-1913620518 tempest-FlavorsAccessNegativeTestJSON-1913620518-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.045202 Aug 23 10:37:14.083148 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 66/134] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:14 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:14.438383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:14.439089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:14.449493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:14.450404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:14.451554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:14.452965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:14.454450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:14.454883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:14.663883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:14.673167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4fd4403-a79d-4eb7-ba7b-5ff93cf8eebd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.239356 Aug 23 10:37:14.677069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 69/135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:14 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:14.760635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-316345499", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "131333572", "adminPass": "***", "networks": [{"uuid": "dc514dca-a5e8-47bf-9347-21ed7903c689"}], "security_groups": [{"name": "tempest-securitygroup--1699699424"}], "key_name": "tempest-keypair-1949485104", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:14.942760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] validate_networks() for [('dc514dca-a5e8-47bf-9347-21ed7903c689', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:37:15.601024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc5b3b7d-c92d-456b-b77e-e8f563c8655f tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '.version_select at 0x7fdc9d91b3a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:15.799530 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc5b3b7d-c92d-456b-b77e-e8f563c8655f tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1" status: 200 len: 371 microversion: 2.1 time: 0.430336 Aug 23 10:37:15.801118 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 70/136] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 10:37:15 2022] GET /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1 => generated 371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:15.837915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:15.841614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:15.866398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:15.867796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:15.868851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:15.871556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:15.871556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:15.872181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:15.902506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:16.075142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:16.088430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cd18069-e3ba-4797-9513-dc33688aedae tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.277879 Aug 23 10:37:16.090304 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 71/137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:15 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:16.100540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d73b5e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:16.270570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:37:16.271076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:37:16.271484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:37:16.272072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:37:16.272492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:37:16.286329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:16.286827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:16.287397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:16.288151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:16.288615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:16.289083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:16.301880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=55 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:16.318722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Getting quotas for project fb96481a39404b0f91e81ea0183698b9. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:16.325390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Getting quotas for user da8a7b6ac53d4b9cbac1d2ab7f48fc4c and project fb96481a39404b0f91e81ea0183698b9. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:16.342524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:37:16.353517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:37:16.418987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b588bde-1638-4b88-a1d6-08f3bacd629b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.663449 Aug 23 10:37:16.419952 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 67/138] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:37:16.433860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ca3502c-b028-439a-ae54-aed0bcca7a89 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:16.435592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ca3502c-b028-439a-ae54-aed0bcca7a89 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:16.537946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ca3502c-b028-439a-ae54-aed0bcca7a89 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:16.551364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ca3502c-b028-439a-ae54-aed0bcca7a89 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1262 microversion: 2.1 time: 0.122982 Aug 23 10:37:16.553035 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 68/139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:16 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1262 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:16.667192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:16.668857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:16.670073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:16.671001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:16.671533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:16.672341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:16.683554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=11 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:16.764481 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5b01188-2560-45fd-b50e-616d75e828cc tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1" status: 200 len: 328 microversion: 2.1 time: 0.672688 Aug 23 10:37:16.766539 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 72/140] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:37:16 2022] PUT /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1 => generated 328 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:16.779042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e2eac13-4612-4add-b71b-f0581c586c3c tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:16.806984 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e2eac13-4612-4add-b71b-f0581c586c3c tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1" status: 202 len: 0 microversion: 2.1 time: 0.032279 Aug 23 10:37:16.807987 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 69/141] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 10:37:16 2022] DELETE /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:16.818008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0db4437f-086c-420d-a120-ab26583e3b7c tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '.version_select at 0x7fdc9d7cfe50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:17.115388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:17.116020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:17.125548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:17.127130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:17.128831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:17.131017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:17.133395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:17.134178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:17.285692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0db4437f-086c-420d-a120-ab26583e3b7c tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1" status: 200 len: 371 microversion: 2.1 time: 0.473083 Aug 23 10:37:17.287196 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 73/142] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 10:37:16 2022] GET /compute/v2.1/os-quota-sets/5aa0add730344675b9e855bab432b1a1 => generated 371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:17.311108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:17.324183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-821043cf-7e5e-4452-ac36-92eb70fa4675 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.215320 Aug 23 10:37:17.326189 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 70/143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:17 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:17.580351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:17.581074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:17.598166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:17.598698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:17.599121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:17.599839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:17.605004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:17.605842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:17.663094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7e451ec8-3da0-4084-b1f7-7cb2bb0c0d2e tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '.version_select at 0x7fdc9da08670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:17.690476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:17.702808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bce5ba06-b266-4d8b-a9fa-f95229f9de6d tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1266 microversion: 2.1 time: 0.127829 Aug 23 10:37:17.704247 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 74/144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:17 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:18.189911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Calling method '.version_select at 0x7fdc9d9f3550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:18.191378 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:18.191378 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:18.192812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.193635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.194275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.210919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.211682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.212621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.215153 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7e451ec8-3da0-4084-b1f7-7cb2bb0c0d2e tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741/defaults" status: 200 len: 371 microversion: 2.1 time: 0.556790 Aug 23 10:37:18.215887 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 71/145] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:37:17 2022] GET /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741/defaults => generated 371 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:18.242675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.243226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.243592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.251182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20aa5337-a4b9-4e15-9f41-5daec5c5267c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.302061 Aug 23 10:37:18.258067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 75/146] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:18.262635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Calling method '.version_select at 0x7fdc9d6eb8b0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:18.263874 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:18.263874 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:18.265034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.265532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.265967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.289134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.289814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.290578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.293690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1048799129", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:18.342093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.342844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.343673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.353151 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee11f2a0-5b6d-4898-93a3-e730c41746af tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-847009-13/servers" status: 200 len: 197 microversion: 2.1 time: 0.093881 Aug 23 10:37:18.353658 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 76/147] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Aug 23 10:37:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-847009-13/servers => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:18.360147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:37:18.366364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:18.367191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:18.375423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.376339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.377205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.379274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.380787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.380787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.678766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:18.687118 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19ad8fcc-bbd1-4bc1-885b-d1f415506a57 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.325072 Aug 23 10:37:18.687696 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 77/148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:18 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:18.700805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Calling method '.version_select at 0x7fdc9d6faa60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:18.702516 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:18.702516 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:18.706421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.709115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.709832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.787411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.788180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.788917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.829403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.831282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.832351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.841245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4afab6e7-3b8e-43bc-9977-628446f0289c tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.144049 Aug 23 10:37:18.842009 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 78/149] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:37:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:18.845707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:37:18.846182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:37:18.846666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:37:18.847081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:37:18.847631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:37:18.848102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d729700>, body: {"quota_set": {"ram": "5120"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:18.870957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.871527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.871900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.872639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:18.873209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:18.873645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:18.899051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:18.904220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for user 9574ff57c9474f7fb5ec4567bc06d531 and project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:18.910593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=79,nova_api:DELETE=13 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:18.934217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:37:18.947714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:37:19.075350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2345d91c-615b-4a8d-af68-e7ba008c662b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858172 Aug 23 10:37:19.075998 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 72/150] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:37:19.102138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:19.105087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:19.127525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.128284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.130198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.130700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.132340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.133305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.133786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.134221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.134893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.140658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.141179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.151762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.298923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:19.302702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:19.310474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ceb792de-0e9b-4ea5-887b-099d00cbdcaf tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1320 microversion: 2.1 time: 0.218600 Aug 23 10:37:19.311459 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 73/151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:19 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:19.319291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Calling method '.version_select at 0x7fdc9d5b6f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:19.322267 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:19.322267 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:19.324853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.325567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.326283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.354104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.354855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.355500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.364659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8dcda194-714f-4c59-a7e3-2767478e2697 tempest-HypervisorAdminUnderV252Test-757343312 tempest-HypervisorAdminUnderV252Test-757343312-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-847009-13/search" status: 200 len: 105 microversion: 2.1 time: 0.050818 Aug 23 10:37:19.365673 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 74/152] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Aug 23 10:37:19 2022] GET /compute/v2.1/os-hypervisors/n-h1-847009-13/search => generated 105 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:19.386341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc1419d8-b8c9-415a-a8ee-6f5f626b9f5d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:19.391690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc1419d8-b8c9-415a-a8ee-6f5f626b9f5d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:19.444578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3ea5242-8748-4d2f-8e8b-1b670b3d9796 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407" status: 200 len: 328 microversion: 2.1 time: 0.601197 Aug 23 10:37:19.452479 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 79/153] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:37:18 2022] PUT /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407 => generated 328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:19.460426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '.version_select at 0x7fdc9d69eee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:19.495116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc1419d8-b8c9-415a-a8ee-6f5f626b9f5d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:19.508882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc1419d8-b8c9-415a-a8ee-6f5f626b9f5d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1213 microversion: 2.1 time: 0.141833 Aug 23 10:37:19.509677 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 75/154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:19 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:19.726620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:19.730373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:19.741427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.742320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.743030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.744074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.744546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.745047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.908236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.909568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.909727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.911020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:19.911670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:19.912246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:19.956077 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71e5f340-e91c-4ac5-a1d3-2e7f1c0a1678 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407/detail" status: 200 len: 916 microversion: 2.1 time: 0.501258 Aug 23 10:37:19.957087 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 80/155] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:37:19 2022] GET /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407/detail => generated 916 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:20.049755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:20.059341 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44a58fb8-ca70-4309-b4a8-8e20b008f4a1 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.346608 Aug 23 10:37:20.060036 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 76/156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:19 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:20.342953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:20.343880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:20.350546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.351263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.351920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.352831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.353494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.354074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.449975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d5b68b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:20.461279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:20.470050 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69cabcad-6234-46f8-94b8-7b93a956630e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1320 microversion: 2.1 time: 0.132116 Aug 23 10:37:20.471121 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 81/157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:20 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1320 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:20.540297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:20.541500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:20.554079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.554884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.555559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.557292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.558204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.558819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.657788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:20.666440 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16784d4c-c5d9-4fb0-91f1-9fb2497bcfdc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1287 microversion: 2.1 time: 0.138522 Aug 23 10:37:20.667191 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 82/158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:20 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:20.722849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.723339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.723771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.727373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.727373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.727373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.797525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.798126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.798569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.799589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:20.800395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:20.800900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:20.895089 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407?user_id=a72f4bfee30641b8a7757ccc1c5cbbcf" status: 200 len: 328 microversion: 2.1 time: 0.449566 Aug 23 10:37:20.896175 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 77/159] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:37:20 2022] PUT /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407?user_id=a72f4bfee30641b8a7757ccc1c5cbbcf => generated 328 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:20.908496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cfc31de-6640-4afe-87fe-89e23a058e27 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '.version_select at 0x7fdc9d7bfc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:20.953366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:20.954872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-471f8dfb-5108-466a-8151-f78bc4b6aff3 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003359 Aug 23 10:37:20.978656 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 78/160] 10.222.0.78 () {56 vars in 886 bytes} [Tue Aug 23 10:37:20 2022] GET /compute/ => generated 377 bytes in 29 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 10:37:21.081297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:21.082086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:21.091100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:21.092309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:21.093371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:21.094843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:21.095349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:21.095826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:21.380660 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cfc31de-6640-4afe-87fe-89e23a058e27 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407?user_id=a72f4bfee30641b8a7757ccc1c5cbbcf" status: 200 len: 370 microversion: 2.1 time: 0.476666 Aug 23 10:37:21.381307 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 83/161] 10.222.0.78 () {58 vars in 1323 bytes} [Tue Aug 23 10:37:20 2022] GET /compute/v2.1/os-quota-sets/32345714e19a4e93af935690f601c407?user_id=a72f4bfee30641b8a7757ccc1c5cbbcf => generated 370 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:21.494944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:21.495834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:21.503846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:21.504975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:21.506019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:21.506969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:21.507762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:21.508342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:21.556103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:21.563691 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e4f7ccb-7c6a-4f5c-a300-827f370a2fa9 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.486617 Aug 23 10:37:21.564319 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 79/162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:21 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:21.616457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:21.626659 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-795aa135-da99-49fe-a949-46e87dbaf1aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1320 microversion: 2.1 time: 0.138467 Aug 23 10:37:21.643477 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 84/163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:21 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:21.710628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:21.711976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:21.725797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:21.726521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:21.727107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:21.727969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:21.728694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:21.734161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:21.932426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:21.947300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b105d42-fd34-45f3-803c-efa0f02f0896 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1293 microversion: 2.1 time: 0.246212 Aug 23 10:37:21.957674 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 80/164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:21 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1293 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:22.213180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f1eedcde-48d2-4cdd-98be-947a4346cbb4 req-b00a79be-ac89-46ae-86e0-68bdc31f3de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c36d63-b983-4569-ab0f-f01d56bd7aa2", "name": "network-vif-plugged", "status": "completed", "tag": "bce8cf8e-7517-4e90-9b74-7607b14dde39"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:22.242600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f1eedcde-48d2-4cdd-98be-947a4346cbb4 req-b00a79be-ac89-46ae-86e0-68bdc31f3de5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:22.243262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f1eedcde-48d2-4cdd-98be-947a4346cbb4 req-b00a79be-ac89-46ae-86e0-68bdc31f3de5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:22.244032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f1eedcde-48d2-4cdd-98be-947a4346cbb4 req-b00a79be-ac89-46ae-86e0-68bdc31f3de5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:22.273081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f1eedcde-48d2-4cdd-98be-947a4346cbb4 req-b00a79be-ac89-46ae-86e0-68bdc31f3de5 service nova] Creating event network-vif-plugged:bce8cf8e-7517-4e90-9b74-7607b14dde39 for instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 on n-h1-847009-13 Aug 23 10:37:22.281460 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f1eedcde-48d2-4cdd-98be-947a4346cbb4 req-b00a79be-ac89-46ae-86e0-68bdc31f3de5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.515360 Aug 23 10:37:22.285427 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 85/165] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:22.545878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-676aa672-96f9-4fff-981c-e06e163f5669 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Calling method '.version_select at 0x7fdc9d8f5e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:22.591490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:22.592387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:22.615124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:22.617621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:22.618206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:22.619375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:22.622136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:22.625011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:22.861405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:22.872210 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc581ed8-f363-466f-90fb-88a493606796 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.288723 Aug 23 10:37:22.872820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 86/166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:22 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:22.883766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:22.884426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:22.913218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:22.913754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:22.914812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:22.916758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:22.917258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:22.919045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.033155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:23.045592 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70539c32-6ec2-4fc0-901a-09f28f2873e0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1320 microversion: 2.1 time: 0.170685 Aug 23 10:37:23.047039 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 87/167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:22 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:23.052714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:23.053747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:23.060986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.062106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.062720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.063611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.064304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.065610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.141732 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-676aa672-96f9-4fff-981c-e06e163f5669 tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741/defaults" status: 200 len: 371 microversion: 2.1 time: 0.605610 Aug 23 10:37:23.142596 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 81/168] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:37:22 2022] GET /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741/defaults => generated 371 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:23.155602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d584b80>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:23.261412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:23.278175 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92f00e18-307d-469d-bd15-8bc1a9ff9c41 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.229879 Aug 23 10:37:23.278960 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 88/169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:23 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:23.754969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f290be1c-f326-4044-9a96-486fc9880e0a req-0e3422d3-56c0-4649-ba9c-60d8019d5dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e76eb0-da10-435b-ac03-0a014dbd11e5", "tag": "4c1fb94e-059f-43fd-b258-97c51fb0e459"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:23.768949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.769586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.770246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.771567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.772122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.772618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.786136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f290be1c-f326-4044-9a96-486fc9880e0a req-0e3422d3-56c0-4649-ba9c-60d8019d5dba service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.786617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f290be1c-f326-4044-9a96-486fc9880e0a req-0e3422d3-56c0-4649-ba9c-60d8019d5dba service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.787050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f290be1c-f326-4044-9a96-486fc9880e0a req-0e3422d3-56c0-4649-ba9c-60d8019d5dba service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.804110 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f290be1c-f326-4044-9a96-486fc9880e0a req-0e3422d3-56c0-4649-ba9c-60d8019d5dba service nova] Creating event network-changed:4c1fb94e-059f-43fd-b258-97c51fb0e459 for instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 on n-h1-847009-13 Aug 23 10:37:23.812679 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f290be1c-f326-4044-9a96-486fc9880e0a req-0e3422d3-56c0-4649-ba9c-60d8019d5dba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062327 Aug 23 10:37:23.813956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 89/170] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:23.894956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:23.895894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:23.904413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.905260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.906819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:23.906819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:23.906997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:23.907616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.097456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60f34cd5-5fe2-46ec-bdab-3016ac55caff tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741" status: 200 len: 329 microversion: 2.1 time: 0.946542 Aug 23 10:37:24.098304 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 82/171] 10.222.0.78 () {60 vars in 1263 bytes} [Tue Aug 23 10:37:23 2022] PUT /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741 => generated 329 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:24.105453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:24.106087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:24.114681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:24.115536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:24.116330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.117183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:24.117766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:24.118368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.163605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:24.175759 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf53ce48-f806-4b3a-bd6b-07d1a0248254 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.286043 Aug 23 10:37:24.176914 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 90/172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:23 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:24.189090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d69e160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:24.206657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:24.216097 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d09f73ea-8a44-4d6c-b971-a06b7bbf59ef tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1320 microversion: 2.1 time: 0.114248 Aug 23 10:37:24.216680 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 83/173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:24 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1320 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:24.305352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:24.305352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:24.308095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:24.308918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:24.309513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.310372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:24.310981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:24.311745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.498687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:24.499875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:24.500815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.502274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:24.503488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:24.505074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:24.598936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:24.646330 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b679453b-8edf-42aa-acd7-ec45e156c9bb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.350126 Aug 23 10:37:24.650389 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 84/174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:24 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:24.999739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:INSERT=15,nova_api:SELECT=71,nova_api:UPDATE=14 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:25.029113 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de84b228-c09e-4787-a43a-27da67cf2dab tempest-QuotasAdminTestJSON-271292536 tempest-QuotasAdminTestJSON-271292536-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741" status: 200 len: 329 microversion: 2.1 time: 0.850785 Aug 23 10:37:25.036579 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 91/175] 10.222.0.78 () {60 vars in 1263 bytes} [Tue Aug 23 10:37:24 2022] PUT /compute/v2.1/os-quota-sets/88c5bf35f5cc463c84aec9dadbb03741 => generated 329 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:25.198295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:25.198974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:25.211260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:25.213236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:25.214048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:25.216411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:25.216927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:25.217371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:25.239857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:25.241120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:25.254009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:25.254530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:25.254978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:25.257360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:25.258745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:25.261525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:25.640284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:25.650620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1d149936-05b7-4103-8fae-42e76891eba5 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.457308 Aug 23 10:37:25.667405 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 85/176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:25 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:25.672362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:25.673059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:25.684493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:25.685114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:25.685565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:25.686429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:25.686992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:25.687589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:25.734554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:25.754515 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7189a7c1-7da7-434c-bfe8-bc526e3692b0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.519250 Aug 23 10:37:25.763759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 92/177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:25 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:25.955471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:25.986098 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74b71f6d-ba50-44d9-b31a-a34a172e7e61 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.317512 Aug 23 10:37:25.987624 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 86/178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:25 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:26.378702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a86480cb-8595-4a77-aea0-be1541b6bc54 tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] Calling method '.version_select at 0x7fdc9d73bd30>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:26.380423 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:26.380423 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:26.396225 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a86480cb-8595-4a77-aea0-be1541b6bc54 tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.247070 Aug 23 10:37:26.398106 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 93/179] 10.222.0.78 () {60 vars in 1226 bytes} [Tue Aug 23 10:37:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:26.407868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9bf9951-6b6f-43df-9f3d-60dd52f692be tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d5769d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:26.411533 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:26.411533 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:26.452323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=19,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:26.657613 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9bf9951-6b6f-43df-9f3d-60dd52f692be tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.253383 Aug 23 10:37:26.659367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 87/180] 10.222.0.78 () {62 vars in 1247 bytes} [Tue Aug 23 10:37:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:26.670625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dcf8126e-2ade-4d43-a068-049e39283c4f tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] Calling method '.version_select at 0x7fdc9d7cf790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:26.681380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:26.682137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:26.689888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:26.690388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:26.690633 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dcf8126e-2ade-4d43-a068-049e39283c4f tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.024513 Aug 23 10:37:26.690966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:26.691692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:26.692292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:26.692718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:26.697357 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 94/181] 10.222.0.78 () {60 vars in 1226 bytes} [Tue Aug 23 10:37:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:26.703396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-165251e4-c1a7-4a4d-814d-f5c364ab423d tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d7468b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:26.707531 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:26.707531 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:26.803134 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-165251e4-c1a7-4a4d-814d-f5c364ab423d tempest-QuotaClassesAdmin257Test-698244644 tempest-QuotaClassesAdmin257Test-698244644-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.104275 Aug 23 10:37:26.804389 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 95/182] 10.222.0.78 () {62 vars in 1247 bytes} [Tue Aug 23 10:37:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:26.813033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:26.814202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:26.824303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:26.826109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:26.831565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:26.832617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:26.834717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:26.835473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:26.895701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:27.013227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:27.025217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4640028-4146-4981-86eb-4e74fbf8998c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1338 microversion: 2.1 time: 0.348522 Aug 23 10:37:27.027058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 88/183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:26 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1338 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:27.045148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:27.046094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:27.054540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:27.055229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:27.055878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:27.057321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:27.057954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:27.070771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:27.304674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:27.319535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f1b2dc7f-a490-4f55-bd02-1a90116121c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.291269 Aug 23 10:37:27.320479 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 89/184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:27 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:27.338459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:27.349352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1c36207-ce38-4462-a6a7-18c842577a1f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.543712 Aug 23 10:37:27.362538 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 96/185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:26 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:28.046883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:28.048347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:28.058965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.061934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.063764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.067783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.069192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.069864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.344188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:28.344655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:28.352197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.353082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.354085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.355674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.356300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.357365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.478918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:28.498671 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1558cdc4-c9f2-41a8-a575-f74c65691a83 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1488 microversion: 2.1 time: 0.456397 Aug 23 10:37:28.515192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 90/186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:28 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1488 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:28.532809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:28.534902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:28.543991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.545901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.546642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.547803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.548651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.549272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.727060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:28.742083 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-37928141-a91d-4cc3-851d-cadad6346280 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.224605 Aug 23 10:37:28.743563 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 91/187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:28 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:28.912347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210a1dcd-feea-4748-8039-313b88b28f45", "tag": "06045ad4-6b39-4a6f-a33e-e34eed046ca4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:28.926890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.927429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.927972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.956376 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Creating event network-changed:06045ad4-6b39-4a6f-a33e-e34eed046ca4 for instance 210a1dcd-feea-4748-8039-313b88b28f45 on n-h2-847009-13 Aug 23 10:37:28.957181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:37:28.957742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-350ef8b9-5939-4fb0-a799-2d1a9cc94596 req-0f4d3221-cfbf-4c5e-adc6-ddbfb47f8229 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:37:28.965101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.965751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.967041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.967937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:28.968664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:28.969264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:28.981478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:28.987309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=18 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:28.991196 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.compute.rpcapi [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 10:37:28.992284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] Releasing lock "compute-rpcapi-router" {{(pid=128859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:37:28.997339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5ce48de-42ed-4e4d-a41a-6834688a8c3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.657546 Aug 23 10:37:28.998384 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 97/188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:28 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:29.016088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:29.016231 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ad0990a-4334-48cb-8c12-ed002fc70ada None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271050 Aug 23 10:37:29.017205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:29.020328 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 92/189] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:29.024543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:29.025248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:29.025836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:29.026727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:29.027336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:29.027911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:29.686894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9477349b-776b-442a-bd82-2ecd0dfe3a82 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1641 microversion: 2.1 time: 0.683763 Aug 23 10:37:29.695896 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 98/190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:28 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1641 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:29.710989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:29.712407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:29.722402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:29.723531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:29.724166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:29.726440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:29.727592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:29.728821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:29.756936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:29.764974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:29.766281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:29.778989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:29.779602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:29.781821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:29.782815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:29.785024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:29.785682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:29.790696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:37:30.026005 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e563aa4-76ae-48bf-af2a-322c5941f809 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 204 len: 0 microversion: 2.1 time: 0.320547 Aug 23 10:37:30.026828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 93/191] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:37:29 2022] DELETE /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:30.037733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:30.038591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:30.049693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:30.051669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:30.052449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:30.053364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:30.054347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:30.056498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:30.142912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:30.156612 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6db30f75-5fc8-40ef-aed6-311973422835 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.394309 Aug 23 10:37:30.159282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 99/192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:29 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:30.173652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:30.176410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:30.191593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:30.192814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:30.193427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:30.195235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:30.197299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:30.197904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:30.276288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:30.285472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3580f932-9cc5-4a08-8bb9-57d2ce54033b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.253925 Aug 23 10:37:30.288039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 94/193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:30 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:30.708852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:30.719960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53ccbc6a-867f-489d-b2d4-e60479f4d561 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1494 microversion: 2.1 time: 0.554416 Aug 23 10:37:30.720569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 100/194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:30 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1494 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:30.758194 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09af5d5b-9264-43a5-a869-dfa5d33f0ca1 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] 10.222.0.78 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.339456 Aug 23 10:37:30.759581 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 95/195] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Aug 23 10:37:30 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 23 10:37:30.769395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96fb5fc9-6aa1-4177-8746-87f29a6924a9 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Calling method '.version_select at 0x7fdc9d5e63a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:30.834313 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-96fb5fc9-6aa1-4177-8746-87f29a6924a9 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] HTTP exception thrown: Image not found. Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96fb5fc9-6aa1-4177-8746-87f29a6924a9 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Request method failure captured: Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3qRWqQIlDBiCJ-fLpx_YmHXEGsxhMR95gHZQ3opMa78fPdp-0u8DeOxXMAkNJuTvnuvqT6lh4aFt6YLQsxPmwGiK9o1CCkQ_yAB3LKJsQBc6TRN09fShZ1IDsBwPs8D7yWb-JFoQVgj7QLBioBX0KU1alDKNKJJsgK9_5_f4qYVps Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:30.847314 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e0021b457904bee9f01a4a91a36e2ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}] Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9404ea66699d454c8ef9de733ac79a49 Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '-1'} Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:30.848879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.850068 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:30.851305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:37:30.852579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.854947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96fb5fc9-6aa1-4177-8746-87f29a6924a9 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:30.856020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96fb5fc9-6aa1-4177-8746-87f29a6924a9 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] 10.222.0.78 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.091609 Aug 23 10:37:30.857204 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 101/196] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Aug 23 10:37:30 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:30.869071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea450be0-ed6f-4359-8db4-da1ada1323ee tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Calling method '.version_select at 0x7fdc9d554af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:30.903657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ea450be0-ed6f-4359-8db4-da1ada1323ee tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] HTTP exception thrown: Image not found. Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea450be0-ed6f-4359-8db4-da1ada1323ee tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Request method failure captured: Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/a4a7b161-92a8-4173-ba74-88bd84ed737j HTTP/1.1 Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3qRWqQIlDBiCJ-fLpx_YmHXEGsxhMR95gHZQ3opMa78fPdp-0u8DeOxXMAkNJuTvnuvqT6lh4aFt6YLQsxPmwGiK9o1CCkQ_yAB3LKJsQBc6TRN09fShZ1IDsBwPs8D7yWb-JFoQVgj7QLBioBX0KU1alDKNKJJsgK9_5_f4qYVps Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:30.908027 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e0021b457904bee9f01a4a91a36e2ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}] Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9404ea66699d454c8ef9de733ac79a49 Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'a4a7b161-92a8-4173-ba74-88bd84ed737j'} Aug 23 10:37:30.910021 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a4a7b161-92a8-4173-ba74-88bd84ed737j to delete Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.910860 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4a7b161-92a8-4173-ba74-88bd84ed737j could not be found. Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:30.912708 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:37:30.914140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.916425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea450be0-ed6f-4359-8db4-da1ada1323ee tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:30.917553 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea450be0-ed6f-4359-8db4-da1ada1323ee tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] 10.222.0.78 "DELETE /compute/v2.1/images/a4a7b161-92a8-4173-ba74-88bd84ed737j" status: 404 len: 62 microversion: 2.1 time: 0.052677 Aug 23 10:37:30.918984 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 96/197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:30 2022] DELETE /compute/v2.1/images/a4a7b161-92a8-4173-ba74-88bd84ed737j => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:30.930874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55ccfeee-e836-43db-b945-2d0bf79a2066 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Calling method '.version_select at 0x7fdc9d7cf790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:30.953171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-55ccfeee-e836-43db-b945-2d0bf79a2066 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] HTTP exception thrown: Image not found. Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55ccfeee-e836-43db-b945-2d0bf79a2066 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Request method failure captured: Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/images/7dc314a4-4262-42d9-8d2c-e30ea8d884a71 HTTP/1.1 Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3qRWqQIlDBiCJ-fLpx_YmHXEGsxhMR95gHZQ3opMa78fPdp-0u8DeOxXMAkNJuTvnuvqT6lh4aFt6YLQsxPmwGiK9o1CCkQ_yAB3LKJsQBc6TRN09fShZ1IDsBwPs8D7yWb-JFoQVgj7QLBioBX0KU1alDKNKJJsgK9_5_f4qYVps Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:30.956073 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e0021b457904bee9f01a4a91a36e2ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}] Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9404ea66699d454c8ef9de733ac79a49 Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7dc314a4-4262-42d9-8d2c-e30ea8d884a71'} Aug 23 10:37:30.957616 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7dc314a4-4262-42d9-8d2c-e30ea8d884a71 to delete Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.958461 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7dc314a4-4262-42d9-8d2c-e30ea8d884a71 could not be found. Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:30.965107 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55ccfeee-e836-43db-b945-2d0bf79a2066 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:30.966310 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55ccfeee-e836-43db-b945-2d0bf79a2066 tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] 10.222.0.78 "DELETE /compute/v2.1/images/7dc314a4-4262-42d9-8d2c-e30ea8d884a71" status: 404 len: 62 microversion: 2.1 time: 0.033688 Aug 23 10:37:30.967387 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 102/198] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:37:30 2022] DELETE /compute/v2.1/images/7dc314a4-4262-42d9-8d2c-e30ea8d884a71 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:30.971427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7359805e-99de-4ac4-8d0e-75376e018a4d tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Calling method '.version_select at 0x7fdc9d4da040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:31.001626 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7359805e-99de-4ac4-8d0e-75376e018a4d tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] HTTP exception thrown: Image not found. Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7359805e-99de-4ac4-8d0e-75376e018a4d tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Request method failure captured: Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/tempest-invalid-1016009357 HTTP/1.1 Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3qRWqQIlDBiCJ-fLpx_YmHXEGsxhMR95gHZQ3opMa78fPdp-0u8DeOxXMAkNJuTvnuvqT6lh4aFt6YLQsxPmwGiK9o1CCkQ_yAB3LKJsQBc6TRN09fShZ1IDsBwPs8D7yWb-JFoQVgj7QLBioBX0KU1alDKNKJJsgK9_5_f4qYVps Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:31.004295 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e0021b457904bee9f01a4a91a36e2ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}] Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9404ea66699d454c8ef9de733ac79a49 Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'tempest-invalid-1016009357'} Aug 23 10:37:31.005764 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1016009357 to delete Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:31.006673 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1016009357 could not be found. Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:31.008014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7359805e-99de-4ac4-8d0e-75376e018a4d tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:31.009425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7359805e-99de-4ac4-8d0e-75376e018a4d tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] 10.222.0.78 "DELETE /compute/v2.1/images/tempest-invalid-1016009357" status: 404 len: 62 microversion: 2.1 time: 0.040510 Aug 23 10:37:31.010320 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 97/199] 10.222.0.78 () {58 vars in 1206 bytes} [Tue Aug 23 10:37:30 2022] DELETE /compute/v2.1/images/tempest-invalid-1016009357 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:37:31.017073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f485199a-85a2-49c7-a7df-3eadb33e4e1b tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Calling method '.version_select at 0x7fdc9d686550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:31.049045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f485199a-85a2-49c7-a7df-3eadb33e4e1b tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] HTTP exception thrown: Image not found. Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f485199a-85a2-49c7-a7df-3eadb33e4e1b tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Request method failure captured: Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/images/ac03dcff-9972-4193-9ad6-28f6c34fab0d HTTP/1.1 Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3qRWqQIlDBiCJ-fLpx_YmHXEGsxhMR95gHZQ3opMa78fPdp-0u8DeOxXMAkNJuTvnuvqT6lh4aFt6YLQsxPmwGiK9o1CCkQ_yAB3LKJsQBc6TRN09fShZ1IDsBwPs8D7yWb-JFoQVgj7QLBioBX0KU1alDKNKJJsgK9_5_f4qYVps Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:31.051565 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7e0021b457904bee9f01a4a91a36e2ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7e0021b457904bee9f01a4a91a36e2ee"}]}] Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 7e0021b457904bee9f01a4a91a36e2ee Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987 Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9404ea66699d454c8ef9de733ac79a49 Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1829576987-project Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ac03dcff-9972-4193-9ad6-28f6c34fab0d'} Aug 23 10:37:31.053365 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ac03dcff-9972-4193-9ad6-28f6c34fab0d to delete Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:31.054316 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ac03dcff-9972-4193-9ad6-28f6c34fab0d could not be found. Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:31.055524 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f485199a-85a2-49c7-a7df-3eadb33e4e1b tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:31.056732 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f485199a-85a2-49c7-a7df-3eadb33e4e1b tempest-ImagesDeleteNegativeTestJSON-1829576987 tempest-ImagesDeleteNegativeTestJSON-1829576987-project] 10.222.0.78 "DELETE /compute/v2.1/images/ac03dcff-9972-4193-9ad6-28f6c34fab0d" status: 404 len: 62 microversion: 2.1 time: 0.039991 Aug 23 10:37:31.058327 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 103/200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:31 2022] DELETE /compute/v2.1/images/ac03dcff-9972-4193-9ad6-28f6c34fab0d => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:31.182459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:31.183097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:31.192690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:31.193217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:31.193659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:31.194375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:31.194832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:31.195264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:31.310991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:31.311939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:31.318811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:31.319552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:31.320208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:31.321103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:31.325055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:31.325656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:31.453231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:31.468673 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c68da54-e027-4b53-a1af-0c485f9653d6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.290466 Aug 23 10:37:31.470071 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 98/201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:31 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:31.704040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64409aaa-5204-4364-ac1a-9941a24c7088 tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] Calling method '.version_select at 0x7fdc9d554af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:31.704961 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:31.704961 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:31.729917 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64409aaa-5204-4364-ac1a-9941a24c7088 tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.203555 Aug 23 10:37:31.730503 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 99/202] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 10:37:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:31.741900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:31.742509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:31.754492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:31.765664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:31.766223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:31.767288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:31.768319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:31.768838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:31.850981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:31.859479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a52e7155-e1ac-4652-8d97-2226145bebaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.553779 Aug 23 10:37:31.860056 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 104/203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:31 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:31.872234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7bbd5aa7-fab9-40f7-9553-a0e27b2ac7c4 tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d9259d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:31.874100 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:31.874100 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:32.211937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:32.223029 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ffd4787c-6c67-42a5-84bc-42a764ba8e4c tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1494 microversion: 2.1 time: 0.485110 Aug 23 10:37:32.228472 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 100/204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:31 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1494 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:32.370649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:32.371953 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7bbd5aa7-fab9-40f7-9553-a0e27b2ac7c4 tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.510875 Aug 23 10:37:32.372886 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 105/205] 10.222.0.78 () {60 vars in 1206 bytes} [Tue Aug 23 10:37:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:32.386189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4ca8072-1b8a-4307-8478-96a16c875229 tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] Calling method '.version_select at 0x7fdc9d4f9ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:32.386970 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:32.386970 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:32.400058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4ca8072-1b8a-4307-8478-96a16c875229 tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017709 Aug 23 10:37:32.414297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67e30a1c-e06e-42de-b7c9-aa425177ac5f tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d686550>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:32.419346 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 101/206] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 10:37:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:32.502551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:32.504101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:32.522348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:32.523354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:32.525352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:32.529953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:32.530720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:32.531318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:32.563732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=27,nova_api:INSERT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:32.673442 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67e30a1c-e06e-42de-b7c9-aa425177ac5f tempest-QuotaClassesAdminTestJSON-75801519 tempest-QuotaClassesAdminTestJSON-75801519-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.264146 Aug 23 10:37:32.684274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 106/207] 10.222.0.78 () {60 vars in 1206 bytes} [Tue Aug 23 10:37:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:32.891917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:32.893510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:32.908188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:32.909410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:32.913815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:32.916646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:32.917534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:32.918708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:33.255435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:33.263774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c30982bc-194d-413d-a030-1e77be984e3e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.772122 Aug 23 10:37:33.274251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 102/208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:32 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:33.279756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7f3a95b8-8af5-4009-ac84-7208883629da req-b2d3531d-1a28-4fae-89ef-71426723ab61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c36d63-b983-4569-ab0f-f01d56bd7aa2", "name": "network-vif-deleted", "tag": "bce8cf8e-7517-4e90-9b74-7607b14dde39"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:33.316813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7f3a95b8-8af5-4009-ac84-7208883629da req-b2d3531d-1a28-4fae-89ef-71426723ab61 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:33.319711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7f3a95b8-8af5-4009-ac84-7208883629da req-b2d3531d-1a28-4fae-89ef-71426723ab61 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:33.321534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7f3a95b8-8af5-4009-ac84-7208883629da req-b2d3531d-1a28-4fae-89ef-71426723ab61 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:33.368619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7f3a95b8-8af5-4009-ac84-7208883629da req-b2d3531d-1a28-4fae-89ef-71426723ab61 service nova] Creating event network-vif-deleted:bce8cf8e-7517-4e90-9b74-7607b14dde39 for instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 on n-h1-847009-13 Aug 23 10:37:33.387047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7f3a95b8-8af5-4009-ac84-7208883629da req-b2d3531d-1a28-4fae-89ef-71426723ab61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110772 Aug 23 10:37:33.388365 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 103/209] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:33.406967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:33.415207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:33.435571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:33.436252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:33.441986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:33.442995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:33.444348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:33.445559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:33.539150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:33.539672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:33.540122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:33.542305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lazy-loading 'fault' on Instance uuid b9c36d63-b983-4569-ab0f-f01d56bd7aa2 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:37:33.599165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:33.610924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd782d75-89e5-4924-86bb-8e5db52236ec tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.733965 Aug 23 10:37:33.613519 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 107/210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:32 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:33.658798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f26f2a3e5d74b13b987c36ff3e4cc1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd71c4c4e9af4306904d19b723b78447', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:33.668125 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ff30ef9-d683-46b6-9425-738588a8bcda tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 200 len: 1328 microversion: 2.1 time: 0.275123 Aug 23 10:37:33.676787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 104/211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:33 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 1328 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:33.882676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-20c06532-a69e-4fa6-9ddb-2781686053cd req-47e7088e-da98-4395-ac8d-682b2b659392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e76eb0-da10-435b-ac03-0a014dbd11e5", "name": "network-vif-plugged", "status": "completed", "tag": "4c1fb94e-059f-43fd-b258-97c51fb0e459"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:33.915517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-20c06532-a69e-4fa6-9ddb-2781686053cd req-47e7088e-da98-4395-ac8d-682b2b659392 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:33.917058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-20c06532-a69e-4fa6-9ddb-2781686053cd req-47e7088e-da98-4395-ac8d-682b2b659392 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:33.917502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-20c06532-a69e-4fa6-9ddb-2781686053cd req-47e7088e-da98-4395-ac8d-682b2b659392 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:33.958120 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-20c06532-a69e-4fa6-9ddb-2781686053cd req-47e7088e-da98-4395-ac8d-682b2b659392 service nova] Creating event network-vif-plugged:4c1fb94e-059f-43fd-b258-97c51fb0e459 for instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 on n-h1-847009-13 Aug 23 10:37:33.970560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-20c06532-a69e-4fa6-9ddb-2781686053cd req-47e7088e-da98-4395-ac8d-682b2b659392 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090056 Aug 23 10:37:33.973123 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 108/212] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:34.306470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:34.307352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:34.322919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.323741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.324825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.327199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.328472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.329213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.524360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:34.579582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:34.589317 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bc3bf2c-cd0b-482b-be77-3503ae2cd35c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.297922 Aug 23 10:37:34.589901 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 105/213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:34 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:34.635473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:34.636521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:34.645167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.645858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.646688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.647557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.648162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.648719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.800523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:34.813957 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c37c08c0-6971-4e5b-9682-878d2a336e17 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1335 microversion: 2.1 time: 0.182937 Aug 23 10:37:34.821187 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 106/214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:34 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1335 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:34.834195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:34.835906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:34.843079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.843563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.843994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.865104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.865613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.866067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.883969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-565bbfae-9a7d-44fa-a701-2b1a92cfa6d2 tempest-ListImagesTestJSON-661211659 tempest-ListImagesTestJSON-661211659-project] Calling method '.version_select at 0x7fdc9d6faee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:34.891242 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] HTTP exception thrown: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Request method failure captured: Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 HTTP/1.1 Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK28kgEzi0zTnyHIPJGWKoa8KTOhOStXUhVHWhWp3Neq78hewcj3qxCyn19cvBxtf65T01PRV-MFoyTxsjjGAt_oA6TItjSmHSU5F1E9QFlKWueUAlmFgyxPmb6KaNMK3JVYicWgWdp9TBi1MRvcU0ZKPPLNHxtzYhNyufu3vvwcJtY Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fd71c4c4e9af4306904d19b723b78447 Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:34.899611 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd71c4c4e9af4306904d19b723b78447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd71c4c4e9af4306904d19b723b78447", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd71c4c4e9af4306904d19b723b78447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd71c4c4e9af4306904d19b723b78447"}]}] Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fd71c4c4e9af4306904d19b723b78447 Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminTestJSON-1491247805-project Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9f26f2a3e5d74b13b987c36ff3e4cc1c Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminTestJSON-1491247805-project Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:34.900867 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b9c36d63-b983-4569-ab0f-f01d56bd7aa2'} Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:34.901734 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:34.902887 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:34.905618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Returning 404 to user: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:34.909353 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a044938d-6297-4945-9f19-18cd8fda6efd tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 404 len: 111 microversion: 2.1 time: 0.085612 Aug 23 10:37:34.910290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 107/215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:34 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:34.922553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-781579f8-0962-4ba4-8a2e-5f8cd7616f75 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:34.926373 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:34.926373 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:34.941714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-781579f8-0962-4ba4-8a2e-5f8cd7616f75 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:34.942655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-781579f8-0962-4ba4-8a2e-5f8cd7616f75 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:34.943175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-781579f8-0962-4ba4-8a2e-5f8cd7616f75 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:34.970453 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-565bbfae-9a7d-44fa-a701-2b1a92cfa6d2 tempest-ListImagesTestJSON-661211659 tempest-ListImagesTestJSON-661211659-project] 10.222.0.78 "GET /compute/v2.1/images/b4ffccc2-7c96-4941-8a42-0d5d5e6236b8" status: 200 len: 784 microversion: 2.1 time: 0.648178 Aug 23 10:37:34.985206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 109/216] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:37:34 2022] GET /compute/v2.1/images/b4ffccc2-7c96-4941-8a42-0d5d5e6236b8 => generated 784 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:34.998101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01ad8d3a-8a82-4a68-8536-32b881d40c4b tempest-ListImagesTestJSON-661211659 tempest-ListImagesTestJSON-661211659-project] Calling method '.version_select at 0x7fdc9d69e430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:35.115256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-01ad8d3a-8a82-4a68-8536-32b881d40c4b tempest-ListImagesTestJSON-661211659 tempest-ListImagesTestJSON-661211659-project] 10.222.0.78 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.128429 Aug 23 10:37:35.115937 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 110/217] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Aug 23 10:37:34 2022] GET /compute/v2.1/images => generated 445 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:35.136287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13689f02-6f13-41c3-acac-c1b81c856534 tempest-ListImagesTestJSON-661211659 tempest-ListImagesTestJSON-661211659-project] Calling method '.version_select at 0x7fdc9d6fa940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:35.201186 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13689f02-6f13-41c3-acac-c1b81c856534 tempest-ListImagesTestJSON-661211659 tempest-ListImagesTestJSON-661211659-project] 10.222.0.78 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.076285 Aug 23 10:37:35.212647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 111/218] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:37:35 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:35.228304 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-781579f8-0962-4ba4-8a2e-5f8cd7616f75 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.310320 Aug 23 10:37:35.229372 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 108/219] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:35.241639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5cd9b26-8bb9-4968-9ffa-a283c7363001 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:35.243714 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:35.243714 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:35.278479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5cd9b26-8bb9-4968-9ffa-a283c7363001 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.040369 Aug 23 10:37:35.279290 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 112/220] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:35 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:35.295739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-95cecf23-de74-40fa-87b1-b0f73b2a15ff tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1033958299"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:35.299155 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:35.299155 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:35.300659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-95cecf23-de74-40fa-87b1-b0f73b2a15ff tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid afcf1042-1301-4793-b345-f7d291f298e2 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:35.374442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-95cecf23-de74-40fa-87b1-b0f73b2a15ff tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082243 Aug 23 10:37:35.376030 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 109/221] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:35.392613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2507113-2379-405c-8540-76b07e9e1e2c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:35.397835 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:35.397835 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:35.421035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2507113-2379-405c-8540-76b07e9e1e2c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:35.421769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2507113-2379-405c-8540-76b07e9e1e2c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:35.423055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2507113-2379-405c-8540-76b07e9e1e2c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:35.616787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:35.618013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:35.639169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:35.641584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:35.642277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:35.644072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:35.646843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:35.649632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:35.684782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2507113-2379-405c-8540-76b07e9e1e2c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.298817 Aug 23 10:37:35.686993 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 113/222] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:35.700184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a954225-036e-459e-b606-4409265ac3ab tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:35.700712 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:35.700712 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:35.717775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a954225-036e-459e-b606-4409265ac3ab tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.021622 Aug 23 10:37:35.718368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 114/223] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:37:35 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:35.736650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71249a84-470d-4efe-b85e-694940d0962c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:35.743446 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:35.743446 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:35.780992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71249a84-470d-4efe-b85e-694940d0962c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:35.782005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71249a84-470d-4efe-b85e-694940d0962c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:35.783082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71249a84-470d-4efe-b85e-694940d0962c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:35.979636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:35.996929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81e489eb-f3c8-4872-a415-4456dbde8b79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.386785 Aug 23 10:37:36.000863 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 110/224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:35 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:36.012133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:36.012407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:36.029922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:36.030451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:36.031053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:36.031942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:36.032559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:36.033316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:36.057126 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71249a84-470d-4efe-b85e-694940d0962c tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.324582 Aug 23 10:37:36.058706 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 115/225] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:35 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:36.072126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fdd2750c-4147-4baf-82b0-4e97bc2c5ed5 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:36.072924 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.072924 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:36.135745 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fdd2750c-4147-4baf-82b0-4e97bc2c5ed5 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.068070 Aug 23 10:37:36.144516 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 116/226] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:36 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:36.154483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8062cc84-254d-405b-9014-8121a83a63c3 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1578275428"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:36.163747 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.163747 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:36.164776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-8062cc84-254d-405b-9014-8121a83a63c3 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid f25d3ed0-126c-4e69-8581-ed0b4e817839 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:36.233763 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8062cc84-254d-405b-9014-8121a83a63c3 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082731 Aug 23 10:37:36.235916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 117/227] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:36.250995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a82bc2f-5f5f-4e82-81c6-d3348b02b13f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:36.257373 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.257373 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:36.260409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:36.273146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-003572dd-4a14-4609-81ae-f4b0b3345649 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1313 microversion: 2.1 time: 0.270470 Aug 23 10:37:36.274078 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 111/228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:36 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:36.286736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a82bc2f-5f5f-4e82-81c6-d3348b02b13f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:36.288722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a82bc2f-5f5f-4e82-81c6-d3348b02b13f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:36.289515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a82bc2f-5f5f-4e82-81c6-d3348b02b13f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:36.466172 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a82bc2f-5f5f-4e82-81c6-d3348b02b13f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.223027 Aug 23 10:37:36.467396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 118/229] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:36.479318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4740df8-2d75-47e6-8ab0-a9f3c49f87aa tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:36.480338 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.480338 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:36.493383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4740df8-2d75-47e6-8ab0-a9f3c49f87aa tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.018680 Aug 23 10:37:36.494820 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 112/230] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:37:36 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:36.508477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d766f8c3-1e47-47ca-884b-d1c122debd47 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:36.512670 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.512670 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:36.525207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d766f8c3-1e47-47ca-884b-d1c122debd47 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:36.525990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d766f8c3-1e47-47ca-884b-d1c122debd47 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:36.526644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d766f8c3-1e47-47ca-884b-d1c122debd47 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:36.694764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d766f8c3-1e47-47ca-884b-d1c122debd47 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.191271 Aug 23 10:37:36.695372 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 119/231] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:36 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:36.708150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f54283e8-48bc-4b34-8f60-27d559fc423b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:36.709255 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.709255 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:36.743318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:UPDATE=7,nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:36.773232 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f54283e8-48bc-4b34-8f60-27d559fc423b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.070515 Aug 23 10:37:36.775292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 113/232] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:36 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:36.791761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3951c007-527a-4c2a-9bef-4bf7f03df57a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-559104086"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:36.795699 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.795699 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:36.797380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-3951c007-527a-4c2a-9bef-4bf7f03df57a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid 405e3ea1-ea81-4591-b94f-311baac3b7b3 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:36.878482 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3951c007-527a-4c2a-9bef-4bf7f03df57a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.088660 Aug 23 10:37:36.880601 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 120/233] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:36.891505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e3691c6-3bc7-4777-b2bd-9c2612b71e1a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:36.894822 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:36.894822 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:36.912098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e3691c6-3bc7-4777-b2bd-9c2612b71e1a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:36.920819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e3691c6-3bc7-4777-b2bd-9c2612b71e1a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:36.922059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e3691c6-3bc7-4777-b2bd-9c2612b71e1a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:37.029135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:37.029964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:37.052339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:37.054164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:37.055081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:37.056646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:37.058593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:37.059600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:37.102736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e3691c6-3bc7-4777-b2bd-9c2612b71e1a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.213944 Aug 23 10:37:37.103697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 114/234] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:36 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:37.120447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26f1d81a-ed30-4230-9017-213544ad459a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:37.132345 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:37.132345 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:37.148639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26f1d81a-ed30-4230-9017-213544ad459a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:37.159396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26f1d81a-ed30-4230-9017-213544ad459a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:37.162453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26f1d81a-ed30-4230-9017-213544ad459a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:37.385271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26f1d81a-ed30-4230-9017-213544ad459a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.274253 Aug 23 10:37:37.385897 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 115/235] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:37 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:37:37.390706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:37.391326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:37.407086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:37.407585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:37.408029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:37.408953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:37.409302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:37.409735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:37.615994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:37.639639 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d970c7ea-d8e6-4c08-b6cb-771443972f12 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.618253 Aug 23 10:37:37.664419 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 121/236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:37 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:37.686080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a7338cd-d8dc-4a44-8e1e-ab95000717d0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:37.686926 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:37.686926 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:37.706364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:37.719474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b336b012-0e49-487b-8199-feb3d14ca917 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1462 microversion: 2.1 time: 0.330689 Aug 23 10:37:37.722850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 116/237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:37 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1462 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:37.767031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a7338cd-d8dc-4a44-8e1e-ab95000717d0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.099884 Aug 23 10:37:37.778762 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 122/238] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:37 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:37.790980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cca10d25-3f2b-4c3b-8f68-a7b5d332cd35 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1952044546"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:37.794393 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:37.794393 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:37.796983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-cca10d25-3f2b-4c3b-8f68-a7b5d332cd35 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid 0877e070-2dfe-471f-ab66-99e9093467c7 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:37.843995 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cca10d25-3f2b-4c3b-8f68-a7b5d332cd35 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063916 Aug 23 10:37:37.845278 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 123/239] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:37.851940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ee0343b-4c48-4a2f-81e8-94fbb8f463b9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1244286936"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:37.856043 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:37.856043 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:37.857174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-6ee0343b-4c48-4a2f-81e8-94fbb8f463b9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid 026051fa-267a-4181-86f0-ee3ffdde79f6 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:37.893330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ee0343b-4c48-4a2f-81e8-94fbb8f463b9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.045460 Aug 23 10:37:37.895201 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 124/240] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:37 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:37.901076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a65e93ce-44aa-4a50-a617-1fd7ae03461a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:37.902107 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:37.902107 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:37.956883 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a65e93ce-44aa-4a50-a617-1fd7ae03461a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.057837 Aug 23 10:37:37.959259 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 125/241] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:37 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:37.965726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-66f11cc4-7475-41a2-88a9-213d87fda3da req-67a01ea9-d4c6-4db6-9de8-68f5f12fc708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210a1dcd-feea-4748-8039-313b88b28f45", "name": "network-vif-plugged", "status": "completed", "tag": "06045ad4-6b39-4a6f-a33e-e34eed046ca4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:37.980932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-66f11cc4-7475-41a2-88a9-213d87fda3da req-67a01ea9-d4c6-4db6-9de8-68f5f12fc708 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:37.981707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-66f11cc4-7475-41a2-88a9-213d87fda3da req-67a01ea9-d4c6-4db6-9de8-68f5f12fc708 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:37.982293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-66f11cc4-7475-41a2-88a9-213d87fda3da req-67a01ea9-d4c6-4db6-9de8-68f5f12fc708 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.001518 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-66f11cc4-7475-41a2-88a9-213d87fda3da req-67a01ea9-d4c6-4db6-9de8-68f5f12fc708 service nova] Creating event network-vif-plugged:06045ad4-6b39-4a6f-a33e-e34eed046ca4 for instance 210a1dcd-feea-4748-8039-313b88b28f45 on n-h2-847009-13 Aug 23 10:37:38.011823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-66f11cc4-7475-41a2-88a9-213d87fda3da req-67a01ea9-d4c6-4db6-9de8-68f5f12fc708 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050933 Aug 23 10:37:38.013557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 126/242] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:38.024481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d80e8db-1881-4e5b-a404-db56df615dc7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:38.027933 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:38.027933 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:38.040452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d80e8db-1881-4e5b-a404-db56df615dc7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.041328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d80e8db-1881-4e5b-a404-db56df615dc7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.042515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d80e8db-1881-4e5b-a404-db56df615dc7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.188492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:38.189100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:38.202076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.202580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.203033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.203761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.204217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.213485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.269748 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d80e8db-1881-4e5b-a404-db56df615dc7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 243 microversion: 2.1 time: 0.254819 Aug 23 10:37:38.270379 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 127/243] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:38 2022] POST /compute/v2.1/os-aggregates/7/action => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:38.286400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b7037d1-47ae-4b5e-8b99-5fab4f61e02b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:38.287899 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:38.287899 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:38.302477 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-7b7037d1-47ae-4b5e-8b99-5fab4f61e02b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b7037d1-47ae-4b5e-8b99-5fab4f61e02b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Request method failure captured: Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK2-IMkHJ5AR5fHf9scEbCyHgrLbiidAAfLrdvsFHcyWNM30zjz-bwgAaUnfsM98Kl4adkrI9hEegYjTVoPN0e4pNTV-CPo_BXFSQ37TKbpPT23jfAl4lc-zN7yIjRo7NvFcro2WaUXb8Vd9NHgBGX5PY5w5pDtrvO5CwNzRSP-eFvc Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:38.308977 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9544c86a9ffc4bf3aa4ae13ce7159b2c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}] Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: f89b81d57b934b5490a51dec22e664a1 Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: exception: Aggregate 6 could not be found. Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6'} Aug 23 10:37:38.310436 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.311305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 23 10:37:38.312438 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.319127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b7037d1-47ae-4b5e-8b99-5fab4f61e02b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:38.321659 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b7037d1-47ae-4b5e-8b99-5fab4f61e02b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.042414 Aug 23 10:37:38.325376 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 128/244] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:37:38 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:38.337530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:38.344121 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:38.344121 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:38.365099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.367780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.369179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.394566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=4,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:38.444428 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h1-847009-13. Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 40 Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:38.502981 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: {"add_host": {"host": "n-h1-847009-13"}} Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:38.504520 n-d-847009-13 devstack@n-api.service[128860]: exception: Aggregate 7 already has host n-h1-847009-13. Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7', 'body': {'add_host': {'host': 'n-h1-847009-13'}}} Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result.read() Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 10:37:38.505527 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-847009-13-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi session.flush() Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 10:37:38.509428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 10:37:38.510686 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 10:37:38.512097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result.read() Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-847009-13-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 23, 10, 37, 38, 421803), 'updated_at': None, 'host': 'n-h1-847009-13', 'aggregate_id': 7}] Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.513244 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host n-h1-847009-13. Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.514890 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host n-h1-847009-13. Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:38.516071 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:38.520470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host n-h1-847009-13. Aug 23 10:37:38.520470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.520470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 409 to user: Aggregate 7 already has host n-h1-847009-13. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:38.520470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86d46849-47e3-4397-b9ac-05a3ddbe3e4e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 96 microversion: 2.1 time: 0.182589 Aug 23 10:37:38.520470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 129/245] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:38 2022] POST /compute/v2.1/os-aggregates/7/action => generated 96 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 23 10:37:38.521807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86fa3c5b-5fac-4d46-8349-668b78e9c7bc tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:38.522203 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:38.522203 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:38.552777 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-86fa3c5b-5fac-4d46-8349-668b78e9c7bc tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86fa3c5b-5fac-4d46-8349-668b78e9c7bc tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Request method failure captured: Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK2-IMkHJ5AR5fHf9scEbCyHgrLbiidAAfLrdvsFHcyWNM30zjz-bwgAaUnfsM98Kl4adkrI9hEegYjTVoPN0e4pNTV-CPo_BXFSQ37TKbpPT23jfAl4lc-zN7yIjRo7NvFcro2WaUXb8Vd9NHgBGX5PY5w5pDtrvO5CwNzRSP-eFvc Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:38.554662 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9544c86a9ffc4bf3aa4ae13ce7159b2c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}] Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: f89b81d57b934b5490a51dec22e664a1 Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: exception: Aggregate 6 could not be found. Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6'} Aug 23 10:37:38.555839 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:38.556609 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:38.557626 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86fa3c5b-5fac-4d46-8349-668b78e9c7bc tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:38.558801 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86fa3c5b-5fac-4d46-8349-668b78e9c7bc tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.047755 Aug 23 10:37:38.559573 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 130/246] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:38 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:38.572967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-430005a4-0cfc-4547-a023-4888ac65f8c0 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:38.576212 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:38.576212 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:38.587417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-430005a4-0cfc-4547-a023-4888ac65f8c0 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.588453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-430005a4-0cfc-4547-a023-4888ac65f8c0 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.589295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-430005a4-0cfc-4547-a023-4888ac65f8c0 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.837396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-430005a4-0cfc-4547-a023-4888ac65f8c0 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.272139 Aug 23 10:37:38.838259 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 131/247] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:38 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:38.843587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89c5ac56-f309-4954-89c4-10eceb83e278 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-244900415", "name": "tempest-test_aggregate-298834581"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:38.847547 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:38.847547 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:38.848532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-89c5ac56-f309-4954-89c4-10eceb83e278 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid 1e43e7f2-8de6-4a64-a8a6-c4d4bf5171f5 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:38.920348 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89c5ac56-f309-4954-89c4-10eceb83e278 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.079644 Aug 23 10:37:38.921825 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 132/248] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Aug 23 10:37:38 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:38.928530 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b6d8f3f-814d-467f-8e14-9d08bc165d7b tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1615 microversion: 2.1 time: 1.177803 Aug 23 10:37:38.928530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 117/249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:37 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1615 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:38.930878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:38.931885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:38.982851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.988937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.989485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:38.995603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:38.996114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:38.996564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:39.004286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:39.418732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c58c4f9-811c-4f71-b720-f89f10ac3961 tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] Action: 'create', calling method: .version_select at 0x7fdc9d584ee0>, body: {"security_group": {"name": "tempest-securitygroup-1724065295", "description": "tempest-description-1379103935"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:39.662561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:39.678069 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afac8dd7-482e-476f-a78c-5ff289217ad3 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1388 microversion: 2.1 time: 0.752997 Aug 23 10:37:39.678772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 133/250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:38 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1388 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:39.688782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee1fa91f-06dc-4ffd-a019-39562258eaef tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:39.688782 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:39.688782 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:39.713937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee1fa91f-06dc-4ffd-a019-39562258eaef tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.033851 Aug 23 10:37:39.714529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 134/251] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:39 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:39.724813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf106a5e-8de7-40cd-9673-06f16da9d9a2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:39.725573 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:39.725573 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:39.755704 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf106a5e-8de7-40cd-9673-06f16da9d9a2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.039964 Aug 23 10:37:39.756517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 135/252] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:39 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:39.763429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:39.764139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:39.771878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:39.772413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:39.772981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:39.773795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:39.774323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:39.775218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:39.775329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c58c4f9-811c-4f71-b720-f89f10ac3961 tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.847546 Aug 23 10:37:39.780819 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 118/253] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:37:38 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:39.842932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-914381a0-89e8-4d9e-a667-7b0e4a0179c4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9fe325e0>, body: {"keypair": {"name": "tempest-keypair-79526642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbjUnsnYep3eG7YrSWzS5Q4Tbfa9ZarvrKsW90HQ5+Gs8CI4j90bZSt5oEuRP6uVtTYhpjIp7u2+A4t32Co+5LasK1vBiYRfuyqAaXLH237Zd2yziALiEARJ0zwJhnvkA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:39.860286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=90,nova_cell0:UPDATE=7 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:39.865232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-914381a0-89e8-4d9e-a667-7b0e4a0179c4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:39.871703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-914381a0-89e8-4d9e-a667-7b0e4a0179c4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:39.900504 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-914381a0-89e8-4d9e-a667-7b0e4a0179c4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.123173 Aug 23 10:37:39.901150 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 119/254] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:39.906500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e53f09cf-3b77-4f17-ab0f-ee704931dcee tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-440985664"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:39.909619 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:39.909619 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:39.910798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-e53f09cf-3b77-4f17-ab0f-ee704931dcee tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid b64d43d1-7a34-479d-89bd-4d1e68085733 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:39.933492 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e53f09cf-3b77-4f17-ab0f-ee704931dcee tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.030622 Aug 23 10:37:39.934156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 120/255] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:39.945507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec7fdb93-e76b-4b58-bc4b-3f80a57e4ca8 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:39.946261 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:39.946261 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:39.953144 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ec7fdb93-e76b-4b58-bc4b-3f80a57e4ca8 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec7fdb93-e76b-4b58-bc4b-3f80a57e4ca8 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Request method failure captured: Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK2-IMkHJ5AR5fHf9scEbCyHgrLbiidAAfLrdvsFHcyWNM30zjz-bwgAaUnfsM98Kl4adkrI9hEegYjTVoPN0e4pNTV-CPo_BXFSQ37TKbpPT23jfAl4lc-zN7yIjRo7NvFcro2WaUXb8Vd9NHgBGX5PY5w5pDtrvO5CwNzRSP-eFvc Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:39.956265 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9544c86a9ffc4bf3aa4ae13ce7159b2c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}] Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: f89b81d57b934b5490a51dec22e664a1 Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: exception: Aggregate 8 could not be found. Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '8'} Aug 23 10:37:39.957872 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:39.959025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:39.960103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec7fdb93-e76b-4b58-bc4b-3f80a57e4ca8 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:39.961742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec7fdb93-e76b-4b58-bc4b-3f80a57e4ca8 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.019803 Aug 23 10:37:39.962508 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 121/256] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:37:39 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:39.972056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9fad1f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:39.974869 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:39.974869 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:39.975663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:39.976171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:39.976623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:39.977398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:39.977992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:39.978432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:40.004060 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bca27a48-5e18-4097-8860-82fcede7ca3c tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.040413 Aug 23 10:37:40.004660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 122/257] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Aug 23 10:37:39 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:40.009551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a23b64f-9e92-4c00-8825-da827545d653 tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] Action: 'create', calling method: .version_select at 0x7fdc9d5dc550>, body: {"security_group": {"name": "tempest-securitygroup-2015858342", "description": "tempest-description-673200807"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:40.071081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ccce31992b2b48e488ef42ca535f468a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f01fc09301d47359592d4df1ed9c962', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:40.072789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] flavor_id is None. Assuming migration. {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 10:37:40.074022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 10:37:40.192511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a23b64f-9e92-4c00-8825-da827545d653 tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.186475 Aug 23 10:37:40.200169 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 123/258] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:37:40 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:40.200169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-902d0e05-0590-48ca-b7e8-1b71543ae42e tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9fe324c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:40.220681 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-902d0e05-0590-48ca-b7e8-1b71543ae42e tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-79526642" status: 200 len: 510 microversion: 2.2 time: 0.025657 Aug 23 10:37:40.221811 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 124/259] 10.222.0.78 () {60 vars in 1252 bytes} [Tue Aug 23 10:37:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-79526642 => generated 510 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:40.314246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9beb9a1-f9fe-4852-9efa-8137b0438063 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5/action" status: 202 len: 0 microversion: 2.1 time: 0.555788 Aug 23 10:37:40.316467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 136/260] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:37:39 2022] POST /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:40.323312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af4da56a-df45-45b2-98f0-aef73064316b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:40.325053 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:40.325053 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:40.338525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-af4da56a-df45-45b2-98f0-aef73064316b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af4da56a-df45-45b2-98f0-aef73064316b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Request method failure captured: Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK2-IMkHJ5AR5fHf9scEbCyHgrLbiidAAfLrdvsFHcyWNM30zjz-bwgAaUnfsM98Kl4adkrI9hEegYjTVoPN0e4pNTV-CPo_BXFSQ37TKbpPT23jfAl4lc-zN7yIjRo7NvFcro2WaUXb8Vd9NHgBGX5PY5w5pDtrvO5CwNzRSP-eFvc Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:40.340613 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9544c86a9ffc4bf3aa4ae13ce7159b2c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9544c86a9ffc4bf3aa4ae13ce7159b2c"}]}] Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 9544c86a9ffc4bf3aa4ae13ce7159b2c Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-440221132 Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: f89b81d57b934b5490a51dec22e664a1 Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminTestJSON-440221132-project-admin Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: exception: Aggregate 8 could not be found. Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8'} Aug 23 10:37:40.341829 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:40.342525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:40.343520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af4da56a-df45-45b2-98f0-aef73064316b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af4da56a-df45-45b2-98f0-aef73064316b tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.025171 Aug 23 10:37:40.346537 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 137/261] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:40 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:40.357209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9d41be50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:40.361446 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:40.361446 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:40.363527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:40.364182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:40.364732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:40.365815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:40.366387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:40.367120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:40.434059 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ef5d898-aa8b-4893-afcc-58064a4a465b tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.088094 Aug 23 10:37:40.434664 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 138/262] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:40 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:40.478060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-136c41cf-d04a-409b-bb5c-26ba0ef2485c tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:40.480670 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:40.480670 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:40.481686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-136c41cf-d04a-409b-bb5c-26ba0ef2485c tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd316e568117248668174e1c37def9e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3399592444c1cb1f1e953e8d7e346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-136c41cf-d04a-409b-bb5c-26ba0ef2485c tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Request method failure captured: Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 40 Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Kqk81JnXHO4mXD20DJYPPZib1v6mgIOAqzXg-JburRiZNxzhZwcLmLLHm6ai_WrM6gjU48R059-30tvSo72Hdh1PjHXfqnsYYThuzRMQJSouQ344XPZ52yJKRUH4xedc83vNOcmgHdQP-mmIdJKUu6yh92ZNh1qoOYOmBVSqCJFU Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:40.490022 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dee3399592444c1cb1f1e953e8d7e346", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}] Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d316e568117248668174e1c37def9e90 Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: {"add_host": {"host": "n-h1-847009-13"}} Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:40.491260 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-847009-13'}}} Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:40.491994 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 23 10:37:40.493077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:40.498604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-136c41cf-d04a-409b-bb5c-26ba0ef2485c tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:40.498604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-136c41cf-d04a-409b-bb5c-26ba0ef2485c tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.261930 Aug 23 10:37:40.498604 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 125/263] 10.222.0.78 () {60 vars in 1191 bytes} [Tue Aug 23 10:37:40 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:40.507509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7fd6b523-e0b2-46da-8474-800793ede817 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d584670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:40.569052 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7fd6b523-e0b2-46da-8474-800793ede817 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-79526642" status: 204 len: 0 microversion: 2.2 time: 0.075533 Aug 23 10:37:40.576951 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 126/264] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Aug 23 10:37:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-79526642 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:40.583038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:40.583838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:40.590211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:40.590923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:40.591554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:40.592432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:40.593089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:40.593668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:40.599390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:40.704324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb0ef4e1-22be-459c-b93e-a9de75a19469 tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] Action: 'create', calling method: .version_select at 0x7fdc9d375430>, body: {"security_group": {"name": "tempest-securitygroup-424179775", "description": "tempest-description-1497074119"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:41.109118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:41.134896 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-39626d69-fdf9-4233-b2bf-e18942f11648 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1471 microversion: 2.1 time: 0.556465 Aug 23 10:37:41.137108 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 127/265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:40 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1471 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:41.152555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-afc644d3-877b-4f45-8203-2ce961841e7f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1796543040"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:41.164557 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.164557 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:41.166084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-afc644d3-877b-4f45-8203-2ce961841e7f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid a7e84ce0-3c17-4abe-8dd5-13a35d375b61 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:41.231625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-afc644d3-877b-4f45-8203-2ce961841e7f tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091166 Aug 23 10:37:41.234158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 128/266] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.239525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9d5b6f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.244228 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.244228 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:41.254902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:41.255415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:41.255872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:41.256981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:41.257687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:41.258271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:41.335019 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb0ef4e1-22be-459c-b93e-a9de75a19469 tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.895204 Aug 23 10:37:41.342722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 139/267] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:37:40 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.350336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d568c9b1-e980-4f07-8347-26267e704724 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.350537 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b63c7e64-c0df-4277-b569-72bbf726ed73 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.110989 Aug 23 10:37:41.356099 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.356099 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:41.356371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 129/268] 10.222.0.78 () {58 vars in 1128 bytes} [Tue Aug 23 10:37:41 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.358938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bef1995d-121c-41d1-ace6-462c8554da2e tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9d554550>, body: {"keypair": {"name": "tempest-keypair-1700266886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0ZbQ24pkJhKItWKJjfOJwrj8OI5qow/t7ALgVnqvIB2px97l2nCcuT89lI9T4HsknAL1BGivbX2Sl6iapWq4CZ2w8D4nDv/McZkuXzRmxASBYLHbh46OnXEkABrucFJA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:41.406866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bef1995d-121c-41d1-ace6-462c8554da2e tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:41.414910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d568c9b1-e980-4f07-8347-26267e704724 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.072485 Aug 23 10:37:41.417321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 140/269] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:41.420869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bef1995d-121c-41d1-ace6-462c8554da2e tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:41.439856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.441145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:41.455626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:41.458246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:41.460335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:41.461512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:41.464445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:41.465321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:41.482359 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bef1995d-121c-41d1-ace6-462c8554da2e tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.129605 Aug 23 10:37:41.482957 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 130/270] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:41.495167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-16626af4-a09f-4542-a1f1-cf48d97230d9 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.496021 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.496021 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:41.504068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:41.513320 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-16626af4-a09f-4542-a1f1-cf48d97230d9 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.023286 Aug 23 10:37:41.519669 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 131/271] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:41 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.525638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-242c970a-3b47-4c45-8651-8cd36289a71b tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] Action: 'create', calling method: .version_select at 0x7fdc9d33e160>, body: {"security_group": {"name": "tempest-securitygroup-990864601", "description": "tempest-description-162433877"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:41.699990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:41.715023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e54161a8-2c82-41c0-8316-d668fa7b66a7 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1587 microversion: 2.1 time: 0.291363 Aug 23 10:37:41.734527 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 141/272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:41 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1587 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:41.748543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9d375700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.754756 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.754756 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:41.771021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:41.773177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:41.774086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:41.804234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:41.805086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:41.805757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:41.826251 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-848fc949-3150-40b9-a16a-9d3484c9559e tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h1-847009-13" status: 200 len: 471 microversion: 2.1 time: 0.090261 Aug 23 10:37:41.827859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 142/273] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Aug 23 10:37:41 2022] GET /compute/v2.1/os-hosts/n-h1-847009-13 => generated 471 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.842506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e068999-e0c6-4c3c-94cb-8e8352afda68 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2106076765"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:41.846574 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.846574 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:41.848172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-2e068999-e0c6-4c3c-94cb-8e8352afda68 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid 499ca354-0a17-409d-8f88-01859ea26373 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:41.881315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e068999-e0c6-4c3c-94cb-8e8352afda68 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052063 Aug 23 10:37:41.888625 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 143/274] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.889575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f25b034-f55f-400f-a421-d36de3e22e9c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d3b7430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.928574 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f25b034-f55f-400f-a421-d36de3e22e9c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700266886" status: 204 len: 0 microversion: 2.2 time: 0.043874 Aug 23 10:37:41.930040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 144/275] 10.222.0.78 () {60 vars in 1261 bytes} [Tue Aug 23 10:37:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1700266886 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:41.939059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c1d7d979-fcf0-4af0-986c-b7624a63632a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:41.943614 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.943614 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:41.972721 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-242c970a-3b47-4c45-8651-8cd36289a71b tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.451706 Aug 23 10:37:41.975094 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 132/276] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:37:41 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.982382 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c1d7d979-fcf0-4af0-986c-b7624a63632a tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.050732 Aug 23 10:37:41.983286 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 145/277] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 10:37:41 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:41.984904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.984904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:41.994626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Calling method '.version_select at 0x7fdc9d686dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:41.997483 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:41.997483 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:42.005073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.006530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.007383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.007696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.008098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.009214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.009944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.010651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.013130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.028323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.029660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.030912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.051288 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9a5c4d0-c5c8-408e-8cf5-612c0a49ff47 tempest-HostsAdminTestJSON-989422800 tempest-HostsAdminTestJSON-989422800-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h2-847009-13" status: 200 len: 471 microversion: 2.1 time: 0.066918 Aug 23 10:37:42.052532 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 146/278] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Aug 23 10:37:41 2022] GET /compute/v2.1/os-hosts/n-h2-847009-13 => generated 471 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:42.066254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-685125487"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:42.073347 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:42.073347 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:42.084728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.085262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.086654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.096054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.097206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.097581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.107090 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-685125487 could not be found. Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 57 Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:42.109107 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: {"add_host": {"host": "tempest-nonexist_host-685125487"}} Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:42.110583 n-d-847009-13 devstack@n-api.service[128860]: exception: Compute host tempest-nonexist_host-685125487 could not be found. Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-685125487'}}} Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-685125487' is not mapped to any cell Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:42.111980 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 23 10:37:42.113152 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-685125487 could not be found. Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-685125487 could not be found. Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:42.114351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-685125487 could not be found. Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-685125487 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93a45af4-6697-4644-acad-f49c9dbb8202 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.050408 Aug 23 10:37:42.115580 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 147/279] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 10:37:42 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:42.117404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abf72421-5bd6-4288-bd58-1f7325cfe07c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9d686b80>, body: {"keypair": {"name": "tempest-keypair-541016938", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:42.134895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-abf72421-5bd6-4288-bd58-1f7325cfe07c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:42.141141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-abf72421-5bd6-4288-bd58-1f7325cfe07c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:42.174497 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abf72421-5bd6-4288-bd58-1f7325cfe07c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.060854 Aug 23 10:37:42.180757 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 148/280] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:42 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:42.195057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-658bb439-2120-45a9-9b39-65f925b47215 tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] Calling method '.version_select at 0x7fdc9d3b7ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:42.403283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8d457b7-9bdb-42c8-9faf-17d7192b1bf1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.426550 Aug 23 10:37:42.406761 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 133/281] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:37:41 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45/os-interface => generated 284 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:42.419234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee70985e-1653-45c7-a2b4-250f6855e7ea tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:42.420691 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:42.420691 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:42.447393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee70985e-1653-45c7-a2b4-250f6855e7ea tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.039127 Aug 23 10:37:42.448593 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 134/282] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:42 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:42.456318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de328ef4-5127-4d8a-9cfe-a58c20100992 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:42.457439 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:42.457439 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:42.494195 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de328ef4-5127-4d8a-9cfe-a58c20100992 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.044193 Aug 23 10:37:42.496100 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 135/283] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:42 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:42.503221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:42.506102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:42.513983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.514759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.515851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.518051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:42.518957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:42.519586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:42.755757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:42.781966 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88392b01-27fb-423e-bdd2-f945e81a1364 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1471 microversion: 2.1 time: 0.284436 Aug 23 10:37:42.782778 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 136/284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:42 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:42.797289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-781adcf6-b359-4d81-822c-45264efa4cc9 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d33edc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:42.884336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-781adcf6-b359-4d81-822c-45264efa4cc9 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541016938" status: 204 len: 0 microversion: 2.2 time: 0.096533 Aug 23 10:37:42.893248 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 137/285] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Aug 23 10:37:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541016938 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:42.904650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df727d9c-d7a4-4b7f-b52d-e3b3c490b783 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:42.905654 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:42.905654 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:42.958039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:43.008026 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df727d9c-d7a4-4b7f-b52d-e3b3c490b783 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.111139 Aug 23 10:37:43.008961 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 138/286] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:42 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:43.023722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1adbe982-82a5-4128-b3f3-651486230c7c tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1adbe982-82a5-4128-b3f3-651486230c7c tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 283 Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:43.035739 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:43.037236 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:37:43.038027 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:43.038792 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:43.040074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:43.041287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:37:43.041287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:37:43.041287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:37:43.041287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.042655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1adbe982-82a5-4128-b3f3-651486230c7c tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:43.062529 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1adbe982-82a5-4128-b3f3-651486230c7c tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.051437 Aug 23 10:37:43.070803 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 139/287] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:37:43.082297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a001484-aa57-4bc3-8464-dfc73d4d5676 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9d3b93a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2124311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHzH6FTzXZcqEHv/Dt3uaroQfPzcQOK/nLPrI02jvjVWbPulsHIF4Zr+RBG3yHO/NOGQ5ps9Kv6sYb+NFlf/h9OXcw0MZJskgIjV//XhmGmNBAw9VaG6r2e1MLalayzVA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.136563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6a001484-aa57-4bc3-8464-dfc73d4d5676 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:43.180842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6a001484-aa57-4bc3-8464-dfc73d4d5676 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:43.265260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a001484-aa57-4bc3-8464-dfc73d4d5676 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 418 microversion: 2.2 time: 0.193474 Aug 23 10:37:43.267022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 140/288] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-keypairs => generated 418 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:43.275559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31ecc636-cf89-40d0-96d6-73e1f34deab2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-791539106", "availability_zone": "tempest-test_az-766263664"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.308353 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:43.308353 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:43.309946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-31ecc636-cf89-40d0-96d6-73e1f34deab2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid 6a42fc29-833b-43f0-9361-924c6d339343 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:43.371797 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31ecc636-cf89-40d0-96d6-73e1f34deab2 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.101851 Aug 23 10:37:43.373182 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 141/289] 10.222.0.78 () {60 vars in 1165 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:43.386304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa0dfcc7-a86a-4e8c-b5e8-4fec21a632f9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa0dfcc7-a86a-4e8c-b5e8-4fec21a632f9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 27 Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:43.394451 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: {"aggregate": {"name": ""}} Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:43.395745 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '' Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:43.396470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:37:43.398655 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.401554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa0dfcc7-a86a-4e8c-b5e8-4fec21a632f9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:43.402878 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa0dfcc7-a86a-4e8c-b5e8-4fec21a632f9 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.028340 Aug 23 10:37:43.404048 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 142/290] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:37:43.424391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bcfebc41-ded5-45b1-bcc6-bf4d7a7c5dc4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9fe32790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1693344861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImTAV+AixpsldemK+yiaSR1DO7BNqYWLoOMWOU5w/pjQIOPZ5v2QRfe1Q9+485RcBNzpYchgROLwQEzerNtxpIjazYBHvKVOyxfE21NV0WEUBX9dJm17UyxYLd4GbZ/Pg=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.447326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bcfebc41-ded5-45b1-bcc6-bf4d7a7c5dc4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:43.453845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bcfebc41-ded5-45b1-bcc6-bf4d7a7c5dc4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:43.488659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bcfebc41-ded5-45b1-bcc6-bf4d7a7c5dc4 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.082579 Aug 23 10:37:43.489696 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 143/291] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:43.495840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31c0e799-a1d3-4be2-9d1c-55d316c96025 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-791539106_new", "availability_zone": "tempest-test_az-766263664_new"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.595365 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:43.595365 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:43.654506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31c0e799-a1d3-4be2-9d1c-55d316c96025 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:43.655208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31c0e799-a1d3-4be2-9d1c-55d316c96025 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:43.655771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31c0e799-a1d3-4be2-9d1c-55d316c96025 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:43.702504 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31c0e799-a1d3-4be2-9d1c-55d316c96025 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 334 microversion: 2.1 time: 0.211467 Aug 23 10:37:43.709296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 144/292] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Aug 23 10:37:43 2022] PUT /compute/v2.1/os-aggregates/12 => generated 334 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:43.716535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddba1f5e-31c1-457f-95d3-5cf7bbe3df4d tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-723666853"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.719673 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:43.719673 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:43.722956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddba1f5e-31c1-457f-95d3-5cf7bbe3df4d tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd316e568117248668174e1c37def9e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3399592444c1cb1f1e953e8d7e346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddba1f5e-31c1-457f-95d3-5cf7bbe3df4d tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Request method failure captured: Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 59 Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Kqk81JnXHO4mXD20DJYPPZib1v6mgIOAqzXg-JburRiZNxzhZwcLmLLHm6ai_WrM6gjU48R059-30tvSo72Hdh1PjHXfqnsYYThuzRMQJSouQ344XPZ52yJKRUH4xedc83vNOcmgHdQP-mmIdJKUu6yh92ZNh1qoOYOmBVSqCJFU Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:43.724875 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dee3399592444c1cb1f1e953e8d7e346", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}] Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d316e568117248668174e1c37def9e90 Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: {"aggregate": {"name": "tempest-test_aggregate-723666853"}} Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:43.726333 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-723666853'}}} Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:43.731508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:43.732943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 23 10:37:43.734324 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:43.734324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddba1f5e-31c1-457f-95d3-5cf7bbe3df4d tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:43.734324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddba1f5e-31c1-457f-95d3-5cf7bbe3df4d tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021370 Aug 23 10:37:43.734324 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 145/293] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:43.737053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a98817a5-eef3-46fa-baf5-1f8fff94aaa9 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9d5434c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-631011802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR/aXdiKu3YdnNloZN6q5ut+Mx2tW7pQ25CJvzqAfw/9XnNnTw0wozxZ0FHCWdeTOM99Gwji5+QZgdFiySswzEo4Q0KONR8GhQRw8wGgtCtl+DBOsbDelnRCKcJsSK39g=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.759679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a98817a5-eef3-46fa-baf5-1f8fff94aaa9 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:43.766784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a98817a5-eef3-46fa-baf5-1f8fff94aaa9 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:43.816865 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a98817a5-eef3-46fa-baf5-1f8fff94aaa9 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.088480 Aug 23 10:37:43.818751 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 146/294] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:43.826330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3289478b-3bf5-4689-9fa0-c0403aa10462 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:43.827654 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:43.827654 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:43.847972 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3289478b-3bf5-4689-9fa0-c0403aa10462 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.021163 Aug 23 10:37:43.849222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 147/295] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:37:43 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:43.859410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9c58960-6f0c-43c7-938f-4de33c7181ce tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1646041634"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:43.865232 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:43.865232 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:43.868313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-a9c58960-6f0c-43c7-938f-4de33c7181ce tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid 826eaf32-6d04-48a0-8a68-93f6bf1a9cb5 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:43.911717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9c58960-6f0c-43c7-938f-4de33c7181ce tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060388 Aug 23 10:37:43.913188 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 148/296] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:43.929665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:43.930315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:43.945831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:43.949402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:43.949928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:43.950722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:43.951880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:43.953985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:44.416502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:44.424591 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-611bf0e0-df58-4b81-b474-b2262e28d418 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1471 microversion: 2.1 time: 0.510254 Aug 23 10:37:44.425215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 149/297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:43 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:44.443494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb768ec3-1b2e-4c9a-96e7-6fd4211e94a8 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d3d3d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:44.447494 n-d-847009-13 devstack@n-api.service[128859]: WARNING oslo_db.sqlalchemy.utils [None req-bb768ec3-1b2e-4c9a-96e7-6fd4211e94a8 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 10:37:44.468407 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb768ec3-1b2e-4c9a-96e7-6fd4211e94a8 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1138 microversion: 2.2 time: 0.029270 Aug 23 10:37:44.469302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 150/298] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Aug 23 10:37:44 2022] GET /compute/v2.1/os-keypairs => generated 1138 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:44.474548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e926d4d9-6254-4c16-b423-bd0cbcf5c605 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:44.475546 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:44.475546 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:44.509913 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e926d4d9-6254-4c16-b423-bd0cbcf5c605 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.039298 Aug 23 10:37:44.511053 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 151/299] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:44 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:44.519808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c20d3ed-42f5-4000-8f01-be906bfaf0a4 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1646041634"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:44.524443 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:44.524443 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:44.525547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-1c20d3ed-42f5-4000-8f01-be906bfaf0a4 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid c8e827ca-4da1-4e71-aef2-90c4ec561401 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:44.548062 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1c20d3ed-42f5-4000-8f01-be906bfaf0a4 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1646041634 already exists. Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c20d3ed-42f5-4000-8f01-be906bfaf0a4 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 60 Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:44.551341 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: {"aggregate": {"name": "tempest-test_aggregate-1646041634"}} Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:44.552988 n-d-847009-13 devstack@n-api.service[128859]: exception: Aggregate tempest-test_aggregate-1646041634 already exists. Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1646041634'}}} Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 23 10:37:44.553817 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1646041634 already exists. Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:44.555080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1646041634 already exists. Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1646041634 already exists. Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c20d3ed-42f5-4000-8f01-be906bfaf0a4 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1646041634 already exists. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:44.556411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c20d3ed-42f5-4000-8f01-be906bfaf0a4 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.040760 Aug 23 10:37:44.557867 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 152/300] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:44 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:44.563117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80d361cc-9509-4582-bcb9-8b392790aee0 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d33ea60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:44.589086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80d361cc-9509-4582-bcb9-8b392790aee0 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-631011802" status: 204 len: 0 microversion: 2.2 time: 0.029773 Aug 23 10:37:44.590095 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 153/301] 10.222.0.78 () {60 vars in 1318 bytes} [Tue Aug 23 10:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-631011802 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:44.596814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99fc45ab-0c00-42dd-9efa-0050f53e3348 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1668945006"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:44.600372 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:44.600372 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:44.601423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-99fc45ab-0c00-42dd-9efa-0050f53e3348 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Generated uuid 179aa70e-9f9e-40a5-83d2-3ceb40eb609a for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:44.631436 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99fc45ab-0c00-42dd-9efa-0050f53e3348 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040126 Aug 23 10:37:44.632536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 154/302] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:44.655456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3663fff2-53fb-4cb8-919b-3e97d548fd6c tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:44.656306 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:44.656306 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:44.737620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3663fff2-53fb-4cb8-919b-3e97d548fd6c tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.099493 Aug 23 10:37:44.746112 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 155/303] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:44 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:44.759930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53e65dac-79b0-42e1-865c-4c2d806b97a2 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d2f9040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:44.815737 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53e65dac-79b0-42e1-865c-4c2d806b97a2 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1693344861" status: 204 len: 0 microversion: 2.2 time: 0.067372 Aug 23 10:37:44.818361 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 156/304] 10.222.0.78 () {60 vars in 1321 bytes} [Tue Aug 23 10:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1693344861 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:44.832489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f14bfea7-c964-425c-b5f8-d581295abf84 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:44.835073 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:44.835073 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:44.845348 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f14bfea7-c964-425c-b5f8-d581295abf84 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.024379 Aug 23 10:37:44.848030 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 157/305] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:37:44 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:44.872558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59b76de3-9119-48bd-9699-df2df13577a5 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1526829810"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:44.882457 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:44.882457 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:44.886803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-59b76de3-9119-48bd-9699-df2df13577a5 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid 215e0db2-cba4-4303-b90d-cfa0bb8397f0 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:44.941137 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59b76de3-9119-48bd-9699-df2df13577a5 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091681 Aug 23 10:37:44.950109 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 158/306] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:44.999874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-955f46ce-dc6b-4a66-be72-7c9b105ebe0c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d3b9700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.017136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:45.042683 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-955f46ce-dc6b-4a66-be72-7c9b105ebe0c tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2124311" status: 204 len: 0 microversion: 2.2 time: 0.089908 Aug 23 10:37:45.043462 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 159/307] 10.222.0.78 () {60 vars in 1312 bytes} [Tue Aug 23 10:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2124311 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:45.053577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f212995a-24f0-4183-90dd-d40576abd1d0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.054414 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:45.054414 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:45.090718 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f212995a-24f0-4183-90dd-d40576abd1d0 tempest-AggregatesAdminTestJSON-440221132 tempest-AggregatesAdminTestJSON-440221132-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.045811 Aug 23 10:37:45.091826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 160/308] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:45.104181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4705eb28-0e4e-49d3-9987-94fb9eab2a2e tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.105107 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:45.105107 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:45.106599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4705eb28-0e4e-49d3-9987-94fb9eab2a2e tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd316e568117248668174e1c37def9e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3399592444c1cb1f1e953e8d7e346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4705eb28-0e4e-49d3-9987-94fb9eab2a2e tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Request method failure captured: Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Kqk81JnXHO4mXD20DJYPPZib1v6mgIOAqzXg-JburRiZNxzhZwcLmLLHm6ai_WrM6gjU48R059-30tvSo72Hdh1PjHXfqnsYYThuzRMQJSouQ344XPZ52yJKRUH4xedc83vNOcmgHdQP-mmIdJKUu6yh92ZNh1qoOYOmBVSqCJFU Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:45.108794 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dee3399592444c1cb1f1e953e8d7e346", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}] Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d316e568117248668174e1c37def9e90 Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 23 10:37:45.110106 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '15'} Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:45.110819 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.112516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4705eb28-0e4e-49d3-9987-94fb9eab2a2e tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:45.114957 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4705eb28-0e4e-49d3-9987-94fb9eab2a2e tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.012555 Aug 23 10:37:45.114957 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 161/309] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:45.119310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0beeb30b-6b5e-4e99-9738-ac2afa3c8aae tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9d2ea550>, body: {"keypair": {"name": "tempest-keypair-327841200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdwXx0AcJ2Y6y0wET6i8P9+IIqOOSsqZ1HypeQ6BmoEGaEygkK4kKbUcT54yqhrv4ugJUEOtqH8Sgscyw1ppEqKwPrZcjih/M/dxA+1x31ywRmlAVXRt8Z/k9WrQ5ocig=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:45.142497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0beeb30b-6b5e-4e99-9738-ac2afa3c8aae tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:45.149568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0beeb30b-6b5e-4e99-9738-ac2afa3c8aae tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:45.183252 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0beeb30b-6b5e-4e99-9738-ac2afa3c8aae tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.069248 Aug 23 10:37:45.184307 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 162/310] 10.222.0.78 () {62 vars in 1199 bytes} [Tue Aug 23 10:37:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:37:45.191803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.192658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:45.205785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.206325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.206822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.207892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.208374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.209033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.225979 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] HTTP exception thrown: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Request method failure captured: Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 HTTP/1.1 Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK28kgEzi0zTnyHIPJGWKoa8KTOhOStXUhVHWhWp3Neq78hewcj3qxCyn19cvBxtf65T01PRV-MFoyTxsjjGAt_oA6TItjSmHSU5F1E9QFlKWueUAlmFgyxPmb6KaNMK3JVYicWgWdp9TBi1MRvcU0ZKPPLNHxtzYhNyufu3vvwcJtY Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fd71c4c4e9af4306904d19b723b78447 Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:45.227864 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd71c4c4e9af4306904d19b723b78447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd71c4c4e9af4306904d19b723b78447", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd71c4c4e9af4306904d19b723b78447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd71c4c4e9af4306904d19b723b78447"}]}] Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fd71c4c4e9af4306904d19b723b78447 Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminTestJSON-1491247805-project Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9f26f2a3e5d74b13b987c36ff3e4cc1c Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminTestJSON-1491247805-project Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.229396 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b9c36d63-b983-4569-ab0f-f01d56bd7aa2'} Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:45.230207 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.231486 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.232806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Returning 404 to user: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:45.232806 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0062beac-009a-4833-a02d-a835fc894417 tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 404 len: 111 microversion: 2.1 time: 0.044051 Aug 23 10:37:45.233571 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 163/311] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:37:45 2022] DELETE /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:45.239041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a51de9be-7701-4aa3-860a-ca8efdb7e608 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.240000 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:45.240000 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:45.295061 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a51de9be-7701-4aa3-860a-ca8efdb7e608 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.034478 Aug 23 10:37:45.295061 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 164/312] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:45.295061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66f60e7a-6eb3-4410-b852-93d9b3ccebdd tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9fe32ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.308717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66f60e7a-6eb3-4410-b852-93d9b3ccebdd tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-327841200" status: 200 len: 511 microversion: 2.2 time: 0.022706 Aug 23 10:37:45.310364 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 165/313] 10.222.0.78 () {60 vars in 1255 bytes} [Tue Aug 23 10:37:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-327841200 => generated 511 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:45.326643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.327425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] [instance: b9c36d63-b983-4569-ab0f-f01d56bd7aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:45.354818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.355661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.356264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.357765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.369414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.370279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.400662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] HTTP exception thrown: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Request method failure captured: Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 HTTP/1.1 Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK28kgEzi0zTnyHIPJGWKoa8KTOhOStXUhVHWhWp3Neq78hewcj3qxCyn19cvBxtf65T01PRV-MFoyTxsjjGAt_oA6TItjSmHSU5F1E9QFlKWueUAlmFgyxPmb6KaNMK3JVYicWgWdp9TBi1MRvcU0ZKPPLNHxtzYhNyufu3vvwcJtY Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fd71c4c4e9af4306904d19b723b78447 Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:45.404561 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fd71c4c4e9af4306904d19b723b78447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fd71c4c4e9af4306904d19b723b78447", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd71c4c4e9af4306904d19b723b78447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fd71c4c4e9af4306904d19b723b78447"}]}] Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fd71c4c4e9af4306904d19b723b78447 Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1491247805 Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminTestJSON-1491247805-project Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9f26f2a3e5d74b13b987c36ff3e4cc1c Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminTestJSON-1491247805-project Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.406058 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b9c36d63-b983-4569-ab0f-f01d56bd7aa2'} Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:45.407123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. Aug 23 10:37:45.409063 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.415804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] Returning 404 to user: Instance b9c36d63-b983-4569-ab0f-f01d56bd7aa2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:45.420131 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f63787c5-0d26-4cce-9939-0b60d9f6970b tempest-AggregatesAdminTestJSON-1491247805 tempest-AggregatesAdminTestJSON-1491247805-project] 10.222.0.78 "GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2" status: 404 len: 111 microversion: 2.1 time: 0.107347 Aug 23 10:37:45.423494 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 166/314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:45 2022] GET /compute/v2.1/servers/b9c36d63-b983-4569-ab0f-f01d56bd7aa2 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:45.436497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0731055f-707c-4471-86fb-4ef907e0414f tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.440601 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:45.440601 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:45.484231 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0731055f-707c-4471-86fb-4ef907e0414f tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0731055f-707c-4471-86fb-4ef907e0414f tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:45.488978 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: exception: Aggregate -1 could not be found. Aug 23 10:37:45.495475 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '-1'} Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 10:37:45.496534 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.498272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0731055f-707c-4471-86fb-4ef907e0414f tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:45.499614 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0731055f-707c-4471-86fb-4ef907e0414f tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.063324 Aug 23 10:37:45.505154 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 167/315] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:45 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:45.509992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46017a9d-ed4c-4e98-8dbe-243facdd9c94 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d3d3ca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.520634 n-d-847009-13 devstack@n-api.service[128859]: WARNING oslo_db.sqlalchemy.utils [None req-46017a9d-ed4c-4e98-8dbe-243facdd9c94 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 10:37:45.530242 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46017a9d-ed4c-4e98-8dbe-243facdd9c94 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.023768 Aug 23 10:37:45.535148 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 168/316] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Aug 23 10:37:45 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:45.546918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.550625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:45.577072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.577682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.578770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.579761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.581180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.581845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.803656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:45.813689 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac8e2322-182b-4d62-94e6-d696e25d7485 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.276817 Aug 23 10:37:45.815088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 169/317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:45 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:45.822001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eeee3be5-289f-450a-be88-64e47315745d tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1868677610"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:45.825049 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:45.825049 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:45.826699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-eeee3be5-289f-450a-be88-64e47315745d tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid b2876f56-6f4b-481b-9779-917d30ed0908 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:45.870674 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eeee3be5-289f-450a-be88-64e47315745d tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049471 Aug 23 10:37:45.882281 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 170/318] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:45.888166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4450e694-af04-4a10-a57a-072058c916fc tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d2ea700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.926500 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4450e694-af04-4a10-a57a-072058c916fc tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327841200" status: 204 len: 0 microversion: 2.2 time: 0.042985 Aug 23 10:37:45.927889 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 171/319] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Aug 23 10:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327841200 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:45.939002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:45.940333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:45.953589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.964170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.964691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:45.965561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:45.971669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:45.972213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:46.271498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:46.282122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-37ef9164-8565-4fb2-83a2-8c5406bc18aa tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 200 len: 1587 microversion: 2.1 time: 0.352944 Aug 23 10:37:46.286167 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 172/320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:45 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 1587 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:46.295455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3832ccde-39ee-40f4-9d87-7e717d2e63bd req-ddd5faf6-7b3f-42e9-b2ba-54fb4341bff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210a1dcd-feea-4748-8039-313b88b28f45", "tag": "06045ad4-6b39-4a6f-a33e-e34eed046ca4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:46.319488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3832ccde-39ee-40f4-9d87-7e717d2e63bd req-ddd5faf6-7b3f-42e9-b2ba-54fb4341bff6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:46.319879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3832ccde-39ee-40f4-9d87-7e717d2e63bd req-ddd5faf6-7b3f-42e9-b2ba-54fb4341bff6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:46.320304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3832ccde-39ee-40f4-9d87-7e717d2e63bd req-ddd5faf6-7b3f-42e9-b2ba-54fb4341bff6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:46.342407 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3832ccde-39ee-40f4-9d87-7e717d2e63bd req-ddd5faf6-7b3f-42e9-b2ba-54fb4341bff6 service nova] Creating event network-changed:06045ad4-6b39-4a6f-a33e-e34eed046ca4 for instance 210a1dcd-feea-4748-8039-313b88b28f45 on n-h2-847009-13 Aug 23 10:37:46.351524 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3832ccde-39ee-40f4-9d87-7e717d2e63bd req-ddd5faf6-7b3f-42e9-b2ba-54fb4341bff6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063837 Aug 23 10:37:46.352132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 173/321] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:46.648920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-438382149", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "16058aaf-a351-4bde-a15a-8b9493e9e115"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:46.739711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] validate_networks() for [('16058aaf-a351-4bde-a15a-8b9493e9e115', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:37:47.258946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-658bb439-2120-45a9-9b39-65f925b47215 tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10368 microversion: 2.1 time: 5.081853 Aug 23 10:37:47.269260 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 149/322] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Aug 23 10:37:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10368 bytes in 5084 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:37:47.269260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46273ff6-4496-4045-88d8-148b8161b571 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:47.269260 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:47.269260 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:47.269260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46273ff6-4496-4045-88d8-148b8161b571 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd316e568117248668174e1c37def9e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3399592444c1cb1f1e953e8d7e346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46273ff6-4496-4045-88d8-148b8161b571 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Request method failure captured: Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Kqk81JnXHO4mXD20DJYPPZib1v6mgIOAqzXg-JburRiZNxzhZwcLmLLHm6ai_WrM6gjU48R059-30tvSo72Hdh1PjHXfqnsYYThuzRMQJSouQ344XPZ52yJKRUH4xedc83vNOcmgHdQP-mmIdJKUu6yh92ZNh1qoOYOmBVSqCJFU Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:37:47.269756 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dee3399592444c1cb1f1e953e8d7e346", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}] Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d316e568117248668174e1c37def9e90 Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 23 10:37:47.270914 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '16'} Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:47.271749 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:47.280005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46273ff6-4496-4045-88d8-148b8161b571 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:47.281215 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46273ff6-4496-4045-88d8-148b8161b571 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.010134 Aug 23 10:37:47.281215 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 150/323] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:47 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:47.281215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Action: 'create', calling method: .version_select at 0x7fdc9d2e9ee0>, body: {"keypair": {"name": "tempest-keypair-1412710026", "type": "x509"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:47.309268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:47.321442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:47.373957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.processutils [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpxbg0r0j9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxbg0r0j9/temp.key -subj /CN=976dca1c97394c2192444e6275418d21 -extensions v3_req_client {{(pid=128860) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 23 10:37:47.464820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:37:47.465783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:37:47.466719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:37:47.467275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:37:47.467947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:37:47.484371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:47.485164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:47.485756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:47.487604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:47.488218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:47.488939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:47.515640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:47.526535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for user b2ac0227a26f41c8a9b5c89cddea52f5 and project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:47.557114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:37:47.560324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:37:47.634908 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7bea034-0747-4f75-9389-477594705ec0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281027 Aug 23 10:37:47.641406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 174/324] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:37:47.647280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:47.647897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:47.656298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:47.656972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:47.657289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:47.658015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:47.658470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:47.658893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:47.819030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.processutils [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpxbg0r0j9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpxbg0r0j9/temp.key -subj /CN=976dca1c97394c2192444e6275418d21 -extensions v3_req_client" returned: 0 in 0.443s {{(pid=128860) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 23 10:37:47.820106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.processutils [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpxbg0r0j9/temp.key -password pass: {{(pid=128860) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 23 10:37:47.889955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.processutils [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpxbg0r0j9/temp.key -password pass:" returned: 0 in 0.069s {{(pid=128860) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 23 10:37:47.940145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:47.971369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:47.976676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:47.981952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15a16aef-f0b0-4832-b8db-0b5ad442d20e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.344674 Aug 23 10:37:47.982538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 175/325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:47 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:47.995343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Getting quotas for user 976dca1c97394c2192444e6275418d21 and project 687a48ac44e941008fb2584927bd0d8a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:47.999149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3e61206-31c0-436d-9b65-d82d93e2c224 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.009032 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:48.009032 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:48.059337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e660c30b-6d0b-430e-80e9-a560fcd9593d tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.781419 Aug 23 10:37:48.061374 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 151/326] 10.222.0.78 () {62 vars in 1198 bytes} [Tue Aug 23 10:37:47 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 786 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:48.075582 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3e61206-31c0-436d-9b65-d82d93e2c224 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.087383 Aug 23 10:37:48.076857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 176/327] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:47 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:48.086369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b7a13e0-fb22-4057-bfe0-e03582c84c6f tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] Calling method '.version_select at 0x7fdc9d2e9940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.091417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee6fedc5-5a9d-474f-a308-5cad604c2787 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.093076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee6fedc5-5a9d-474f-a308-5cad604c2787 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:48.223478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ee6fedc5-5a9d-474f-a308-5cad604c2787 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:48.237866 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee6fedc5-5a9d-474f-a308-5cad604c2787 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1210 microversion: 2.1 time: 0.157392 Aug 23 10:37:48.251597 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 177/328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:48 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:48.257771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c476a1d6-f8ef-4b62-be83-e0388237c77a tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d33e1f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.268849 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c476a1d6-f8ef-4b62-be83-e0388237c77a tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1412710026" status: 200 len: 1533 microversion: 2.2 time: 0.014995 Aug 23 10:37:48.269846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 178/329] 10.222.0.78 () {60 vars in 1258 bytes} [Tue Aug 23 10:37:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1412710026 => generated 1533 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:48.274639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e411e276-61f9-4377-8ca2-1a8a66b9c3af tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.275758 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:48.275758 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:48.283529 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e411e276-61f9-4377-8ca2-1a8a66b9c3af tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e411e276-61f9-4377-8ca2-1a8a66b9c3af tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:37:48.286602 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: exception: Aggregate -1 could not be found. Aug 23 10:37:48.287826 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '-1'} Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.288492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 23 10:37:48.289593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.292190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e411e276-61f9-4377-8ca2-1a8a66b9c3af tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:48.293455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e411e276-61f9-4377-8ca2-1a8a66b9c3af tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022443 Aug 23 10:37:48.294683 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 179/330] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:37:48 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:48.301851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ffa53a0-74dc-4068-bf8d-5b1c5f9afd94 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d2f9430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.306951 n-d-847009-13 devstack@n-api.service[128859]: WARNING oslo_db.sqlalchemy.utils [None req-8ffa53a0-74dc-4068-bf8d-5b1c5f9afd94 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 10:37:48.312629 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ffa53a0-74dc-4068-bf8d-5b1c5f9afd94 tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.016726 Aug 23 10:37:48.313594 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 180/331] 10.222.0.78 () {60 vars in 1177 bytes} [Tue Aug 23 10:37:48 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:48.319131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9be13ed9-da7f-4a61-953e-aee3ef6bd421 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.320209 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:48.320209 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:48.321356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9be13ed9-da7f-4a61-953e-aee3ef6bd421 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd316e568117248668174e1c37def9e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3399592444c1cb1f1e953e8d7e346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9be13ed9-da7f-4a61-953e-aee3ef6bd421 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Request method failure captured: Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Kqk81JnXHO4mXD20DJYPPZib1v6mgIOAqzXg-JburRiZNxzhZwcLmLLHm6ai_WrM6gjU48R059-30tvSo72Hdh1PjHXfqnsYYThuzRMQJSouQ344XPZ52yJKRUH4xedc83vNOcmgHdQP-mmIdJKUu6yh92ZNh1qoOYOmBVSqCJFU Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:48.323259 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dee3399592444c1cb1f1e953e8d7e346", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}] Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d316e568117248668174e1c37def9e90 Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 23 10:37:48.324481 n-d-847009-13 devstack@n-api.service[128859]: action_args: {} Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:48.325179 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 23 10:37:48.326172 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.328367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9be13ed9-da7f-4a61-953e-aee3ef6bd421 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:48.329497 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9be13ed9-da7f-4a61-953e-aee3ef6bd421 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.014208 Aug 23 10:37:48.332135 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 181/332] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:37:48 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:48.339934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c60afdf1-19d4-4f20-b38d-678cbf5d0e2f tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] Calling method '.version_select at 0x7fdc9d3d3b80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.414014 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c60afdf1-19d4-4f20-b38d-678cbf5d0e2f tempest-KeyPairsV22TestJSON-2023117972 tempest-KeyPairsV22TestJSON-2023117972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412710026" status: 204 len: 0 microversion: 2.2 time: 0.080175 Aug 23 10:37:48.420457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 182/333] 10.222.0.78 () {60 vars in 1261 bytes} [Tue Aug 23 10:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412710026 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:37:48.427486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-12ca20fd-42af-4804-b9b2-c39d677a9eed tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-88004866"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:48.431324 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:48.431324 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:48.432712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-12ca20fd-42af-4804-b9b2-c39d677a9eed tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid 2f7143c9-0e28-4913-a9e1-ec8a4fb143b2 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:48.491784 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-12ca20fd-42af-4804-b9b2-c39d677a9eed tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069863 Aug 23 10:37:48.492436 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 183/334] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:48.505601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-284540e9-2ddf-4d0e-916e-e41060375708 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:48.508702 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:48.508702 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:48.518993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284540e9-2ddf-4d0e-916e-e41060375708 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:48.520497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284540e9-2ddf-4d0e-916e-e41060375708 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:48.521061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284540e9-2ddf-4d0e-916e-e41060375708 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:48.530916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b7a13e0-fb22-4057-bfe0-e03582c84c6f tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.462087 Aug 23 10:37:48.532026 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 152/335] 10.222.0.78 () {58 vars in 1191 bytes} [Tue Aug 23 10:37:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:48.549404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e15c9e50-e252-40d6-82e4-9cbb0690951a tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] Calling method '.version_select at 0x7fdc9d375040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:48.759045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-284540e9-2ddf-4d0e-916e-e41060375708 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.258602 Aug 23 10:37:48.759742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 184/336] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 10:37:48 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:48.781651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d462807-432e-4ed5-b1ad-4a4767e3f8f3 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:48.787941 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:48.787941 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:37:48.790223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d462807-432e-4ed5-b1ad-4a4767e3f8f3 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd316e568117248668174e1c37def9e90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee3399592444c1cb1f1e953e8d7e346', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d462807-432e-4ed5-b1ad-4a4767e3f8f3 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Request method failure captured: Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 43 Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Kqk81JnXHO4mXD20DJYPPZib1v6mgIOAqzXg-JburRiZNxzhZwcLmLLHm6ai_WrM6gjU48R059-30tvSo72Hdh1PjHXfqnsYYThuzRMQJSouQ344XPZ52yJKRUH4xedc83vNOcmgHdQP-mmIdJKUu6yh92ZNh1qoOYOmBVSqCJFU Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:37:48.811933 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dee3399592444c1cb1f1e953e8d7e346", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dee3399592444c1cb1f1e953e8d7e346"}]}] Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: dee3399592444c1cb1f1e953e8d7e346 Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-35317976 Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d316e568117248668174e1c37def9e90 Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-35317976-project Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: {"remove_host": {"host": "n-h1-847009-13"}} Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:37:48.813593 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-847009-13'}}} Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:48.815045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 23 10:37:48.816309 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:37:48.829809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d462807-432e-4ed5-b1ad-4a4767e3f8f3 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:48.834045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d462807-432e-4ed5-b1ad-4a4767e3f8f3 tempest-AggregatesAdminNegativeTestJSON-35317976 tempest-AggregatesAdminNegativeTestJSON-35317976-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.063676 Aug 23 10:37:48.839437 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 185/337] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 10:37:48 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:37:48.864666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35eb202e-b924-4dcc-84fa-4990f94f6217 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:48.929310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:48.931918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35eb202e-b924-4dcc-84fa-4990f94f6217 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:48.934732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35eb202e-b924-4dcc-84fa-4990f94f6217 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:48.935427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35eb202e-b924-4dcc-84fa-4990f94f6217 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:49.052724 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e15c9e50-e252-40d6-82e4-9cbb0690951a tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/36796c69-b9ca-470a-b290-121935a00362" status: 202 len: 0 microversion: 2.1 time: 0.509370 Aug 23 10:37:49.053699 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 153/338] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:37:48 2022] DELETE /compute/v2.1/os-security-groups/36796c69-b9ca-470a-b290-121935a00362 => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:49.059559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:49.064594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:49.102305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:49.105320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:49.105807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:49.109573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:49.115034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:49.116134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:49.271367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35eb202e-b924-4dcc-84fa-4990f94f6217 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 226 microversion: 2.1 time: 0.424156 Aug 23 10:37:49.279088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 186/339] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 10:37:48 2022] POST /compute/v2.1/os-aggregates/17/action => generated 226 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:49.291254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f567951f-1e0b-4e89-8ca8-5fa7493189fd tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] Calling method '.version_select at 0x7fdc9d2ea670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:49.529109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:49.550706 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c603d879-0223-4a73-98de-febf8c261467 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.493799 Aug 23 10:37:49.552773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 154/340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:49 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:49.563301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:49.567035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:49.578058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:49.578825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:49.579380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:49.580410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:49.581636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:49.582516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:49.779457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:49.790190 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eaece95e-1449-4bd6-a2f8-686e4ddfb818 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1262 microversion: 2.1 time: 0.236015 Aug 23 10:37:49.801552 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 155/341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:49 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1262 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:49.806946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3bba50e3-a884-47d8-ac96-628469c112a7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:49.808125 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:49.808125 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:49.875327 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3bba50e3-a884-47d8-ac96-628469c112a7 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.071897 Aug 23 10:37:49.876461 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 156/342] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:49 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:49.894534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c68c4083-924d-419d-8037-65a5cc872576 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1687614936"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:49.902833 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:49.902833 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:49.907187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.aggregate [None req-c68c4083-924d-419d-8037-65a5cc872576 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Generated uuid 533457b5-f450-4975-a08f-8f63629fcff2 for aggregate {{(pid=128860) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 10:37:49.965655 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c68c4083-924d-419d-8037-65a5cc872576 tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079743 Aug 23 10:37:49.966526 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 157/343] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 10:37:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:49.992929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:50.002749 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:50.002749 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:50.019716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f567951f-1e0b-4e89-8ca8-5fa7493189fd tempest-SecurityGroupsTestAdminJSON-518015649 tempest-SecurityGroupsTestAdminJSON-518015649-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/25ad5fff-d95c-4d93-b73b-3e354f987ca6" status: 202 len: 0 microversion: 2.1 time: 0.737458 Aug 23 10:37:50.021262 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 187/344] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:37:49 2022] DELETE /compute/v2.1/os-security-groups/25ad5fff-d95c-4d93-b73b-3e354f987ca6 => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:50.028137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:50.034874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddf36738-b725-4d10-b415-b8b5c1c85343 tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] Calling method '.version_select at 0x7fdc9d2f98b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:50.035080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:50.035452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:50.053555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:50.054066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:50.054511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:50.082845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.compute.aggregates [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 23 10:37:50.086100 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Request method failure captured: Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 42 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3PETeePaGfhrCUJ6vlApupZZMACK_O9ahKscso7QGB_pjl2TGSkID6wIs1mj3Mq2V6J9EH8nPYUpgqGQeZ05tc4rx0ZnN9I_PYv_bcmbxDkjBQpQaY_pZ5l63RU00N_4dG2Y8RQaJbHbalfZi1dM1-bHSRYBy6fmAYkROV4dH2gss Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:37:50.088534 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/934efb431fea4175893b38e2771b3634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_934efb431fea4175893b38e2771b3634", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/934efb431fea4175893b38e2771b3634"}]}] Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 934efb431fea4175893b38e2771b3634 Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-200128100 Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 90565daae94e4eedad3e70e63ef71d05 Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: {"remove_host": {"host": "nonexist_host"}} Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:37:50.090048 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 23 10:37:50.090786 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 23 10:37:50.091874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.092989 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:37:50.094109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:37:50.094109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:37:50.094109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:37:50.094109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:37:50.094109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 23 10:37:50.094109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:37:50.096162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:37:50.097345 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54cf0ec0-7801-403a-a2ca-1cea4aa3bd7a tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.120872 Aug 23 10:37:50.098139 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 158/345] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 10:37:49 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:37:50.106940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-856f39e7-56ff-469f-9dc7-71c25deb564e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:50.107956 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:50.107956 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:50.140230 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-856f39e7-56ff-469f-9dc7-71c25deb564e tempest-AggregatesAdminNegativeTestJSON-200128100 tempest-AggregatesAdminNegativeTestJSON-200128100-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.036626 Aug 23 10:37:50.141262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 159/346] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:37:50 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 10:37:50.572771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:50.574052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:50.593086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:50.593900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:50.597555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:50.598556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:50.599028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:50.599635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:50.852574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:50.871289 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2ee9211-621a-4d4b-988d-b5e237c3045f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.294465 Aug 23 10:37:50.882517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 160/347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:50 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:50.897735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:50.898430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:50.910406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:50.911130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:50.911718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:50.912584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:50.913219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:50.913796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:51.037384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:51.047039 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-691c57d3-4854-450e-9883-d16811759ccb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1268 microversion: 2.1 time: 0.163346 Aug 23 10:37:51.061345 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 161/348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:50 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:51.358073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddf36738-b725-4d10-b415-b8b5c1c85343 tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/bf0864c1-3a19-44e2-8c61-374e54a07dcc" status: 202 len: 0 microversion: 2.1 time: 1.330919 Aug 23 10:37:51.359612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 188/349] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:37:50 2022] DELETE /compute/v2.1/os-security-groups/bf0864c1-3a19-44e2-8c61-374e54a07dcc => generated 0 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:37:51.368450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07125376-55ee-488d-a530-947f4e67f14c tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] Calling method '.version_select at 0x7fdc9d2f9280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:51.728247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:51.730707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:51.731204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:51.731811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:51.732728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:51.738334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:51.738807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:51.796347 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa71ed5d-a662-46cd-ae33-dfc49d1335b8 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.691102 Aug 23 10:37:51.798328 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 162/350] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Aug 23 10:37:51 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:37:51.827443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:51.828661 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:37:51.828661 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:37:51.837467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:51.838053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:51.838508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:51.839418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:51.841794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:51.842339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:51.888305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3cf8377-7a45-4225-9708-434bb6744cc3 tempest-AZAdminV2TestJSON-1978688448 tempest-AZAdminV2TestJSON-1978688448-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.071274 Aug 23 10:37:51.890389 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 163/351] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 10:37:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:51.896390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:51.896977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:51.904493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:51.905327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:51.905913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:51.906790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:51.908446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:51.909099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:52.101763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:52.113524 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2dcacd9c-cde4-4465-aae4-9bbeaba5e150 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.221946 Aug 23 10:37:52.128103 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 164/352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:51 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:52.133195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:52.134157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:52.143940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:52.144716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:52.145423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:52.146368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:52.147033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:52.147464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:52.242304 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07125376-55ee-488d-a530-947f4e67f14c tempest-SecurityGroupsTestAdminJSON-1271882202 tempest-SecurityGroupsTestAdminJSON-1271882202-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/fc644c27-03c5-40d1-9331-d69bc77e4353" status: 202 len: 0 microversion: 2.1 time: 0.877995 Aug 23 10:37:52.248195 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 189/353] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:37:51 2022] DELETE /compute/v2.1/os-security-groups/fc644c27-03c5-40d1-9331-d69bc77e4353 => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:37:52.280943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:52.289435 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86385a09-f443-4338-8aca-0db91409a2f4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1268 microversion: 2.1 time: 0.160022 Aug 23 10:37:52.290026 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 165/354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:52 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:53.135932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:53.136668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:53.145157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:53.149414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:53.149874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:53.150639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:53.151099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:53.151530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:53.310791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:53.311425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:53.324312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:53.324830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:53.325519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:53.326400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:53.327894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:53.329411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:53.395574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:53.417045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0fd190c7-fb28-4c22-9ef9-6bb562b5d8df tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.286077 Aug 23 10:37:53.421048 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 190/355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:53 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:53.961006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:53.971362 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f81d37c-4865-48b4-95ff-a81edcee0b9e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.664265 Aug 23 10:37:53.988523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 166/356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:53 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:54.440225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:54.441261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:54.454016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:54.456250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:54.456952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:54.458721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:54.459621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:54.462185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:54.995105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:54.995819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:55.014098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:55.018835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:55.019532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:55.023147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:55.023691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:55.024153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:55.095846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:55.112089 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d918d59f-04b3-430c-953d-f8f4a8bc2550 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.675159 Aug 23 10:37:55.126061 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 191/357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:54 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:55.241505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a8677eb8-dc6c-4a33-8443-bc0f1e2e4113 req-19ce8a97-a5ce-4147-a3fc-267105617024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "918f1dd3-6cf0-4039-955b-30877b478575", "tag": "f280a4a9-1cc8-4c58-8789-f1ed450d48bc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:55.267943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a8677eb8-dc6c-4a33-8443-bc0f1e2e4113 req-19ce8a97-a5ce-4147-a3fc-267105617024 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:55.270469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a8677eb8-dc6c-4a33-8443-bc0f1e2e4113 req-19ce8a97-a5ce-4147-a3fc-267105617024 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:55.271192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a8677eb8-dc6c-4a33-8443-bc0f1e2e4113 req-19ce8a97-a5ce-4147-a3fc-267105617024 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:55.290286 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a8677eb8-dc6c-4a33-8443-bc0f1e2e4113 req-19ce8a97-a5ce-4147-a3fc-267105617024 service nova] Creating event network-changed:f280a4a9-1cc8-4c58-8789-f1ed450d48bc for instance 918f1dd3-6cf0-4039-955b-30877b478575 on n-h1-847009-13 Aug 23 10:37:55.299609 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a8677eb8-dc6c-4a33-8443-bc0f1e2e4113 req-19ce8a97-a5ce-4147-a3fc-267105617024 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065481 Aug 23 10:37:55.301261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 192/358] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:37:55.462560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:55.480561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f14302c-e2fd-4155-8c4c-3282b8ea719f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.491045 Aug 23 10:37:55.495955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 167/359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:54 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:56.136583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:56.137308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:56.149657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:56.150165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:56.151795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:56.154182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:56.154657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:56.156508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:56.505609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:56.506242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:56.518913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:56.520313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:56.521871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:56.525191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:56.526023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:56.526648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:56.997108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:57.002664 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c944f3b5-a2b1-4e04-9e7a-51ba1e2aa421 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.870712 Aug 23 10:37:57.009128 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 193/360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:56 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:57.190218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:57.207316 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2566d382-7008-4bc2-bbe0-5fa5af72f292 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.708187 Aug 23 10:37:57.207912 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 168/361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:56 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:57.724219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:57.987913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-390366986", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:37:58.035321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:58.036658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:58.039774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=14 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:58.047033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:58.058010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:58.058538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:58.059301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:58.059770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:58.060203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:58.128003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:37:58.230331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=31 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:37:58.479471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:58.492260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9da91615-2c40-4a3a-a18d-33f62e95f0d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.463226 Aug 23 10:37:58.493054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 169/362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:58 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:58.498598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:58.499462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:58.518994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:58.521461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:58.522109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:58.523149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:58.525308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:58.526071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:58.654231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:37:58.654657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:37:58.655129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:37:58.655537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:37:58.655941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:37:58.682803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:58.683315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:58.683754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:58.686338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:58.687078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:58.692066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:58.772428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Getting quotas for project 8ab17592d8444fe58c447209f2246b83. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:37:58.789729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Getting quotas for user cbbc20b50547490db82a6d73412a617c and project 8ab17592d8444fe58c447209f2246b83. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:37:58.822446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:37:58.828457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:37:58.973289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-383cba46-958f-4863-a543-a2f2ceb08083 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.252349 Aug 23 10:37:58.987782 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 194/363] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:37:58.999775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11bf554a-c324-45a3-981d-37e86bb2a54c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:59.005742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11bf554a-c324-45a3-981d-37e86bb2a54c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:59.167110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:59.179201 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ebbfdcd-3fce-4c39-a41d-ff5a725bad88 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.684168 Aug 23 10:37:59.181049 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 170/364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:58 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:37:59.322817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-11bf554a-c324-45a3-981d-37e86bb2a54c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:37:59.350841 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11bf554a-c324-45a3-981d-37e86bb2a54c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1219 microversion: 2.1 time: 0.352664 Aug 23 10:37:59.352857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 195/365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:58 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1219 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:37:59.521022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:37:59.521709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:37:59.534673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:59.536384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:59.537246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:37:59.539828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:37:59.541556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:37:59.543184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:00.200467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:00.202175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:00.218208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:00.218716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:00.219159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:00.219883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:00.220939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:00.221377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:00.244578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:00.259675 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3e646e4-9fb4-4999-ae32-fd32315090ce tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.743878 Aug 23 10:38:00.263866 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 171/366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:37:59 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:00.382178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:00.382988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:00.394156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:00.398620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:00.399992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:00.401113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:00.403833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:00.404833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:00.469680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:00.603072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:00.616408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfa32fd3-96d6-4429-b52d-b46d21e64845 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1215 microversion: 2.1 time: 0.240605 Aug 23 10:38:00.618368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 172/367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:00 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:00.749161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:00.761337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f531db2-61d1-4ff5-bb66-266d5b6b588d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.565111 Aug 23 10:38:00.768362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 196/368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:00 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:01.233391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4987bdc0-d12a-44d7-8448-623f77c21093 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1280872016", "id": 1663153668, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:01.247479 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:01.247479 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:01.289746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.290961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:01.298575 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4987bdc0-d12a-44d7-8448-623f77c21093 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.328926 Aug 23 10:38:01.299464 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 173/369] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:00 2022] POST /compute/v2.1/flavors => generated 430 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:01.320141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:01.322213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:01.324343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:01.327949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:01.331795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:01.332441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c4331dd-98cb-469e-b48e-cfef24d85fa5 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.333191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:01.334318 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:01.334318 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:01.384032 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c4331dd-98cb-469e-b48e-cfef24d85fa5 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1663153668" status: 202 len: 0 microversion: 2.1 time: 0.067673 Aug 23 10:38:01.385121 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 174/370] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:01 2022] DELETE /compute/v2.1/flavors/1663153668 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:01.393731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-575bc231-3c2f-491b-bed1-921c2aa38765 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.421739 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-575bc231-3c2f-491b-bed1-921c2aa38765 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.032469 Aug 23 10:38:01.422779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 175/371] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:01 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:01.445750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2662e76f-a93d-49c8-beda-b44869bde97c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-866161115", "id": 1381497779, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:01.481442 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2662e76f-a93d-49c8-beda-b44869bde97c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.039535 Aug 23 10:38:01.488584 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 176/372] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:01 2022] POST /compute/v2.1/flavors => generated 416 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:01.494410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29800114-bdb8-4932-83a8-7f5608104108 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.518985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29800114-bdb8-4932-83a8-7f5608104108 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.028271 Aug 23 10:38:01.519960 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 177/373] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:01 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:01.539361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9db9c64-85b2-46dc-9030-85b2a20bffd2 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.565412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9db9c64-85b2-46dc-9030-85b2a20bffd2 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1381497779" status: 202 len: 0 microversion: 2.1 time: 0.029980 Aug 23 10:38:01.566105 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 178/374] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:01 2022] DELETE /compute/v2.1/flavors/1381497779 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:38:01.574120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c88aa997-b4c6-4e03-bc8e-be46b83536b5 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.600641 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c88aa997-b4c6-4e03-bc8e-be46b83536b5 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.029946 Aug 23 10:38:01.601633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 179/375] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:01 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:01.622167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e244d05-f635-4fd1-9285-b21b458a1033 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-918078493", "id": 1970517280, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:01.657521 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e244d05-f635-4fd1-9285-b21b458a1033 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.039210 Aug 23 10:38:01.659378 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 180/376] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:01 2022] POST /compute/v2.1/flavors => generated 428 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:38:01.676676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.677599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:01.683943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:01.684443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:01.688005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:01.689488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:01.690184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:01.690816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:01.838006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:01.860327 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54710fd6-95ca-44f1-a5ca-a53e3e6968e8 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1277 microversion: 2.1 time: 0.198733 Aug 23 10:38:01.862332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 181/377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:01 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:01.870581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-994b7f3f-50b1-4677-b912-f3de90536738 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.871603 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:01.871603 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:01.903186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:01.916660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=13,nova_api:INSERT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:01.943536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-994b7f3f-50b1-4677-b912-f3de90536738 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1970517280" status: 202 len: 0 microversion: 2.1 time: 0.072477 Aug 23 10:38:01.944355 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 182/378] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:01 2022] DELETE /compute/v2.1/flavors/1970517280 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:01.975113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:01.975865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:01.996665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:01.997514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:02.002037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:02.003577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:02.004076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:02.004519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:02.187006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:02.210829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6bfc8869-7516-447f-88fa-7906a46f6eae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.925135 Aug 23 10:38:02.211677 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 197/379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:01 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:02.226848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-523b0a2e-11c7-4ce3-b495-e10f268741ca tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.304922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-523b0a2e-11c7-4ce3-b495-e10f268741ca tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.091571 Aug 23 10:38:02.305865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 198/380] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:02 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:02.332210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14d77bb5-1e6c-47f8-af80-302b329fe359 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-784531291", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:02.336217 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:02.336217 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:02.373284 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14d77bb5-1e6c-47f8-af80-302b329fe359 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.046804 Aug 23 10:38:02.374583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 199/381] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:02 2022] POST /compute/v2.1/flavors => generated 506 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:38:02.390531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a0bca85b-4728-4def-a9f4-3dccb09c96c7 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.391621 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:02.391621 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:02.413810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a0bca85b-4728-4def-a9f4-3dccb09c96c7 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/dcee4350-1c90-4a1c-8446-395d245f38bf" status: 202 len: 0 microversion: 2.1 time: 0.029265 Aug 23 10:38:02.415323 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 200/382] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:38:02 2022] DELETE /compute/v2.1/flavors/dcee4350-1c90-4a1c-8446-395d245f38bf => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:02.429360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3d987b5-c0fe-452f-a1e6-f79e0e438265 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.455340 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3d987b5-c0fe-452f-a1e6-f79e0e438265 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.034211 Aug 23 10:38:02.457538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 201/383] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:02 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:02.481635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae50c75e-3e2d-4274-a8c0-6ee4f32b8ed3 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1382955273", "id": "8b3bfea6-089c-4c32-b3b3-04c79dd5a3bb", "os-flavor-access:is_public": "True"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:02.506102 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae50c75e-3e2d-4274-a8c0-6ee4f32b8ed3 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.028758 Aug 23 10:38:02.507110 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 202/384] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:02 2022] POST /compute/v2.1/flavors => generated 507 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:02.524695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9f6d1aa-6b2a-4d4c-8ac3-f30f86c50aeb tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.566517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9f6d1aa-6b2a-4d4c-8ac3-f30f86c50aeb tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/8b3bfea6-089c-4c32-b3b3-04c79dd5a3bb" status: 202 len: 0 microversion: 2.1 time: 0.051313 Aug 23 10:38:02.570571 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 203/385] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:38:02 2022] DELETE /compute/v2.1/flavors/8b3bfea6-089c-4c32-b3b3-04c79dd5a3bb => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:38:02.582816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf27f7da-47d7-49d3-b7ae-1fcfeb40af95 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.627200 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf27f7da-47d7-49d3-b7ae-1fcfeb40af95 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.055157 Aug 23 10:38:02.646613 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 204/386] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:02 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:02.664946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f7c52f1-e0bc-43d0-9dbb-a3c6dc9f224e tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1423963595", "id": 1686085997, "os-flavor-access:is_public": "True"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:02.689873 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f7c52f1-e0bc-43d0-9dbb-a3c6dc9f224e tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.035973 Aug 23 10:38:02.698945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 205/387] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:02 2022] POST /compute/v2.1/flavors => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:38:02.709565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b4d176ef-8d09-4ff8-922f-ce884f763e0c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.732061 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b4d176ef-8d09-4ff8-922f-ce884f763e0c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1686085997" status: 200 len: 414 microversion: 2.1 time: 0.031681 Aug 23 10:38:02.737390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 206/388] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:38:02 2022] GET /compute/v2.1/flavors/1686085997 => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:02.765758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:02.779738 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da7ba14d-4c14-4cf1-bc11-a7039d7a1f87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.832632 Aug 23 10:38:02.780457 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 183/389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:01 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:02.885731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:02.886983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:02.900659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:02.901132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:02.911310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:02.913856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:02.914351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:02.914791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:03.124775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ab1aa0ff-e248-45f6-ab62-8d6a951ddaa8 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.169809 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ab1aa0ff-e248-45f6-ab62-8d6a951ddaa8 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.424220 Aug 23 10:38:03.171077 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 207/390] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:02 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:03.197488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b9c6dee-da14-4cc7-b61b-58eb71d870fa tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.253672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8b9c6dee-da14-4cc7-b61b-58eb71d870fa tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1686085997" status: 202 len: 0 microversion: 2.1 time: 0.066512 Aug 23 10:38:03.258317 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 208/391] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:03 2022] DELETE /compute/v2.1/flavors/1686085997 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:03.264405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.269118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:03.285632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:03.303746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:03.304311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:03.305373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:03.306507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:03.308150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:03.318026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:03.328268 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35a21939-0c0c-4960-bc61-e60996b55283 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1277 microversion: 2.1 time: 0.446594 Aug 23 10:38:03.331183 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 184/392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:02 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1277 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:03.344362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7239172-b2de-4ceb-bfa9-d49e66d36a34 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.431125 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7239172-b2de-4ceb-bfa9-d49e66d36a34 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.095673 Aug 23 10:38:03.433376 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 185/393] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:03 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:03.482319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-668c0356-7155-4d3f-b82c-4c685b67c239 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-797144671", "id": 1871296065, "os-flavor-access:is_public": "False"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:03.490135 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:03.490135 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:03.549513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-668c0356-7155-4d3f-b82c-4c685b67c239 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.088396 Aug 23 10:38:03.557819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 186/394] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:03 2022] POST /compute/v2.1/flavors => generated 429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:03.589816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4d7e7b2-0865-4cfd-a556-f1c53392c0e6 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "1871296065"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:03.638419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f4d7e7b2-0865-4cfd-a556-f1c53392c0e6 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] HTTP exception thrown: Flavor 1871296065 could not be found. Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4d7e7b2-0865-4cfd-a556-f1c53392c0e6 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] Request method failure captured: Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 107 Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4Hd1DAIIB8J5DJcRBihOrr5ZrCRtf7PDNmg1-5pYeohpfe_QIhRxuVVRjRtHspU42yRvT91uisqbmWfphBaBEKrot188RaXNk9r1fO5pHyyF4CDBownzyTqUufYkW1xeTgxdJgO6gAEfUCt6rjmITZu_CdfaBXkOzBeV6II0mkREE Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5eba3aea869447cb98d8b1affcf0d20a Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FlavorsAdminTestJSON-854695504 Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:38:03.641627 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5eba3aea869447cb98d8b1affcf0d20a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5eba3aea869447cb98d8b1affcf0d20a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5eba3aea869447cb98d8b1affcf0d20a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5eba3aea869447cb98d8b1affcf0d20a"}]}] Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FlavorsAdminTestJSON-854695504 Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5eba3aea869447cb98d8b1affcf0d20a Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-854695504 Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FlavorsAdminTestJSON-854695504-project Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 5eae640187b2466ea7133776ff7f7680 Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FlavorsAdminTestJSON-854695504-project Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "test", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "1871296065"}} Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:38:03.643399 n-d-847009-13 devstack@n-api.service[128860]: exception: Flavor 1871296065 could not be found. Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '1871296065'}}} Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1871296065 could not be found. Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:03.644334 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1871296065 could not be found. Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:03.645585 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1871296065 could not be found. Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4d7e7b2-0865-4cfd-a556-f1c53392c0e6 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] Returning 400 to user: Flavor 1871296065 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4d7e7b2-0865-4cfd-a556-f1c53392c0e6 tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.076362 Aug 23 10:38:03.647888 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 187/395] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:03 2022] POST /compute/v2.1/servers => generated 81 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:38:03.666104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43a60d88-f11b-4514-a23e-ce891dff1b75 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.674060 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:03.674060 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:03.740023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43a60d88-f11b-4514-a23e-ce891dff1b75 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1871296065" status: 202 len: 0 microversion: 2.1 time: 0.086342 Aug 23 10:38:03.742196 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 188/396] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:03 2022] DELETE /compute/v2.1/flavors/1871296065 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:03.752201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44923441-7040-49c4-861b-eae0c5d8d039 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.837713 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44923441-7040-49c4-861b-eae0c5d8d039 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.091324 Aug 23 10:38:03.839026 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 189/397] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:03 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:03.867706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:03.869655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:03.889111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:03.890003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:03.891355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:03.895412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:03.896674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:03.899047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:04.074988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:04.088123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ef53255-1ed2-4d72-b0cf-fc90c8a80167 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.828284 Aug 23 10:38:04.089341 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 209/398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:03 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:04.100840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b021e839-6ea8-4137-933a-7862356a4199 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-917588645", "id": 1960457357, "os-flavor-access:is_public": "False"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:04.117385 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:04.117385 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:04.152874 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b021e839-6ea8-4137-933a-7862356a4199 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.059976 Aug 23 10:38:04.154224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 210/399] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:04 2022] POST /compute/v2.1/flavors => generated 414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:04.337238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:04.348632 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83f84b6e-99ab-42c7-80ab-4d03d5256eec tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.507091 Aug 23 10:38:04.351123 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 190/400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:03 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:04.381224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ecf0d23-b257-4f71-848d-72b78ee56ce9 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-725394045", "id": 344633076, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:04.392634 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:04.392634 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:04.438876 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ecf0d23-b257-4f71-848d-72b78ee56ce9 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.081521 Aug 23 10:38:04.441431 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 191/401] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:04 2022] POST /compute/v2.1/flavors => generated 410 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:04.464911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:04.465808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:04.490074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:04.490690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:04.491793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:04.492614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:04.493213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:04.493724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:04.645644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c82f56b6-997f-495c-9632-acbafffdce8d tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2eaa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-659761010", "description": "tempest-description-317388554"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:04.828462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:04.841496 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c9be284-e467-4d42-b08d-98e2908562c1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.397570 Aug 23 10:38:04.854484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 192/402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:04 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:04.859316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e06a90e-23c1-427d-84ca-9ff8c6eb9bd6 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:04.925752 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e06a90e-23c1-427d-84ca-9ff8c6eb9bd6 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.056901 Aug 23 10:38:04.926454 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 193/403] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Aug 23 10:38:04 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:04.948770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5fdd47f-fbb3-452c-bcd7-b91124dc229c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:04.989765 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5fdd47f-fbb3-452c-bcd7-b91124dc229c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.047841 Aug 23 10:38:04.994690 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 194/404] 10.222.0.78 () {58 vars in 1177 bytes} [Tue Aug 23 10:38:04 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:05.015113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f91d8b9b-bf37-49b9-aa4e-303e0741991b tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:05.051637 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f91d8b9b-bf37-49b9-aa4e-303e0741991b tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.040812 Aug 23 10:38:05.055219 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 195/405] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Aug 23 10:38:05 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:05.068776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99de7f01-dcd6-4f71-bb8c-d6f2fb324010 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:05.097899 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99de7f01-dcd6-4f71-bb8c-d6f2fb324010 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.034034 Aug 23 10:38:05.103861 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 196/406] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Aug 23 10:38:05 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:05.117869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:05.120373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:05.142122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:05.145322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:05.145916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:05.146781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:05.152389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:05.153024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:05.666855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c82f56b6-997f-495c-9632-acbafffdce8d tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.511339 Aug 23 10:38:05.667544 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 211/407] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:04 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:05.681727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7108743-b421-4c03-93d9-13cccfea7446 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:05.744341 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7108743-b421-4c03-93d9-13cccfea7446 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6213 microversion: 2.1 time: 0.075501 Aug 23 10:38:05.745355 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 212/408] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Aug 23 10:38:05 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:05.751936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:05.752902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:05.761558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:05.769927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:05.771091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:05.772280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:05.773001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:05.774104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:05.815826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:06.114355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:06.129095 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c97a64b-38d2-4dac-9bf8-6e7e62dd0fc2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 1.021128 Aug 23 10:38:06.130284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 197/409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:05 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:06.137040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d21cdb70-23e2-47a0-955b-a9777f4fac9a tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d5d7dc0>, body: {"security_group_rule": {"parent_group_id": "f9fd5236-0c5a-4908-868d-6f1fa24399d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:06.314331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:06.328819 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d568c9e7-9142-496d-9a11-db6e541acc4a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.582002 Aug 23 10:38:06.331340 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 213/410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:05 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:06.339013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88f3f766-baa2-4b7f-a7a4-511cbb47252d tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:06.405998 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88f3f766-baa2-4b7f-a7a4-511cbb47252d tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6213 microversion: 2.1 time: 0.073196 Aug 23 10:38:06.413808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 214/411] 10.222.0.78 () {58 vars in 1175 bytes} [Tue Aug 23 10:38:06 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:06.420506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:06.423694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:06.441313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:06.441962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:06.443816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:06.444865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:06.448649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:06.449497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:07.009038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:07.023511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54ed8062-8044-453c-b449-05de7b692af0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.608313 Aug 23 10:38:07.024329 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 215/412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:06 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:07.037414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b4fd516-82fc-4909-ba63-91b64d3229af tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:07.087475 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b4fd516-82fc-4909-ba63-91b64d3229af tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6213 microversion: 2.1 time: 0.061324 Aug 23 10:38:07.088433 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 216/413] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Aug 23 10:38:07 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:07.108864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a9e08ad-834d-455e-af17-5625ba382993 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:07.138292 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a9e08ad-834d-455e-af17-5625ba382993 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6213 microversion: 2.1 time: 0.032989 Aug 23 10:38:07.139158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 217/414] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Aug 23 10:38:07 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6213 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:07.152537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:07.153586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:07.156729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:07.164487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:07.171396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:07.171916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:07.174251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:07.176942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:07.177241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:07.340411 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d21cdb70-23e2-47a0-955b-a9777f4fac9a tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.207990 Aug 23 10:38:07.347485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 198/415] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:38:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:07.365133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ccff8b0-f2b2-425b-9b7b-297071c66810 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:07.368005 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:07.368005 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:07.432167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ccff8b0-f2b2-425b-9b7b-297071c66810 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/344633076" status: 202 len: 0 microversion: 2.1 time: 0.080986 Aug 23 10:38:07.434221 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 199/416] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:38:07 2022] DELETE /compute/v2.1/flavors/344633076 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:07.446180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e8bcc99c-d9e2-45a5-910f-c041d4dc31ce req-a81e1e8f-50b5-4f67-b684-ce00e7a29052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4067c38d-f38f-45c1-9c64-1115be24afc6", "tag": "ad657a1a-28a7-4ee9-9600-463cb01b3458"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:07.474933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e8bcc99c-d9e2-45a5-910f-c041d4dc31ce req-a81e1e8f-50b5-4f67-b684-ce00e7a29052 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:07.477462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e8bcc99c-d9e2-45a5-910f-c041d4dc31ce req-a81e1e8f-50b5-4f67-b684-ce00e7a29052 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:07.479703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e8bcc99c-d9e2-45a5-910f-c041d4dc31ce req-a81e1e8f-50b5-4f67-b684-ce00e7a29052 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:07.513188 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e8bcc99c-d9e2-45a5-910f-c041d4dc31ce req-a81e1e8f-50b5-4f67-b684-ce00e7a29052 service nova] Creating event network-changed:ad657a1a-28a7-4ee9-9600-463cb01b3458 for instance 4067c38d-f38f-45c1-9c64-1115be24afc6 on n-h2-847009-13 Aug 23 10:38:07.553726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e8bcc99c-d9e2-45a5-910f-c041d4dc31ce req-a81e1e8f-50b5-4f67-b684-ce00e7a29052 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108287 Aug 23 10:38:07.556260 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 200/417] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:07.572770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:07.579147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:07.597220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:07.599011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:07.599864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:07.601340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:07.601969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:07.603812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:07.684451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:07.694711 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de172e02-49a2-415d-aad4-3706ea4eb01b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1476 microversion: 2.1 time: 0.545532 Aug 23 10:38:07.696640 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 218/418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:07 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1476 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:07.729984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b802c385-2fb3-4718-a7f5-571111d2f596 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2f9550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-691784898", "description": "tempest-description-1328882887"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:08.269371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:08.281892 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc45a5e9-7327-4ed6-a59c-7d8f615fdb22 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.721923 Aug 23 10:38:08.285002 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 201/419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:07 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:08.290258 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b802c385-2fb3-4718-a7f5-571111d2f596 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.591785 Aug 23 10:38:08.291274 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 219/420] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:08.296386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:08.301486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:08.305257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76757696-bc12-4b7b-8985-e618e57bdbff tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:08.316858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:08.318335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:08.318928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:08.321011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:08.323064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:08.323917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:08.349148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76757696-bc12-4b7b-8985-e618e57bdbff tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.061222 Aug 23 10:38:08.362034 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 202/421] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:08 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:08.380445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e04be786-72af-4e37-b447-d6e2f31ddf27 req-8af6d994-05ad-42c2-b175-9babaa995087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918f1dd3-6cf0-4039-955b-30877b478575", "name": "network-vif-plugged", "status": "completed", "tag": "f280a4a9-1cc8-4c58-8789-f1ed450d48bc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:08.399462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e04be786-72af-4e37-b447-d6e2f31ddf27 req-8af6d994-05ad-42c2-b175-9babaa995087 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:08.400775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e04be786-72af-4e37-b447-d6e2f31ddf27 req-8af6d994-05ad-42c2-b175-9babaa995087 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:08.401409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e04be786-72af-4e37-b447-d6e2f31ddf27 req-8af6d994-05ad-42c2-b175-9babaa995087 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:08.427536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e04be786-72af-4e37-b447-d6e2f31ddf27 req-8af6d994-05ad-42c2-b175-9babaa995087 service nova] Creating event network-vif-plugged:f280a4a9-1cc8-4c58-8789-f1ed450d48bc for instance 918f1dd3-6cf0-4039-955b-30877b478575 on n-h1-847009-13 Aug 23 10:38:08.444772 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e04be786-72af-4e37-b447-d6e2f31ddf27 req-8af6d994-05ad-42c2-b175-9babaa995087 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081082 Aug 23 10:38:08.445917 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 203/422] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:08.451191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c15dfbb3-2e52-4df8-ad93-3fb61a33474f tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d561160>, body: {"security_group_rule": {"parent_group_id": "d33b2f1b-6df3-4591-b2e8-9265cd08025d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:08.718637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:08.814936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:08.827755 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e0d641c-edd3-481f-a6f2-82918be2a0e6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.534797 Aug 23 10:38:08.830631 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 220/423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:08 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:08.840493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e338a3c5-7b83-4ced-bb0d-5dc40648ea1e tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:08.841632 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:08.841632 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:08.877547 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e338a3c5-7b83-4ced-bb0d-5dc40648ea1e tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1960457357" status: 202 len: 0 microversion: 2.1 time: 0.045485 Aug 23 10:38:08.878896 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 221/424] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:08 2022] DELETE /compute/v2.1/flavors/1960457357 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:08.885459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:08.888294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:08.901229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:08.913597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:08.914360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:08.915382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:08.916239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:08.916953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:09.342623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:09.531198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:09.540014 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-583b36ea-8d63-4b58-974f-d101e9852403 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1475 microversion: 2.1 time: 0.659835 Aug 23 10:38:09.541158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 222/425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:08 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1475 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:09.551575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e692022b-1f29-41ef-9755-c324effc465c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:09.590402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e692022b-1f29-41ef-9755-c324effc465c tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.047776 Aug 23 10:38:09.596452 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 223/426] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:09 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:09.601395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:09.602011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:09.618591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:09.619926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:09.620582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:09.621493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:09.622108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:09.622676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:09.945099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:09.948420 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c15dfbb3-2e52-4df8-ad93-3fb61a33474f tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.501122 Aug 23 10:38:09.949083 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 204/427] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:38:08 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:09.962011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d62af241-4eb8-4b02-b6e2-73cd04da1602 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1116728359", "id": 1221680301, "os-flavor-access:is_public": "False"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:09.968360 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:09.968360 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:09.980905 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da089ef5-af3d-423a-b214-03b039267c11 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1310 microversion: 2.1 time: 0.382254 Aug 23 10:38:09.985318 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 224/428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:09 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1310 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:09.994109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:09.995209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:10.003614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:10.005989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:10.006600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:10.007820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:10.009928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:10.010576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:10.013303 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d62af241-4eb8-4b02-b6e2-73cd04da1602 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.063143 Aug 23 10:38:10.014151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 205/429] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:09 2022] POST /compute/v2.1/flavors => generated 415 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:10.028707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9476c273-b306-4269-a15e-90e2458459dd tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2cb1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1728199799", "description": "tempest-description-439986809"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:10.421619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:10.440315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-381df3c3-a9b9-428d-a12a-5a46a5835a94 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.452938 Aug 23 10:38:10.452768 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 225/430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:09 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:10.452768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f256ebd-3af4-437c-9a49-683aa0d936fa tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:10.485370 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f256ebd-3af4-437c-9a49-683aa0d936fa tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.042882 Aug 23 10:38:10.486716 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 226/431] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:10 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:10.492271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e76eb0-da10-435b-ac03-0a014dbd11e5", "name": "network-vif-unplugged", "status": "completed", "tag": "4c1fb94e-059f-43fd-b258-97c51fb0e459"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:10.529005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:10.529503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:10.529944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:10.573233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] Creating event network-vif-unplugged:4c1fb94e-059f-43fd-b258-97c51fb0e459 for instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 on n-h2-847009-13 Aug 23 10:38:10.621687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:38:10.659010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e478735b-0920-4b44-9b29-774fdc8bf688 req-5251e363-81c8-41ac-9599-0f51962243ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171006 Aug 23 10:38:10.660225 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 227/432] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:10.665622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0dd8f3e4-1624-41f1-81fc-d1bf36aef31c tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:10.695023 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0dd8f3e4-1624-41f1-81fc-d1bf36aef31c tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.033311 Aug 23 10:38:10.698019 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 228/433] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:10 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:10.705868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:10.706947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:10.732024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:10.732869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:10.733467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:10.734398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:10.735024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:10.735464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:11.445351 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9476c273-b306-4269-a15e-90e2458459dd tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.428238 Aug 23 10:38:11.447596 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 206/434] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:11.453067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:11.454125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ef3154d-64ac-4136-832a-846f051d6b44 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:11.456395 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:11.456395 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:11.464777 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-940e91bc-7b19-4029-87a1-61c87736d4a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1475 microversion: 2.1 time: 0.765378 Aug 23 10:38:11.465557 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 229/435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:10 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1475 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:11.472255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:11.473497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:11.481204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:11.481866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:11.482461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:11.483497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:11.484508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:11.485222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:11.497965 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ef3154d-64ac-4136-832a-846f051d6b44 tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1221680301" status: 202 len: 0 microversion: 2.1 time: 0.047818 Aug 23 10:38:11.501889 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 207/436] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:38:11 2022] DELETE /compute/v2.1/flavors/1221680301 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:11.521909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-684d4554-43bf-4e4c-a359-cb7b6f695160 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2b14c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-686475552", "description": "tempest-description-420942828"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:11.703041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:11.713438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79a988db-6d1d-4919-a2eb-a74236fc9360 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1493 microversion: 2.1 time: 0.244708 Aug 23 10:38:11.714649 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 230/437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:11 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1493 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:11.735119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:11.737036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:11.744800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:11.748318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:11.749102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:11.750514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:11.752497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:11.753209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:11.986314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:11.995932 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4c1b8d6-7857-4630-86fa-3864d7834fba tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.279653 Aug 23 10:38:11.997959 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 231/438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:11 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:12.004483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-40c591c8-f843-42bc-a908-0d4bf76a998e tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:12.033205 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-40c591c8-f843-42bc-a908-0d4bf76a998e tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.033347 Aug 23 10:38:12.035043 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 232/439] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:11 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:12.495422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:12.496039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:12.510636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:12.511145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:12.511690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:12.512575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:12.513211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:12.513869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:12.736488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4554b70c-a9de-4251-b443-4d7cae553a14 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1646 microversion: 2.1 time: 0.699120 Aug 23 10:38:12.757455 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 233/440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:12 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1646 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:12.771886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fda0e985-5e3f-41a0-9d61-1975df8345af tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1652624819", "id": 55928648, "os-flavor-access:is_public": "True"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:12.775233 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:12.775233 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:12.818422 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fda0e985-5e3f-41a0-9d61-1975df8345af tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.050684 Aug 23 10:38:12.819590 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 234/441] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:12.831007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:12.831870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:12.848470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:12.850157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:12.850615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:12.851350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:12.851817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:12.852246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:13.275161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:13.287558 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-766426e8-a633-4d0e-bbb3-15e8f50a1acc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1475 microversion: 2.1 time: 0.466521 Aug 23 10:38:13.289168 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 235/442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:12 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1475 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:13.316297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:13.318775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:13.331931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:13.332429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:13.332908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:13.336181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:13.340718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:13.342366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:13.572890 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-684d4554-43bf-4e4c-a359-cb7b6f695160 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.067963 Aug 23 10:38:13.573597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 208/443] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:11 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:13.589627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7e30ae9-ba3d-4366-9b24-195a6b3fbebf tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:13.640220 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7e30ae9-ba3d-4366-9b24-195a6b3fbebf tempest-FlavorsAdminTestJSON-854695504 tempest-FlavorsAdminTestJSON-854695504-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6211 microversion: 2.1 time: 0.055581 Aug 23 10:38:13.645527 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 209/444] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:13 2022] GET /compute/v2.1/flavors/detail => generated 6211 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:13.667305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:13.670426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:13.695325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:13.695841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:13.696291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:13.697038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:13.697506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:13.697942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:13.828887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04bf959e-485c-4454-b11c-9b7544f4b4a1 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1646 microversion: 2.1 time: 0.516548 Aug 23 10:38:13.831452 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 236/445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:13 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1646 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:13.845163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e76eb0-da10-435b-ac03-0a014dbd11e5", "tag": "4c1fb94e-059f-43fd-b258-97c51fb0e459"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:13.871106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:13.873833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:13.875573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:13.920868 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] Creating event network-changed:4c1fb94e-059f-43fd-b258-97c51fb0e459 for instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 on n-h2-847009-13 Aug 23 10:38:13.930221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:38:13.948710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7134bdea-c54d-4f33-86e5-5f39ea5079b2 req-5fa5eb02-29cc-46fc-ae09-ef59f33209d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112444 Aug 23 10:38:13.950085 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 237/446] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:13.960700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4efa0fd5-ea63-4a20-b541-b1a21d481096 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2f9160>, body: {"security_group_rule": {"parent_group_id": "c133045b-5bcc-4d1d-bd99-a6f51b464b70", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0ccffb53-870d-4edc-958c-b517c9656343"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:14.250332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:14.273698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4aab6e41-4736-40e3-8fe1-8d6b3a8ed36c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.626626 Aug 23 10:38:14.274203 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 210/447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:13 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:14.278775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53fa8289-610e-423c-9d07-9c4d46d76dbf tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:14.279731 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:14.279731 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:14.332536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53fa8289-610e-423c-9d07-9c4d46d76dbf tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/55928648" status: 202 len: 0 microversion: 2.1 time: 0.057006 Aug 23 10:38:14.333874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 211/448] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 10:38:14 2022] DELETE /compute/v2.1/flavors/55928648 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:14.341120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:14.343959 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:14.343959 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:14.346892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:14.348786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:14.362179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:14.366367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:14.367279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:14.368557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:14.421735 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e600a1f-fef3-436a-a414-f5525eb5ddf8 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.086606 Aug 23 10:38:14.422748 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 212/449] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:38:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:14.429159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:14.430439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:14.453788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:14.455853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:14.456623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:14.457677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:14.459031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:14.459848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:14.803977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:14.839480 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b15be6de-2a34-41c6-832d-8f1491b7a11f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1475 microversion: 2.1 time: 0.408130 Aug 23 10:38:14.840193 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 213/450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:14 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1475 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:14.851188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74abafc4-ce3f-4f74-953a-1cb22e119b3b tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:14.932817 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74abafc4-ce3f-4f74-953a-1cb22e119b3b tempest-FlavorsAdminTestJSON-1675695285 tempest-FlavorsAdminTestJSON-1675695285-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.085132 Aug 23 10:38:14.935254 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 214/451] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:38:14 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:14.941705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-13", "block_migration": true, "disk_over_commit": false}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:14.953527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:14.993055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:14.993562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:14.994008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:14.994729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:14.995182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:14.998913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:15.104193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lazy-loading 'flavor' on Instance uuid 918f1dd3-6cf0-4039-955b-30877b478575 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:15.244055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Going to try to live migrate instance to n-h2-847009-13 {{(pid=128860) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:38:15.558541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4efa0fd5-ea63-4a20-b541-b1a21d481096 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.606918 Aug 23 10:38:15.559732 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 238/452] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:38:13 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:15.567393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:15.568541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:15.587381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:15.589341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:15.591322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:15.592317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:15.593686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:15.596164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:16.357007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:16.366363 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08fcc130-f922-4e30-9875-1e38e228e30f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.805009 Aug 23 10:38:16.383095 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 239/453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:15 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:16.399650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14b23b6c-e42e-4252-8872-eb9ccc94e3d1 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9fe32c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-108974447", "description": "tempest-description-515901119"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:17.410590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14b23b6c-e42e-4252-8872-eb9ccc94e3d1 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.025321 Aug 23 10:38:17.411710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 240/454] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:16 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:17.418029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:17.421301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:17.441829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:17.442563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:17.443016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:17.446848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:17.449491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:17.452922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:18.645069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:18.671242 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6db4ded-ba34-4580-8222-abfadbaf415d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1470 microversion: 2.1 time: 1.258216 Aug 23 10:38:18.688777 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 241/455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:17 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1470 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:18.745103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:18.746716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:18.757345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:18.758627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:18.760421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:18.765633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:18.766439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:18.779801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:18.849501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:19.383196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:19.401184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-191fde2a-f542-42cc-a336-56716adba0e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.712552 Aug 23 10:38:19.416667 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 242/456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:18 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:19.429137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb7e1e0f-cd49-41d0-8ec2-3360494383ad tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d3a1700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1255805730", "description": "tempest-description-255236279"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:20.283372 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb7e1e0f-cd49-41d0-8ec2-3360494383ad tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.864900 Aug 23 10:38:20.284218 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 243/457] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:20.290522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9ac2a415-b24d-4d19-8f87-27e8ba5aa743 req-9764f9bf-1601-487e-ac9b-5cc5f8cb3507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4067c38d-f38f-45c1-9c64-1115be24afc6", "name": "network-vif-plugged", "status": "completed", "tag": "ad657a1a-28a7-4ee9-9600-463cb01b3458"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:20.324843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9ac2a415-b24d-4d19-8f87-27e8ba5aa743 req-9764f9bf-1601-487e-ac9b-5cc5f8cb3507 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:20.328228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9ac2a415-b24d-4d19-8f87-27e8ba5aa743 req-9764f9bf-1601-487e-ac9b-5cc5f8cb3507 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:20.328703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9ac2a415-b24d-4d19-8f87-27e8ba5aa743 req-9764f9bf-1601-487e-ac9b-5cc5f8cb3507 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:20.351575 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0a35d29-b282-4836-9b2f-95503f989e60 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575/action" status: 202 len: 0 microversion: 2.1 time: 5.414106 Aug 23 10:38:20.353252 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 215/458] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:38:14 2022] POST /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575/action => generated 0 bytes in 5416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:20.359176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:20.360101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:20.382320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:20.390603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9ac2a415-b24d-4d19-8f87-27e8ba5aa743 req-9764f9bf-1601-487e-ac9b-5cc5f8cb3507 service nova] Creating event network-vif-plugged:ad657a1a-28a7-4ee9-9600-463cb01b3458 for instance 4067c38d-f38f-45c1-9c64-1115be24afc6 on n-h2-847009-13 Aug 23 10:38:20.392044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:20.394780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:20.396481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:20.400350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:20.402797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:20.410659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9ac2a415-b24d-4d19-8f87-27e8ba5aa743 req-9764f9bf-1601-487e-ac9b-5cc5f8cb3507 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124818 Aug 23 10:38:20.419650 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 244/459] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:20.441297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a62083d-09f4-43f0-8e1e-3e5c96bb20b9 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d293c10>, body: {"security_group_rule": {"parent_group_id": "77658092-38d2-4756-bda8-0a22b94b4ad3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "84bd2031-3d7d-4efd-8a8c-777b290c2cb7"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:20.627961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8663df8-84bf-4e6f-9a3e-b2ac68657949 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5/action" status: 204 len: 0 microversion: 2.1 time: 0.269544 Aug 23 10:38:20.632608 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 216/460] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:38:20 2022] POST /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5/action => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:38:20.648906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:20.655981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:20.676338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:20.678163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:20.680156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:20.683000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:20.683831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:20.685346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:21.506901 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a62083d-09f4-43f0-8e1e-3e5c96bb20b9 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.083956 Aug 23 10:38:21.507892 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 245/461] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:38:20 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:21.513004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:21.514016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:21.535927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:21.541981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:21.544073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:21.550102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:21.550822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:21.551865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:21.948988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:21.954343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:21.956326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:21.961242 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-290d5250-bb78-41fe-96b1-a55fb60f254d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 1.327258 Aug 23 10:38:21.965067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 217/462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:20 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:21.978343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:21.983267 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-303aaa48-55bc-460f-a17a-42bb6ac82666 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.474046 Aug 23 10:38:21.984172 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 246/463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:21 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:22.003184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:22.030937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:22.031877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:22.038012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:22.040287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:22.041303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:22.044484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:22.577930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1946800492", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "7b449e6f-509a-4a8d-a8cd-87fd09ee4594"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:22.638954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:22.671419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] validate_networks() for [('7b449e6f-509a-4a8d-a8cd-87fd09ee4594', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:38:22.680372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ba9d484-11e0-4706-a83e-dde0c63dd74f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1470 microversion: 2.1 time: 0.702605 Aug 23 10:38:22.682927 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 218/464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:21 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1470 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:22.699188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e927dd4a-f335-4ef6-8cc0-bf832850707f tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d686670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:23.158995 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e927dd4a-f335-4ef6-8cc0-bf832850707f tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/84bd2031-3d7d-4efd-8a8c-777b290c2cb7" status: 202 len: 0 microversion: 2.1 time: 0.474838 Aug 23 10:38:23.159640 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 219/465] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:22 2022] DELETE /compute/v2.1/os-security-groups/84bd2031-3d7d-4efd-8a8c-777b290c2cb7 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:23.249141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a3620d2-5c91-4c36-ae0c-9b6e6caafc9e tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-390368702", "id": 466204419, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:23.253025 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:23.253025 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:23.275147 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a3620d2-5c91-4c36-ae0c-9b6e6caafc9e tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.114085 Aug 23 10:38:23.275721 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 220/466] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:38:23 2022] POST /compute/v2.1/flavors => generated 467 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:38:23.492135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:38:23.492554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:38:23.493420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:38:23.493978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:38:23.494570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:38:23.508941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:23.510496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:23.511313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:23.512425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:23.513153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:23.513804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:23.540014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-534392e9-68a1-4ae5-a681-dedf46439f00 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Action: 'create', calling method: .version_select at 0x7fdc9d157a60>, body: {"keypair": {"name": "tempest-keypair-627388710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+I0ZBWDfM+9z6fY0DMxOu/7r+hPfiMD7r18bY4fu1eEM/FSPiRomue0dIS94HnlYEM+PNddvTviRST0m9jnslVDV13HgDUhdWmtdHirAD6R7XDI14bnRl3mq1CyzdMdQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:23.553344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:23.571776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:23.577074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-534392e9-68a1-4ae5-a681-dedf46439f00 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Getting quotas for project 5dfc4e7196d34e709a5a869216864151. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:23.589937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for user 04d5d44e84d5459ab1a59c13bcf69012 and project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:23.594474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-534392e9-68a1-4ae5-a681-dedf46439f00 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Getting quotas for user 92552bd027104cdc879b59446df626ce and project 5dfc4e7196d34e709a5a869216864151. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:23.625328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:38:23.628199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:38:23.662287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-534392e9-68a1-4ae5-a681-dedf46439f00 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.385289 Aug 23 10:38:23.663599 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 221/467] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:38:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:23.668792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:23.670210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:23.683218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:23.685091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:23.696602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:23.700052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:23.700805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:23.702918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:23.749555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c159568d-deeb-48ec-ae00-d3e8208485e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.763764 Aug 23 10:38:23.755967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 247/468] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:38:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:38:23.769076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:23.770423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:23.790375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:23.790884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:23.791360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:23.792083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:23.800095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:23.800606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:24.091629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:24.106469 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16087f88-75e5-4b62-b5ff-7a9c93e8e7e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.441519 Aug 23 10:38:24.109842 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 222/469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:23 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:24.126836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:24.140884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03c8d8e2-a048-48d3-8108-585e91f86788 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1319 microversion: 2.1 time: 0.383310 Aug 23 10:38:24.141631 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 248/470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:23 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:24.149251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d2707c93-9d2c-4ae9-af5f-01dc834281b4 tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:24.153162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88414a15-75c5-4af8-9de5-e2ffecaa2181 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d157040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:24.170310 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:24.170310 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:24.388075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:24.479066 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88414a15-75c5-4af8-9de5-e2ffecaa2181 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/77658092-38d2-4756-bda8-0a22b94b4ad3" status: 200 len: 246 microversion: 2.1 time: 0.366949 Aug 23 10:38:24.497229 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 223/471] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:38:24 2022] GET /compute/v2.1/os-security-groups/77658092-38d2-4756-bda8-0a22b94b4ad3 => generated 246 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:24.503099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:24.504489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:24.512228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:24.513072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:24.513737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:24.514655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:24.515264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:24.515922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:24.598685 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d2707c93-9d2c-4ae9-af5f-01dc834281b4 tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/466204419/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.454144 Aug 23 10:38:24.606656 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 249/472] 10.222.0.78 () {62 vars in 1262 bytes} [Tue Aug 23 10:38:24 2022] POST /compute/v2.1/flavors/466204419/os-extra_specs => generated 62 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:24.620101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-95c8bba1-3422-45a7-9498-6b15f2793363 req-bb60c521-5910-4f8b-9690-db61f9d5cb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e76eb0-da10-435b-ac03-0a014dbd11e5", "name": "network-vif-plugged", "status": "completed", "tag": "4c1fb94e-059f-43fd-b258-97c51fb0e459"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:24.634170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-95c8bba1-3422-45a7-9498-6b15f2793363 req-bb60c521-5910-4f8b-9690-db61f9d5cb81 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:24.635343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-95c8bba1-3422-45a7-9498-6b15f2793363 req-bb60c521-5910-4f8b-9690-db61f9d5cb81 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:24.636130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-95c8bba1-3422-45a7-9498-6b15f2793363 req-bb60c521-5910-4f8b-9690-db61f9d5cb81 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:24.650176 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-95c8bba1-3422-45a7-9498-6b15f2793363 req-bb60c521-5910-4f8b-9690-db61f9d5cb81 service nova] Creating event network-vif-plugged:4c1fb94e-059f-43fd-b258-97c51fb0e459 for instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 on n-h2-847009-13 Aug 23 10:38:24.657465 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-95c8bba1-3422-45a7-9498-6b15f2793363 req-bb60c521-5910-4f8b-9690-db61f9d5cb81 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047401 Aug 23 10:38:24.659168 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 250/473] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:24.669938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5188e08e-b3ba-4852-b964-b1b51414c777 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:24.671044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5188e08e-b3ba-4852-b964-b1b51414c777 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:24.785497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5188e08e-b3ba-4852-b964-b1b51414c777 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:24.807870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5188e08e-b3ba-4852-b964-b1b51414c777 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:24.824073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5188e08e-b3ba-4852-b964-b1b51414c777 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:24.825925 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5188e08e-b3ba-4852-b964-b1b51414c777 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1262 microversion: 2.25 time: 0.161518 Aug 23 10:38:24.828051 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 251/474] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:24 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:24.842096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:24.843487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:24.854018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:24.856467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:24.857609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:24.858732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:24.860775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:24.863879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:24.930224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:38:25.121491 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92766884-ab44-41cf-920d-78ca3cb78340 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 204 len: 0 microversion: 2.1 time: 0.289787 Aug 23 10:38:25.122948 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 252/475] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:38:24 2022] DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:38:25.131713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9705ee8b-49de-4af5-843e-4ad85ca0ba4e tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2eadc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-812262505", "description": "tempest-description-747780731"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:25.319380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:25.328549 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80feddbb-d627-4964-9b5e-7c43dc331c76 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1462 microversion: 2.1 time: 0.830063 Aug 23 10:38:25.329713 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 224/476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:24 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1462 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:25.341041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b749eef7-b6c8-4f7c-b457-d25b0b476ec9 tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:25.342065 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:25.342065 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:25.389529 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b749eef7-b6c8-4f7c-b457-d25b0b476ec9 tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/466204419" status: 202 len: 0 microversion: 2.86 time: 0.052297 Aug 23 10:38:25.390941 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 225/477] 10.222.0.78 () {60 vars in 1199 bytes} [Tue Aug 23 10:38:25 2022] DELETE /compute/v2.1/flavors/466204419 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:38:25.396971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:25.397895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:25.404201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:25.405118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:25.405774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:25.406719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:25.409121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:25.409890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:25.542110 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9705ee8b-49de-4af5-843e-4ad85ca0ba4e tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.417660 Aug 23 10:38:25.543607 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 253/478] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:38:25 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:25.550382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c4db5aa9-bc03-408e-8d96-520f67399ba7 req-88a28aca-7c09-4992-b76c-dae92129ee16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918f1dd3-6cf0-4039-955b-30877b478575", "name": "network-vif-unplugged", "status": "completed", "tag": "f280a4a9-1cc8-4c58-8789-f1ed450d48bc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:25.564553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c4db5aa9-bc03-408e-8d96-520f67399ba7 req-88a28aca-7c09-4992-b76c-dae92129ee16 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:25.565083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c4db5aa9-bc03-408e-8d96-520f67399ba7 req-88a28aca-7c09-4992-b76c-dae92129ee16 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:25.565672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c4db5aa9-bc03-408e-8d96-520f67399ba7 req-88a28aca-7c09-4992-b76c-dae92129ee16 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:25.578220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c4db5aa9-bc03-408e-8d96-520f67399ba7 req-88a28aca-7c09-4992-b76c-dae92129ee16 service nova] Creating event network-vif-unplugged:f280a4a9-1cc8-4c58-8789-f1ed450d48bc for instance 918f1dd3-6cf0-4039-955b-30877b478575 on n-h1-847009-13 Aug 23 10:38:25.583535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c4db5aa9-bc03-408e-8d96-520f67399ba7 req-88a28aca-7c09-4992-b76c-dae92129ee16 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038897 Aug 23 10:38:25.584460 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 254/479] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:25.590201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:25.590917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:25.595182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:25.599796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:25.600973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:25.601755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:25.602640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:25.603273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:25.604084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:25.667105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:25.675907 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4eda980-ca72-4027-9158-a9a4f1e5e912 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.282819 Aug 23 10:38:25.676500 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 226/480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:25 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:25.682094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1160536519", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "672356926", "adminPass": "***", "networks": [{"uuid": "dc514dca-a5e8-47bf-9347-21ed7903c689"}], "security_groups": [{"name": "tempest-securitygroup--1699699424"}], "key_name": "tempest-keypair-1949485104", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:25.818869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] validate_networks() for [('dc514dca-a5e8-47bf-9347-21ed7903c689', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:38:26.003513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:26.017240 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7df58ce8-25d4-42b2-a26c-0a5bcc301132 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1469 microversion: 2.1 time: 0.430874 Aug 23 10:38:26.030599 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 255/481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:25 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1469 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:26.042207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:26.042894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:26.051522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:26.052029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:26.052476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:26.053455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:26.053960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:26.054347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:26.381243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:38:26.381877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:38:26.382690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:38:26.383256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:38:26.383833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:38:26.393501 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dad6809e-ca14-46fe-a295-2e9364e7a045 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1615 microversion: 2.1 time: 0.361660 Aug 23 10:38:26.393890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:26.394359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:26.394803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:26.395531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:26.396222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:26.396932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:26.410313 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 256/482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:26 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1615 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:26.416361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22ee99ea-f302-49ea-a01a-f5b5cf1564af tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:26.424999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Getting quotas for project fb96481a39404b0f91e81ea0183698b9. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:26.432636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Getting quotas for user da8a7b6ac53d4b9cbac1d2ab7f48fc4c and project fb96481a39404b0f91e81ea0183698b9. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:26.452212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:38:26.456325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:38:26.461083 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22ee99ea-f302-49ea-a01a-f5b5cf1564af tempest-FlavorMetadataValidation-410032321 tempest-FlavorMetadataValidation-410032321-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6677 microversion: 2.86 time: 0.049301 Aug 23 10:38:26.464879 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 257/483] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:38:26 2022] GET /compute/v2.1/flavors/detail => generated 6677 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:26.473000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-479bd9c7-114c-49f5-80dc-7dedce7de7ff tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2935e0>, body: {"security_group_rule": {"parent_group_id": "cbec1ecb-974a-46fa-bd3e-a942a07ecf0d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:26.597730 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95011c5c-86cf-4d27-9d82-d8adc0ee9ad0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.920088 Aug 23 10:38:26.604128 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 227/484] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:38:26.606016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:26.606868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:26.620063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:26.620885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:26.629370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:26.630304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:26.630965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:26.632205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:26.779939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:26.797011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:26.799730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:26.801256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-faaa71c6-2358-4d8d-893e-864202858af4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1266 microversion: 2.25 time: 0.200894 Aug 23 10:38:26.802608 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 228/485] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:26 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:26.997548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-479bd9c7-114c-49f5-80dc-7dedce7de7ff tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.531276 Aug 23 10:38:26.999178 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 258/486] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:38:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:27.006300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-099fa5aa-9d26-4d7d-b1f1-73a10cb53454 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '.version_select at 0x7fdc9d293310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:27.013027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099fa5aa-9d26-4d7d-b1f1-73a10cb53454 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:27.013772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099fa5aa-9d26-4d7d-b1f1-73a10cb53454 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:27.014373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099fa5aa-9d26-4d7d-b1f1-73a10cb53454 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:27.029342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:27.030049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:27.041091 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-099fa5aa-9d26-4d7d-b1f1-73a10cb53454 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.040058 Aug 23 10:38:27.053192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 259/487] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:38:26 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:27.053192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b799229-bd20-4f35-abbd-792e9a70c17e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:27.053192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b799229-bd20-4f35-abbd-792e9a70c17e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:27.067305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:27.068043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:27.069027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:27.070083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:27.070715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:27.071307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:27.146667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:38:27.173828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b799229-bd20-4f35-abbd-792e9a70c17e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:27.195456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b799229-bd20-4f35-abbd-792e9a70c17e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1263 microversion: 2.1 time: 0.151064 Aug 23 10:38:27.196653 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 260/488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:27 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:27.209587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:27.212816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:27.227694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:27.231538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:27.233579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:27.236330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:27.238361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:27.239498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:27.323198 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94a38b9b-194c-472f-adad-7800ede4331f tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 204 len: 0 microversion: 2.1 time: 0.518955 Aug 23 10:38:27.327115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 229/489] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:38:26 2022] DELETE /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:38:27.329889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-4070617", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "ab02a44d-a7f4-4f61-a71c-9ea478b0f99f"}], "security_groups": [{"name": "tempest-securitygroup--342455562"}], "key_name": "tempest-keypair-627388710", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:27.456345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] validate_networks() for [('ab02a44d-a7f4-4f61-a71c-9ea478b0f99f', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:38:27.507204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:27.517359 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3bf92a60-453f-463b-bb5a-b497a41be144 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.318123 Aug 23 10:38:27.517945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 261/490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:27 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:27.523224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08ccf3af-9a7a-4db9-8129-ffb291fb7234 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Action: 'create', calling method: .version_select at 0x7fdc9d2ea5e0>, body: {"security_group_rule": {"parent_group_id": "cbec1ecb-974a-46fa-bd3e-a942a07ecf0d", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:27.792369 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08ccf3af-9a7a-4db9-8129-ffb291fb7234 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.273182 Aug 23 10:38:27.793086 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 262/491] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:38:27 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:27.798220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1327088499", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:27.873041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:38:28.096430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:38:28.098972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:38:28.099438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:38:28.099855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:38:28.100267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:38:28.114482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.114976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.115411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.116272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.116931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.117536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.136868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:28.143306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for user 9574ff57c9474f7fb5ec4567bc06d531 and project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:28.157427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:38:28.161152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:38:28.212652 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1bfe7833-309f-4f5f-9efc-ec654a0039d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.418185 Aug 23 10:38:28.214294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 263/492] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:38:28.219496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.220957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:28.229759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.229989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.230656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.231380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.231834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.232509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.269055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:38:28.269488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:38:28.269994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:38:28.270416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:38:28.271083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:38:28.289388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.292043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.293330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.297061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.297779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.300658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.340366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Getting quotas for project 5dfc4e7196d34e709a5a869216864151. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:28.350394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Getting quotas for user 92552bd027104cdc879b59446df626ce and project 5dfc4e7196d34e709a5a869216864151. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:28.372118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:38:28.374974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:38:28.401675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.411736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d0d8588-e74c-4705-a981-cbc2e3240570 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1475 microversion: 2.1 time: 0.195849 Aug 23 10:38:28.416989 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 264/493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1475 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:28.425717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-92060c43-8001-4890-9348-c49cd22dffbf req-8c5ae977-856c-45ad-ba0f-daa06c870ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "918f1dd3-6cf0-4039-955b-30877b478575", "tag": "f280a4a9-1cc8-4c58-8789-f1ed450d48bc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:28.438602 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2d5d21d-0cc1-41e1-8b79-39d489990d43 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.113539 Aug 23 10:38:28.440059 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 230/494] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:38:28.444573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88b219fa-86cb-40ce-9660-f59e98aa851d tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d153040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.449025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-92060c43-8001-4890-9348-c49cd22dffbf req-8c5ae977-856c-45ad-ba0f-daa06c870ea7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.457735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-92060c43-8001-4890-9348-c49cd22dffbf req-8c5ae977-856c-45ad-ba0f-daa06c870ea7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.458357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-92060c43-8001-4890-9348-c49cd22dffbf req-8c5ae977-856c-45ad-ba0f-daa06c870ea7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.477025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-92060c43-8001-4890-9348-c49cd22dffbf req-8c5ae977-856c-45ad-ba0f-daa06c870ea7 service nova] Creating event network-changed:f280a4a9-1cc8-4c58-8789-f1ed450d48bc for instance 918f1dd3-6cf0-4039-955b-30877b478575 on n-h1-847009-13 Aug 23 10:38:28.482301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-92060c43-8001-4890-9348-c49cd22dffbf req-8c5ae977-856c-45ad-ba0f-daa06c870ea7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063957 Aug 23 10:38:28.483418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 265/495] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:28.489685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.490460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:28.497986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.498845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.499509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.500728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.502159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.502809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.518047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88b219fa-86cb-40ce-9660-f59e98aa851d tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/cbec1ecb-974a-46fa-bd3e-a942a07ecf0d" status: 200 len: 663 microversion: 2.1 time: 0.076831 Aug 23 10:38:28.518634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 231/496] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/os-security-groups/cbec1ecb-974a-46fa-bd3e-a942a07ecf0d => generated 663 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:28.534190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.534190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:28.551186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.551984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.552653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.553783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.554602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.555498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.631024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.655165 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8fb1a68a-5972-4e81-a6d2-7bcac7fca6a1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1267 microversion: 2.1 time: 0.134212 Aug 23 10:38:28.658542 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 232/497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:28.680294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.695946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.698235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51a64d65-ac47-4c06-81f6-f8f6bfb1830a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.699048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51a64d65-ac47-4c06-81f6-f8f6bfb1830a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:28.702276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.706087 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77b4d710-eff8-4a94-b2c3-22ede70d2996 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1314 microversion: 2.25 time: 0.218874 Aug 23 10:38:28.706694 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 266/498] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:28.718545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1a4223e8-054f-454c-ab9d-fa0bc5034a21 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.719360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a4223e8-054f-454c-ab9d-fa0bc5034a21 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:28.780477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51a64d65-ac47-4c06-81f6-f8f6bfb1830a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.796921 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51a64d65-ac47-4c06-81f6-f8f6bfb1830a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1213 microversion: 2.1 time: 0.136205 Aug 23 10:38:28.809940 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 233/499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:28.809940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68397f93-9842-4afa-81b5-e8a4f822dc4d tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d1570d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.874146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1a4223e8-054f-454c-ab9d-fa0bc5034a21 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:28.899313 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1a4223e8-054f-454c-ab9d-fa0bc5034a21 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1238 microversion: 2.1 time: 0.188218 Aug 23 10:38:28.899846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 267/500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1238 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:28.913393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:28.918238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:28.928290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.929797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.930519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:28.931241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:28.931712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:28.932141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.179538 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68397f93-9842-4afa-81b5-e8a4f822dc4d tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/b86fabdb-7d4e-4ed6-a5e8-daf0405395e0" status: 202 len: 0 microversion: 2.1 time: 0.380422 Aug 23 10:38:29.180333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 234/501] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Aug 23 10:38:28 2022] DELETE /compute/v2.1/os-security-group-rules/b86fabdb-7d4e-4ed6-a5e8-daf0405395e0 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:29.191459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86559817-0b70-4f22-9a9f-6e4d5ce82b5c tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d0c2af0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.223703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:29.233483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8d3e82f-bac1-485f-a14d-81919d1449f1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.329735 Aug 23 10:38:29.234155 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 268/502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:28 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:29.435411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.435981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:29.444138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.444637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.445857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.447472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.450239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.460524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.479971 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86559817-0b70-4f22-9a9f-6e4d5ce82b5c tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cbec1ecb-974a-46fa-bd3e-a942a07ecf0d" status: 202 len: 0 microversion: 2.1 time: 0.294848 Aug 23 10:38:29.480567 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 235/503] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:29 2022] DELETE /compute/v2.1/os-security-groups/cbec1ecb-974a-46fa-bd3e-a942a07ecf0d => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:29.489223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d3753a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.521828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:38:29.522987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Neutron security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:38:29.524048 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] HTTP exception thrown: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.524048 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Request method failure captured: Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-security-groups/84bd2031-3d7d-4efd-8a8c-777b290c2cb7 HTTP/1.1 Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4LrMD6HsAwiCyJG9AzIiJdZ2SQ_cSZd0gDjtyw5xgb18d9o_9WFkuXI7xinUDxdqK352hl3JRfNl-_OlyjNXpOikpvyvJv2o27ySAqLqBA0UaCoz7x_k1GLdcamAl7cpYsSZfpNRLwhgj9QlreEIZuWaK80-bwNTrUOseP8upm7rs Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c63d2b2693ef41e4aff117dde36de45d Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1631886828 Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:38:29.547282 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c63d2b2693ef41e4aff117dde36de45d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c63d2b2693ef41e4aff117dde36de45d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c63d2b2693ef41e4aff117dde36de45d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c63d2b2693ef41e4aff117dde36de45d"}]}] Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1631886828 Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c63d2b2693ef41e4aff117dde36de45d Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1631886828 Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupRulesTestJSON-1631886828-project Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 5fd4f5f50f40401b90d9ec09a4525355 Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1631886828-project Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] Aug 23 10:38:29.549625 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '84bd2031-3d7d-4efd-8a8c-777b290c2cb7'} Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:38:29.550577 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:38:29.553103 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.555073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Returning 404 to user: Security group 84bd2031-3d7d-4efd-8a8c-777b290c2cb7 does not exist Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-a529fbf4-3f3a-4ef4-a1c6-35a40da2fda1'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2f29949-6fab-44e2-bd05-9197e6d60435 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/84bd2031-3d7d-4efd-8a8c-777b290c2cb7" status: 404 len: 194 microversion: 2.1 time: 0.067440 Aug 23 10:38:29.556949 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 236/504] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:29 2022] DELETE /compute/v2.1/os-security-groups/84bd2031-3d7d-4efd-8a8c-777b290c2cb7 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:38:29.565363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df445161-dda2-40e8-a445-6fb47a1ed789 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d3753a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.657992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:29.666955 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6561e094-78ec-4639-b4b6-fbc70993dcd9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1475 microversion: 2.1 time: 0.235953 Aug 23 10:38:29.667541 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 269/505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:29 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1475 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:29.679511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.683909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:29.696355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.697053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.698032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.700221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.700720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.701194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.786467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:29.797390 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f52f2b70-da4d-49e6-bebe-dcf378637e1a tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1259 microversion: 2.1 time: 0.121107 Aug 23 10:38:29.799609 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 270/506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:29 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1259 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:29.818357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.819197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:29.830826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.831534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.831981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.832760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.833232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.833663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.836098 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df445161-dda2-40e8-a445-6fb47a1ed789 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/77658092-38d2-4756-bda8-0a22b94b4ad3" status: 202 len: 0 microversion: 2.1 time: 0.276278 Aug 23 10:38:29.836918 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 237/507] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:29 2022] DELETE /compute/v2.1/os-security-groups/77658092-38d2-4756-bda8-0a22b94b4ad3 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:29.846478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:29.847540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:29.859575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.862587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.863757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.867031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:29.869837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:29.874224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:29.988337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:30.009505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:30.011534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:30.012935 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-856991ec-5796-48c7-9d6c-beb74d2dc222 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1314 microversion: 2.25 time: 0.212178 Aug 23 10:38:30.014224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 271/508] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:29 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:30.020106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a183eef8-55de-40d7-b1ec-22d9d5dff411 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d293af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:30.132590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:30.158190 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-babe927d-8671-4e54-892b-49f553bdb945 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1217 microversion: 2.1 time: 0.320061 Aug 23 10:38:30.158794 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 238/509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:29 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1217 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:30.184518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:30.192901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:30.209550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:30.210044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:30.210482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:30.211204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:30.211704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:30.221492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:30.432289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a183eef8-55de-40d7-b1ec-22d9d5dff411 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/0ccffb53-870d-4edc-958c-b517c9656343" status: 202 len: 0 microversion: 2.1 time: 0.416735 Aug 23 10:38:30.432892 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 272/510] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:30 2022] DELETE /compute/v2.1/os-security-groups/0ccffb53-870d-4edc-958c-b517c9656343 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:30.439063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:30.439942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:30.451177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:30.451680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:30.452134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:30.456001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:30.459122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:30.459757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:30.487613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:30.499253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:30.517475 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d902be5-7b38-47e2-934f-1763a3be6fbe tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1290 microversion: 2.1 time: 0.354445 Aug 23 10:38:30.522415 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 239/511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:30 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1290 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:30.532631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0729aba-9dc5-4716-b61d-d18cf2a8d20b tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9cf6df70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:30.729663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:30.740473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b5474a5-3468-4154-bd30-fdea42cb68db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.306353 Aug 23 10:38:30.742793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 273/512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:30 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:30.760614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:30.761395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:30.771268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:30.773679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:30.774234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:30.775157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:30.775716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:30.776515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:30.990434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.002201 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-831613c9-3761-4f0f-919d-9570679303e0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1475 microversion: 2.1 time: 0.256330 Aug 23 10:38:31.003410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 274/513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:30 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:31.008468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:31.009318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:31.015613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.018532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.019158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.020054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.020810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.021388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.115550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.136419 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26ffd45e-5a13-4dc6-94a7-33686e39610f tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1315 microversion: 2.1 time: 0.131056 Aug 23 10:38:31.154138 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 275/514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:31 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:31.165978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:31.170510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:31.188835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.192098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.192827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.194505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.196468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.197211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.356699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.368990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.371849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.373348 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-398f028d-8c2c-4637-ae8b-af2c98254d32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1314 microversion: 2.25 time: 0.216381 Aug 23 10:38:31.373987 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 276/515] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:31 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:31.380360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:31.381368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:31.388010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.388876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.389532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.390457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.391217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.392044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.517719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0729aba-9dc5-4716-b61d-d18cf2a8d20b tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c133045b-5bcc-4d1d-bd99-a6f51b464b70" status: 202 len: 0 microversion: 2.1 time: 0.993392 Aug 23 10:38:31.518305 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 240/516] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:30 2022] DELETE /compute/v2.1/os-security-groups/c133045b-5bcc-4d1d-bd99-a6f51b464b70 => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:31.526689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67d058e4-5148-4d6c-a58c-d0f5c8e7991f tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d023c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:31.684835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.697657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1bac80b-621e-41a8-b88e-200677720fc3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1265 microversion: 2.1 time: 0.321878 Aug 23 10:38:31.698700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 277/517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:31 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:31.709864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:31.713068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:31.724605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.725866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.726773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.727629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.728860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.729303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.808606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:31.818969 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-940e17fe-85e6-428d-a6fa-78f491f3a9a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1290 microversion: 2.1 time: 0.118984 Aug 23 10:38:31.819798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 278/518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:31 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:31.834821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:31.835926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:31.849821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.849821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.850302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:31.851271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:31.851920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:31.856386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.288020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:32.299509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46d519d7-5f37-4dcd-a75f-ac6590f8d76f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.473728 Aug 23 10:38:32.301904 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 279/519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:31 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:32.396443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67d058e4-5148-4d6c-a58c-d0f5c8e7991f tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d33b2f1b-6df3-4591-b2e8-9265cd08025d" status: 202 len: 0 microversion: 2.1 time: 0.873790 Aug 23 10:38:32.397985 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 241/520] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:31 2022] DELETE /compute/v2.1/os-security-groups/d33b2f1b-6df3-4591-b2e8-9265cd08025d => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:38:32.404238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:32.405411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:32.418892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.421388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.422370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.426331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.427084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.427743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.528466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Calling method '.version_select at 0x7fdc9d23dee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:32.530328 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:32.530328 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:32.532785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.536224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.539675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.574690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.575617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.576293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.595080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.596163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.596532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.613803 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d58f021-c74f-4d60-8271-f4670acd0f16 tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.310553 Aug 23 10:38:32.614325 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 280/521] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:38:32 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:38:32.628993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ea190bc1-87cf-44b5-a6d3-9a398f7e30b3 req-347d28df-9123-45c5-89a6-102765db9023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4067c38d-f38f-45c1-9c64-1115be24afc6", "name": "network-vif-deleted", "tag": "ad657a1a-28a7-4ee9-9600-463cb01b3458"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:32.653708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ea190bc1-87cf-44b5-a6d3-9a398f7e30b3 req-347d28df-9123-45c5-89a6-102765db9023 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.654483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ea190bc1-87cf-44b5-a6d3-9a398f7e30b3 req-347d28df-9123-45c5-89a6-102765db9023 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.656451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ea190bc1-87cf-44b5-a6d3-9a398f7e30b3 req-347d28df-9123-45c5-89a6-102765db9023 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.688101 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ea190bc1-87cf-44b5-a6d3-9a398f7e30b3 req-347d28df-9123-45c5-89a6-102765db9023 service nova] Creating event network-vif-deleted:ad657a1a-28a7-4ee9-9600-463cb01b3458 for instance 4067c38d-f38f-45c1-9c64-1115be24afc6 on n-h2-847009-13 Aug 23 10:38:32.701205 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ea190bc1-87cf-44b5-a6d3-9a398f7e30b3 req-347d28df-9123-45c5-89a6-102765db9023 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080490 Aug 23 10:38:32.702473 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 281/522] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:32.713074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:32.714405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:32.728669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.729488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.731015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.732891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:32.733528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:32.736966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:32.956983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:32.967534 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f605c3f-4003-447f-93ba-84a402cab5b1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1304 microversion: 2.1 time: 0.568254 Aug 23 10:38:32.968124 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 242/523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:32 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1304 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:32.974320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:32.990039 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c5e5727-b264-4367-b4d1-a95e96d83428 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1323 microversion: 2.1 time: 0.285561 Aug 23 10:38:33.000761 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 282/524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:32 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:33.002651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22338d59-3bd0-4ab6-a6da-e7d95a475db9 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] Calling method '.version_select at 0x7fdc9d33e670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:33.006119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:33.006119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:33.020296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.020851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.021861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.023277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.023750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.024193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.177399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:33.194066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:33.195577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:33.197510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3bfbfd1-1470-4329-8cf1-8fa61bf66e6c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1320 microversion: 2.25 time: 0.211034 Aug 23 10:38:33.198792 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 243/525] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:32 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:33.212451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Calling method '.version_select at 0x7fdc9cfa5c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:33.213405 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:33.213405 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:33.214523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.215020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.215466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.245426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.245921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.246364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.269669 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d86e775d-e2aa-4fca-9610-f41dff4b079e tempest-HypervisorAdminV228Test-2025435928 tempest-HypervisorAdminV228Test-2025435928-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.069506 Aug 23 10:38:33.271009 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 244/526] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:38:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:38:33.275867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:33.279124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:33.306676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.307617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.308265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.309208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.309871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.310491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.681823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:33.696830 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e0689a1-94c5-4d42-be37-6045b66ae9b2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1265 microversion: 2.1 time: 0.422424 Aug 23 10:38:33.697732 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 245/527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:33 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1265 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:33.710382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:33.712048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:33.731038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.733718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.735736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:33.736758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:33.739102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:33.740616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.002028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:34.017691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-826c96d6-cc43-45e2-b7ba-41a27c3c297a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1308 microversion: 2.1 time: 0.318635 Aug 23 10:38:34.025900 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 246/528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:33 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:34.047418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:34.050317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:34.062266 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22338d59-3bd0-4ab6-a6da-e7d95a475db9 tempest-SecurityGroupRulesTestJSON-1631886828 tempest-SecurityGroupRulesTestJSON-1631886828-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f9fd5236-0c5a-4908-868d-6f1fa24399d4" status: 202 len: 0 microversion: 2.1 time: 1.070518 Aug 23 10:38:34.072210 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 283/529] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:38:32 2022] DELETE /compute/v2.1/os-security-groups/f9fd5236-0c5a-4908-868d-6f1fa24399d4 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:34.077817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.079933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.083892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.086700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:34.087448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:34.088081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.088828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.089430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.113750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.115890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.129525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.130284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.131115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.131715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.210424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:34.303277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.303945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.304504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.305128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lazy-loading 'fault' on Instance uuid 4067c38d-f38f-45c1-9c64-1115be24afc6 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:34.595754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:34.608520 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e97bcaa3-9483-499a-8323-0afa14680de3 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1309 microversion: 2.1 time: 0.535079 Aug 23 10:38:34.611492 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 284/530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:34 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:34.622642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:34.623496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:34.639521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.641126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.642375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.648306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.649004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.649600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.853011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:34.867900 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd498fbd-fead-49e2-a7c9-c54d9af2dac0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1321 microversion: 2.1 time: 0.255060 Aug 23 10:38:34.870367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 285/531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:34 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:34.893378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:34.894043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:34.913076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.913646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.914017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:34.914744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:34.915212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:34.915640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.456476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.465531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6eb99c3-6eca-4780-8521-c71f998f5196 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 1.427145 Aug 23 10:38:35.483217 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 247/532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:34 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:35.489494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:35.490050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:35.496643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.497406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.497852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.498571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.499038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.499463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.609251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.619867 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5feb7f54-8103-4d13-bcf3-35dd25491942 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1271 microversion: 2.1 time: 0.135220 Aug 23 10:38:35.621040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 248/533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:35 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:35.629095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f96bfc45-86cd-40ce-b511-f073e38bbb90 req-dfa81077-58ac-4e66-9418-d53a99bf56e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210a1dcd-feea-4748-8039-313b88b28f45", "name": "network-vif-deleted", "tag": "06045ad4-6b39-4a6f-a33e-e34eed046ca4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:35.649363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f96bfc45-86cd-40ce-b511-f073e38bbb90 req-dfa81077-58ac-4e66-9418-d53a99bf56e6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.650205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f96bfc45-86cd-40ce-b511-f073e38bbb90 req-dfa81077-58ac-4e66-9418-d53a99bf56e6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.650855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f96bfc45-86cd-40ce-b511-f073e38bbb90 req-dfa81077-58ac-4e66-9418-d53a99bf56e6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.650977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.660111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.661634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.662739 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68f39d85-8c53-496f-8a73-6aec88c73419 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.780541 Aug 23 10:38:35.667150 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f96bfc45-86cd-40ce-b511-f073e38bbb90 req-dfa81077-58ac-4e66-9418-d53a99bf56e6 service nova] Creating event network-vif-deleted:06045ad4-6b39-4a6f-a33e-e34eed046ca4 for instance 210a1dcd-feea-4748-8039-313b88b28f45 on n-h2-847009-13 Aug 23 10:38:35.675781 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f96bfc45-86cd-40ce-b511-f073e38bbb90 req-dfa81077-58ac-4e66-9418-d53a99bf56e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052915 Aug 23 10:38:35.676956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 249/534] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:35.677479 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 286/535] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:34 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:35.682372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:35.683177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:35.684379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:35.685543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:35.694594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.695722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.696339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.697955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.700572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.702355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.702664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.703082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.703518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.704847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.705523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.706103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.764589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.769528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.770210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.770825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lazy-loading 'fault' on Instance uuid 4067c38d-f38f-45c1-9c64-1115be24afc6 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:35.912354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.930435 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85c8e214-72d0-49c8-9240-37a7b2478cf6 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 200 len: 1309 microversion: 2.1 time: 0.251399 Aug 23 10:38:35.931215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 287/536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:35 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:35.937342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:35.939749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:35.948224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.950083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.950831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.952159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:35.952871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:35.953457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:35.976227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:35.987250 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53163308-ec55-41f4-875b-0ea9544d3838 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1296 microversion: 2.1 time: 0.307291 Aug 23 10:38:35.992852 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 250/537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:35 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1296 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:36.147098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:36.160902 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-074a4ca5-fa5c-4234-b81b-ea59e6abfca1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1321 microversion: 2.1 time: 0.228002 Aug 23 10:38:36.178781 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 288/538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:35 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:36.489206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:36.490458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:36.497760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.498807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.499957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.501526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.502156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.502904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.580549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a67b79a6-4f2b-4734-b5ab-eb8fac66da38 req-094f474b-155b-4e23-bf05-b6993dce2c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7fb487-32c8-4c54-96b8-1a587f153aa2", "tag": "c17c9163-c59a-4086-b714-1fd30e316965"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:36.607334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a67b79a6-4f2b-4734-b5ab-eb8fac66da38 req-094f474b-155b-4e23-bf05-b6993dce2c2e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.608722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a67b79a6-4f2b-4734-b5ab-eb8fac66da38 req-094f474b-155b-4e23-bf05-b6993dce2c2e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.613844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a67b79a6-4f2b-4734-b5ab-eb8fac66da38 req-094f474b-155b-4e23-bf05-b6993dce2c2e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.641874 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a67b79a6-4f2b-4734-b5ab-eb8fac66da38 req-094f474b-155b-4e23-bf05-b6993dce2c2e service nova] Creating event network-changed:c17c9163-c59a-4086-b714-1fd30e316965 for instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 on n-h2-847009-13 Aug 23 10:38:36.652850 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a67b79a6-4f2b-4734-b5ab-eb8fac66da38 req-094f474b-155b-4e23-bf05-b6993dce2c2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084902 Aug 23 10:38:36.654842 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 289/539] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:38:36.660343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:36.661367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:36.669281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.670664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.671268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.673466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.674361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.674979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.789796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:36.805156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a7d79295-f660-46db-bab5-ceb8e4409b52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1271 microversion: 2.1 time: 0.148431 Aug 23 10:38:36.806225 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 290/540] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:36 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:36.811811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:36.812803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:36.820578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.821168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.821650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.822509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:36.823207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:36.823641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:36.844044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:37.046665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.057032 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de160b8b-24bd-4205-a695-3f5d24035f95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.573025 Aug 23 10:38:37.057778 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 251/541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:36 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:37.076027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:37.077292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:37.081113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:37.086830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.087645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.088194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.089157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.089748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.090356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.109240 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] HTTP exception thrown: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Request method failure captured: Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 HTTP/1.1 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4ET9pFY98ApFWht-TUUgYkS4hojheZbYT65HgKyJ5TEkTOCmplttalO-yUyP6MFXFWeRl_Jw1qcfblAi5dK6nxbZSERtENeY62w3rM_jgQjIRZFFIK3dWtYtLFw0eiTofGTNRAYGSXwGM220sviHAhGbqjJdB8RXFnDSJ8Ab7om80 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:38:37.113334 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ab17592d8444fe58c447209f2246b83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}] Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: cbbc20b50547490db82a6d73412a617c Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:38:37.115046 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '4067c38d-f38f-45c1-9c64-1115be24afc6'} Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:38:37.115985 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:38:37.117502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:37.120203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Returning 404 to user: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:38:37.120203 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c1bf2332-2b6e-44fb-bcc5-8fb3040e3708 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 404 len: 111 microversion: 2.1 time: 0.060484 Aug 23 10:38:37.133974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 252/542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:37 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:38:37.145965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:37.147146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:37.156174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.157795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.158645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.163272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.164800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.165589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.225836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.243858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.245406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.246751 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-758894ea-8341-4ff2-b4ab-958c4bd048db tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.439585 Aug 23 10:38:37.247785 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 291/543] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:36 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:37.253092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:37.253911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:37.260190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.260947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.261543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.262413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.263017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.263589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.437844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.450844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d97b5a9c-f11e-4edb-8059-e5afafcae663 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1296 microversion: 2.1 time: 0.314531 Aug 23 10:38:37.457609 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 253/544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:37 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1296 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:37.475311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2096727784", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:37.544187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:38:37.693100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.703769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-acdd81b8-f025-4ceb-abac-47efe8439089 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.454721 Aug 23 10:38:37.716986 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 292/545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:37 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:37.827511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:37.828119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:37.841582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.842074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.842693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.843559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:37.844170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:37.845280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:37.977364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:37.997194 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2edca1c-715e-445d-829c-6287dd4af60b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1271 microversion: 2.1 time: 0.173177 Aug 23 10:38:37.998559 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 293/546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:37 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:38.086262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:38.088618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:38.099457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.099963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.100617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.101541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.101998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.102422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.128254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:38.318869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:38.444638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:38.457070 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7b05f4b-3ee7-497a-9d6d-5fe544e586cb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.379954 Aug 23 10:38:38.468773 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 294/547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:38 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:38.468773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:38.468773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:38.470995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.471731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.472242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.473085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.473731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.474175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.568761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:38:38.569265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:38:38.574978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:38:38.574978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:38:38.574978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:38:38.586975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.587493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.587982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.588770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.589257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.589683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.612290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Getting quotas for project 8ab17592d8444fe58c447209f2246b83. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:38.620440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Getting quotas for user cbbc20b50547490db82a6d73412a617c and project 8ab17592d8444fe58c447209f2246b83. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:38.636768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:38:38.640280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:38:38.684106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:38.694978 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27a446da-6f9c-4860-ab00-ff3dc06a92fa tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236017 Aug 23 10:38:38.695633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 254/548] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:38:38.701057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:38.701894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:38.710175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.710678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.711167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.711474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:38.711937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.712362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.712783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.745586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:38.751614 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-416fdc6f-586c-47e6-ab79-c0ea6f155b32 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.287433 Aug 23 10:38:38.754135 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 295/549] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:38 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:38.774313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-660b0864-78ea-4e32-bb26-5d6c04d15c28 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:38.774931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-660b0864-78ea-4e32-bb26-5d6c04d15c28 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:38.838859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-660b0864-78ea-4e32-bb26-5d6c04d15c28 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:38.847472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-660b0864-78ea-4e32-bb26-5d6c04d15c28 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1220 microversion: 2.1 time: 0.077593 Aug 23 10:38:38.848550 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 296/550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:38 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:38.854971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:38.855787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:38.862592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:38.864757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.866086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.866516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:38.867612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:38.869090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:38.869684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:39.149017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:39.160539 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bea94ccd-a887-4060-8d65-c709af5f35fb tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.309546 Aug 23 10:38:39.161702 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 297/551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:38 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:39.166909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:39.167807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:39.177013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:39.177729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:39.178746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:39.180006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:39.180675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:39.181341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:39.326303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:39.343679 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc79a76c-a3b9-486d-a9f0-6548d6b7d36b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.642345 Aug 23 10:38:39.347773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 255/552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:38 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:39.389883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:39.409510 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2844c72c-2e76-48fa-b584-72624137387d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.246364 Aug 23 10:38:39.423591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 298/553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:39 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:39.479534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:39.480165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:39.487547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:39.488110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:39.488551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:39.489351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:39.489754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:39.490176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:39.780500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:39.781852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:39.789867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:39.790567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:39.791266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:39.792214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:39.792840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:39.793474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.009757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:40.019903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:40.022556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:40.023373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a67d431b-9e71-442b-9afd-8aea3f65da9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.247934 Aug 23 10:38:40.034282 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 299/554] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:39 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:38:40.044163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:40.045095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:40.054431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.055227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.056449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.057399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.058244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.059170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.236374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:40.258622 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78578fae-4bb0-479e-8f26-76e659d1d51e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1272 microversion: 2.1 time: 0.219628 Aug 23 10:38:40.258622 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 300/555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:40 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:40.277515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:40.278554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:40.289010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.289769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.290718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.292256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.293186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.293816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.399491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:40.414827 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e7108ea-03c5-48c4-a8ee-3d4e503c3048 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1503 microversion: 2.1 time: 0.939036 Aug 23 10:38:40.415416 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 256/556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:39 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1503 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:40.429558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:40.430644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:40.437266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.438049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.439244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.440204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.440860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.441582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.803516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:40.812905 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a6c0e0d-f5ca-41e8-bb42-8b170d6932c6 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.553740 Aug 23 10:38:40.816132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 301/557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:40 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:40.833163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:40.834072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:40.840670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.841451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.842065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:40.843015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:40.843705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:40.844903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.012312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.025866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e781e43-2591-41db-80bd-c9b5b379ae92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.601314 Aug 23 10:38:41.027455 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 257/558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:40 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:41.033743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-31fabd34-d66c-46fa-9579-27faf6a04ad0 req-a5f85663-8769-4a9b-9e15-c971c6817eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc9606a-f510-4f75-b789-4e0259ead9e0", "tag": "1950d98b-1069-4c11-b1dc-0d917368e80a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:41.047541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-31fabd34-d66c-46fa-9579-27faf6a04ad0 req-a5f85663-8769-4a9b-9e15-c971c6817eb6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.049103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-31fabd34-d66c-46fa-9579-27faf6a04ad0 req-a5f85663-8769-4a9b-9e15-c971c6817eb6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.049989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-31fabd34-d66c-46fa-9579-27faf6a04ad0 req-a5f85663-8769-4a9b-9e15-c971c6817eb6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.066578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-31fabd34-d66c-46fa-9579-27faf6a04ad0 req-a5f85663-8769-4a9b-9e15-c971c6817eb6 service nova] Creating event network-changed:1950d98b-1069-4c11-b1dc-0d917368e80a for instance bbc9606a-f510-4f75-b789-4e0259ead9e0 on n-h2-847009-13 Aug 23 10:38:41.074073 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-31fabd34-d66c-46fa-9579-27faf6a04ad0 req-a5f85663-8769-4a9b-9e15-c971c6817eb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043760 Aug 23 10:38:41.075677 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 258/559] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:41.268526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.284086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bede1960-a759-4a2f-b62e-7d610dbe2571 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.455789 Aug 23 10:38:41.285619 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 302/560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:40 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:41.298927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.299838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e75063c-d8dc-48af-9b80-026bfae26769 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.300073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:41.300961 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:41.300961 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:41.303152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-6e75063c-d8dc-48af-9b80-026bfae26769 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 23 10:38:41.309896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.311194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.311834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.313012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.314374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e75063c-d8dc-48af-9b80-026bfae26769 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin] Request method failure captured: Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4woY0FA1jWmJ-k12g58c9uSNe4wd7Kr-ictaq3vXDvmmFstX1X7kht-Lzhmr7ceggyRiLx6dqTCWrI51SRylEH64J2UvxFWjjRZtPT3CgU8MOFq3vzVCvHKMRg-o0SB1iJOEF7C5JpLhkfq3Qb2QiY_J-nz2TiLNPtJQQumKn1G5g Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: ff92576f3b3f449795f85e8c2b4b6fe8 Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:38:41.315605 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ff92576f3b3f449795f85e8c2b4b6fe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ff92576f3b3f449795f85e8c2b4b6fe8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff92576f3b3f449795f85e8c2b4b6fe8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ff92576f3b3f449795f85e8c2b4b6fe8"}]}] Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: ff92576f3b3f449795f85e8c2b4b6fe8 Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 747c5c60e250421fb3116a4415eb88a9 Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:38:41.317263 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid timestamp for date invalid_time Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'invalid_time'} Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:38:41.318060 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 23 10:38:41.319430 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.320321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.322328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e75063c-d8dc-48af-9b80-026bfae26769 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:38:41.323555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e75063c-d8dc-48af-9b80-026bfae26769 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307 tempest-InstanceUsageAuditLogNegativeTestJSON-2128222307-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.246498 Aug 23 10:38:41.324333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 259/561] 10.222.0.78 () {58 vars in 1224 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:38:41.332631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.333747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:41.343190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.344038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.345231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.346181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.346846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.347450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.453530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.466283 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ddc25c0-47f6-4e2d-a281-3b9b76d7096f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1278 microversion: 2.1 time: 0.139287 Aug 23 10:38:41.467842 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 260/562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:41.677072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-faf7242b-a104-4d8e-b17a-db71754c5431 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.678148 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:41.678148 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:38:41.679499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-faf7242b-a104-4d8e-b17a-db71754c5431 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '08a2c682a5d443f4adc31e8f827bd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd32a430bb4c9a85aebb1a615db99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-faf7242b-a104-4d8e-b17a-db71754c5431 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Request method failure captured: Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4vbYR5ywcAOwE5SQP8anzgDjWInJPp6IX7xmzDuKm2piyows1NOnC8fpLZG-hmfQpfUrEi0Ynz72qmJAV_LuvKQ0rizfOIrrU4e77il9FSdT9sVuFehfRG9mfP8VpDA4p_TqoiqcuVBkfrTX0Ky4j_X9UfNmciMX87uuGcIP4rPXc Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 44fd32a430bb4c9a85aebb1a615db99a Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:38:41.681880 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44fd32a430bb4c9a85aebb1a615db99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44fd32a430bb4c9a85aebb1a615db99a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44fd32a430bb4c9a85aebb1a615db99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44fd32a430bb4c9a85aebb1a615db99a"}]}] Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 44fd32a430bb4c9a85aebb1a615db99a Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 08a2c682a5d443f4adc31e8f827bd9ca Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project Aug 23 10:38:41.683561 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:38:41.684357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 23 10:38:41.686179 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.689154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-faf7242b-a104-4d8e-b17a-db71754c5431 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:38:41.690196 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-faf7242b-a104-4d8e-b17a-db71754c5431 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.221162 Aug 23 10:38:41.691222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 261/563] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:38:41.698106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.699122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:41.706979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.707758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.708400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.709522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.710170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.710793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.772770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.781189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.783576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.784726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60734712-6920-4451-88db-2ab85481937b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.498035 Aug 23 10:38:41.785305 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 303/564] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:41.805922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93a2d163-7e08-4ae0-b80b-c66e9f512490 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.807496 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:41.807496 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:41.808814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-93a2d163-7e08-4ae0-b80b-c66e9f512490 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '08a2c682a5d443f4adc31e8f827bd9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fd32a430bb4c9a85aebb1a615db99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93a2d163-7e08-4ae0-b80b-c66e9f512490 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Request method failure captured: Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23%2010:38:41 HTTP/1.1 Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4vbYR5ywcAOwE5SQP8anzgDjWInJPp6IX7xmzDuKm2piyows1NOnC8fpLZG-hmfQpfUrEi0Ynz72qmJAV_LuvKQ0rizfOIrrU4e77il9FSdT9sVuFehfRG9mfP8VpDA4p_TqoiqcuVBkfrTX0Ky4j_X9UfNmciMX87uuGcIP4rPXc Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 44fd32a430bb4c9a85aebb1a615db99a Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:38:41.810904 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44fd32a430bb4c9a85aebb1a615db99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44fd32a430bb4c9a85aebb1a615db99a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44fd32a430bb4c9a85aebb1a615db99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44fd32a430bb4c9a85aebb1a615db99a"}]}] Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 44fd32a430bb4c9a85aebb1a615db99a Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 08a2c682a5d443f4adc31e8f827bd9ca Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project Aug 23 10:38:41.812401 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2022-08-23 10:38:41'} Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:38:41.813647 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 23 10:38:41.815009 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:38:41.817398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93a2d163-7e08-4ae0-b80b-c66e9f512490 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:38:41.818409 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93a2d163-7e08-4ae0-b80b-c66e9f512490 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033 tempest-InstanceUsageAuditLogNegativeTestJSON-183477033-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23 10:38:41" status: 403 len: 128 microversion: 2.1 time: 0.016327 Aug 23 10:38:41.819388 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 304/565] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23%2010%3A38%3A41 => generated 128 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:38:41.839797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:41.845731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:41.853867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.854936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.855583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:41.856506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:41.857333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:41.857958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.139362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:42.148022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-301f9194-6df5-4087-a9f8-85ffa2758688 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1493 microversion: 2.1 time: 0.455470 Aug 23 10:38:42.153835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 262/566] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1493 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:42.159959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:42.160889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:42.167847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.168579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.170312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.171232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.173524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.175091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.566290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:42.575787 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e05ed90b-0d93-4084-bb22-29d6664c395e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.420543 Aug 23 10:38:42.581320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 263/567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:42 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:42.585929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc3e2dda-60c4-4fb0-a5ab-9501528153ae tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '.version_select at 0x7fdc9d0c2d30>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:42.590185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc3e2dda-60c4-4fb0-a5ab-9501528153ae tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.591072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc3e2dda-60c4-4fb0-a5ab-9501528153ae tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.592013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc3e2dda-60c4-4fb0-a5ab-9501528153ae tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.606012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc3e2dda-60c4-4fb0-a5ab-9501528153ae tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.023612 Aug 23 10:38:42.615701 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 264/568] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:38:42 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:42.620716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:42.621599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:42.629158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.629734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.630360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.631229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.631962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.632544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.873418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:42.904817 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed2f7680-4559-461b-adc7-e3013855db02 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.287860 Aug 23 10:38:42.905995 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 265/569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:42 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:42.917915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:42.918567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:42.927034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.927536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.927978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.931792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:42.932305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:42.932945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:42.984017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:42.998191 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-044aa96f-e868-4a42-a286-8916196e46d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 1.165544 Aug 23 10:38:43.002290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 305/570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:41 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:43.008226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:43.009994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:43.022141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.022786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.023327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.025269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.025845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.026470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.199129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:43.216399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-258e754f-b41c-4f72-b775-a3a11e620074 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.302721 Aug 23 10:38:43.235455 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 266/571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:42 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:43.246975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:43.252689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:43.273518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.278237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.283428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.285848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.286897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.290546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.486941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:43.496086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac30d0d9-cf97-4099-a4e6-7d80ae00e41c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1646 microversion: 2.1 time: 0.492162 Aug 23 10:38:43.497839 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 306/572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:43 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1646 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:43.505292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:43.507794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1054768a-2e3f-4247-ada1-fd6ab4fb46e3", "tag": "8c12973d-00fc-4c00-8796-b7c9651575f9"}, {"name": "network-changed", "server_uuid": "15c18564-2b98-46ce-bcf4-cb02af84cb42", "tag": "580ca05b-9b64-4591-b4d5-6b8926b0a301"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:43.511642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:43.517889 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-881317bd-0eb3-458a-bb24-aec57d3cd08d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.279845 Aug 23 10:38:43.519279 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 267/573] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:43 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:43.529396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.530148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.530706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.544299 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] Creating event network-changed:8c12973d-00fc-4c00-8796-b7c9651575f9 for instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 on n-h2-847009-13 Aug 23 10:38:43.545193 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] Creating event network-changed:580ca05b-9b64-4591-b4d5-6b8926b0a301 for instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 on n-h2-847009-13 Aug 23 10:38:43.553502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ee3a677e-24c9-40a4-87eb-058b59b2fb15 req-a6eec0ad-c1c0-479e-9545-b117e1e5b293 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053532 Aug 23 10:38:43.554482 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 307/574] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:43.601128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:43.601927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:43.616465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.618705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.619157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.621604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.623245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.623692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.685028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-99914917", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "16058aaf-a351-4bde-a15a-8b9493e9e115"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:43.805171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] validate_networks() for [('16058aaf-a351-4bde-a15a-8b9493e9e115', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:38:43.841123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:43.851244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84b0da23-e6d1-493e-a2e5-f6edb25267ae tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.257261 Aug 23 10:38:43.853024 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 268/575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:43 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:43.859024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e6466574-7034-4138-b9c5-4c36e3535a83 req-6995f824-bd34-4875-8253-9ff97cee334a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7fb487-32c8-4c54-96b8-1a587f153aa2", "name": "network-vif-plugged", "status": "completed", "tag": "c17c9163-c59a-4086-b714-1fd30e316965"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:43.870844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e6466574-7034-4138-b9c5-4c36e3535a83 req-6995f824-bd34-4875-8253-9ff97cee334a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.871332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e6466574-7034-4138-b9c5-4c36e3535a83 req-6995f824-bd34-4875-8253-9ff97cee334a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.871772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e6466574-7034-4138-b9c5-4c36e3535a83 req-6995f824-bd34-4875-8253-9ff97cee334a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.885944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e6466574-7034-4138-b9c5-4c36e3535a83 req-6995f824-bd34-4875-8253-9ff97cee334a service nova] Creating event network-vif-plugged:c17c9163-c59a-4086-b714-1fd30e316965 for instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 on n-h2-847009-13 Aug 23 10:38:43.892129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e6466574-7034-4138-b9c5-4c36e3535a83 req-6995f824-bd34-4875-8253-9ff97cee334a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037145 Aug 23 10:38:43.893881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 269/576] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:43.931637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:43.932526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:43.940764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.941231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.941657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.942412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:43.942861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:43.943510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:43.970282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:44.386794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:44.405274 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fda64663-8f55-42d4-ad4c-a49439a3da0e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.480877 Aug 23 10:38:44.419915 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 270/577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:43 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:44.438630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:44.441010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:44.460658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:44.461445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:44.462217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:44.463629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:44.465121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:44.466067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:44.830242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:44.840436 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3585a709-eaa5-4994-8188-94e9ae468f9e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.427500 Aug 23 10:38:44.841269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 271/578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:44 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:44.860096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:44.860712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:44.868230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:44.868230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:44.868230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:44.868583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:44.868978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:44.869578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.215883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.228550 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dae334f-ea03-4b1a-8709-1a503603fb7b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.373751 Aug 23 10:38:45.229167 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 272/579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:44 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:45.246406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:45.247559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:45.255593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.256085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.256520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.257251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.257805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.258325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.280228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:38:45.280730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:38:45.281437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:38:45.282235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:38:45.282958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:38:45.311815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.312623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.314246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.315236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.316162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.317073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.342515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:45.348834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for user b2ac0227a26f41c8a9b5c89cddea52f5 and project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:45.366196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:38:45.370158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:38:45.445449 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc60919f-e1e6-4274-91c1-da0277ab246b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.764550 Aug 23 10:38:45.451689 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 308/580] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 10:38:45.452331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7e575d4c-9983-43a9-b757-9b7bbcbde6ea req-b5edefe0-78e8-4405-87cf-e0185b4be75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f914cb78-270e-4800-ae39-5679620e2577", "tag": "e1cc670b-8cdf-4e4e-92d5-b1e1d5305712"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:45.464724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e575d4c-9983-43a9-b757-9b7bbcbde6ea req-b5edefe0-78e8-4405-87cf-e0185b4be75d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.465271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e575d4c-9983-43a9-b757-9b7bbcbde6ea req-b5edefe0-78e8-4405-87cf-e0185b4be75d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.465824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e575d4c-9983-43a9-b757-9b7bbcbde6ea req-b5edefe0-78e8-4405-87cf-e0185b4be75d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.479303 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7e575d4c-9983-43a9-b757-9b7bbcbde6ea req-b5edefe0-78e8-4405-87cf-e0185b4be75d service nova] Creating event network-changed:e1cc670b-8cdf-4e4e-92d5-b1e1d5305712 for instance f914cb78-270e-4800-ae39-5679620e2577 on n-h1-847009-13 Aug 23 10:38:45.485929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7e575d4c-9983-43a9-b757-9b7bbcbde6ea req-b5edefe0-78e8-4405-87cf-e0185b4be75d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037445 Aug 23 10:38:45.486837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 309/581] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:45.494476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:45.495192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:45.504787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.505300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.506299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.507030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.507492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.507921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.549946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.570662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.578182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.580058 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bc31f90-fa99-4eaa-b700-12846ec48ab7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.349756 Aug 23 10:38:45.580633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 273/582] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:45 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:45.608418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:45.614520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:45.633176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.634064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.635026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.637761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.639381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.640062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.744953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.756414 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5116d117-9ed0-4624-a609-91094ba15801 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.268011 Aug 23 10:38:45.757812 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 310/583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:45 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:45.762586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ed2e5c5-51a1-4bd5-91d7-90386b328806 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:45.763437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ed2e5c5-51a1-4bd5-91d7-90386b328806 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:45.901379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ed2e5c5-51a1-4bd5-91d7-90386b328806 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.909568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ed2e5c5-51a1-4bd5-91d7-90386b328806 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1209 microversion: 2.1 time: 0.150508 Aug 23 10:38:45.920760 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 311/584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:45 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1209 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:45.925796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:45.926762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:45.936452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.937281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.938389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.940613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:45.941621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:45.942203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:45.959068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:45.970892 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-638f5289-34cd-4750-92b9-f6a5bbc1e181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.374540 Aug 23 10:38:45.971917 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 274/585] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:45 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:46.250128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:46.251029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:46.266848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:46.267446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:46.267881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:46.268597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:46.269079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:46.269644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:46.435868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:46.445283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74759fc8-7cfc-4b1b-bddf-f9a0e838cc59 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.531557 Aug 23 10:38:46.445950 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 312/586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:45 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:46.602589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:46.603203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:46.615674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:46.616293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:46.617118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:46.618425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:46.619232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:46.619951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:46.620674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:46.628064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:46.632412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3bbefea9-abcf-4d8e-8151-6222b4242005 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.385933 Aug 23 10:38:46.633963 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 275/587] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:46 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:46.780787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:46.789977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:46.791487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:46.792948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5795f2b3-8742-459e-87d4-b9f9720c99e5 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.194186 Aug 23 10:38:46.793509 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 313/588] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:46 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:46.799317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:46.799922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:46.806093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:46.806590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:46.807024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:46.807725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:46.808182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:46.808611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:46.999230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:47.007758 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-890e11bd-24a3-43f5-a424-ca9995fab573 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.213082 Aug 23 10:38:47.008638 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 314/589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:46 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:47.013174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.013781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:47.025967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.026464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.027378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.028182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.028644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.029121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.110340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:47.118897 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb490c2f-3249-4786-a681-205d93e60514 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1213 microversion: 2.1 time: 0.109105 Aug 23 10:38:47.119622 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 315/590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:47.139808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.140511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:47.147502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.148023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.148499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.149414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.149887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.150338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.160945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a79b974f-836f-47e6-81c4-d503523be5a7 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Action: 'create', calling method: .version_select at 0x7fdc9cf9c550>, body: {"keypair": {"name": "tempest-keypair-1695322564", "type": "ssh", "user_id": "0560ece8f0eb4a6485d5aa8f00335d96", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8NDQyKt52g0IqcLuyzFPX+iRMJvhhuIdj6W0PTxTETNaYjemcRSsIEfdxY9zdl0aJmfE6UYHuFQ1JvmsfX7QKyc5j/ztyhS6oJDXZmFwpcD4OwyA7dOn9TdCP5rwRW3w=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:47.178395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a79b974f-836f-47e6-81c4-d503523be5a7 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Getting quotas for project 7f2c715ea9d042169d0a7edafb9065e3. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:47.183861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a79b974f-836f-47e6-81c4-d503523be5a7 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Getting quotas for user f56ad172011b41e9a1d5388a8b81ab48 and project 7f2c715ea9d042169d0a7edafb9065e3. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:47.210053 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a79b974f-836f-47e6-81c4-d503523be5a7 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.477282 Aug 23 10:38:47.210653 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 276/591] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:38:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 479 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 10:38:47.225576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15d5859e-b129-4620-ae95-c15b7c316cb0 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Action: 'create', calling method: .version_select at 0x7fdc9cf6d040>, body: {"keypair": {"name": "tempest-keypair-1311676980", "type": "ssh", "user_id": "0560ece8f0eb4a6485d5aa8f00335d96", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnxkg9iSufeeLi6ySwkWLowBYbf/a258Sw74glW6zsUrOWGUvg3DcP7oNlDgCWEP0TJzomAzCOwciIIPzdxG0jG1aQOaN8f19wqZIq6gDEPW/gR3dk7ULPLnJ30r6x9Kg=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:47.245235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-15d5859e-b129-4620-ae95-c15b7c316cb0 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Getting quotas for project 7f2c715ea9d042169d0a7edafb9065e3. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:47.250989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-15d5859e-b129-4620-ae95-c15b7c316cb0 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Getting quotas for user f56ad172011b41e9a1d5388a8b81ab48 and project 7f2c715ea9d042169d0a7edafb9065e3. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:47.278417 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15d5859e-b129-4620-ae95-c15b7c316cb0 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.057759 Aug 23 10:38:47.279346 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 277/592] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:38:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 10:38:47.300102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-620f11c6-0e94-40ee-a70f-0891923397b2 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Calling method '.version_select at 0x7fdc9d0231f0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.320204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-620f11c6-0e94-40ee-a70f-0891923397b2 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1695322564?user_id=0560ece8f0eb4a6485d5aa8f00335d96" status: 200 len: 513 microversion: 2.10 time: 0.027816 Aug 23 10:38:47.321138 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 278/593] 10.222.0.78 () {60 vars in 1340 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1695322564?user_id=0560ece8f0eb4a6485d5aa8f00335d96 => generated 513 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 10:38:47.327472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:47.335159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-937f28af-965b-4da5-936e-dc9d319f914a tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Action: 'create', calling method: .version_select at 0x7fdc9d023820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-460024715", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhvTnnHzIcpnmvwHTaDblaMNkqoNtowHCPREg9lKF5SesTRww/zKs5+ZwG3qAp8cx/Fc7FWs33xxAua384IsdchAkQq5j7YrSdZgIc4hchNMQNAhUldBmOVmtT5tiGibw=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:47.336507 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f569c66-508f-41bf-839b-e49294dca5f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.208810 Aug 23 10:38:47.337212 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 316/594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:47.351316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-937f28af-965b-4da5-936e-dc9d319f914a tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Getting quotas for project 7f2c715ea9d042169d0a7edafb9065e3. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:38:47.356419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-937f28af-965b-4da5-936e-dc9d319f914a tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Getting quotas for user f56ad172011b41e9a1d5388a8b81ab48 and project 7f2c715ea9d042169d0a7edafb9065e3. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:38:47.381280 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-937f28af-965b-4da5-936e-dc9d319f914a tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.049637 Aug 23 10:38:47.381809 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 279/595] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:38:47 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 10:38:47.393939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64b37ddb-4fea-415b-8d5f-ab4aef2a8d3c tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Calling method '.version_select at 0x7fdc9d2f9c10>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.397891 n-d-847009-13 devstack@n-api.service[128859]: WARNING oslo_db.sqlalchemy.utils [None req-64b37ddb-4fea-415b-8d5f-ab4aef2a8d3c tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 10:38:47.403232 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64b37ddb-4fea-415b-8d5f-ab4aef2a8d3c tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs?user_id=0560ece8f0eb4a6485d5aa8f00335d96" status: 200 len: 726 microversion: 2.10 time: 0.014550 Aug 23 10:38:47.404300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 317/596] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/os-keypairs?user_id=0560ece8f0eb4a6485d5aa8f00335d96 => generated 726 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:38:47.415205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-47b4b472-12bb-4110-a28a-91f05a382bcb tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Calling method '.version_select at 0x7fdc9cf97dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.436425 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-47b4b472-12bb-4110-a28a-91f05a382bcb tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-460024715" status: 204 len: 0 microversion: 2.10 time: 0.025253 Aug 23 10:38:47.437053 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 280/597] 10.222.0.78 () {60 vars in 1322 bytes} [Tue Aug 23 10:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-460024715 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:38:47.445757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db1d8cde-cf8e-4e7a-aa3b-7b299e1562ee tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Calling method '.version_select at 0x7fdc9d2ea820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.466807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.467439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:47.472894 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db1d8cde-cf8e-4e7a-aa3b-7b299e1562ee tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311676980?user_id=0560ece8f0eb4a6485d5aa8f00335d96" status: 204 len: 0 microversion: 2.10 time: 0.030546 Aug 23 10:38:47.474078 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 318/598] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311676980?user_id=0560ece8f0eb4a6485d5aa8f00335d96 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 10:38:47.474405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.474971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.475624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.476341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.476921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.477362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.488498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba6632fc-7be2-46f0-9818-8fbfba8faa51 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] Calling method '.version_select at 0x7fdc9d23d8b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.541570 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba6632fc-7be2-46f0-9818-8fbfba8faa51 tempest-KeyPairsV210TestJSON-690428782 tempest-KeyPairsV210TestJSON-690428782-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695322564?user_id=0560ece8f0eb4a6485d5aa8f00335d96" status: 204 len: 0 microversion: 2.10 time: 0.062890 Aug 23 10:38:47.547853 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 319/599] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:38:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695322564?user_id=0560ece8f0eb4a6485d5aa8f00335d96 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:38:47.654230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.654848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:47.661711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.662205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.662648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.663367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.663846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.664295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.691109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:47.702702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d51411a8-6a70-4ce4-9244-ed196abfa656 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.239671 Aug 23 10:38:47.716813 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 281/600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:47.819598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:47.820830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:47.823572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:47.830427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.831041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.831492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.832401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:47.832684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:47.833274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:47.869490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:47.879235 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87db5dc4-a5b5-4813-931e-8b4a254246c2 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.228736 Aug 23 10:38:47.893568 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 320/601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:38:48.029210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:48.029846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:48.043731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.044046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.046493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.050081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.051209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.051782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.052238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.064314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.067703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.069108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cb06c76-0524-4bd7-9648-f74005374c01 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.254639 Aug 23 10:38:48.099888 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 282/602] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:47 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:38:48.152677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:48.158677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:48.171208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.171889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.172137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.174359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.177525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.178375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.309827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.319193 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8faf2f46-71cf-4a33-86d9-86735d09a0fa tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.293701 Aug 23 10:38:48.319788 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 321/603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:48 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:48.344017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.353798 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71a9e2c6-18b0-4cbb-a176-38c8497c3acc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1205 microversion: 2.1 time: 0.215743 Aug 23 10:38:48.357889 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 283/604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:48 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1205 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:48.374117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:48.375128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:48.385906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.393144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.393646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.396470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.396991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.397718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.602866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.612588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c89da011-73af-4757-b483-63c9aebe8be2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.258711 Aug 23 10:38:48.623075 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 322/605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:48 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:48.725852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:48.726511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:48.728406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:48.739934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.739934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.740237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.740931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.741395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.741924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.903113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:48.903872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:48.916205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.917110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.917724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.918580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:48.919340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:48.920040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:48.984102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:48.997835 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1e01579-facc-491b-a274-909c3d14a333 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.275873 Aug 23 10:38:49.011482 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 284/606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:48 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:49.097003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:49.098124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:49.105892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.107001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.107718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.108663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.109357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.111289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.405178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:49.410730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:49.419288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:49.422898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:49.427417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f05ac2ab-5509-4401-993f-c6c8090c971f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.527687 Aug 23 10:38:49.429526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 323/607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:48 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:49.431337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52dae84a-e2f7-4aca-936e-9730e8d7b32c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1362 microversion: 2.25 time: 0.339407 Aug 23 10:38:49.431907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 285/608] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:49 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:38:49.441593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:49.442462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:49.458490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:49.459314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:49.462625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.463423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.465209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.466165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.467685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.473770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.482246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.482746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.483188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.487350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.489752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.489916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.590646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:49.601693 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f21f3eec-688c-4b83-a9ad-dcc747668ca3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1267 microversion: 2.1 time: 0.167550 Aug 23 10:38:49.602371 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 286/609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:49 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:49.638565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:49.639327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:49.652071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.652852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.653784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.655139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:49.657476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:49.659603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:49.911960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:49.921605 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52feae63-bd56-417a-9dd1-ffa73bbc9da6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.290378 Aug 23 10:38:49.923593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 287/610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:49 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:50.018557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:50.020646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:50.021307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:50.029017 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e30c6956-4a69-4e55-80b3-d8e947349bb1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.595906 Aug 23 10:38:50.031365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.032608 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 324/611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:49 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:50.034207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.034827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.036498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.038173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.038653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.147846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-23691d0b-ab8e-4aee-9e08-768ac8115925 req-1260c04d-4372-4042-ba9a-b81d78658222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc9606a-f510-4f75-b789-4e0259ead9e0", "name": "network-vif-plugged", "status": "completed", "tag": "1950d98b-1069-4c11-b1dc-0d917368e80a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:50.165098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-23691d0b-ab8e-4aee-9e08-768ac8115925 req-1260c04d-4372-4042-ba9a-b81d78658222 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.168370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-23691d0b-ab8e-4aee-9e08-768ac8115925 req-1260c04d-4372-4042-ba9a-b81d78658222 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.169036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-23691d0b-ab8e-4aee-9e08-768ac8115925 req-1260c04d-4372-4042-ba9a-b81d78658222 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.197457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-23691d0b-ab8e-4aee-9e08-768ac8115925 req-1260c04d-4372-4042-ba9a-b81d78658222 service nova] Creating event network-vif-plugged:1950d98b-1069-4c11-b1dc-0d917368e80a for instance bbc9606a-f510-4f75-b789-4e0259ead9e0 on n-h2-847009-13 Aug 23 10:38:50.210370 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-23691d0b-ab8e-4aee-9e08-768ac8115925 req-1260c04d-4372-4042-ba9a-b81d78658222 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066140 Aug 23 10:38:50.212375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 325/612] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:50.330149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:50.380533 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e54cb53e-d5d5-4914-997f-702acd6819f1 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.363604 Aug 23 10:38:50.399416 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 288/613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:50 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:50.468696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:50.473507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:50.476778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:50.480585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:50.495385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.496927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.500020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.502534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.505159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.505879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.506489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.510425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.511189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.512169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.515162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.515866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.780884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:50.791561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:50.799205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:50.803353 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45381e97-acb9-4a80-aaa8-46d783b36b3b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1558 microversion: 2.25 time: 0.349864 Aug 23 10:38:50.816752 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 289/614] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:50 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1558 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:50.838738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:50.839393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:50.861219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.863312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.863844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:50.865063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:50.866949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:50.868071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.112343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:51.123164 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ad8104b-2870-4828-9082-2e7b379401de tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.303117 Aug 23 10:38:51.124187 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 290/615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:50 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:51.134878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:51.146125 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fa54ada4-b37f-4fbc-8606-559960807da1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.695750 Aug 23 10:38:51.146738 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 326/616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:50 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:51.168489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:51.173028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:51.189688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.190630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.193042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.194016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.195425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.196218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.542726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:51.543354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:51.555274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.556019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.556628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.557529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.558149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.558732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.791531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:51.800248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 3c7fb487-32c8-4c54-96b8-1a587f153aa2 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:51.928449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:51.940164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da3d608a-95a1-4731-bc27-53127c9b19e0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.778663 Aug 23 10:38:51.941228 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 327/617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:51 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:51.955873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:51.957111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:51.959463 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4744403-900f-47ea-a727-7788bf3e8f12 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 2053 microversion: 2.25 time: 0.833521 Aug 23 10:38:51.960687 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 291/618] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:51 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 2053 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:51.978579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:51.979486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:51.989563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.990112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.990728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.991401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.991913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.992232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.992712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.993367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.994020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:51.995897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:51.996706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:51.999418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:52.340836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:52.357961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cbf91b6-6208-4371-9fcf-00561417332e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1389 microversion: 2.1 time: 0.395838 Aug 23 10:38:52.358898 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 292/619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:51 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1389 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:52.371552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:52.372483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:52.381059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:52.381869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:52.382490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:52.384510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:52.385228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:52.385834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:52.542800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:52.552488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3cfa8b3-5561-4cf2-9831-4bf2c189abf1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.609300 Aug 23 10:38:52.553347 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 328/620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:51 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:52.561338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:52.562113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:52.569808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:52.570149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:52.570948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:52.572057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:52.572463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:52.573124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:52.707279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 3c7fb487-32c8-4c54-96b8-1a587f153aa2 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:52.728142 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c1ba065-9031-48df-b097-87839f1023be tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 2053 microversion: 2.25 time: 0.368088 Aug 23 10:38:52.729129 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 293/621] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:52 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 2053 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:52.753343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:52.755808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:52.763099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:52.763958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:52.765006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:52.766160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:52.767111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:52.767852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.046157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:53.081621 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a07048be-7501-48a4-9c56-8dfdb83170ad tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.525942 Aug 23 10:38:53.084348 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 329/622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:52 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:53.089699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5ddfcfc9-574d-4303-9a59-13c9d8d60eb9 req-8a6c1a37-72ac-4dd0-b3b4-6ee7dd3ccfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f914cb78-270e-4800-ae39-5679620e2577", "name": "network-vif-plugged", "status": "completed", "tag": "e1cc670b-8cdf-4e4e-92d5-b1e1d5305712"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:53.106477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5ddfcfc9-574d-4303-9a59-13c9d8d60eb9 req-8a6c1a37-72ac-4dd0-b3b4-6ee7dd3ccfb0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.107167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5ddfcfc9-574d-4303-9a59-13c9d8d60eb9 req-8a6c1a37-72ac-4dd0-b3b4-6ee7dd3ccfb0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.107873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5ddfcfc9-574d-4303-9a59-13c9d8d60eb9 req-8a6c1a37-72ac-4dd0-b3b4-6ee7dd3ccfb0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.136305 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5ddfcfc9-574d-4303-9a59-13c9d8d60eb9 req-8a6c1a37-72ac-4dd0-b3b4-6ee7dd3ccfb0 service nova] Creating event network-vif-plugged:e1cc670b-8cdf-4e4e-92d5-b1e1d5305712 for instance f914cb78-270e-4800-ae39-5679620e2577 on n-h1-847009-13 Aug 23 10:38:53.154123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5ddfcfc9-574d-4303-9a59-13c9d8d60eb9 req-8a6c1a37-72ac-4dd0-b3b4-6ee7dd3ccfb0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065961 Aug 23 10:38:53.155539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 330/623] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:53.169379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:53.172613 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:38:53.172613 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:38:53.175587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.176338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.177105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.178158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.179058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.179813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.230122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-745a9658-ad22-4bdb-a5d8-44e735350d1c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.071072 Aug 23 10:38:53.237206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 331/624] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Aug 23 10:38:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:38:53.244481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:53.246135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:53.254655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.255423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.256146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.259983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.261017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.264291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.460078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:53.474034 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19eea56c-accd-4a1b-b698-c4c84dadd9d0 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1320 microversion: 2.1 time: 0.730967 Aug 23 10:38:53.475037 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 294/625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:52 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1320 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:53.493039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-13", "block_migration": "auto"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:53.497325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:53.506643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.507474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.508137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.509148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:53.510706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:53.511464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:53.543975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'flavor' on Instance uuid 3c7fb487-32c8-4c54-96b8-1a587f153aa2 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:53.565605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Going to try to live migrate instance to n-h1-847009-13 {{(pid=128860) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:38:54.048351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:54.085726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f31314ae-d774-4fc4-a666-032b1eb62cfb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.846649 Aug 23 10:38:54.098036 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 332/626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:53 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:54.105685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:54.106308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:54.119732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:54.120237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:54.120868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:54.121541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:54.122068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:54.129265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:54.758379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:54.773273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e809a9c-bc2f-4021-a5af-b3b85eecbe79 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1589 microversion: 2.1 time: 0.685476 Aug 23 10:38:54.774054 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 333/627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:54 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1589 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:54.791414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:54.792041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:54.800852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:54.801758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:54.802385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:54.803320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:54.803963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:54.805077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:55.165054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:55.171243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:55.181080 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc13822e-c9ba-47d1-84a8-ac94db4adc2e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.405901 Aug 23 10:38:55.183426 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 334/628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:54 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:55.188259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5885465f-6344-4ecd-83f2-a490154bfe3b req-f8d84365-627a-42c3-939c-1f7d90439198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd1d2a11-c639-47c1-8987-849de67c63ba", "tag": "5b1d8b1c-42fc-4d01-a50a-853265d4ec13"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:55.199496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5885465f-6344-4ecd-83f2-a490154bfe3b req-f8d84365-627a-42c3-939c-1f7d90439198 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:55.200257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5885465f-6344-4ecd-83f2-a490154bfe3b req-f8d84365-627a-42c3-939c-1f7d90439198 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:55.200901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5885465f-6344-4ecd-83f2-a490154bfe3b req-f8d84365-627a-42c3-939c-1f7d90439198 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:55.226143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5885465f-6344-4ecd-83f2-a490154bfe3b req-f8d84365-627a-42c3-939c-1f7d90439198 service nova] Creating event network-changed:5b1d8b1c-42fc-4d01-a50a-853265d4ec13 for instance fd1d2a11-c639-47c1-8987-849de67c63ba on n-h1-847009-13 Aug 23 10:38:55.234644 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5885465f-6344-4ecd-83f2-a490154bfe3b req-f8d84365-627a-42c3-939c-1f7d90439198 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051327 Aug 23 10:38:55.239074 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 335/629] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:55.250436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:55.251437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:55.258917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:55.259478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:55.259987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:55.261056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:55.261575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:55.262194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:55.541734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:55.554531 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30693b60-008b-4286-971b-f7c059c666fd tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.313990 Aug 23 10:38:55.561049 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 336/630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:55 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:55.569425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:55.574360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:55.582482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:55.590878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:55.591393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:55.591842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:55.592577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:55.598718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:55.599544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:55.909302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=28 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:56.341049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:56.353609 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c84189f5-426d-4917-b01e-4beb23f80753 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1469 microversion: 2.1 time: 0.790492 Aug 23 10:38:56.356674 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 337/631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:55 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1469 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:56.364713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:56.372831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:56.389420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:56.390247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:56.391139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:56.393611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:56.394310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:56.396366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:56.691435 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b7862811-7004-44f5-b09d-46bccc91eedc tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.333380 Aug 23 10:38:56.692396 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 338/632] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:38:56 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0/os-interface => generated 285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:56.698324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:56.700360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:56.721485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:56.722327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:56.723101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:56.726175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:56.726985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:56.727677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:56.965300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-633609bb-e72b-4535-a0be-5e5a5c7ad144 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2/action" status: 202 len: 0 microversion: 2.25 time: 3.488664 Aug 23 10:38:56.969831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 295/633] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:38:53 2022] POST /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2/action => generated 0 bytes in 3494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:38:56.979810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5e504374-0259-472e-b15c-d1c713a4d879 req-1dd61547-e114-400b-9cda-0733b0c40d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1054768a-2e3f-4247-ada1-fd6ab4fb46e3", "name": "network-vif-plugged", "status": "completed", "tag": "8c12973d-00fc-4c00-8796-b7c9651575f9"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:57.003417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e504374-0259-472e-b15c-d1c713a4d879 req-1dd61547-e114-400b-9cda-0733b0c40d70 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.007464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e504374-0259-472e-b15c-d1c713a4d879 req-1dd61547-e114-400b-9cda-0733b0c40d70 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.008201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e504374-0259-472e-b15c-d1c713a4d879 req-1dd61547-e114-400b-9cda-0733b0c40d70 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.030734 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5e504374-0259-472e-b15c-d1c713a4d879 req-1dd61547-e114-400b-9cda-0733b0c40d70 service nova] Creating event network-vif-plugged:8c12973d-00fc-4c00-8796-b7c9651575f9 for instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 on n-h2-847009-13 Aug 23 10:38:57.048972 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5e504374-0259-472e-b15c-d1c713a4d879 req-1dd61547-e114-400b-9cda-0733b0c40d70 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077516 Aug 23 10:38:57.050341 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 296/634] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:57.064008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:57.065142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:57.080364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.081174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.081762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.082640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.083301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.083885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.247688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:57.260217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7943dad7-b372-4d38-94d8-d8aa28155ede tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.566030 Aug 23 10:38:57.260840 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 339/635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:56 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:57.280178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:57.283423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:57.290786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.292077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.292077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.292984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.293801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.294378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.306350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:57.325929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48e9ee63-7aae-4965-97bf-d70d6a3da582 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.274135 Aug 23 10:38:57.326523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 297/636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:57 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:57.355127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:57.355746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:57.364176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=36 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:38:57.378600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.379128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.379569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.380555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.381413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.381991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.504301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58ffe3b0-fa14-4b42-b197-0397f60f641d tempest-DeleteServersAdminTestJSON-1900175205 tempest-DeleteServersAdminTestJSON-1900175205-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577/action" status: 202 len: 0 microversion: 2.1 time: 0.227852 Aug 23 10:38:57.508525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 340/637] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:38:57 2022] POST /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:38:57.516013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:57.518915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:57.532878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.533567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.534166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.535072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.535692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.538242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.774737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:57.786149 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6575f64-768f-4928-8688-6b287d8bedd8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.434716 Aug 23 10:38:57.787532 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 298/638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:57 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:57.808650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:57.811477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:57.833913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.835711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.835711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.835920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.836406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.836969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.898071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:57.900889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:57.901530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:57.902159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lazy-loading 'fault' on Instance uuid f914cb78-270e-4800-ae39-5679620e2577 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:58.117781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:58.141130 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b081e50-de71-4557-9199-f8ffa8c3510d tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1452 microversion: 2.1 time: 0.351950 Aug 23 10:38:58.143215 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 299/639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:57 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1452 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:58.163725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:58.164481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:58.178302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:58.179042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:58.179727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:58.180890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:58.181536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:58.182158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:58.240043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:38:58.489089 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8062d0aa-0a02-4321-b9ef-a092b232c64c tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 204 len: 0 microversion: 2.1 time: 0.329289 Aug 23 10:38:58.494083 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 300/640] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:38:58 2022] DELETE /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:38:58.500790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:58.501798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:58.520345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:58.520954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:58.521406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:58.522135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:58.522602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:58.523035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:58.990544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.000193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.009315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.011296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-23d743ad-a6fb-4da3-a5b4-69c83ee51fa8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 1.500945 Aug 23 10:38:59.014252 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 341/641] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:38:57 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:38:59.025328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:59.025328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:59.030639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.038350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.038863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.039302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.041606 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e672ed13-5460-48f3-bd95-b0d00466da8b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.545910 Aug 23 10:38:59.043743 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 301/642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:58 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:59.044157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.044787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.045234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.056922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:59.057617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:59.065887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.066719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.067359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.068260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.068943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.069559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.129741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.131300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.131913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.132542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lazy-loading 'fault' on Instance uuid f914cb78-270e-4800-ae39-5679620e2577 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:38:59.298600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.309013 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cfbdcb2-156e-4235-913e-95fb75302b04 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1458 microversion: 2.1 time: 0.263513 Aug 23 10:38:59.309952 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 302/643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:59 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1458 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:59.315790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:59.317715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:59.325031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.325780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.326445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.327807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.329159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.329917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.492238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.500897 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90164984-c48a-430d-b918-d1268b275ffd tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1363 microversion: 2.1 time: 0.484624 Aug 23 10:38:59.504781 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 342/644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:59 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:59.512970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8aee5c92-3a7d-42c0-8fa4-0e7cdc11f688 req-27952332-8e91-4e0f-a141-ac6c0da3e872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c18564-2b98-46ce-bcf4-cb02af84cb42", "name": "network-vif-plugged", "status": "completed", "tag": "580ca05b-9b64-4591-b4d5-6b8926b0a301"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:59.523074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:38:59.537428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aee5c92-3a7d-42c0-8fa4-0e7cdc11f688 req-27952332-8e91-4e0f-a141-ac6c0da3e872 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.542058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aee5c92-3a7d-42c0-8fa4-0e7cdc11f688 req-27952332-8e91-4e0f-a141-ac6c0da3e872 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.543366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aee5c92-3a7d-42c0-8fa4-0e7cdc11f688 req-27952332-8e91-4e0f-a141-ac6c0da3e872 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.554640 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f6c2771-ce34-4677-9fb2-5649122b56b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.243436 Aug 23 10:38:59.569048 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 303/645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:59 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:38:59.570690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8aee5c92-3a7d-42c0-8fa4-0e7cdc11f688 req-27952332-8e91-4e0f-a141-ac6c0da3e872 service nova] Creating event network-vif-plugged:580ca05b-9b64-4591-b4d5-6b8926b0a301 for instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 on n-h2-847009-13 Aug 23 10:38:59.575986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8aee5c92-3a7d-42c0-8fa4-0e7cdc11f688 req-27952332-8e91-4e0f-a141-ac6c0da3e872 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069803 Aug 23 10:38:59.577454 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 343/646] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:38:59.646289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c21a0737-7bca-4403-8a2a-d7f7f9272dbe tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Action: 'create', calling method: .version_select at 0x7fdc9cf57040>, body: {"pool": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:38:59.806865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:38:59.807531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:38:59.823904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.824419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.824921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:38:59.825611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:38:59.826078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:38:59.826513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:00.300515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:00.316882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef329258-fea1-4bcc-a500-efce0a3b0c78 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1589 microversion: 2.1 time: 0.514632 Aug 23 10:39:00.325826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 344/647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:38:59 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1589 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:00.338771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f5c2eb07-6318-4fef-ba84-609e7d9ad9d2 req-32394985-fb27-4c3d-abba-7d567d47aba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc9606a-f510-4f75-b789-4e0259ead9e0", "tag": "1950d98b-1069-4c11-b1dc-0d917368e80a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:00.377837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f5c2eb07-6318-4fef-ba84-609e7d9ad9d2 req-32394985-fb27-4c3d-abba-7d567d47aba0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:00.379339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f5c2eb07-6318-4fef-ba84-609e7d9ad9d2 req-32394985-fb27-4c3d-abba-7d567d47aba0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:00.380875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f5c2eb07-6318-4fef-ba84-609e7d9ad9d2 req-32394985-fb27-4c3d-abba-7d567d47aba0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:00.404693 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f5c2eb07-6318-4fef-ba84-609e7d9ad9d2 req-32394985-fb27-4c3d-abba-7d567d47aba0 service nova] Creating event network-changed:1950d98b-1069-4c11-b1dc-0d917368e80a for instance bbc9606a-f510-4f75-b789-4e0259ead9e0 on n-h2-847009-13 Aug 23 10:39:00.418153 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f5c2eb07-6318-4fef-ba84-609e7d9ad9d2 req-32394985-fb27-4c3d-abba-7d567d47aba0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087257 Aug 23 10:39:00.420765 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 345/648] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:00.440215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:00.441077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:00.488302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:00.489702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:00.491303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:00.492719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:00.493429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:00.494020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:01.534515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:01.543263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:01.558783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:01.560267 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1179eedf-c57d-486a-a727-294f5603531b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 1.138326 Aug 23 10:39:01.563770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 346/649] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:00 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:01.568600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:01.569436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:01.582804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:01.583578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:01.584168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:01.586800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:01.587436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:01.588019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.075885 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c21a0737-7bca-4403-8a2a-d7f7f9272dbe tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.505534 Aug 23 10:39:02.076679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 304/650] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:38:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:02.086740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:02.090950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:02.097748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.098340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.098860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.099566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.100024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.100626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.104893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:02.138587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.139167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.139693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.140223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lazy-loading 'fault' on Instance uuid f914cb78-270e-4800-ae39-5679620e2577 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:02.182300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:02.191725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad1490e4-9549-4d5b-a7ef-de308cd15f5e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1313 microversion: 2.1 time: 0.626743 Aug 23 10:39:02.208527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 347/651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:01 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:02.216090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:02.220725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:02.231323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.232170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.233146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.253586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.254203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.254652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.392403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:02.400754 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d14b9cc0-f887-45a4-8ec8-2a7cfb254975 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1458 microversion: 2.1 time: 0.318683 Aug 23 10:39:02.416017 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 305/652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:02 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1458 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:02.421527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:02.424140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:02.443411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.444051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.444507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.445473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.446103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.447016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.661604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:02.670211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20c0d901-5595-49c2-a799-2e84306ac370 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.252820 Aug 23 10:39:02.671127 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 306/653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:02 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:02.677501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f638537-7b25-457d-8dbb-917a700b7f7d tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Action: 'create', calling method: .version_select at 0x7fdc9d153d30>, body: {"pool": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:02.901978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:02.911656 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-058a0091-cf91-4aab-a097-5af8dbfafe40 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1552 microversion: 2.1 time: 0.699339 Aug 23 10:39:02.912239 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 348/654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:02 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1552 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:02.921174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:02.926665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:02.939308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.943686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.944324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:02.945099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:02.945558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:02.945979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:03.188108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:03.668383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:03.685534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:03.687545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:03.691440 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a99a865a-3ae6-49f6-a4f5-f84dcc9170d8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.773308 Aug 23 10:39:03.692557 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 349/655] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:02 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:03.698239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:03.699323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:03.711276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:03.714339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:03.739408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:03.752477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:03.759440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:03.760125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:03.921695 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85472d19-0264-460e-98de-5d41b49d7482 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227842 Aug 23 10:39:03.926390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 350/656] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:39:03 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:03.942914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:03.947255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:03.980593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:03.983685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:03.985255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:03.987177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:03.989021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:03.990059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:04.456385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:04.465769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-519396a3-786e-4cbf-9cf9-766e9d7fc85f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1463 microversion: 2.1 time: 0.529124 Aug 23 10:39:04.474532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 351/657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:03 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1463 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:04.506425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:04.507448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:04.534299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:04.535340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:04.535959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:04.537481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:04.538087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:04.538942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:04.597447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:04.598186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:04.598948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:04.599569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lazy-loading 'fault' on Instance uuid f914cb78-270e-4800-ae39-5679620e2577 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:04.602990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:04.772898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbbc20b50547490db82a6d73412a617c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ab17592d8444fe58c447209f2246b83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:04.789143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9eb4546-d9f6-497c-b4d9-65e1a7268ee1 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 200 len: 1310 microversion: 2.1 time: 0.309883 Aug 23 10:39:04.791480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 352/658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:04 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 1310 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:04.815993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:04.817706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:04.829601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:04.830528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:04.831146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:04.832200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:04.832849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:04.837060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:05.303832 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f638537-7b25-457d-8dbb-917a700b7f7d tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.631275 Aug 23 10:39:05.305179 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 307/659] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:39:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:05.310025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fef7983b-c490-4632-8963-1a58b7710e2c req-4ec09f68-71ab-48b6-8798-b10d2a1263ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f914cb78-270e-4800-ae39-5679620e2577", "name": "network-vif-deleted", "tag": "e1cc670b-8cdf-4e4e-92d5-b1e1d5305712"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:05.325643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fef7983b-c490-4632-8963-1a58b7710e2c req-4ec09f68-71ab-48b6-8798-b10d2a1263ec service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:05.326847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fef7983b-c490-4632-8963-1a58b7710e2c req-4ec09f68-71ab-48b6-8798-b10d2a1263ec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:05.327420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fef7983b-c490-4632-8963-1a58b7710e2c req-4ec09f68-71ab-48b6-8798-b10d2a1263ec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:05.336165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:05.347168 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fef7983b-c490-4632-8963-1a58b7710e2c req-4ec09f68-71ab-48b6-8798-b10d2a1263ec service nova] Creating event network-vif-deleted:e1cc670b-8cdf-4e4e-92d5-b1e1d5305712 for instance f914cb78-270e-4800-ae39-5679620e2577 on n-h1-847009-13 Aug 23 10:39:05.348667 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-95c4c976-0b01-4d76-a0e6-1b4a85337904 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1309 microversion: 2.1 time: 0.555651 Aug 23 10:39:05.352827 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 353/660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:04 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1309 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:05.360553 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fef7983b-c490-4632-8963-1a58b7710e2c req-4ec09f68-71ab-48b6-8798-b10d2a1263ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051379 Aug 23 10:39:05.361315 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 308/661] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:05.370716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3edd7a00-6c9f-48fa-bffb-5725b100c4e4 req-43bb8aee-85b3-4f5f-bed2-2eb1f5342735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1d2a11-c639-47c1-8987-849de67c63ba", "name": "network-vif-plugged", "status": "completed", "tag": "5b1d8b1c-42fc-4d01-a50a-853265d4ec13"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:05.384956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3edd7a00-6c9f-48fa-bffb-5725b100c4e4 req-43bb8aee-85b3-4f5f-bed2-2eb1f5342735 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:05.385545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3edd7a00-6c9f-48fa-bffb-5725b100c4e4 req-43bb8aee-85b3-4f5f-bed2-2eb1f5342735 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:05.387970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3edd7a00-6c9f-48fa-bffb-5725b100c4e4 req-43bb8aee-85b3-4f5f-bed2-2eb1f5342735 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:05.401244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3edd7a00-6c9f-48fa-bffb-5725b100c4e4 req-43bb8aee-85b3-4f5f-bed2-2eb1f5342735 service nova] Creating event network-vif-plugged:5b1d8b1c-42fc-4d01-a50a-853265d4ec13 for instance fd1d2a11-c639-47c1-8987-849de67c63ba on n-h1-847009-13 Aug 23 10:39:05.410613 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3edd7a00-6c9f-48fa-bffb-5725b100c4e4 req-43bb8aee-85b3-4f5f-bed2-2eb1f5342735 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045160 Aug 23 10:39:05.412022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 309/662] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:05.419127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:05.423679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:05.433495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:05.434564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:05.435468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:05.436719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:05.437381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:05.438698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:05.474819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ccfb99ed-7874-4a80-be8c-12ebdb506f61 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d2f9940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-375158361", "description": "tempest-description-654289359"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:05.652821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:05.662182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Old instance type m1.heat2, new instance type m1.heat {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 10:39:05.670823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:39:05.671512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:39:05.672974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:39:05.673671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:39:05.674269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:39:05.843634 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90db4721-7e79-44c4-9d25-6165b208e275 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42/action" status: 202 len: 0 microversion: 2.1 time: 0.429827 Aug 23 10:39:05.846037 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 310/663] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:39:05 2022] POST /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:05.853543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:05.854443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:05.863693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:05.864604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:05.865333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:05.866414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:05.867193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:05.867857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:06.143723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:06.158505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:06.160422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:06.161956 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd45d867-b3e3-454d-8ad8-1d04d79bdcfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.314684 Aug 23 10:39:06.163821 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 311/664] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:05 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:06.171189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-698770e4-6626-4723-93d8-9f0dc2c1fc27 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Action: 'create', calling method: .version_select at 0x7fdc9ceb6b80>, body: {"pool": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:06.350421 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ccfb99ed-7874-4a80-be8c-12ebdb506f61 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.999675 Aug 23 10:39:06.358863 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 354/665] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:39:05 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:06.358863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:06.358863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:06.368588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:06.369290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:06.369931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:06.370808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:06.371273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:06.371745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:06.395619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] HTTP exception thrown: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Request method failure captured: Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 HTTP/1.1 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4ET9pFY98ApFWht-TUUgYkS4hojheZbYT65HgKyJ5TEkTOCmplttalO-yUyP6MFXFWeRl_Jw1qcfblAi5dK6nxbZSERtENeY62w3rM_jgQjIRZFFIK3dWtYtLFw0eiTofGTNRAYGSXwGM220sviHAhGbqjJdB8RXFnDSJ8Ab7om80 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:06.397506 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ab17592d8444fe58c447209f2246b83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}] Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cbbc20b50547490db82a6d73412a617c Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:06.399315 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'f914cb78-270e-4800-ae39-5679620e2577'} Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:06.400295 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:06.401561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:06.410631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Returning 404 to user: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:06.412261 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfe463f9-35d3-4771-801f-69b780c7e5f7 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 404 len: 111 microversion: 2.1 time: 0.059823 Aug 23 10:39:06.419951 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 355/666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:06 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:06.429328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:06.430241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:06.437326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:06.438127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:06.438705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:06.439557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:06.440263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:06.440787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:06.896373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:06.921472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8745d049-db67-4299-a110-38faf2f40132 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1472 microversion: 2.1 time: 0.497884 Aug 23 10:39:06.924722 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 356/667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:06 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:06.942877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e11845ac-8975-497e-9da0-8e9ad5b72e93 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d584ee0>, body: {"security_group_rule": {"parent_group_id": "de70f29a-6862-4af1-b141-4b15636832f2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:07.712698 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e11845ac-8975-497e-9da0-8e9ad5b72e93 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.785648 Aug 23 10:39:07.714437 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 357/668] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:07.719936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:07.720952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:07.734312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:07.737339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:07.738130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:07.739886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:07.741247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:07.741782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:07.910046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:07.919946 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0ff64fa5-b5ef-4001-8155-e15a9dd5b117 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1491 microversion: 2.1 time: 0.204258 Aug 23 10:39:07.921093 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 358/669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:07 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1491 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:07.927120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:07.927652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:07.934884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:07.935626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:07.936227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:07.937207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:07.937961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:07.938741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:07.959623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] HTTP exception thrown: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Request method failure captured: Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 HTTP/1.1 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4ET9pFY98ApFWht-TUUgYkS4hojheZbYT65HgKyJ5TEkTOCmplttalO-yUyP6MFXFWeRl_Jw1qcfblAi5dK6nxbZSERtENeY62w3rM_jgQjIRZFFIK3dWtYtLFw0eiTofGTNRAYGSXwGM220sviHAhGbqjJdB8RXFnDSJ8Ab7om80 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:07.962289 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ab17592d8444fe58c447209f2246b83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}] Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cbbc20b50547490db82a6d73412a617c Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:07.964334 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'f914cb78-270e-4800-ae39-5679620e2577'} Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:07.965304 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:07.966827 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:07.973437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Returning 404 to user: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:07.973437 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f179bc92-baae-4247-ad41-9c840d16cd3e tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 404 len: 111 microversion: 2.1 time: 0.044070 Aug 23 10:39:07.973437 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 359/670] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:39:07 2022] DELETE /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:07.973859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-698770e4-6626-4723-93d8-9f0dc2c1fc27 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.803459 Aug 23 10:39:07.973859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 312/671] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:39:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:07.983047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:07.983727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:07.985121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7fb487-32c8-4c54-96b8-1a587f153aa2", "name": "network-vif-unplugged", "status": "completed", "tag": "c17c9163-c59a-4086-b714-1fd30e316965"}, {"name": "network-changed", "server_uuid": "3c7fb487-32c8-4c54-96b8-1a587f153aa2", "tag": "c17c9163-c59a-4086-b714-1fd30e316965"}, {"name": "network-changed", "server_uuid": "1054768a-2e3f-4247-ada1-fd6ab4fb46e3", "tag": "8c12973d-00fc-4c00-8796-b7c9651575f9"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:07.991300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:07.991922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:07.992366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:07.993390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:07.993918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:07.994398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.005404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.006454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.007113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.025507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Creating event network-vif-unplugged:c17c9163-c59a-4086-b714-1fd30e316965 for instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 on n-h2-847009-13 Aug 23 10:39:08.026352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Creating event network-changed:c17c9163-c59a-4086-b714-1fd30e316965 for instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 on n-h2-847009-13 Aug 23 10:39:08.027284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] Creating event network-changed:8c12973d-00fc-4c00-8796-b7c9651575f9 for instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 on n-h2-847009-13 Aug 23 10:39:08.036259 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4bf44311-3e24-49bf-a5d0-d72ef7fb93d4 req-4a3eb792-503f-4dd4-8b70-5c1aa80928b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.060979 Aug 23 10:39:08.037493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 313/672] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:08.043962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2a133a3-f23d-4115-b13e-087b8b69cf18 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9ceb6ca0>, body: {"security_group_rule": {"parent_group_id": "de70f29a-6862-4af1-b141-4b15636832f2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:08.135278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b2a133a3-f23d-4115-b13e-087b8b69cf18 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: This rule already exists in group de70f29a-6862-4af1-b141-4b15636832f2 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2a133a3-f23d-4115-b13e-087b8b69cf18 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 138 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:08.137074 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: {"security_group_rule": {"parent_group_id": "de70f29a-6862-4af1-b141-4b15636832f2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 23 10:39:08.138683 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: exception: This rule already exists in group de70f29a-6862-4af1-b141-4b15636832f2 Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'de70f29a-6862-4af1-b141-4b15636832f2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group de70f29a-6862-4af1-b141-4b15636832f2 Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:08.139750 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group de70f29a-6862-4af1-b141-4b15636832f2 Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group de70f29a-6862-4af1-b141-4b15636832f2 Aug 23 10:39:08.141261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.143381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2a133a3-f23d-4115-b13e-087b8b69cf18 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 400 to user: This rule already exists in group de70f29a-6862-4af1-b141-4b15636832f2 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:08.144254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2a133a3-f23d-4115-b13e-087b8b69cf18 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.105035 Aug 23 10:39:08.145245 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 314/673] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:08 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:39:08.152961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:08.153801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:08.162012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.163792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.164523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.165581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.166211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.166842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.225777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:08.244615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:08.254134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:08.256717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-57c307cb-1a0f-4331-bc49-df7bf59e44ae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.288359 Aug 23 10:39:08.268135 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 360/674] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:07 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:08.291100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:08.291931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:08.304883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.306826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.307363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.308978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.309772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.310500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.393081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8db16a92-f9ac-4acf-bd19-9e25e3d59d16 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1644 microversion: 2.1 time: 0.246674 Aug 23 10:39:08.393985 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 315/675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:08 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1644 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:08.399344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:08.403721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: f914cb78-270e-4800-ae39-5679620e2577] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:08.415802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.416303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.416732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.417493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.422712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.423767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.445852 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] HTTP exception thrown: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Request method failure captured: Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 HTTP/1.1 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4ET9pFY98ApFWht-TUUgYkS4hojheZbYT65HgKyJ5TEkTOCmplttalO-yUyP6MFXFWeRl_Jw1qcfblAi5dK6nxbZSERtENeY62w3rM_jgQjIRZFFIK3dWtYtLFw0eiTofGTNRAYGSXwGM220sviHAhGbqjJdB8RXFnDSJ8Ab7om80 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:08.448037 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ab17592d8444fe58c447209f2246b83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}] Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: cbbc20b50547490db82a6d73412a617c Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:08.449876 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f914cb78-270e-4800-ae39-5679620e2577'} Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:08.450859 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. Aug 23 10:39:08.453553 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.455012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Returning 404 to user: Instance f914cb78-270e-4800-ae39-5679620e2577 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:08.455012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8f5e787-2089-4060-9824-0056528be31b tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577" status: 404 len: 111 microversion: 2.1 time: 0.056079 Aug 23 10:39:08.455012 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 316/676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:08 2022] GET /compute/v2.1/servers/f914cb78-270e-4800-ae39-5679620e2577 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:08.460251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1fa20193-6830-401d-91a5-80ad9803494f tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Action: 'create', calling method: .version_select at 0x7fdc9cdbe310>, body: {"pool": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:08.506157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:08.516505 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c1961e50-8f19-48ac-91cb-90f9713031b5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1472 microversion: 2.1 time: 0.243563 Aug 23 10:39:08.517562 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 361/677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:08 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:08.522341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e51f025-3cb6-4787-b320-de8b5a8a73f6 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9d13ef70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:08.760410 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e51f025-3cb6-4787-b320-de8b5a8a73f6 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/8207c629-4f4d-4504-bda4-063e1d957906" status: 202 len: 0 microversion: 2.1 time: 0.241639 Aug 23 10:39:08.761455 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 362/678] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Aug 23 10:39:08 2022] DELETE /compute/v2.1/os-security-group-rules/8207c629-4f4d-4504-bda4-063e1d957906 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:08.766663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:08.767438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:08.778182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.779226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.784051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.785179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.786755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.787557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.951688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9dbcc7cc-33c7-4b51-acca-dad4a1288799 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1644 microversion: 2.1 time: 0.188979 Aug 23 10:39:08.952708 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 363/679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:08 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1644 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:08.958526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:08.959327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:08.966022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.966717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.967402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.968294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:08.968693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:08.969223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:08.985420 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] HTTP exception thrown: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Request method failure captured: Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 HTTP/1.1 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4ET9pFY98ApFWht-TUUgYkS4hojheZbYT65HgKyJ5TEkTOCmplttalO-yUyP6MFXFWeRl_Jw1qcfblAi5dK6nxbZSERtENeY62w3rM_jgQjIRZFFIK3dWtYtLFw0eiTofGTNRAYGSXwGM220sviHAhGbqjJdB8RXFnDSJ8Ab7om80 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:08.987612 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ab17592d8444fe58c447209f2246b83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}] Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cbbc20b50547490db82a6d73412a617c Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:08.988980 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '4067c38d-f38f-45c1-9c64-1115be24afc6'} Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:08.989751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:08.990928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:08.992114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Returning 404 to user: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:08.992114 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-895b84ef-3f37-4e77-a018-31157fc229d9 tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 404 len: 111 microversion: 2.1 time: 0.035080 Aug 23 10:39:08.992864 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 364/680] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:39:08 2022] DELETE /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:09.006401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-62cb6418-0ea2-4de3-ac64-f4b0a9282ded tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d1ad3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-457732219", "description": "tempest-description-1121870147"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:09.158277 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-62cb6418-0ea2-4de3-ac64-f4b0a9282ded tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.164137 Aug 23 10:39:09.159372 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 365/681] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:39:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:09.164167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:09.167276 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:09.167276 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:39:09.168853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.169560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.170017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.170771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.171237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.171772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.206736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a882616-b967-44b4-8c75-bde2becfee48 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.045995 Aug 23 10:39:09.207541 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 366/682] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:39:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:09.213003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:09.213823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] [instance: 4067c38d-f38f-45c1-9c64-1115be24afc6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:09.222280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.222876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.223391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.224660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.225242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.225619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.240857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] HTTP exception thrown: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Request method failure captured: Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 HTTP/1.1 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4ET9pFY98ApFWht-TUUgYkS4hojheZbYT65HgKyJ5TEkTOCmplttalO-yUyP6MFXFWeRl_Jw1qcfblAi5dK6nxbZSERtENeY62w3rM_jgQjIRZFFIK3dWtYtLFw0eiTofGTNRAYGSXwGM220sviHAhGbqjJdB8RXFnDSJ8Ab7om80 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:09.242424 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ab17592d8444fe58c447209f2246b83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ab17592d8444fe58c447209f2246b83"}]}] Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ab17592d8444fe58c447209f2246b83 Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-2048389118 Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cbbc20b50547490db82a6d73412a617c Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersAdminTestJSON-2048389118-project Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:09.243843 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '4067c38d-f38f-45c1-9c64-1115be24afc6'} Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:09.244836 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. Aug 23 10:39:09.246086 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.247119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] Returning 404 to user: Instance 4067c38d-f38f-45c1-9c64-1115be24afc6 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:09.247119 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24b68cd9-1f04-4396-9cc8-48d37b86d08f tempest-DeleteServersAdminTestJSON-2048389118 tempest-DeleteServersAdminTestJSON-2048389118-project] 10.222.0.78 "GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6" status: 404 len: 111 microversion: 2.1 time: 0.035205 Aug 23 10:39:09.247119 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 367/683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:09 2022] GET /compute/v2.1/servers/4067c38d-f38f-45c1-9c64-1115be24afc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:09.257214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f44298be-bb25-45ec-881e-0e7b92f1e4a1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d16bb80>, body: {"security_group_rule": {"parent_group_id": "f6b75a76-a24a-4056-b33c-2ac5c9934cee", "ip_protocol": "tcp", "from_port": 861333325, "to_port": 22}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:09.342580 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f44298be-bb25-45ec-881e-0e7b92f1e4a1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Invalid port range 861333325:22. Former value cannot be greater than the later Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f44298be-bb25-45ec-881e-0e7b92f1e4a1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 145 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:09.345357 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: {"security_group_rule": {"parent_group_id": "f6b75a76-a24a-4056-b33c-2ac5c9934cee", "ip_protocol": "tcp", "from_port": 861333325, "to_port": 22}} Aug 23 10:39:09.346660 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid port range 861333325:22. Former value cannot be greater than the later Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f6b75a76-a24a-4056-b33c-2ac5c9934cee', 'ip_protocol': 'tcp', 'from_port': 861333325, 'to_port': 22}}} Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 861333325:22. Former value cannot be greater than the later Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:09.347406 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 861333325:22. Former value cannot be greater than the later Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 861333325:22. Former value cannot be greater than the later Aug 23 10:39:09.348556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.349758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f44298be-bb25-45ec-881e-0e7b92f1e4a1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 400 to user: Invalid port range 861333325:22. Former value cannot be greater than the later {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:09.349758 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f44298be-bb25-45ec-881e-0e7b92f1e4a1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.100773 Aug 23 10:39:09.349758 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 368/684] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:09 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:39:09.353215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:09.353739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:09.366229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.370040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.370780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.372013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.372627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.373277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.461265 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59a480ca-b143-450c-a19d-4a1c99eb8703 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba/action" status: 202 len: 0 microversion: 2.1 time: 0.111612 Aug 23 10:39:09.465488 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 369/685] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:39:09 2022] POST /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:09.482821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:09.484722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:09.495795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.496666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.498152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.500003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.501232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.501861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.680184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:09.692590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:09.694144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:09.696508 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0705462a-1c1d-4b27-b2b8-94b30086faac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.229055 Aug 23 10:39:09.697848 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 370/686] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:09 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:09.702920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d48b55dd-4310-452d-906b-0b9f9717dd55 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d1ad0d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2146055167", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:09.706702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d48b55dd-4310-452d-906b-0b9f9717dd55 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Security group id should be uuid Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d48b55dd-4310-452d-906b-0b9f9717dd55 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 131 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:09.709047 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2146055167", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:39:09.710437 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group id should be uuid Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2146055167', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:09.711236 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 23 10:39:09.712370 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:09.714446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d48b55dd-4310-452d-906b-0b9f9717dd55 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 400 to user: Security group id should be uuid {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:09.716041 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d48b55dd-4310-452d-906b-0b9f9717dd55 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016483 Aug 23 10:39:09.716700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 371/687] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:09 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:39:09.722882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:09.723856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:09.736145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.737354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.739156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:09.741977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:09.742707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:09.743350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:10.005783 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de163bef-8bac-42e9-a732-f1cf08d4d729 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1649 microversion: 2.1 time: 0.287705 Aug 23 10:39:10.006596 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 372/688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:09 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1649 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:10.011719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:10.012606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:10.020057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:10.020885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:10.021537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:10.022554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:10.023218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:10.023716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:10.199343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:10.211257 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3512cb6b-c995-473f-bf2b-12d7d5c1a497 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1472 microversion: 2.1 time: 0.203316 Aug 23 10:39:10.212281 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 373/689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:10 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:10.217615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9d4cccb6-a0b9-4ee6-a90b-6e247e4ab883 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d3b9940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1910234592", "description": "tempest-description-2089926369"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:10.399051 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9d4cccb6-a0b9-4ee6-a90b-6e247e4ab883 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.185356 Aug 23 10:39:10.401332 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 374/690] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:39:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:10.419566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-837dc46d-9f34-480e-9a4b-3fadda21df54 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d13edc0>, body: {"security_group_rule": {"parent_group_id": "c789dd9b-df09-4e94-bc8d-356932104e34", "ip_protocol": "tempest-999-293958735", "from_port": 22, "to_port": 22}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:10.491272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-837dc46d-9f34-480e-9a4b-3fadda21df54 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Invalid IP protocol tempest-999-293958735. Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-837dc46d-9f34-480e-9a4b-3fadda21df54 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 156 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:10.493817 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: {"security_group_rule": {"parent_group_id": "c789dd9b-df09-4e94-bc8d-356932104e34", "ip_protocol": "tempest-999-293958735", "from_port": 22, "to_port": 22}} Aug 23 10:39:10.495405 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid IP protocol tempest-999-293958735. Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c789dd9b-df09-4e94-bc8d-356932104e34', 'ip_protocol': 'tempest-999-293958735', 'from_port': 22, 'to_port': 22}}} Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-293958735. Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:10.496218 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-293958735. Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-293958735. Aug 23 10:39:10.497479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:10.498931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-837dc46d-9f34-480e-9a4b-3fadda21df54 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 400 to user: Invalid IP protocol tempest-999-293958735. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:10.498931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-837dc46d-9f34-480e-9a4b-3fadda21df54 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.082413 Aug 23 10:39:10.498931 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 375/691] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:10 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:39:10.506449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc631743-1739-4931-8fba-fa7e1eb82ec9 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d16b280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-702575093", "description": "tempest-description-1657167611"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:10.770434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc631743-1739-4931-8fba-fa7e1eb82ec9 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.268114 Aug 23 10:39:10.782902 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 376/692] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:39:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:10.787985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:10.788591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:10.799257 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1fa20193-6830-401d-91a5-80ad9803494f tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.344821 Aug 23 10:39:10.800128 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 317/693] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:39:08 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:10.804463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:10.805011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:10.805449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:10.805607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6acee45f-c827-40d5-9069-f96d25dc5a26 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9cd63b80>, body: {"security_group_rule": {"parent_group_id": "8a46422e-49f0-4ac0-934f-efd2e30b493e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:10.806154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:10.806608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:10.807226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:10.995683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:11.000047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-6acee45f-c827-40d5-9069-f96d25dc5a26 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6acee45f-c827-40d5-9069-f96d25dc5a26 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 138 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:11.001942 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: {"security_group_rule": {"parent_group_id": "8a46422e-49f0-4ac0-934f-efd2e30b493e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 23 10:39:11.003285 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8a46422e-49f0-4ac0-934f-efd2e30b493e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:11.004332 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 10:39:11.006349 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.009163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6acee45f-c827-40d5-9069-f96d25dc5a26 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:11.010321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6acee45f-c827-40d5-9069-f96d25dc5a26 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.208915 Aug 23 10:39:11.011143 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 318/694] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:39:11.019385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:11.019851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:11.021287 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-86ab5d90-3b97-4e8e-abc4-4d5298c9a3ed tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.236979 Aug 23 10:39:11.022045 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 377/695] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:10 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:11.024493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43474ba4-48ba-439b-ba27-4dac50a38194 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9cdbee50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:11.036723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07311018-f3c1-4fe5-bfa2-cbbc1f493c4d tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d16b940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1297507440", "description": "tempest-description-355248467"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:11.223876 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07311018-f3c1-4fe5-bfa2-cbbc1f493c4d tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.200224 Aug 23 10:39:11.224697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 378/696] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:39:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:11.237210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:11.237826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:11.247370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:11.247859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:11.248520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:11.249278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:11.250152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:11.250648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:11.423853 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81aadb89-6051-4a5d-9378-3c867b6bd8e4 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1629 microversion: 2.1 time: 0.197165 Aug 23 10:39:11.424605 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 379/697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:11 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1629 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:11.429870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:11.430738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:11.440678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:11.441537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:11.443155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:11.443960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:11.444497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:11.445290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:11.446614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43474ba4-48ba-439b-ba27-4dac50a38194 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/7f62502e-2ffc-4753-8ef7-695eac3917ef" status: 200 len: 141 microversion: 2.1 time: 0.433553 Aug 23 10:39:11.447857 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 319/698] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:39:11 2022] GET /compute/v2.1/os-floating-ips/7f62502e-2ffc-4753-8ef7-695eac3917ef => generated 141 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:11.452369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d670c2a-7408-409f-ab24-e584642f52b1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9cd63550>, body: {"security_group_rule": {"parent_group_id": "24b838b2-db15-4a5f-a99b-c18347e955d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1570944998}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:11.563275 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1d670c2a-7408-409f-ab24-e584642f52b1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Invalid port range 22:1570944998. Valid TCP ports should be between 1-65535 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d670c2a-7408-409f-ab24-e584642f52b1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 146 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:11.565133 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: {"security_group_rule": {"parent_group_id": "24b838b2-db15-4a5f-a99b-c18347e955d4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1570944998}} Aug 23 10:39:11.566422 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid port range 22:1570944998. Valid TCP ports should be between 1-65535 Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'security_group_rule': {'parent_group_id': '24b838b2-db15-4a5f-a99b-c18347e955d4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1570944998}}} Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1570944998. Valid TCP ports should be between 1-65535 Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:11.567220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1570944998. Valid TCP ports should be between 1-65535 Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1570944998. Valid TCP ports should be between 1-65535 Aug 23 10:39:11.568366 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:11.569517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d670c2a-7408-409f-ab24-e584642f52b1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 400 to user: Invalid port range 22:1570944998. Valid TCP ports should be between 1-65535 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:11.570755 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d670c2a-7408-409f-ab24-e584642f52b1 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.121752 Aug 23 10:39:11.570941 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 320/699] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:11 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:39:11.579517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-13", "block_migration": true, "disk_over_commit": false}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:11.582211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:11.588322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:11.588850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:11.589529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:11.590575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:11.591048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:11.591477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:11.630266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lazy-loading 'flavor' on Instance uuid fd1d2a11-c639-47c1-8987-849de67c63ba {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:11.665957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Going to try to live migrate instance to n-h2-847009-13 {{(pid=128860) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:39:11.700286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:11.712355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6a88f8c-fc8a-48c1-a63a-251e1e13ba04 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1472 microversion: 2.1 time: 0.286232 Aug 23 10:39:11.715583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 380/700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:11 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:11.724153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-95603b51-4380-4cc9-98c5-576fd2c66585 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9d2ea430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:12.756163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-95603b51-4380-4cc9-98c5-576fd2c66585 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/7f62502e-2ffc-4753-8ef7-695eac3917ef" status: 202 len: 0 microversion: 2.1 time: 1.039273 Aug 23 10:39:12.760883 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 381/701] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:39:11 2022] DELETE /compute/v2.1/os-floating-ips/7f62502e-2ffc-4753-8ef7-695eac3917ef => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:12.765135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Action: 'create', calling method: .version_select at 0x7fdc9d293e50>, body: {"security_group_rule": {"parent_group_id": "b5d71f8e-c342-4475-8686-24f56389d5e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:12.795300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:39:12.796419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Neutron security group b5d71f8e-c342-4475-8686-24f56389d5e9 not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:39:12.797401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.797401 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 138 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:39:12.808084 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: {"security_group_rule": {"parent_group_id": "b5d71f8e-c342-4475-8686-24f56389d5e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 23 10:39:12.809421 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b5d71f8e-c342-4475-8686-24f56389d5e9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:39:12.810115 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 23 10:39:12.811253 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] Aug 23 10:39:12.812998 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 404 to user: Security group b5d71f8e-c342-4475-8686-24f56389d5e9 does not exist Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-11229777-e8aa-4870-8306-8b04d0085102'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:12.816516 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69173ba2-d923-4428-b4ee-99c5836428e8 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.051532 Aug 23 10:39:12.818493 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 382/702] 10.222.0.78 () {60 vars in 1195 bytes} [Tue Aug 23 10:39:12 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:12.831025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:12.831798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:12.839059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:12.840109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:12.840679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:12.841301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:12.841765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:12.842197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:12.864353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:13.059869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:13.068547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:13.070178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:13.071392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-472f5486-f3f6-4d25-b74d-aaa232988488 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.252142 Aug 23 10:39:13.071961 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 383/703] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:12 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:13.076732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.077522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:13.083937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.084560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.085466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.086740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.087334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.087848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.244978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:13.254417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47014552-0aef-48fa-91a3-38a97914a213 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.181384 Aug 23 10:39:13.254988 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a13daa0a-ec01-422b-8e33-c83c7f4b319d tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba/action" status: 202 len: 0 microversion: 2.1 time: 1.682188 Aug 23 10:39:13.255793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 384/704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:13 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:13.259350 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 321/705] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:39:11 2022] POST /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba/action => generated 0 bytes in 1686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:13.260480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b803ff9e-039e-4c06-9dd9-79021ebea299 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9d2938b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.264134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9cdbe550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.286743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:39:13.287383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Neutron security group rule b201934b-a043-407b-98d8-783843f7b2f8 not found {{(pid=128860) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 23 10:39:13.287884 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] HTTP exception thrown: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.287884 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Request method failure captured: Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-security-group-rules/b201934b-a043-407b-98d8-783843f7b2f8 HTTP/1.1 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5HZ3Va7mgu4GKfew1Rjq2wATCALpqn_1wMv2F6df5oylmOed8d_Y8ZdLJOg7jeuekAmmopZL4vRhlIKEOqyjDWr9qPbECYDFTaJgDGA8pjo_Q_cGDhqRiGV_IplizAw85xf7npaUI85-YC4GSfXFFmR_lgewKAImMg5FdvHLXEFw8 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:13.289863 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa9a4f21ee4d47a28e4bc2ae657510f9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa9a4f21ee4d47a28e4bc2ae657510f9"}]}] Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aa9a4f21ee4d47a28e4bc2ae657510f9 Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451 Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c6bc24480e1e448cbeeb62f9d6932126 Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-578682451-project Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.291511 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b201934b-a043-407b-98d8-783843f7b2f8'} Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:13.292337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 23 10:39:13.293783 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.295109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] Aug 23 10:39:13.297455 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:13.299262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Returning 404 to user: Security group rule b201934b-a043-407b-98d8-783843f7b2f8 does not exist Aug 23 10:39:13.299262 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-58162624-7e17-48e8-9dbe-5fd5c47d1870'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:13.300132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0646a02d-8c54-4abe-9590-78307bdba29e tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/b201934b-a043-407b-98d8-783843f7b2f8" status: 404 len: 199 microversion: 2.1 time: 0.039882 Aug 23 10:39:13.304881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 322/706] 10.222.0.78 () {58 vars in 1287 bytes} [Tue Aug 23 10:39:13 2022] DELETE /compute/v2.1/os-security-group-rules/b201934b-a043-407b-98d8-783843f7b2f8 => generated 199 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:13.449146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Calling method '.version_select at 0x7fdc9d0c2f70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.454330 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:13.454330 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:13.455900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.456412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.456887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.470172 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b803ff9e-039e-4c06-9dd9-79021ebea299 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.213181 Aug 23 10:39:13.470753 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 385/707] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Aug 23 10:39:13 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:39:13.473455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.474075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.474691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.476974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.477592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:13.483519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.484007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.485191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.485905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.486371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.486802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.496986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.497490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.497934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.509880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.510364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.510804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.540437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.541212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.541661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.548950 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd554f59-9b0e-4434-8fff-5f2e9bea4725 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2155 microversion: 2.53 time: 0.242902 Aug 23 10:39:13.549662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 323/708] 10.222.0.78 () {60 vars in 1243 bytes} [Tue Aug 23 10:39:13 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2155 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:13.561035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2c08c34-66aa-4135-bcfd-7ec939b6886c tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9d25d1f0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.638721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:13.647258 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02d84f1e-6828-40a0-8f44-77cb8ceeec65 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.175331 Aug 23 10:39:13.647940 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 386/709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:13 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:13.652820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8e86de4-1723-4cb7-97bc-797fc88837e7 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9d09db80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.862109 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a8e86de4-1723-4cb7-97bc-797fc88837e7 tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.212846 Aug 23 10:39:13.871024 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 387/710] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:39:13 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:13.876395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Calling method '.version_select at 0x7fdc9d293dc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.879177 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:13.879177 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:39:13.880292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.880801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.881429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.900220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.900710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.901138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2c08c34-66aa-4135-bcfd-7ec939b6886c tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/24b838b2-db15-4a5f-a99b-c18347e955d4" status: 202 len: 0 microversion: 2.1 time: 0.349634 Aug 23 10:39:13.901270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.902360 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 324/711] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:39:13 2022] DELETE /compute/v2.1/os-security-groups/24b838b2-db15-4a5f-a99b-c18347e955d4 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:13.908915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7429af88-adbf-421f-a45e-13038f06becd tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9cdcec10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:13.939314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.939801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.940240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.951302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.951776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.952206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.983145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:13.983720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:13.984263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:13.990802 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b8d57e5-c8c6-437b-b0c3-991bb87fb9f3 tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 846 microversion: 2.53 time: 0.118606 Aug 23 10:39:13.991449 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 388/712] 10.222.0.78 () {60 vars in 1222 bytes} [Tue Aug 23 10:39:13 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 846 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:39:13.995971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad587cb2-807e-4b74-b236-d8292253e19c tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9d16b9d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:14.184545 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad587cb2-807e-4b74-b236-d8292253e19c tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/8a46422e-49f0-4ac0-934f-efd2e30b493e" status: 202 len: 0 microversion: 2.1 time: 0.191965 Aug 23 10:39:14.185174 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 389/713] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:39:13 2022] DELETE /compute/v2.1/os-security-groups/8a46422e-49f0-4ac0-934f-efd2e30b493e => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:14.189757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Calling method '.version_select at 0x7fdc9d09dee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:14.192161 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:14.192161 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:39:14.194114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:14.194660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:14.195105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:14.216018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:14.216880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:14.217324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:14.225536 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5c47d3e0-be37-4004-8ca5-1e33e1923e2c tempest-HypervisorAdminV253TestBase-774974039 tempest-HypervisorAdminV253TestBase-774974039-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/9cdfcc29-71b1-4e0f-b822-d8747deb3779" status: 200 len: 794 microversion: 2.53 time: 0.039359 Aug 23 10:39:14.226134 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 390/714] 10.222.0.78 () {60 vars in 1298 bytes} [Tue Aug 23 10:39:14 2022] GET /compute/v2.1/os-hypervisors/9cdfcc29-71b1-4e0f-b822-d8747deb3779 => generated 794 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:39:14.230672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:14.231472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:14.241967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:14.242658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:14.243357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:14.244231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:14.244984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:14.245657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:14.401428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:14.411381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:14.413262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:14.414701 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0265c2ee-fbc0-4cb5-a33a-1ed2254c84cf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.187598 Aug 23 10:39:14.415656 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 391/715] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:14 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:14.436640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-628dac6a-3d79-42c7-8522-092d9ce660f0 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9d09dca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:14.646383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-628dac6a-3d79-42c7-8522-092d9ce660f0 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c789dd9b-df09-4e94-bc8d-356932104e34" status: 202 len: 0 microversion: 2.1 time: 0.229440 Aug 23 10:39:14.648785 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 392/716] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:39:14 2022] DELETE /compute/v2.1/os-security-groups/c789dd9b-df09-4e94-bc8d-356932104e34 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:14.655618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:14.657170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:14.673711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:14.675044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:14.675862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:14.676825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:14.677841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:14.678867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:14.825628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:14.835195 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f454c63f-08ea-4eb1-a2b7-45fb0853c77b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.184880 Aug 23 10:39:14.835792 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 393/717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:14 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:14.840329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-182ccc8d-252c-4edc-841d-861dee505d3d tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9d16b790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:15.030288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-182ccc8d-252c-4edc-841d-861dee505d3d tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f6b75a76-a24a-4056-b33c-2ac5c9934cee" status: 202 len: 0 microversion: 2.1 time: 0.193430 Aug 23 10:39:15.031039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 394/718] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:39:14 2022] DELETE /compute/v2.1/os-security-groups/f6b75a76-a24a-4056-b33c-2ac5c9934cee => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:15.035986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:15.037299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:15.045582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:15.048039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:15.048666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:15.049459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:15.049993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:15.051391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:15.194155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:15.202970 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3dad9110-960e-411b-8e13-bb2b7292e0d7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.170762 Aug 23 10:39:15.203535 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 395/719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:15 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:15.208391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6fea9c3-348c-4d80-baef-153547cd0646 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] Calling method '.version_select at 0x7fdc9d293d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:15.404469 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6fea9c3-348c-4d80-baef-153547cd0646 tempest-SecurityGroupRulesNegativeTestJSON-578682451 tempest-SecurityGroupRulesNegativeTestJSON-578682451-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/de70f29a-6862-4af1-b141-4b15636832f2" status: 202 len: 0 microversion: 2.1 time: 0.199683 Aug 23 10:39:15.409582 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 396/720] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:39:15 2022] DELETE /compute/v2.1/os-security-groups/de70f29a-6862-4af1-b141-4b15636832f2 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:15.439642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:15.441138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:15.458365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:15.460351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:15.461221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:15.467903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:15.468456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:15.471007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:15.563209 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7429af88-adbf-421f-a45e-13038f06becd tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/a1f50a49-31d3-4b0b-a4ff-02c4c8445a3a" status: 202 len: 0 microversion: 2.1 time: 1.658925 Aug 23 10:39:15.566805 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 325/721] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:39:13 2022] DELETE /compute/v2.1/os-floating-ips/a1f50a49-31d3-4b0b-a4ff-02c4c8445a3a => generated 0 bytes in 1661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:15.573978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-224b7c7c-239e-4aba-afc3-f0887324969c tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9cd1e430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:16.004420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:16.013694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:16.015485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:16.016984 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a070086-7d3b-4ea3-81fc-b8325ffe4da6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.582121 Aug 23 10:39:16.017579 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 397/722] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:15 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:39:16.024419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-4b7f33e3-0168-4a6e-a9c0-2c674752b10d req-6adb4ebc-e233-47cb-bf0d-b7f0d72f1016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1d2a11-c639-47c1-8987-849de67c63ba", "name": "network-vif-unplugged", "status": "completed", "tag": "5b1d8b1c-42fc-4d01-a50a-853265d4ec13"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:16.041508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4b7f33e3-0168-4a6e-a9c0-2c674752b10d req-6adb4ebc-e233-47cb-bf0d-b7f0d72f1016 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:16.042815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4b7f33e3-0168-4a6e-a9c0-2c674752b10d req-6adb4ebc-e233-47cb-bf0d-b7f0d72f1016 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:16.043855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4b7f33e3-0168-4a6e-a9c0-2c674752b10d req-6adb4ebc-e233-47cb-bf0d-b7f0d72f1016 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:16.065623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-4b7f33e3-0168-4a6e-a9c0-2c674752b10d req-6adb4ebc-e233-47cb-bf0d-b7f0d72f1016 service nova] Creating event network-vif-unplugged:5b1d8b1c-42fc-4d01-a50a-853265d4ec13 for instance fd1d2a11-c639-47c1-8987-849de67c63ba on n-h1-847009-13 Aug 23 10:39:16.071058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-4b7f33e3-0168-4a6e-a9c0-2c674752b10d req-6adb4ebc-e233-47cb-bf0d-b7f0d72f1016 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052135 Aug 23 10:39:16.071762 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 398/723] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:16.084580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:16.085584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:16.096921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:16.097473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:16.098059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:16.099636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:16.100257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:16.101133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:16.475475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:16.487874 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff4ce5a7-3f0b-44b6-9aa4-081f466bc7d1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.413707 Aug 23 10:39:16.488603 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 399/724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:16 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:16.507094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:16.507939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:16.510185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:16.516842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:16.517634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:16.518301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:16.519227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:16.519918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:16.520443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:16.875860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:16.885014 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67083697-023d-4e8c-8cb4-fb10011905e0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.382350 Aug 23 10:39:16.885601 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 400/725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:16 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:17.043989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:17.045696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:17.052859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:17.053572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:17.054203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:17.055082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:17.056312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:17.056965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:17.066224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-224b7c7c-239e-4aba-afc3-f0887324969c tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b964ec23-70f7-42ac-a1f8-bf4377477038" status: 202 len: 0 microversion: 2.1 time: 1.497300 Aug 23 10:39:17.066824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 326/726] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:39:15 2022] DELETE /compute/v2.1/os-floating-ips/b964ec23-70f7-42ac-a1f8-bf4377477038 => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:17.074516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85be3a28-7cd4-4258-a85d-441f6e03651c tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] Calling method '.version_select at 0x7fdc9cd1edc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:17.350048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:17.360411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:17.361967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:17.363163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14278c5b-e73b-4a77-a2cc-387e841a608b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.323578 Aug 23 10:39:17.363730 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 401/727] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:17 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:17.512986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:17.513809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:17.520274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:17.521017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:17.521629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:17.522492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:17.523104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:17.524027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:17.880530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:17.890896 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24938589-44a5-4c50-9bce-fee11e8987e2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.381026 Aug 23 10:39:17.909836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 402/728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:17 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:17.915483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:17.916106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:17.922755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:17.923488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:17.924511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:17.925807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:17.926470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:17.927222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:18.072379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85be3a28-7cd4-4258-a85d-441f6e03651c tempest-FloatingIPDetailsTestJSON-1180748095 tempest-FloatingIPDetailsTestJSON-1180748095-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/f001d34f-f704-478c-9676-543d6e07f379" status: 202 len: 0 microversion: 2.1 time: 1.001437 Aug 23 10:39:18.077366 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 327/729] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:39:17 2022] DELETE /compute/v2.1/os-floating-ips/f001d34f-f704-478c-9676-543d6e07f379 => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:39:18.100061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8502d49e-8a3f-447a-bda7-f16f7d94dce1 req-e705bb24-da0b-48d8-bab8-09788be337d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd1d2a11-c639-47c1-8987-849de67c63ba", "tag": "5b1d8b1c-42fc-4d01-a50a-853265d4ec13"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:18.118505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:18.128003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8502d49e-8a3f-447a-bda7-f16f7d94dce1 req-e705bb24-da0b-48d8-bab8-09788be337d9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:18.128503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8502d49e-8a3f-447a-bda7-f16f7d94dce1 req-e705bb24-da0b-48d8-bab8-09788be337d9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:18.128973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8502d49e-8a3f-447a-bda7-f16f7d94dce1 req-e705bb24-da0b-48d8-bab8-09788be337d9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:18.159087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8502d49e-8a3f-447a-bda7-f16f7d94dce1 req-e705bb24-da0b-48d8-bab8-09788be337d9 service nova] Creating event network-changed:5b1d8b1c-42fc-4d01-a50a-853265d4ec13 for instance fd1d2a11-c639-47c1-8987-849de67c63ba on n-h1-847009-13 Aug 23 10:39:18.168050 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8502d49e-8a3f-447a-bda7-f16f7d94dce1 req-e705bb24-da0b-48d8-bab8-09788be337d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074749 Aug 23 10:39:18.177233 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 328/730] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:18.358097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:18.368089 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f28899e-9601-479a-b263-de661a3e18d3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.456899 Aug 23 10:39:18.368967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 403/731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:17 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:18.388572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:18.389700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:18.400086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:18.400583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:18.401832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:18.402731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:18.403886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:18.404365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:18.907196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:18.916683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:18.917679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:18.929047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:18.930268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:18.931309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:18.932815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:18.933804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:18.935210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:18.935862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:18.936576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:18.938479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-977d66bd-c0a8-4dd9-b84b-dbd039f41db9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1568 microversion: 2.25 time: 0.554944 Aug 23 10:39:18.942052 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 329/732] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:18 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1568 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:19.188005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:19.224722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.234651 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6cfeb2f0-eee7-4c06-b055-7b43bd0a1b83 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.325988 Aug 23 10:39:19.253043 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 404/733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:18 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:19.393111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.394657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:19.401290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.402026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.402615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.403663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.404422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.405194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.422642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36bd63de-7567-422a-b221-d572959204c2 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Calling method '.version_select at 0x7fdc9cd215e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.423949 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.423949 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:19.425273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36bd63de-7567-422a-b221-d572959204c2 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '0eef10c2d63948a4af8d5f48c39a3777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a62c653d254a7d8473473088601baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36bd63de-7567-422a-b221-d572959204c2 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Request method failure captured: Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5Wqz_VqNSRONhVC98QWxCKkFkquykdJHsBQX0EG5-8gyQH4hR2KFR_sZv9J176_wnQ_dnwpGjHh1riGf2OMzDsfHUTzHRqtA_BPGto9ungklr_qXz4vi9-fM4mpVs5vj84VJZUBE5iQupa2u4qi5mUs_6rIThGaFP6nGEG_0iFODY Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:19.428112 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9a62c653d254a7d8473473088601baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9a62c653d254a7d8473473088601baa", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}] Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 0eef10c2d63948a4af8d5f48c39a3777 Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:39:19.429661 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:39:19.430523 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 23 10:39:19.431647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.433312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36bd63de-7567-422a-b221-d572959204c2 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.433312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36bd63de-7567-422a-b221-d572959204c2 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.301466 Aug 23 10:39:19.436313 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 330/734] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 307 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:19.441886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93716c73-0e2b-4124-a4ba-78935a0c87f5 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Calling method '.version_select at 0x7fdc9cd29790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.442780 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.442780 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:19.444033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93716c73-0e2b-4124-a4ba-78935a0c87f5 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '0eef10c2d63948a4af8d5f48c39a3777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a62c653d254a7d8473473088601baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93716c73-0e2b-4124-a4ba-78935a0c87f5 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Request method failure captured: Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5Wqz_VqNSRONhVC98QWxCKkFkquykdJHsBQX0EG5-8gyQH4hR2KFR_sZv9J176_wnQ_dnwpGjHh1riGf2OMzDsfHUTzHRqtA_BPGto9ungklr_qXz4vi9-fM4mpVs5vj84VJZUBE5iQupa2u4qi5mUs_6rIThGaFP6nGEG_0iFODY Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:19.446616 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9a62c653d254a7d8473473088601baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9a62c653d254a7d8473473088601baa", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}] Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 0eef10c2d63948a4af8d5f48c39a3777 Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:39:19.447892 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:39:19.448647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 23 10:39:19.450177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.451292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93716c73-0e2b-4124-a4ba-78935a0c87f5 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.451292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93716c73-0e2b-4124-a4ba-78935a0c87f5 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010616 Aug 23 10:39:19.451292 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 331/735] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:19.458895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06ced4c0-a4eb-4ae2-afac-1be93e9b49da tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Calling method '.version_select at 0x7fdc9cd21940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.460275 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.460275 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:19.462004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06ced4c0-a4eb-4ae2-afac-1be93e9b49da tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '0eef10c2d63948a4af8d5f48c39a3777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a62c653d254a7d8473473088601baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06ced4c0-a4eb-4ae2-afac-1be93e9b49da tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Request method failure captured: Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5Wqz_VqNSRONhVC98QWxCKkFkquykdJHsBQX0EG5-8gyQH4hR2KFR_sZv9J176_wnQ_dnwpGjHh1riGf2OMzDsfHUTzHRqtA_BPGto9ungklr_qXz4vi9-fM4mpVs5vj84VJZUBE5iQupa2u4qi5mUs_6rIThGaFP6nGEG_0iFODY Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:19.464112 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9a62c653d254a7d8473473088601baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9a62c653d254a7d8473473088601baa", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}] Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 0eef10c2d63948a4af8d5f48c39a3777 Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:39:19.465649 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:39:19.466575 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 23 10:39:19.467748 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.470728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06ced4c0-a4eb-4ae2-afac-1be93e9b49da tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.472336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06ced4c0-a4eb-4ae2-afac-1be93e9b49da tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.017936 Aug 23 10:39:19.477520 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 332/736] 10.222.0.78 () {58 vars in 1179 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:19.560380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Calling method '.version_select at 0x7fdc9cdbe280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.564806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.565693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.566362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.589144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.590518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.591331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.604183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.605068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.605728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.615860 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b60fba2f-159b-4dce-b454-9d5bd848c960 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.136843 Aug 23 10:39:19.616732 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 333/737] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:19.628991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59a9570f-1aa4-4fec-bacb-c05415c5db76 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Calling method '.version_select at 0x7fdc9cd21160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.629971 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.629971 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:19.631511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-59a9570f-1aa4-4fec-bacb-c05415c5db76 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '0eef10c2d63948a4af8d5f48c39a3777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a62c653d254a7d8473473088601baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59a9570f-1aa4-4fec-bacb-c05415c5db76 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Request method failure captured: Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5Wqz_VqNSRONhVC98QWxCKkFkquykdJHsBQX0EG5-8gyQH4hR2KFR_sZv9J176_wnQ_dnwpGjHh1riGf2OMzDsfHUTzHRqtA_BPGto9ungklr_qXz4vi9-fM4mpVs5vj84VJZUBE5iQupa2u4qi5mUs_6rIThGaFP6nGEG_0iFODY Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:19.633431 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9a62c653d254a7d8473473088601baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9a62c653d254a7d8473473088601baa", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}] Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 0eef10c2d63948a4af8d5f48c39a3777 Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1'} Aug 23 10:39:19.635063 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:39:19.636015 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 23 10:39:19.637565 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.640050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59a9570f-1aa4-4fec-bacb-c05415c5db76 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.641609 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59a9570f-1aa4-4fec-bacb-c05415c5db76 tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.016918 Aug 23 10:39:19.642987 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 334/738] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:19.651892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88d25fac-c3c2-40d0-adf1-0ecc20367222 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Calling method '.version_select at 0x7fdc9cd29a60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.654698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-88d25fac-c3c2-40d0-adf1-0ecc20367222 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] HTTP exception thrown: Hypervisor with ID 'df355b1e-5d73-48e8-8ba1-6c9c29924630' could not be found. Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88d25fac-c3c2-40d0-adf1-0ecc20367222 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Request method failure captured: Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/df355b1e-5d73-48e8-8ba1-6c9c29924630/uptime HTTP/1.1 Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5WyZExzFRcLzzwh0uBvz1ir3deQQGXhYuKBCOup5xVeDrQYEGxEYy6SqdeFV5OVMVAhWiOK_mZDblMtCnsgvG2LwDBS0lj7wNRANoIrttlpMwEnxGjr5iF5bof-EC58ly1DV1DlHZG9SURD1dvfEywWjtxd1MpxGGvRAXRdOFIk-E Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c0210774029f406390e2af6139b4aad9 Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-404043650 Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:39:19.663088 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0210774029f406390e2af6139b4aad9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0210774029f406390e2af6139b4aad9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0210774029f406390e2af6139b4aad9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0210774029f406390e2af6139b4aad9"}]}] Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-404043650 Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c0210774029f406390e2af6139b4aad9 Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-404043650 Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1ceb6202f30949cf8c206f0ec479dd68 Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: exception: Hypervisor with ID 'df355b1e-5d73-48e8-8ba1-6c9c29924630' could not be found. Aug 23 10:39:19.664895 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'df355b1e-5d73-48e8-8ba1-6c9c29924630'} Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'df355b1e-5d73-48e8-8ba1-6c9c29924630' Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 23 10:39:19.665905 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'df355b1e-5d73-48e8-8ba1-6c9c29924630' could not be found. Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.667356 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'df355b1e-5d73-48e8-8ba1-6c9c29924630' could not be found. Aug 23 10:39:19.669418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.672337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88d25fac-c3c2-40d0-adf1-0ecc20367222 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Returning 404 to user: Hypervisor with ID 'df355b1e-5d73-48e8-8ba1-6c9c29924630' could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.673602 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88d25fac-c3c2-40d0-adf1-0ecc20367222 tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/df355b1e-5d73-48e8-8ba1-6c9c29924630/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025746 Aug 23 10:39:19.682498 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 335/739] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors/df355b1e-5d73-48e8-8ba1-6c9c29924630/uptime => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:39:19.695263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Calling method '.version_select at 0x7fdc9cd29c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.696444 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.696444 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:19.697966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.698703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.699336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.721062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.721990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.723149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.737947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.742152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:19.743019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:19.743799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:19.754466 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f2666ac-9e62-4acd-bf45-0803ce5b34af tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.070589 Aug 23 10:39:19.755444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 336/740] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:19.766062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:19.770053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bad9be19-d774-4d91-b3cc-ab2f697118ff tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Calling method '.version_select at 0x7fdc9cd29430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.770447 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43f13a91-a312-4b69-9c67-120cb5e91c08 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.382647 Aug 23 10:39:19.771030 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 405/741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:19.772024 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.772024 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:39:19.775580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bad9be19-d774-4d91-b3cc-ab2f697118ff tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '0eef10c2d63948a4af8d5f48c39a3777', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a62c653d254a7d8473473088601baa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bad9be19-d774-4d91-b3cc-ab2f697118ff tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Request method failure captured: Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5Wqz_VqNSRONhVC98QWxCKkFkquykdJHsBQX0EG5-8gyQH4hR2KFR_sZv9J176_wnQ_dnwpGjHh1riGf2OMzDsfHUTzHRqtA_BPGto9ungklr_qXz4vi9-fM4mpVs5vj84VJZUBE5iQupa2u4qi5mUs_6rIThGaFP6nGEG_0iFODY Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:19.777456 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9a62c653d254a7d8473473088601baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9a62c653d254a7d8473473088601baa", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9a62c653d254a7d8473473088601baa"}]}] Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9a62c653d254a7d8473473088601baa Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158 Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 0eef10c2d63948a4af8d5f48c39a3777 Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2027267158-project Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1'} Aug 23 10:39:19.779014 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:39:19.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 23 10:39:19.781450 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.782886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bad9be19-d774-4d91-b3cc-ab2f697118ff tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.782886 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bad9be19-d774-4d91-b3cc-ab2f697118ff tempest-HypervisorAdminNegativeTestJSON-2027267158 tempest-HypervisorAdminNegativeTestJSON-2027267158-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014804 Aug 23 10:39:19.786420 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 337/742] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:19.793441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f9cbbae-e9b8-461c-86e3-d2fcd15b34ca tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Calling method '.version_select at 0x7fdc9d2ea040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.794469 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:19.794469 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:39:19.795489 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0f9cbbae-e9b8-461c-86e3-d2fcd15b34ca tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] HTTP exception thrown: Hypervisor with ID 'ebd28e9d-4791-42cb-bd34-0c134df80b62' could not be found. Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f9cbbae-e9b8-461c-86e3-d2fcd15b34ca tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Request method failure captured: Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hypervisors/ebd28e9d-4791-42cb-bd34-0c134df80b62 HTTP/1.1 Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK5WyZExzFRcLzzwh0uBvz1ir3deQQGXhYuKBCOup5xVeDrQYEGxEYy6SqdeFV5OVMVAhWiOK_mZDblMtCnsgvG2LwDBS0lj7wNRANoIrttlpMwEnxGjr5iF5bof-EC58ly1DV1DlHZG9SURD1dvfEywWjtxd1MpxGGvRAXRdOFIk-E Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c0210774029f406390e2af6139b4aad9 Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-404043650 Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:39:19.798988 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c0210774029f406390e2af6139b4aad9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c0210774029f406390e2af6139b4aad9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0210774029f406390e2af6139b4aad9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c0210774029f406390e2af6139b4aad9"}]}] Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-404043650 Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c0210774029f406390e2af6139b4aad9 Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-404043650 Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1ceb6202f30949cf8c206f0ec479dd68 Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: exception: Hypervisor with ID 'ebd28e9d-4791-42cb-bd34-0c134df80b62' could not be found. Aug 23 10:39:19.800558 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ebd28e9d-4791-42cb-bd34-0c134df80b62'} Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ebd28e9d-4791-42cb-bd34-0c134df80b62' Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 23 10:39:19.806070 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:39:19.807705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ebd28e9d-4791-42cb-bd34-0c134df80b62' could not be found. Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ebd28e9d-4791-42cb-bd34-0c134df80b62' could not be found. Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f9cbbae-e9b8-461c-86e3-d2fcd15b34ca tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] Returning 404 to user: Hypervisor with ID 'ebd28e9d-4791-42cb-bd34-0c134df80b62' could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f9cbbae-e9b8-461c-86e3-d2fcd15b34ca tempest-HypervisorAdminNegativeTestJSON-404043650 tempest-HypervisorAdminNegativeTestJSON-404043650-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/ebd28e9d-4791-42cb-bd34-0c134df80b62" status: 404 len: 123 microversion: 2.1 time: 0.013907 Aug 23 10:39:19.809501 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 406/743] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/os-hypervisors/ebd28e9d-4791-42cb-bd34-0c134df80b62 => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:39:19.967788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:19.968448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:20.002478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.003355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.005350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.008067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.012366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.012962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.025067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:20.257815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:20.258756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:20.270126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.270618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.271051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.271759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.281828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.282660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.496398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:20.505361 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-267f3aef-2b43-433d-a48e-fdbdb5253253 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.251843 Aug 23 10:39:20.506424 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 407/744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:20 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:20.741077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:20.768680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:20.774985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:20.776547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b82e6ec-fc7d-4282-aa4f-ee434f17a5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1558 microversion: 2.25 time: 0.812628 Aug 23 10:39:20.777149 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 338/745] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:19 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1558 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:20.804670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:20.804670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:20.811405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.811405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.811405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.811405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.811833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.812025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.817475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-824cf3ec-8018-4d6e-a431-4f6263dc0201 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '.version_select at 0x7fdc9cd219d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:20.821085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824cf3ec-8018-4d6e-a431-4f6263dc0201 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.821714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824cf3ec-8018-4d6e-a431-4f6263dc0201 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.822005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824cf3ec-8018-4d6e-a431-4f6263dc0201 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.853368 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-824cf3ec-8018-4d6e-a431-4f6263dc0201 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2629 microversion: 2.25 time: 0.045618 Aug 23 10:39:20.854389 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 339/746] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Aug 23 10:39:20 2022] GET /compute/v2.1/os-migrations => generated 2629 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:20.872571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:20.873861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:20.886515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.887134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.887587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:20.888319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:20.893423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:20.893890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:21.122564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 3c7fb487-32c8-4c54-96b8-1a587f153aa2 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:21.139737 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1607245d-f462-4f52-9f82-e91360721b2d tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 2053 microversion: 2.25 time: 0.272324 Aug 23 10:39:21.153981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:21.176042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f3dcd90-0748-4daf-b5a9-3876676bda9f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.385921 Aug 23 10:39:21.177161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 408/747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:20 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:21.190654 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 340/748] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:20 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 2053 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:39:21.348066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-258356673", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "7b449e6f-509a-4a8d-a8cd-87fd09ee4594"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:21.473774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] validate_networks() for [('7b449e6f-509a-4a8d-a8cd-87fd09ee4594', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:39:21.527023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:21.527651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:21.538179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:21.538695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:21.541569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:21.543142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:21.544211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:21.545848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:22.177663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:22.189798 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dce25791-9089-4ce9-88df-cdb9e827f62b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.666637 Aug 23 10:39:22.206125 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 341/749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:21 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:22.214988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:22.217797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:22.235742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:22.236521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:22.238460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:22.240544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:22.241243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:22.242742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:22.544196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:22.553513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84e885e7-32c4-4d51-877e-aad5e0073e80 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.346015 Aug 23 10:39:22.554232 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 342/750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:22 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:23.216057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:23.221146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:23.232135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:23.232901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:23.233616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:23.239587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:39:23.240634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:39:23.241361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:39:23.242025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:39:23.242731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:39:23.249623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:23.253098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:23.253755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:23.259487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:23.261369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:23.264392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:23.265928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:23.266565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:23.269265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:23.315538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:39:23.321783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for user 04d5d44e84d5459ab1a59c13bcf69012 and project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:39:23.341286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:39:23.344489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:39:23.398365 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca75f918-4d4d-4da6-a6e7-774c260562b0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.054485 Aug 23 10:39:23.399748 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 409/751] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:39:23.413937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52b76089-69fb-4ed5-b91a-2c7f5ee78b76 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:23.415277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52b76089-69fb-4ed5-b91a-2c7f5ee78b76 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:23.488244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52b76089-69fb-4ed5-b91a-2c7f5ee78b76 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:23.497313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52b76089-69fb-4ed5-b91a-2c7f5ee78b76 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:23.501931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52b76089-69fb-4ed5-b91a-2c7f5ee78b76 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:23.504462 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52b76089-69fb-4ed5-b91a-2c7f5ee78b76 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1261 microversion: 2.25 time: 0.095168 Aug 23 10:39:23.518769 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 410/752] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:23 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:23.575391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:23.576056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:23.592802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:23.593228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:23.599423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:23.609829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:23.610314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:23.610757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:23.947945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:23.961152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3f5a0c3-374b-4b28-81b3-229120cc7af7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.751203 Aug 23 10:39:23.965054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 343/753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:23 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:24.126518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:24.135085 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be774328-8651-4611-89f7-323682db829e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.563396 Aug 23 10:39:24.135682 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 411/754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:23 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:24.535446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:24.536996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:24.549084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:24.550925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:24.552337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:24.555459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:24.556385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:24.557212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:24.758301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:24.776191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:24.779861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:24.782624 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cc7c2825-5835-4eaf-9ff4-07ff68f78bce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1257 microversion: 2.25 time: 0.252359 Aug 23 10:39:24.783757 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 344/755] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:24 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1257 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:24.983624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:24.985164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:24.992889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:24.993599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:24.994244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:24.995161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:24.995827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:24.996479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:25.183808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:25.187983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:25.199114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:25.205553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:25.206289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:25.212479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:25.213364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:25.214592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:25.215077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:25.221133 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-766b11ce-5005-4ddc-adca-3f1fe12a53fe tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.241306 Aug 23 10:39:25.221902 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 412/756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:24 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:25.450219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:25.466360 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da87011d-d067-4dfc-822b-d70b88aff226 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1501 microversion: 2.1 time: 0.292768 Aug 23 10:39:25.467898 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 345/757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:25 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:25.815836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:25.816595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:25.825824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:25.826511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:25.827128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:25.828065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:25.828623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:25.829252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:25.927263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:25.937642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:25.940413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:25.941513 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-62385949-92db-4b1e-94ae-be8304e0fe5e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1319 microversion: 2.25 time: 0.134729 Aug 23 10:39:25.942847 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 413/758] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:25 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1319 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:26.244860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:26.246074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:26.256191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.267424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.268454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:26.270116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.270789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.271396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:26.490136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:26.490834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:26.504115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.507732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.508430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:26.514326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.515013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.517010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:26.731460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:26.745391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-623bf4b7-a63d-4ba9-a80f-89dee158fc14 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.502347 Aug 23 10:39:26.746237 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 346/759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:26 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:26.895133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:26.912025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20b61335-ee80-41ce-8a37-10537bd55212 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1476 microversion: 2.1 time: 0.427400 Aug 23 10:39:26.912672 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 414/760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:26 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:26.940235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75eb328c-487d-4525-8463-0c5b75b66f28 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '.version_select at 0x7fdc9cdce280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:26.944720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75eb328c-487d-4525-8463-0c5b75b66f28 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.946100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75eb328c-487d-4525-8463-0c5b75b66f28 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.949122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75eb328c-487d-4525-8463-0c5b75b66f28 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:26.968257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:26.970120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:26.984496 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75eb328c-487d-4525-8463-0c5b75b66f28 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1972 microversion: 2.1 time: 0.048404 Aug 23 10:39:26.987667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.987984 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 347/761] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:39:26 2022] GET /compute/v2.1/os-migrations => generated 1972 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:26.988830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.989293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:26.992501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:26.993015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:26.993451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:27.002054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:27.008003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:27.030355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:27.031998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:27.034063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:27.037967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:27.038785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:27.039240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:27.401933 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddb2707b-c1cb-4118-96ab-525f3589e0e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1629 microversion: 2.1 time: 0.405685 Aug 23 10:39:27.403968 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 348/762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:26 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1629 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:27.440631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b44a0bd-23f2-4d79-b85c-c11e7176577a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Action: 'create', calling method: .version_select at 0x7fdc9cd21550>, body: {"keypair": {"name": "tempest-keypair-1574761953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6jP5fqHbp65QKOP4mB5ouW0hCctjkjGItpgG0lVHp8Sxowf4NT6BqXhNk0pAftQZ2ykaoIs+b5B+PDIEJWd9sJs6kr9Nd3zbFZdSPafBLg0C+vikCoykv3IvlZTofQEg=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:27.494090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7b44a0bd-23f2-4d79-b85c-c11e7176577a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:39:27.504045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7b44a0bd-23f2-4d79-b85c-c11e7176577a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for user b2ac0227a26f41c8a9b5c89cddea52f5 and project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:39:27.564485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b44a0bd-23f2-4d79-b85c-c11e7176577a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134911 Aug 23 10:39:27.565526 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 349/763] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:39:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:27.637914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:27.653193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:27.658524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:27.664369 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98f58631-8c89-46fa-8cc6-927be6a7ef98 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.703008 Aug 23 10:39:27.665222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 415/764] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:26 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:39:27.768534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:27.770433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:27.777467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:27.778332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:27.779015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:27.780004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:27.781296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:27.782153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:28.231581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:28.241816 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ebe0812-86bf-4675-b26a-2be52173f109 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.478266 Aug 23 10:39:28.243396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 350/765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:27 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:28.691932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:28.693625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:28.700772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:28.701533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:28.704010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:28.706472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:28.707231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:28.707819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:28.761849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-672d837d-0e03-440e-a3c0-5cf3ea675267 req-f49e0514-bbf0-4538-bcb0-6f249dee0514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ae298c-7c7e-4421-b2ac-4b63e511b771", "tag": "e6e6794f-24e0-432c-b195-a0b6426a39c7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:28.787437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-672d837d-0e03-440e-a3c0-5cf3ea675267 req-f49e0514-bbf0-4538-bcb0-6f249dee0514 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:28.790042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-672d837d-0e03-440e-a3c0-5cf3ea675267 req-f49e0514-bbf0-4538-bcb0-6f249dee0514 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:28.790597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-672d837d-0e03-440e-a3c0-5cf3ea675267 req-f49e0514-bbf0-4538-bcb0-6f249dee0514 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:28.829494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-672d837d-0e03-440e-a3c0-5cf3ea675267 req-f49e0514-bbf0-4538-bcb0-6f249dee0514 service nova] Creating event network-changed:e6e6794f-24e0-432c-b195-a0b6426a39c7 for instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 on n-h1-847009-13 Aug 23 10:39:28.836285 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-672d837d-0e03-440e-a3c0-5cf3ea675267 req-f49e0514-bbf0-4538-bcb0-6f249dee0514 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079216 Aug 23 10:39:28.837531 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 351/766] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:29.264151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:29.265480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:29.277229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:29.279072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:29.279583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:29.282547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:29.283025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:29.283461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:29.371177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:29.387138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:29.391878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:29.394131 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c98d058-5ca9-4cc7-8bcb-2f4c39f5d40a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.706290 Aug 23 10:39:29.396387 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 416/767] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:28 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:29.646720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:29.659343 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb312e20-86ef-4159-beaf-5c1e19f5d53a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.399493 Aug 23 10:39:29.659945 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 352/768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:29 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:30.425973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:30.430807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:30.445513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:30.447643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:30.449277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:30.451379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:30.451869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:30.455389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:30.685357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:30.686905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:30.696417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:30.697407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:30.698104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:30.699161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:30.699897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:30.703006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:30.925720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:30.982743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:30.990688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:30.993825 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e826e6a-f08c-45c9-97aa-4f0e4bd512b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.575089 Aug 23 10:39:31.003836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 417/769] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:30 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:31.188943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:31.208127 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29eeafde-2fea-42ff-b8c4-23e9d313ff75 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.528878 Aug 23 10:39:31.209041 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 353/770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:30 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:31.833578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-765058394", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "16058aaf-a351-4bde-a15a-8b9493e9e115"}], "security_groups": [{"name": "tempest-securitygroup--685038351"}], "key_name": "tempest-keypair-1574761953", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:32.020285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:32.020951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:32.039137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:32.039932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:32.040554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:32.041756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:32.042434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:32.043854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:32.101804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] validate_networks() for [('16058aaf-a351-4bde-a15a-8b9493e9e115', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:39:32.439482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:32.453542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:32.455975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:32.464571 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44a879cf-863a-4f62-b997-48872a68fbaa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.448553 Aug 23 10:39:32.466884 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 354/771] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:32 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:39:32.474251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:32.478918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:32.492568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:32.495765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:32.496524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:32.497519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:32.500252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:32.509514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:32.988791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:33.014085 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dd6621e-9221-40a3-a244-3e264574887f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.545706 Aug 23 10:39:33.017645 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 355/772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:32 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:33.293730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:33.488233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:33.489096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:33.495763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:33.510182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:33.510957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:33.515213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:33.516259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:33.517279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:33.519220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:33.878821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:33.899264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:33.901245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:33.903674 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8107e01-a4ee-40e8-9654-b733b23e2b78 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.420488 Aug 23 10:39:33.904845 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 356/773] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:33 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:34.038726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:34.039881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:34.048693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:34.049540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:34.053184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:34.053963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:34.054448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:34.054892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:34.101406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:34.447751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:34.482011 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8fa402be-38ef-4b5f-bf77-90d8f64416fb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.447561 Aug 23 10:39:34.482627 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 357/774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:34 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:34.618935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:39:34.619430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:39:34.619882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:39:34.620540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:39:34.621229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:39:34.646807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:34.648237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:34.650820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:34.654262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:34.657238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:34.659086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:34.708825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:39:34.722593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for user b2ac0227a26f41c8a9b5c89cddea52f5 and project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:39:34.748389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:39:34.757100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:39:34.883986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce691dc7-6748-4e26-9982-f15a713a236f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.054188 Aug 23 10:39:34.886949 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 418/775] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:39:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 3058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:39:34.899014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d58577f-f49b-4e8b-9100-36c58a5e2c56 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:34.900660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d58577f-f49b-4e8b-9100-36c58a5e2c56 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:34.930407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:34.930614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:34.969425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:34.981429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:34.982532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:34.985121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:34.985802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:34.988861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:35.202049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4d58577f-f49b-4e8b-9100-36c58a5e2c56 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:35.214096 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d58577f-f49b-4e8b-9100-36c58a5e2c56 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1234 microversion: 2.1 time: 0.319677 Aug 23 10:39:35.215570 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 358/776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:34 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1234 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:35.506878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:35.508340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:35.521930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:35.522827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:35.523457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:35.524373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:35.527473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:35.528110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:35.870848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:35.887157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21138da0-a0e1-4e18-be8c-f0b05f093d9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.383928 Aug 23 10:39:35.889790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:35.890316 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 359/777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:35 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:35.900288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:35.907762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:35.909177 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a46a14b3-7171-46e5-a45e-fc5b85c50592 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.983726 Aug 23 10:39:35.913466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 419/778] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:34 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:39:36.238392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:36.240483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:36.287298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:36.301213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:36.303679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:36.306155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:36.310666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:36.312597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:36.542929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:36.559236 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3c7624a-5f81-47c9-8391-5cff0f96dcc1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1286 microversion: 2.1 time: 0.326304 Aug 23 10:39:36.561749 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 360/779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:36 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1286 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:36.979935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:36.980582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:37.002622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:37.003131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:37.003932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:37.004552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:37.005513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:37.006357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:37.006945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:37.010012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:37.089905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:37.103140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:37.107414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:37.114212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:37.115821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:37.118199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:37.541297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:37.579403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:37.581833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:37.583213 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70d9bf85-b79f-45a1-9e83-ab242deef124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 0.644960 Aug 23 10:39:37.606513 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 361/780] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:36 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:37.620137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:37.633736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:37.641191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:37.642014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:37.642460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:37.643213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:37.643681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:37.644107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:37.767454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:37.786162 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc381f33-3177-479c-9ff8-b0800ca1826a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1292 microversion: 2.1 time: 0.176073 Aug 23 10:39:37.786799 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 362/781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:37 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:38.183851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:38.193731 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10d9904a-d8d3-49e2-b2ca-9c837bf52ead tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 1.284084 Aug 23 10:39:38.198611 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 420/782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:36 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:38.612460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:38.621538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:38.642762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:38.648001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:38.648939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:38.650659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:38.651130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:38.651592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:38.703475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5d92d821-bdfb-4ed3-9623-49d1e86b2c92 req-26823c42-8f4d-44cd-9ab4-f2e4bb2fbe38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ae298c-7c7e-4421-b2ac-4b63e511b771", "name": "network-vif-plugged", "status": "completed", "tag": "e6e6794f-24e0-432c-b195-a0b6426a39c7"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:38.735329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5d92d821-bdfb-4ed3-9623-49d1e86b2c92 req-26823c42-8f4d-44cd-9ab4-f2e4bb2fbe38 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:38.735905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5d92d821-bdfb-4ed3-9623-49d1e86b2c92 req-26823c42-8f4d-44cd-9ab4-f2e4bb2fbe38 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:38.736357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5d92d821-bdfb-4ed3-9623-49d1e86b2c92 req-26823c42-8f4d-44cd-9ab4-f2e4bb2fbe38 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:38.778633 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5d92d821-bdfb-4ed3-9623-49d1e86b2c92 req-26823c42-8f4d-44cd-9ab4-f2e4bb2fbe38 service nova] Creating event network-vif-plugged:e6e6794f-24e0-432c-b195-a0b6426a39c7 for instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 on n-h1-847009-13 Aug 23 10:39:38.796768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5d92d821-bdfb-4ed3-9623-49d1e86b2c92 req-26823c42-8f4d-44cd-9ab4-f2e4bb2fbe38 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095923 Aug 23 10:39:38.797153 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 421/783] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:39:38.809247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:38.809979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:38.823166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:38.823671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:38.824116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:38.827404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:38.828189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:38.831346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:39.044206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:39.058952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53488e84-9d1c-4433-b520-24001804459d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1292 microversion: 2.1 time: 0.253168 Aug 23 10:39:39.059621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 422/784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:38 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:39.221834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:39.222511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:39.233340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:39.234647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:39.236384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:39.237351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:39.238615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:39.241430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:39.649153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:39.661941 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09acb9dc-5d6b-47ad-ab4c-b38b8cd81cbc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.445845 Aug 23 10:39:39.664798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 423/785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:39 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:39.862621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:39.915804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:39.923547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:39.926369 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75188e50-da56-4b27-a83a-63f5ad432d08 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1361 microversion: 2.25 time: 1.321064 Aug 23 10:39:39.927669 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 363/786] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:38 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1361 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:40.082013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:40.084753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:40.095353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:40.098096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:40.102947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:40.105647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:40.106077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:40.106531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:40.770472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:40.789401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b379082f-d095-4b61-b9ad-d0c0853ebdfc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.712734 Aug 23 10:39:40.794556 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 424/787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:40 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:40.830024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c42a6a32-e6c9-4a26-9285-5558e876ea1e tempest-FloatingIPDetailsNegativeTestJSON-952747325 tempest-FloatingIPDetailsNegativeTestJSON-952747325-project] Calling method '.version_select at 0x7fdc9cdce550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:40.831932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:40.835515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:40.843327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:40.853443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:40.855502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:40.856570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:40.861965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:40.866312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:41.297878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:41.307388 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78972e88-0909-4d0a-871b-8a3bc0e45b47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.489310 Aug 23 10:39:41.308605 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 425/788] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:40 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:41.335892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:41.336850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:41.351922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:41.353008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:41.353736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:41.354919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:41.355606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:41.356258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:41.386501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:41.459639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-c42a6a32-e6c9-4a26-9285-5558e876ea1e tempest-FloatingIPDetailsNegativeTestJSON-952747325 tempest-FloatingIPDetailsNegativeTestJSON-952747325-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d6ebb5e2-d898-424e-bf61-00adbff8dff7 could not be found", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:39:41.461894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c42a6a32-e6c9-4a26-9285-5558e876ea1e tempest-FloatingIPDetailsNegativeTestJSON-952747325 tempest-FloatingIPDetailsNegativeTestJSON-952747325-project] HTTP exception thrown: Floating IP not found for ID d6ebb5e2-d898-424e-bf61-00adbff8dff7 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c42a6a32-e6c9-4a26-9285-5558e876ea1e tempest-FloatingIPDetailsNegativeTestJSON-952747325 tempest-FloatingIPDetailsNegativeTestJSON-952747325-project] Request method failure captured: Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-floating-ips/d6ebb5e2-d898-424e-bf61-00adbff8dff7 HTTP/1.1 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5sdhDjOG4vVkYgXuxgha2MomZrUeYwjiO9PoWiKzFRNGBIVMMOZwY6WhPtC4c8QfPTmkiupGyYBM_vsTEvO1Se_HN-AUD64gd7vsOmskjdhnoOQsU-XZIvPoe9BEP1THXo4yM1qWnLZ6wlqVpHHIthybmjuEaVPkGG7C5GmGV08a0 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d801ffd210f04eb48963a12965e2c0a1 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-952747325 Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:39:41.462809 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d801ffd210f04eb48963a12965e2c0a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d801ffd210f04eb48963a12965e2c0a1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d801ffd210f04eb48963a12965e2c0a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d801ffd210f04eb48963a12965e2c0a1"}]}] Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-952747325 Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d801ffd210f04eb48963a12965e2c0a1 Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-952747325 Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-952747325-project Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 716437cd91e4439a97eda3511dcb6098 Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-952747325-project Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: exception: Floating IP not found for ID d6ebb5e2-d898-424e-bf61-00adbff8dff7 Aug 23 10:39:41.464343 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'd6ebb5e2-d898-424e-bf61-00adbff8dff7'} Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:41.467422 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d6ebb5e2-d898-424e-bf61-00adbff8dff7 could not be found Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7a4c97a-254b-420b-a0ea-8d2f41d345fd'] Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d6ebb5e2-d898-424e-bf61-00adbff8dff7. Aug 23 10:39:41.469351 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d6ebb5e2-d898-424e-bf61-00adbff8dff7 Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:39:41.470484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:39:41.474790 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:39:41.474790 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d6ebb5e2-d898-424e-bf61-00adbff8dff7 Aug 23 10:39:41.474790 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:39:41.474790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c42a6a32-e6c9-4a26-9285-5558e876ea1e tempest-FloatingIPDetailsNegativeTestJSON-952747325 tempest-FloatingIPDetailsNegativeTestJSON-952747325-project] Returning 404 to user: Floating IP not found for ID d6ebb5e2-d898-424e-bf61-00adbff8dff7 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:39:41.474790 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c42a6a32-e6c9-4a26-9285-5558e876ea1e tempest-FloatingIPDetailsNegativeTestJSON-952747325 tempest-FloatingIPDetailsNegativeTestJSON-952747325-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/d6ebb5e2-d898-424e-bf61-00adbff8dff7" status: 404 len: 111 microversion: 2.1 time: 1.062209 Aug 23 10:39:41.474790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 364/789] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:39:40 2022] GET /compute/v2.1/os-floating-ips/d6ebb5e2-d898-424e-bf61-00adbff8dff7 => generated 111 bytes in 1064 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:39:41.833616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:41.833991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:41.854937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:41.856364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:41.859147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:41.862681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:41.863556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:41.865337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:41.942835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:41.962124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:41.967651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:41.969930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-366c6339-f5d4-47d9-9c6d-0a75f8a3ff4b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1557 microversion: 2.25 time: 0.650074 Aug 23 10:39:41.997736 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 426/790] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:41 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1557 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:42.041186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:42.042298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:42.054649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:42.055216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:42.055729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:42.057315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:42.058123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:42.058564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:42.276640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:42.286350 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cfb82b9-b90b-46a8-90e8-d02523a404c8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.464412 Aug 23 10:39:42.289654 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 365/791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:41 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:42.333581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:42.334982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:42.348250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:42.349858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:42.350512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:42.353816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:42.354521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:42.355145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:42.721414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:42.882078 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6d6fc4d-dff0-471f-a445-d34f443fffd0 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 2051 microversion: 2.25 time: 0.851920 Aug 23 10:39:42.898122 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 427/792] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:42 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 2051 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:42.913308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:42.915187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:42.915888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:42.925678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:42.927019 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed51e6d1-88dc-4df7-aec6-e9b6f5a391f6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.598087 Aug 23 10:39:42.927693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:42.928203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:42.932181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 366/793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:42 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:39:42.934016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:42.934787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:42.935681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.100794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3f81888f-3f7b-41ef-8c40-9611b9efaf7f req-f1f1257f-8ab8-4609-993c-bd8d19f03b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b74d026-1d35-4393-95b4-2ac77f28b3d1", "tag": "ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:43.120152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3f81888f-3f7b-41ef-8c40-9611b9efaf7f req-f1f1257f-8ab8-4609-993c-bd8d19f03b34 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.120640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3f81888f-3f7b-41ef-8c40-9611b9efaf7f req-f1f1257f-8ab8-4609-993c-bd8d19f03b34 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.121121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3f81888f-3f7b-41ef-8c40-9611b9efaf7f req-f1f1257f-8ab8-4609-993c-bd8d19f03b34 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.193801 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3f81888f-3f7b-41ef-8c40-9611b9efaf7f req-f1f1257f-8ab8-4609-993c-bd8d19f03b34 service nova] Creating event network-changed:ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b for instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 on n-h1-847009-13 Aug 23 10:39:43.201079 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3f81888f-3f7b-41ef-8c40-9611b9efaf7f req-f1f1257f-8ab8-4609-993c-bd8d19f03b34 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103885 Aug 23 10:39:43.201926 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 367/794] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:39:43.310713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:43.311432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:43.318873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.321086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.321586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.322436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.322916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.325316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.634315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:43.663470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8b628b89-c5c6-42b1-a709-a3e61df775ed tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 2051 microversion: 2.25 time: 0.758098 Aug 23 10:39:43.666814 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 428/795] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:42 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 2051 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:39:43.692200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:43.695034 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:39:43.695034 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:39:43.696250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.696756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.697202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.697933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.698436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.698803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.751470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-741238f8-b4f9-43c6-af9d-605af63fdd8c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.062653 Aug 23 10:39:43.759568 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 429/796] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Aug 23 10:39:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:39:43.766666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:43.767338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:43.774927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.775560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.776089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.777684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.778397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.779040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.912468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e93a2243-cbb4-48af-9646-c519d8552b50 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771/action" status: 202 len: 0 microversion: 2.25 time: 0.150596 Aug 23 10:39:43.938968 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 430/797] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:39:43 2022] POST /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:39:43.960649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:43.961926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:43.974817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:43.975606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:43.991228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:43.994932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:44.005125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:44.022749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:44.023225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:44.023760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c94c6b9f-7f6e-46b9-adbe-3a82d8bbae26 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.716813 Aug 23 10:39:44.030033 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 368/798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:43 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:44.041219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:44.042830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:44.055693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:44.056467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:44.057906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:44.058991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:44.059723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:44.060411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:44.392816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:44.403826 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69ccee16-b710-4027-b331-b0418e78b292 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1477 microversion: 2.1 time: 0.370523 Aug 23 10:39:44.419143 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 369/799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:44 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:44.674901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:44.722327 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7f66bb0b-9d36-4ca5-8253-185f1321d595 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 2056 microversion: 2.25 time: 0.779629 Aug 23 10:39:44.723586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 431/800] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:43 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 2056 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:45.045534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:45.047519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:45.061022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:45.067768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:45.071828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:45.078562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:45.082323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:45.083057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:45.209994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:45.430568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:45.434590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:45.472946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:45.476706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:45.477812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:45.478900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:45.479911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:45.480720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:45.481443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:46.031240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:46.055859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e961197-4ae1-4113-a3b8-932f9373f4e8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 1.014254 Aug 23 10:39:46.058934 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 370/801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:45 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:46.065164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:46.066270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:46.073922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:46.074833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:46.075537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:46.076544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:46.077355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:46.078039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:46.096410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:46.110583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e3c2f22-6d0a-402e-bebe-a7fcff7dc047 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1476 microversion: 2.1 time: 0.687104 Aug 23 10:39:46.120658 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 432/802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:45 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1476 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:47.080396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:47.081044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:47.088766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:47.101659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:47.102845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:47.103480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:47.104412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:47.105105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:47.105727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:47.240704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:47.265287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0ac3407-1214-495b-befe-d6b9fdadef2b tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 2036 microversion: 2.25 time: 1.204566 Aug 23 10:39:47.268376 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 371/803] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:46 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 2036 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:47.279920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:47.289871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:47.299651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:47.300255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:47.301023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:47.302088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:47.304930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:47.305750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:47.497262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:47.509653 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06db5c9c-5cb1-4a85-b534-bc50bc21170e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.433722 Aug 23 10:39:47.510226 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 433/804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:47 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:47.528675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-13", "block_migration": "auto"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:47.556653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:47.567260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:47.567761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:47.577243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:47.578289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:47.579211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:47.579813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:47.834298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'flavor' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:39:47.963724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Going to try to live migrate instance to n-h2-847009-13 {{(pid=128859) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:39:48.387714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:48.413945 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f2eb478-6648-402d-9bd4-922c200c2435 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1476 microversion: 2.1 time: 1.142452 Aug 23 10:39:48.429501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 372/805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:47 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1476 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:48.505739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c18564-2b98-46ce-bcf4-cb02af84cb42", "name": "network-vif-unplugged", "status": "completed", "tag": "580ca05b-9b64-4591-b4d5-6b8926b0a301"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:48.521918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:48.528562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:48.530967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:48.531704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:48.564798 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] Creating event network-vif-unplugged:580ca05b-9b64-4591-b4d5-6b8926b0a301 for instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 on n-h2-847009-13 Aug 23 10:39:48.605313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:39:48.617427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a7ab4523-d33b-45c7-8dd4-6aebe34ed785 req-a7075a1b-1fea-48d9-98e9-0019d8a89972 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116027 Aug 23 10:39:48.623421 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 373/806] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:48.635034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:48.638221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:48.657665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:48.658460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:48.661049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:48.662104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:48.662726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:48.665134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:49.403988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:49.416640 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-caf315df-3027-4ee5-b947-f5a0ade896a7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.791356 Aug 23 10:39:49.434091 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 374/807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:48 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:49.436143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:49.438754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:49.458915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:49.460297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:49.465105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:49.466309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:49.468542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:49.469752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:50.075804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:50.089087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-972032df-befd-4982-ba92-489cc3a8edb7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1476 microversion: 2.1 time: 0.656832 Aug 23 10:39:50.095279 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 375/808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:49 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1476 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:50.442209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:50.443064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:50.460286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:50.461968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:50.463623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:50.467323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:50.468616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:50.472295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:50.922763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:50.929774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:50.934426 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e2d28f3-10e5-460b-bf25-8624eeb98063 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.494978 Aug 23 10:39:50.935024 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 376/809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:50 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:50.993317 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9055b216-dd1f-42fd-b25c-b39d90ec0004 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771/action" status: 202 len: 0 microversion: 2.25 time: 3.481833 Aug 23 10:39:51.004467 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 434/810] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:39:47 2022] POST /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771/action => generated 0 bytes in 3493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:39:51.005745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:51.006525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:51.033530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:51.034440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:51.036083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:51.038247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:51.039924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:51.040642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:51.120726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:51.121884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:51.151514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:51.152492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:51.153128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:51.154824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:51.162925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:51.163762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:51.668151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:51.688346 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2d0d15f-890b-4f1f-8bdc-764c3b7681ae tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1474 microversion: 2.1 time: 0.577836 Aug 23 10:39:51.690084 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 435/811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:51 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1474 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:51.735091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:51.752252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:51.760217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:51.764290 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-296f1705-4ba5-411b-8c13-9e314890012f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.761846 Aug 23 10:39:51.781386 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 377/812] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:51 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:51.958783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:51.959401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:51.987917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:51.990855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:51.991857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:51.995076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:51.995646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:51.999824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:52.452276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:52.468920 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fd19c4b9-3137-4e05-9758-27b7e49e9f66 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.515375 Aug 23 10:39:52.481021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 436/813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:51 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:52.716018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:52.716692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:52.731082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:52.732259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:52.734110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:52.735057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:52.736378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:52.737820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:52.796576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:52.798630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:52.814073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:52.814827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:52.816644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:52.820121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:52.822618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:52.823459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.223653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:53.240571 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55577bd1-257b-4e9c-ab12-9bdd81daeb96 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1471 microversion: 2.1 time: 0.523289 Aug 23 10:39:53.257291 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 378/814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:52 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1471 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:53.267231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:53.269194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:53.274200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:53.285883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.286381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:53.288020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:53.294233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.294832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.295610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.299219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.300591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.304431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb8fd0d3-bf54-4e55-a6f0-46931c4d8fb6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.505172 Aug 23 10:39:53.305433 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 437/815] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:52 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:53.354337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-aa4673f5-5295-47b1-b937-394f9f1f6bcd req-8a00118d-a9a8-4365-b6bb-3104724fc656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b74d026-1d35-4393-95b4-2ac77f28b3d1", "name": "network-vif-plugged", "status": "completed", "tag": "ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:53.383253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-aa4673f5-5295-47b1-b937-394f9f1f6bcd req-8a00118d-a9a8-4365-b6bb-3104724fc656 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.385459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-aa4673f5-5295-47b1-b937-394f9f1f6bcd req-8a00118d-a9a8-4365-b6bb-3104724fc656 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.401147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-aa4673f5-5295-47b1-b937-394f9f1f6bcd req-8a00118d-a9a8-4365-b6bb-3104724fc656 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.423684 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-269d4d2c-d74c-412c-85f0-d2da0d349c06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42/action" status: 204 len: 0 microversion: 2.1 time: 0.161039 Aug 23 10:39:53.424420 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 379/816] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:39:53 2022] POST /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42/action => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:39:53.456025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-aa4673f5-5295-47b1-b937-394f9f1f6bcd req-8a00118d-a9a8-4365-b6bb-3104724fc656 service nova] Creating event network-vif-plugged:ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b for instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 on n-h1-847009-13 Aug 23 10:39:53.459553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:53.461567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:53.475365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.477024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.480058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-aa4673f5-5295-47b1-b937-394f9f1f6bcd req-8a00118d-a9a8-4365-b6bb-3104724fc656 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124969 Aug 23 10:39:53.480778 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 438/817] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:53.481259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.482283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.482989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.484406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.508325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:53.509073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:53.552149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.559841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.566735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.570871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:53.580919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:53.581593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:53.724463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:54.461481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:54.473063 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a597f12d-d44d-446a-bc47-0320a533125e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1471 microversion: 2.1 time: 1.035983 Aug 23 10:39:54.497255 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 380/818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:53 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1471 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:54.507868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:54.508935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:54.528553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:54.529257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:54.529857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:54.531626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:54.532444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:54.541918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:54.544541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:54.561602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-285dd8d0-ef7b-4818-a182-45c1cb0be604 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 1.061562 Aug 23 10:39:54.562397 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 439/819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:53 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:54.824203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:54.832885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:54.839732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:54.840999 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-039c2c77-94b4-441f-bf6d-5c83146f4c3c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.342631 Aug 23 10:39:54.841574 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 381/820] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:54 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:54.994598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6447aa16-1b01-4a78-9d0c-657be2fbaf9a tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9cecbb80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:55.060428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6447aa16-1b01-4a78-9d0c-657be2fbaf9a tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b" status: 200 len: 636 microversion: 2.1 time: 0.072266 Aug 23 10:39:55.061417 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 440/821] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:39:54 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b => generated 636 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:55.075893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be1b87f1-7a06-4a90-b676-33eeb7d43518 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9cd168b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:55.160005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-be1b87f1-7a06-4a90-b676-33eeb7d43518 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:39:55.174037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-be1b87f1-7a06-4a90-b676-33eeb7d43518 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:39:55.451534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:55.452272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:55.461201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:55.466159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:55.466803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:55.467749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:55.468373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:55.474532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:55.527399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:39:55.559741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:39:55.767371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-75ed84f0-8b90-423f-a67e-88f22277f77c tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 204 len: 0 microversion: 2.1 time: 0.317953 Aug 23 10:39:55.768006 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 441/822] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:39:55 2022] DELETE /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:39:55.780984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:55.781853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:55.800988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:55.801497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:55.801938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:55.804416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:55.808327 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be1b87f1-7a06-4a90-b676-33eeb7d43518 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.736694 Aug 23 10:39:55.809818 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 382/823] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:39:55 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:39:55.814141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:55.820776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:55.821724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:55.828322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:55.852283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:55.860373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:55.865012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:55.871310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:55.875932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:55.880577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:56.459053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:56.478867 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4999133-82db-4df2-87a1-653ceec7fdb6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1359 microversion: 2.1 time: 0.667420 Aug 23 10:39:56.480371 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 383/824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:55 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1359 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:56.502709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:56.504174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:56.530834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:56.531985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:56.532878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:56.534138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:56.534780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:56.535373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:56.989850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:57.006221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4fd80f0-4404-4752-b76b-3177ff6178c6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1471 microversion: 2.1 time: 1.236619 Aug 23 10:39:57.007102 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 442/825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:55 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1471 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:57.011930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38dba6df-31e9-4716-b0e7-fe7eb9790913 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9cecbb80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:57.278504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:57.292064 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f768eae6-8499-43e5-bfd8-29c9deacaaae tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1714 microversion: 2.1 time: 0.807827 Aug 23 10:39:57.293621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 384/826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:56 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1714 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:57.300056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:57.300928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:57.319801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:57.321242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:57.322729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:57.324504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:57.325946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:57.329141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:57.567412 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38dba6df-31e9-4716-b0e7-fe7eb9790913 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "DELETE /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.559041 Aug 23 10:39:57.568113 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 443/827] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Aug 23 10:39:57 2022] DELETE /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata/os_version => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:39:57.569829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:57.573264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c35541a6-b720-44dc-b340-fe7933e52ccd req-568dd99d-0125-4165-aeda-5193e4f9295e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ae298c-7c7e-4421-b2ac-4b63e511b771", "name": "network-vif-unplugged", "status": "completed", "tag": "e6e6794f-24e0-432c-b195-a0b6426a39c7"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:57.580565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:57.582855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:57.583996 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b8271e8-3385-4e1a-bd04-89d92977e8f3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.288716 Aug 23 10:39:57.600027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 385/828] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:57 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:57.600027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:57.600027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:57.600027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:57.600027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:57.600680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:57.600680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:57.600680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:57.600680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:57.603987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c35541a6-b720-44dc-b340-fe7933e52ccd req-568dd99d-0125-4165-aeda-5193e4f9295e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:57.610751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c35541a6-b720-44dc-b340-fe7933e52ccd req-568dd99d-0125-4165-aeda-5193e4f9295e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:57.611290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c35541a6-b720-44dc-b340-fe7933e52ccd req-568dd99d-0125-4165-aeda-5193e4f9295e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:57.626875 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c35541a6-b720-44dc-b340-fe7933e52ccd req-568dd99d-0125-4165-aeda-5193e4f9295e service nova] Creating event network-vif-unplugged:e6e6794f-24e0-432c-b195-a0b6426a39c7 for instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 on n-h1-847009-13 Aug 23 10:39:57.632654 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c35541a6-b720-44dc-b340-fe7933e52ccd req-568dd99d-0125-4165-aeda-5193e4f9295e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063119 Aug 23 10:39:57.634059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 444/829] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:57.640226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b46d14d-ee80-445e-ad93-1efa569fad48 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9cf47e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:57.763381 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b46d14d-ee80-445e-ad93-1efa569fad48 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 37 microversion: 2.1 time: 0.127789 Aug 23 10:39:57.764045 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 445/830] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:39:57 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 37 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:39:57.782233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29b374af-f8e9-4951-b875-cecac2f1aa6d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9cfa6a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:57.937653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-29b374af-f8e9-4951-b875-cecac2f1aa6d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:39:57.959819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-29b374af-f8e9-4951-b875-cecac2f1aa6d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:39:57.966325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:58.006417 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49a901cb-3b4c-40b7-a79b-a1d112f39899 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1542 microversion: 2.1 time: 0.418268 Aug 23 10:39:58.007040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 386/831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:57 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1542 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:58.029835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:58.031916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:58.068099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:58.070312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:58.075109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:58.082214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:58.086558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:58.091004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:58.735087 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29b374af-f8e9-4951-b875-cecac2f1aa6d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.960253 Aug 23 10:39:58.735980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 446/832] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:39:57 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:39:58.741258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:58.741881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:58.766384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:58.766891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:58.773933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:58.777430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:58.781133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:58.786067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:58.947864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:59.005134 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9409e34a-067c-46d4-9907-c19c14982e3f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1471 microversion: 2.1 time: 0.980620 Aug 23 10:39:59.013112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 387/833] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:58 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1471 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:59.034065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:59.034727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:59.084537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:59.085587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:59.086625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:59.087689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:59.088310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:59.089373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:59.174679 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32a81f42-30d5-424b-9046-fb0c15723d31 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.437484 Aug 23 10:39:59.176155 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 447/834] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:39:58 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-interface => generated 285 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:59.182217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:59.183203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:39:59.215171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:59.216905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:59.219235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:59.221092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:59.222757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:59.223823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:59.614147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:59.627818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:59.629722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:59.632112 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ea0e1d8-7a35-4d90-aeea-bfe606b3c25d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.454695 Aug 23 10:39:59.632871 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 448/835] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:39:59 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:39:59.638204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2aa32e68-2835-4e85-9705-f1ee5095e7fe tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9cec23a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:39:59.684300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:39:59.720516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dc4ba85-0377-42f3-8633-5cf69d758695 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1714 microversion: 2.1 time: 0.703513 Aug 23 10:39:59.721111 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 388/836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:39:59 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1714 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:39:59.739543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c18564-2b98-46ce-bcf4-cb02af84cb42", "name": "network-vif-plugged", "status": "completed", "tag": "580ca05b-9b64-4591-b4d5-6b8926b0a301"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:59.755894 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2aa32e68-2835-4e85-9705-f1ee5095e7fe tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.121713 Aug 23 10:39:59.756699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:59.757473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:59.758098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:59.769431 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 449/837] 10.222.0.78 () {58 vars in 1290 bytes} [Tue Aug 23 10:39:59 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata/os_distro => generated 33 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:39:59.782672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f748cace-f587-423f-b5d4-4c211bba76d1 req-68c2ded6-7c66-446c-bbce-0a2b81a0fbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ae298c-7c7e-4421-b2ac-4b63e511b771", "tag": "e6e6794f-24e0-432c-b195-a0b6426a39c7"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:59.804157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] Creating event network-vif-plugged:580ca05b-9b64-4591-b4d5-6b8926b0a301 for instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 on n-h2-847009-13 Aug 23 10:39:59.814464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:39:59.816527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f748cace-f587-423f-b5d4-4c211bba76d1 req-68c2ded6-7c66-446c-bbce-0a2b81a0fbd0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:39:59.817352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f748cace-f587-423f-b5d4-4c211bba76d1 req-68c2ded6-7c66-446c-bbce-0a2b81a0fbd0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:39:59.817894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f748cace-f587-423f-b5d4-4c211bba76d1 req-68c2ded6-7c66-446c-bbce-0a2b81a0fbd0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:39:59.824478 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bad3a474-287e-4aa0-89d5-27c944c2896b req-1bceb41e-f996-4fa3-bcc9-adf0708b9353 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088974 Aug 23 10:39:59.825430 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 389/838] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:59.833667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a1de274-448c-4449-9be0-ecd3a35af14a tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9cedb280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:39:59.856392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f748cace-f587-423f-b5d4-4c211bba76d1 req-68c2ded6-7c66-446c-bbce-0a2b81a0fbd0 service nova] Creating event network-changed:e6e6794f-24e0-432c-b195-a0b6426a39c7 for instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 on n-h1-847009-13 Aug 23 10:39:59.883785 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f748cace-f587-423f-b5d4-4c211bba76d1 req-68c2ded6-7c66-446c-bbce-0a2b81a0fbd0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106621 Aug 23 10:39:59.887490 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 450/839] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:39:59.980123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1a1de274-448c-4449-9be0-ecd3a35af14a tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:00.003503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1a1de274-448c-4449-9be0-ecd3a35af14a tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:00.040138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:00.043319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:00.068881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:00.069410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:00.069863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:00.070707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:00.071061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:00.071499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:00.360288 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a1de274-448c-4449-9be0-ecd3a35af14a tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.532916 Aug 23 10:40:00.361298 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 390/840] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:39:59 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:00.371293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fdc35acb-6ab3-46dc-b536-ba25a5331dcb tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9cd843a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:00.465312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fdc35acb-6ab3-46dc-b536-ba25a5331dcb tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.098174 Aug 23 10:40:00.466072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 391/841] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:40:00 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:00.478740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1baed94d-78b1-4784-b067-ee8a948b33b2 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9cd293a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:00.586117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1baed94d-78b1-4784-b067-ee8a948b33b2 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:00.597247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1baed94d-78b1-4784-b067-ee8a948b33b2 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:01.000410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1baed94d-78b1-4784-b067-ee8a948b33b2 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.526421 Aug 23 10:40:01.001055 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 392/842] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:40:00 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:01.005957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:01.006781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:01.026031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:01.026743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:01.027027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:01.027797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:01.028268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:01.037767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:01.053541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:01.057334 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8564e90c-c122-41f0-8243-547d1bb11f5f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1471 microversion: 2.1 time: 1.031901 Aug 23 10:40:01.057937 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 451/843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:00 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1471 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:01.074336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:01.074964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:01.100585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:01.101132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:01.102014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:01.103166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:01.103778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:01.104497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:01.741124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:01.758037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:01.759896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:01.765103 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7480f94-69a6-4509-9ab9-9a0343511e23 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.759208 Aug 23 10:40:01.769331 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 393/844] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:01 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:01.777105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db0b50ac-8531-4633-a30f-7c5a618c015d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9ccb24c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:01.825169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:01.853667 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3bf08a85-34c5-4ad3-b2d9-70b1e430cdf9 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1714 microversion: 2.1 time: 0.793035 Aug 23 10:40:01.855373 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 452/845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:01 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1714 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:01.883714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-db0b50ac-8531-4633-a30f-7c5a618c015d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:01.898161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-db0b50ac-8531-4633-a30f-7c5a618c015d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:02.080151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:02.080786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:02.090941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:02.095999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:02.096539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:02.097343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:02.097822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:02.098257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:02.534643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:02.547069 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b667770-4dbe-4774-9e1c-34c4d8c25bdf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1463 microversion: 2.1 time: 0.471124 Aug 23 10:40:02.550256 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 453/846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:02 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1463 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:02.572312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:02.573502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:02.582470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:02.583557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:02.584191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:02.585261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:02.585873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:02.590153 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db0b50ac-8531-4633-a30f-7c5a618c015d tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.819524 Aug 23 10:40:02.595607 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 394/847] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:40:01 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 64 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:02.612936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-395d3d37-de09-4844-bc0b-fcd134b10cef tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9ceb6d30>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:02.614417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:02.724465 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-395d3d37-de09-4844-bc0b-fcd134b10cef tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 64 microversion: 2.1 time: 0.127155 Aug 23 10:40:02.728411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 395/848] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:40:02 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 64 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:02.748367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c53406b-b461-4a5c-9b59-3f264cb468c9 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9cd29430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:02.857160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-6c53406b-b461-4a5c-9b59-3f264cb468c9 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:02.880667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-6c53406b-b461-4a5c-9b59-3f264cb468c9 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:03.336200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:03.345167 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c391f106-faa0-4b08-88b2-66e372cf1e6a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1463 microversion: 2.1 time: 0.777929 Aug 23 10:40:03.361788 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 454/849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:02 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1463 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:03.382807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:03.392071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:03.414862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:03.415844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:03.416463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:03.417257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:03.417807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:03.418341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:03.569667 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c53406b-b461-4a5c-9b59-3f264cb468c9 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.832340 Aug 23 10:40:03.570276 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 396/850] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:40:02 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:03.575310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:03.578079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:03.591852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:03.597384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:03.598225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:03.599241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:03.600879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:03.601984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:03.883941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:03.908012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-66e2be79-bb72-4f05-b3c8-bfe96769073e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1646 microversion: 2.1 time: 0.336629 Aug 23 10:40:03.908610 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 397/851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:03 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1646 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:03.938481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-776aaf17-c7a0-4ab0-8945-9008bc37ba70 req-b02d1514-9843-41f7-b1a0-3a852d412899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b74d026-1d35-4393-95b4-2ac77f28b3d1", "tag": "ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:03.990526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-776aaf17-c7a0-4ab0-8945-9008bc37ba70 req-b02d1514-9843-41f7-b1a0-3a852d412899 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:03.995114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-776aaf17-c7a0-4ab0-8945-9008bc37ba70 req-b02d1514-9843-41f7-b1a0-3a852d412899 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:03.996092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-776aaf17-c7a0-4ab0-8945-9008bc37ba70 req-b02d1514-9843-41f7-b1a0-3a852d412899 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:04.022566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-776aaf17-c7a0-4ab0-8945-9008bc37ba70 req-b02d1514-9843-41f7-b1a0-3a852d412899 service nova] Creating event network-changed:ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b for instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 on n-h1-847009-13 Aug 23 10:40:04.028952 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-776aaf17-c7a0-4ab0-8945-9008bc37ba70 req-b02d1514-9843-41f7-b1a0-3a852d412899 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105927 Aug 23 10:40:04.031222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 398/852] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:04.037439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54bced18-5736-4a09-b9b4-de88a788e4c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'create', calling method: .version_select at 0x7fdc9ceb6c10>, body: {"keypair": {"name": "tempest-keypair-1773868599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFuFSFDyFEO4HrMD+HKKOjuzeoKPLplCebx5uQwTR3i1dJVz1afpYLiU1SupQFkipcbXlfzc0ErTWdjrx1GeXVNIElYPeIIZ8EznLwo1sPbV2eU7NetgOrnBho6WHeviA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:04.058878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-54bced18-5736-4a09-b9b4-de88a788e4c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for project 81dd6dd624b14701860deb0d33332e83. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:04.065866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-54bced18-5736-4a09-b9b4-de88a788e4c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for user 9574ff57c9474f7fb5ec4567bc06d531 and project 81dd6dd624b14701860deb0d33332e83. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:04.130749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54bced18-5736-4a09-b9b4-de88a788e4c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097950 Aug 23 10:40:04.133026 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 399/853] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:40:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:04.147689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a44eba0-8a21-4431-89a7-2882c2f3f30f tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update', calling method: .version_select at 0x7fdc9cf61550>, body: {"meta": {"os_version": "alt"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:04.282903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-2a44eba0-8a21-4431-89a7-2882c2f3f30f tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:04.295776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-2a44eba0-8a21-4431-89a7-2882c2f3f30f tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:04.964336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:04.984259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:04.985689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:04.997583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a83b0e79-9f38-4642-914c-3782042c89ff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 1.634035 Aug 23 10:40:04.998385 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 455/854] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:03 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:05.005596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:05.010694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:05.027619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:05.028323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:05.028661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:05.029956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:05.029956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:05.030310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:05.043052 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a44eba0-8a21-4431-89a7-2882c2f3f30f tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.901220 Aug 23 10:40:05.044699 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 400/855] 10.222.0.78 () {60 vars in 1313 bytes} [Tue Aug 23 10:40:04 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata/os_version => generated 31 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:05.055749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-444f0930-865a-4326-bde3-d5f192fb3f1f tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9cf6dc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:05.121189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:05.124561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:05.129435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:05.130125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lazy-loading 'fault' on Instance uuid bbc9606a-f510-4f75-b789-4e0259ead9e0 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:40:05.154054 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-444f0930-865a-4326-bde3-d5f192fb3f1f tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 58 microversion: 2.1 time: 0.102257 Aug 23 10:40:05.154556 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 401/856] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:40:05 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 58 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:40:05.166546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f953ec83-d6b7-4b65-aa5a-0ee3b8e29620 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'update_all', calling method: .version_select at 0x7fdc9cf6d4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:05.265611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f953ec83-d6b7-4b65-aa5a-0ee3b8e29620 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:05.275789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:05.317350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f953ec83-d6b7-4b65-aa5a-0ee3b8e29620 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:05.483695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8a7b6ac53d4b9cbac1d2ab7f48fc4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb96481a39404b0f91e81ea0183698b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:05.496474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5dff47af-b0fe-403d-bfba-fbd30f78da9b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 200 len: 1353 microversion: 2.1 time: 0.494362 Aug 23 10:40:05.500514 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 456/857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:05 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 1353 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:05.751124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "010aa2da-9154-4f4d-8105-10c842b451af"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:05.754136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:05.768546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:05.769398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:05.770034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:05.770977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:05.771641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:05.772255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:05.996440 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f953ec83-d6b7-4b65-aa5a-0ee3b8e29620 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 61 microversion: 2.1 time: 0.833723 Aug 23 10:40:05.997322 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 402/858] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:40:05 2022] PUT /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 61 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:40:06.009347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b822fb6e-a2ae-4b86-8480-bca4e7f37340 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Action: 'create', calling method: .version_select at 0x7fdc9cf61160>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:06.097183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b822fb6e-a2ae-4b86-8480-bca4e7f37340 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:06.120752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b822fb6e-a2ae-4b86-8480-bca4e7f37340 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Getting quotas for user ab8b88ba23cd46018f547666fad14f0d and project f2db98572aff40dfa501e40eda52c39e. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:06.775893 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-382d9142-512d-4368-a203-b7d48108c3d5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "POST /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030989 Aug 23 10:40:06.798462 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 457/859] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:40:05 2022] POST /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:40:06.804990 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b822fb6e-a2ae-4b86-8480-bca4e7f37340 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "POST /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.799673 Aug 23 10:40:06.805605 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 403/860] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Aug 23 10:40:06 2022] POST /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 85 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:06.816415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-50e5cf20-d783-4fdc-b801-0250ade76bbc req-8be72718-8f3f-4302-9d0e-9cd9e6f52b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc9606a-f510-4f75-b789-4e0259ead9e0", "name": "network-vif-deleted", "tag": "1950d98b-1069-4c11-b1dc-0d917368e80a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:06.842544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:06.845281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:06.858508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-50e5cf20-d783-4fdc-b801-0250ade76bbc req-8be72718-8f3f-4302-9d0e-9cd9e6f52b91 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:06.859105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-50e5cf20-d783-4fdc-b801-0250ade76bbc req-8be72718-8f3f-4302-9d0e-9cd9e6f52b91 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:06.879573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-50e5cf20-d783-4fdc-b801-0250ade76bbc req-8be72718-8f3f-4302-9d0e-9cd9e6f52b91 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:06.895925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:06.898324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:06.899025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:06.899998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:06.903480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:06.904419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:06.936606 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-50e5cf20-d783-4fdc-b801-0250ade76bbc req-8be72718-8f3f-4302-9d0e-9cd9e6f52b91 service nova] Creating event network-vif-deleted:1950d98b-1069-4c11-b1dc-0d917368e80a for instance bbc9606a-f510-4f75-b789-4e0259ead9e0 on n-h2-847009-13 Aug 23 10:40:06.953510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-50e5cf20-d783-4fdc-b801-0250ade76bbc req-8be72718-8f3f-4302-9d0e-9cd9e6f52b91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141076 Aug 23 10:40:06.958750 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 404/861] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:06.971569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:06.987556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:06.994233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:06.994909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:06.995420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:06.996413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:06.997191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:06.997783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:07.015174 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 HTTP/1.1 Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:40:07.017439 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:07.019145 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'bbc9606a-f510-4f75-b789-4e0259ead9e0'} Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:07.020144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:07.021697 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.024360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:07.025743 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d243215-f67b-4f88-a9b1-6ac06ae62f5e tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 404 len: 111 microversion: 2.1 time: 0.059550 Aug 23 10:40:07.026955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 405/862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:06 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:07.033200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51b55a26-dd79-4ef1-9986-a31e9e8545b5 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] Calling method '.version_select at 0x7fdc9d023820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:07.081937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51b55a26-dd79-4ef1-9986-a31e9e8545b5 tempest-ImagesMetadataTestJSON-1714234368 tempest-ImagesMetadataTestJSON-1714234368-project] 10.222.0.78 "GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata" status: 200 len: 85 microversion: 2.1 time: 0.053536 Aug 23 10:40:07.082770 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 406/863] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:40:07 2022] GET /compute/v2.1/images/265c4506-455f-4a0f-acda-e8e4ffc8154b/metadata => generated 85 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:07.089171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:07.093045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:07.117165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:07.120208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:07.120723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:07.121517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:07.122005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:07.125853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:07.153960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 HTTP/1.1 Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:40:07.167426 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.169146 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '210a1dcd-feea-4748-8039-313b88b28f45'} Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:07.170099 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.173120 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.175734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:07.176101 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abc64b53-17ce-43c3-96a9-1637cf759254 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 404 len: 111 microversion: 2.1 time: 0.092099 Aug 23 10:40:07.177598 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 407/864] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:40:07 2022] DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:07.209421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:07.213546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:07.237349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:07.238928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:07.239390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:07.240126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:07.240601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:07.255091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:07.315678 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 HTTP/1.1 Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:40:07.319958 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.321353 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '210a1dcd-feea-4748-8039-313b88b28f45'} Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:07.322141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:07.323324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:07.324390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:07.325271 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf72755d-6319-4312-aec4-34e76db033d0 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 404 len: 111 microversion: 2.1 time: 0.142333 Aug 23 10:40:07.327093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 408/865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:07 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:40:07.344516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76b96cd7-585f-4d26-b341-4f0bc0eb6d5b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '.version_select at 0x7fdc9cf6de50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:07.393965 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76b96cd7-585f-4d26-b341-4f0bc0eb6d5b tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949485104" status: 202 len: 0 microversion: 2.1 time: 0.061911 Aug 23 10:40:07.398559 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 409/866] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949485104 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:07.542049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:07.560573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:07.562964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:07.565106 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a308baa3-8fd6-4c42-9582-8fda3bca010e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.764718 Aug 23 10:40:07.565106 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 458/867] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:06 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:08.589745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:08.591767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:08.602822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:08.604094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:08.605042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:08.606020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:08.606840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:08.607585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:08.615653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:09.049589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:09.067110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:09.069357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:09.070820 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d125398-e323-401e-8d75-8b0617c69460 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1567 microversion: 2.25 time: 0.487529 Aug 23 10:40:09.085991 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 410/868] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:08 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1567 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:09.834553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-145de4d5-59e0-4460-bcd8-49eecb57b295 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '.version_select at 0x7fdc9ce59280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:09.839373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145de4d5-59e0-4460-bcd8-49eecb57b295 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:09.840367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145de4d5-59e0-4460-bcd8-49eecb57b295 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:09.841067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145de4d5-59e0-4460-bcd8-49eecb57b295 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:09.859556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:09.867852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-145de4d5-59e0-4460-bcd8-49eecb57b295 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.1 time: 0.038335 Aug 23 10:40:09.868474 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 459/869] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:40:09 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:09.896623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c565019-bd6f-4209-a423-04507d5f894e tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:09.919358 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c565019-bd6f-4209-a423-04507d5f894e tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027096 Aug 23 10:40:09.923366 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 411/870] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:40:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:09.949916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90e98dec-faa2-4870-8344-c8ab15ecd339 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-325051207", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:09.953694 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:09.953694 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:40:10.001587 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90e98dec-faa2-4870-8344-c8ab15ecd339 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.058952 Aug 23 10:40:10.002741 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 460/871] 10.222.0.78 () {60 vars in 1146 bytes} [Tue Aug 23 10:40:09 2022] POST /compute/v2.1/flavors => generated 498 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:10.019318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8de69f38-2ed8-4641-b6fa-84e3b19a6ea9 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.037016 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8de69f38-2ed8-4641-b6fa-84e3b19a6ea9 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022311 Aug 23 10:40:10.047614 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 412/872] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Aug 23 10:40:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:10.096400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.097352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:10.110826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:10.112800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:10.114307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:10.115062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:10.116415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:10.116876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:10.153009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bd339b0-ece2-4f3e-85ce-fe46fd330b66 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.153859 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:10.153859 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:40:10.212290 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bd339b0-ece2-4f3e-85ce-fe46fd330b66 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/131333572" status: 202 len: 0 microversion: 2.1 time: 0.063315 Aug 23 10:40:10.214858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 413/873] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:40:10 2022] DELETE /compute/v2.1/flavors/131333572 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:10.226945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40e978d6-85bc-4327-9ec6-52b5b9f28b1c tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.289025 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40e978d6-85bc-4327-9ec6-52b5b9f28b1c tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5890 microversion: 2.1 time: 0.068758 Aug 23 10:40:10.290241 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 414/874] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:40:10 2022] GET /compute/v2.1/flavors/detail => generated 5890 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:10.298945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1534347132", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "02ce3e65-aa08-477d-ac56-a793091f4861"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:10.413517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:10.488054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:10.501341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:10.503121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:10.504716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f179d9ce-abdd-4b3f-beb1-24d76d67247b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1542 microversion: 2.25 time: 0.413198 Aug 23 10:40:10.505938 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 461/875] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:10 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1542 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:10.512135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e5f94a7-e44d-44ab-988a-c8cf21169273 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.513054 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:10.513054 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:40:10.544338 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e5f94a7-e44d-44ab-988a-c8cf21169273 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/672356926" status: 202 len: 0 microversion: 2.1 time: 0.036903 Aug 23 10:40:10.546123 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 462/876] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:40:10 2022] DELETE /compute/v2.1/flavors/672356926 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:10.552715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0518f636-14be-4e0d-a11c-f533ff8639c7 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '.version_select at 0x7fdc9cdedaf0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.563422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0518f636-14be-4e0d-a11c-f533ff8639c7 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:10.565979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0518f636-14be-4e0d-a11c-f533ff8639c7 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:10.566747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0518f636-14be-4e0d-a11c-f533ff8639c7 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:10.572794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:10.584417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0518f636-14be-4e0d-a11c-f533ff8639c7 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2809 microversion: 2.25 time: 0.036760 Aug 23 10:40:10.596261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 463/877] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Aug 23 10:40:10 2022] GET /compute/v2.1/os-migrations => generated 2809 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:10.628253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9901369a-0910-46e7-b72e-a5e35e39a4f6 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.683943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9901369a-0910-46e7-b72e-a5e35e39a4f6 tempest-ServersWithSpecificFlavorTestJSON-1392372217 tempest-ServersWithSpecificFlavorTestJSON-1392372217-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.071845 Aug 23 10:40:10.684524 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 464/878] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:40:10 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:10.704119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:10.704726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:10.745548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:10.748006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:10.751433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:10.752388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:10.753710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:10.756034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:10.985001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:40:11.001312 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b60c1f8-a25d-48a4-8987-e415c3dfdd98 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 2036 microversion: 2.25 time: 0.301212 Aug 23 10:40:11.003014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 465/879] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:10 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 2036 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:11.007628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.008131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:11.016305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.016893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.017342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.018060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.018528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.018961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.041977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 HTTP/1.1 Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.043782 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.046004 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'bbc9606a-f510-4f75-b789-4e0259ead9e0'} Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.046879 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.048269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.049816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.049816 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8eaea105-ab0a-4001-b3e0-cdd6a7fa3a58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 404 len: 111 microversion: 2.1 time: 0.041307 Aug 23 10:40:11.049816 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 466/880] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:40:11 2022] DELETE /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:11.051891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e2f01364-5541-4f4d-a4ae-fc5bef34bbd6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Action: 'create', calling method: .version_select at 0x7fdc9ce59d30>, body: {"keypair": {"name": "tempest-keypair-85876398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrsq4s3hDXsNFmF9BdvVB3jl/MHj4uP4Neh1s1RpNy2TsOVzG+wdyDq3D3Sle+vKL3PdVwsmn7JfpagK8X5yuW6xZvB6aGU/QNG0gw9Ha7otDHYOrKaDHBzQAi6vofZQg=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:11.071583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e2f01364-5541-4f4d-a4ae-fc5bef34bbd6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:11.078763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e2f01364-5541-4f4d-a4ae-fc5bef34bbd6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for user 04d5d44e84d5459ab1a59c13bcf69012 and project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:11.113540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e2f01364-5541-4f4d-a4ae-fc5bef34bbd6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.25 time: 0.065909 Aug 23 10:40:11.114163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 467/881] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:40:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 10:40:11.134156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.137542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: bbc9606a-f510-4f75-b789-4e0259ead9e0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:11.160649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.161178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.161618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.162334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.162791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.167511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.199367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 HTTP/1.1 Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.201065 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.203144 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'bbc9606a-f510-4f75-b789-4e0259ead9e0'} Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.204151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. Aug 23 10:40:11.205398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.206452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance bbc9606a-f510-4f75-b789-4e0259ead9e0 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.206452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-932239ee-9ff1-4409-bcdb-9576c805cf58 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0" status: 404 len: 111 microversion: 2.1 time: 0.073223 Aug 23 10:40:11.216260 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 468/882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:11 2022] GET /compute/v2.1/servers/bbc9606a-f510-4f75-b789-4e0259ead9e0 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:11.224619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.227768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:11.242032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.242528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.242971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.243660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.244117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.248668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.278792 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 HTTP/1.1 Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.282670 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.284086 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '210a1dcd-feea-4748-8039-313b88b28f45'} Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.284854 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.286007 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.287282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.287282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ead31255-09b1-4574-8d92-3255aa2f3d53 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 404 len: 111 microversion: 2.1 time: 0.066342 Aug 23 10:40:11.287282 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 469/883] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:40:11 2022] DELETE /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:11.305714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.306764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] [instance: 210a1dcd-feea-4748-8039-313b88b28f45] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:11.322599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.323111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.323555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.324275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.327048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.327852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.377466 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] HTTP exception thrown: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Request method failure captured: Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 HTTP/1.1 Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3Iz9tNEBUX-CvzLD_jr8SGrcLAdir7oy-yHxTfZ4BbGr7AR0H_10x6ZMxPL7wPvDGsC02cXbFCSvSUZrUtCCHXN059MZT9d-fnFSvlUo-MKJdg4EEfrwBGkBhQkQuRezFsSf6IU9VVmEH5u__ADvvz6vDDVxVcMpYQ2QZk9dErTOA Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.381288 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fb96481a39404b0f91e81ea0183698b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fb96481a39404b0f91e81ea0183698b9"}]}] Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: fb96481a39404b0f91e81ea0183698b9 Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107 Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: da8a7b6ac53d4b9cbac1d2ab7f48fc4c Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2016117107-project Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.382737 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '210a1dcd-feea-4748-8039-313b88b28f45'} Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.383438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. Aug 23 10:40:11.384631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.386217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] Returning 404 to user: Instance 210a1dcd-feea-4748-8039-313b88b28f45 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.386217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b044023-938f-4363-ace8-6f3938467d84 tempest-ServersWithSpecificFlavorTestJSON-2016117107 tempest-ServersWithSpecificFlavorTestJSON-2016117107-project] 10.222.0.78 "GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45" status: 404 len: 111 microversion: 2.1 time: 0.093809 Aug 23 10:40:11.387626 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 470/884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:11 2022] GET /compute/v2.1/servers/210a1dcd-feea-4748-8039-313b88b28f45 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:40:11.629162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:11.629663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:11.630072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:11.630493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:11.630926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:11.656106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.656604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.665308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.666317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:11.666755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:11.667196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:11.752725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ead7597-7df5-4b28-8f0c-b35bab8d39c0 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Calling method '.version_select at 0x7fdc9cdde8b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.768761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:11.792523 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5ead7597-7df5-4b28-8f0c-b35bab8d39c0 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] HTTP exception thrown: Image not found. Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ead7597-7df5-4b28-8f0c-b35bab8d39c0 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Request method failure captured: Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/9524dd60-f96f-4633-8532-594c22e897dd/metadata/os_distro HTTP/1.1 Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6LKXztX_5wCTS0erl1oqBSO5iSSS1HJkTzb_azp2tmPbclWKLltxlJOUdgVPuxT2VxFiP6rFsFU-fa7gGavLr7U2mnAegfg4Qqjeju9JI1Lgmf6WdWPhzG-Cua2PlAHf_Q9z0EacnnP-0PB1Cx0VTl6wOP8ZQfdyuZCky0hXNzhTs Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.795128 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06c2f4d74ca24b00a96701e4a46318fe", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}] Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 688b31b20dc9414e99ad2086aec30965 Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'image_id': '9524dd60-f96f-4633-8532-594c22e897dd', 'id': 'os_distro'} Aug 23 10:40:11.797110 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:11.798014 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9524dd60-f96f-4633-8532-594c22e897dd Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:11.799131 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9524dd60-f96f-4633-8532-594c22e897dd could not be found. Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:11.800267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:40:11.801385 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.806903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ead7597-7df5-4b28-8f0c-b35bab8d39c0 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.809587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for user 9574ff57c9474f7fb5ec4567bc06d531 and project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:11.810221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ead7597-7df5-4b28-8f0c-b35bab8d39c0 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] 10.222.0.78 "DELETE /compute/v2.1/images/9524dd60-f96f-4633-8532-594c22e897dd/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.374472 Aug 23 10:40:11.815368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 471/885] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Aug 23 10:40:11 2022] DELETE /compute/v2.1/images/9524dd60-f96f-4633-8532-594c22e897dd/metadata/os_distro => generated 62 bytes in 382 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:40:11.839885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-729bc352-c548-4e00-9490-4097178e2f10 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Calling method '.version_select at 0x7fdc9ce59040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.869602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:11.882862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:11.909198 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-729bc352-c548-4e00-9490-4097178e2f10 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] HTTP exception thrown: Image not found. Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-729bc352-c548-4e00-9490-4097178e2f10 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Request method failure captured: Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/images/7ab60410-b1c2-40b3-8835-656e375c6ee2/metadata/os_version HTTP/1.1 Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6LKXztX_5wCTS0erl1oqBSO5iSSS1HJkTzb_azp2tmPbclWKLltxlJOUdgVPuxT2VxFiP6rFsFU-fa7gGavLr7U2mnAegfg4Qqjeju9JI1Lgmf6WdWPhzG-Cua2PlAHf_Q9z0EacnnP-0PB1Cx0VTl6wOP8ZQfdyuZCky0hXNzhTs Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.911546 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06c2f4d74ca24b00a96701e4a46318fe", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}] Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 688b31b20dc9414e99ad2086aec30965 Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'image_id': '7ab60410-b1c2-40b3-8835-656e375c6ee2', 'id': 'os_version'} Aug 23 10:40:11.913110 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:11.914039 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7ab60410-b1c2-40b3-8835-656e375c6ee2 Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:11.915297 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ab60410-b1c2-40b3-8835-656e375c6ee2 could not be found. Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:11.916652 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:40:11.918050 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.922470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-729bc352-c548-4e00-9490-4097178e2f10 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.925994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-729bc352-c548-4e00-9490-4097178e2f10 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] 10.222.0.78 "GET /compute/v2.1/images/7ab60410-b1c2-40b3-8835-656e375c6ee2/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.106830 Aug 23 10:40:11.931089 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 472/886] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Aug 23 10:40:11 2022] GET /compute/v2.1/images/7ab60410-b1c2-40b3-8835-656e375c6ee2/metadata/os_version => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:40:11.948139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e24fe71-ca41-4a58-be5c-221fa05d04ac tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Calling method '.version_select at 0x7fdc9cde2040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:11.977401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1e24fe71-ca41-4a58-be5c-221fa05d04ac tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] HTTP exception thrown: Image not found. Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e24fe71-ca41-4a58-be5c-221fa05d04ac tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Request method failure captured: Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/images/d35d04e1-38ec-494d-8519-ebea6fb4c7e9/metadata HTTP/1.1 Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6LKXztX_5wCTS0erl1oqBSO5iSSS1HJkTzb_azp2tmPbclWKLltxlJOUdgVPuxT2VxFiP6rFsFU-fa7gGavLr7U2mnAegfg4Qqjeju9JI1Lgmf6WdWPhzG-Cua2PlAHf_Q9z0EacnnP-0PB1Cx0VTl6wOP8ZQfdyuZCky0hXNzhTs Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:11.979819 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06c2f4d74ca24b00a96701e4a46318fe", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}] Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 688b31b20dc9414e99ad2086aec30965 Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'image_id': 'd35d04e1-38ec-494d-8519-ebea6fb4c7e9'} Aug 23 10:40:11.981476 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:11.982469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d35d04e1-38ec-494d-8519-ebea6fb4c7e9 Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:11.984089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d35d04e1-38ec-494d-8519-ebea6fb4c7e9 could not be found. Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:11.985866 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:40:11.987140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:11.990218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e24fe71-ca41-4a58-be5c-221fa05d04ac tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:11.991385 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e24fe71-ca41-4a58-be5c-221fa05d04ac tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] 10.222.0.78 "GET /compute/v2.1/images/d35d04e1-38ec-494d-8519-ebea6fb4c7e9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055157 Aug 23 10:40:11.992380 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 473/887] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:40:11 2022] GET /compute/v2.1/images/d35d04e1-38ec-494d-8519-ebea6fb4c7e9/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:40:12.003413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-003d270f-51de-4125-99c9-fbdea8d0445f tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Action: 'update_all', calling method: .version_select at 0x7fdc9ce59e50>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:12.057123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-003d270f-51de-4125-99c9-fbdea8d0445f tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] HTTP exception thrown: Image not found. Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-003d270f-51de-4125-99c9-fbdea8d0445f tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Request method failure captured: Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/images/fada359c-a481-4a00-a1fa-0bcdae9ed5b9/metadata HTTP/1.1 Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 57 Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6LKXztX_5wCTS0erl1oqBSO5iSSS1HJkTzb_azp2tmPbclWKLltxlJOUdgVPuxT2VxFiP6rFsFU-fa7gGavLr7U2mnAegfg4Qqjeju9JI1Lgmf6WdWPhzG-Cua2PlAHf_Q9z0EacnnP-0PB1Cx0VTl6wOP8ZQfdyuZCky0hXNzhTs Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:12.060046 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06c2f4d74ca24b00a96701e4a46318fe", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}] Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 688b31b20dc9414e99ad2086aec30965 Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:12.062224 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'image_id': 'fada359c-a481-4a00-a1fa-0bcdae9ed5b9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:12.063139 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fada359c-a481-4a00-a1fa-0bcdae9ed5b9 Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:12.064387 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fada359c-a481-4a00-a1fa-0bcdae9ed5b9 could not be found. Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:12.065770 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:40:12.067088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.073412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67a297ff-e707-4b21-a465-02d706800e2c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781235 Aug 23 10:40:12.074080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 415/888] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:40:12.081159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-003d270f-51de-4125-99c9-fbdea8d0445f tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:12.084317 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-003d270f-51de-4125-99c9-fbdea8d0445f tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] 10.222.0.78 "PUT /compute/v2.1/images/fada359c-a481-4a00-a1fa-0bcdae9ed5b9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.086762 Aug 23 10:40:12.095718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9cd312fe-5ed8-46d2-8951-634256c7d26d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:12.095718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9cd312fe-5ed8-46d2-8951-634256c7d26d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:12.106350 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 474/889] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:40:11 2022] PUT /compute/v2.1/images/fada359c-a481-4a00-a1fa-0bcdae9ed5b9/metadata => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:40:12.121285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5153ae4d-ab8e-4026-9ace-557839273448 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Action: 'update', calling method: .version_select at 0x7fdc9cded790>, body: {"meta": {"os_distro": "alt"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:12.199342 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5153ae4d-ab8e-4026-9ace-557839273448 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] HTTP exception thrown: Image not found. Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5153ae4d-ab8e-4026-9ace-557839273448 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Request method failure captured: Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/images/a2776646-59b4-4f7b-a530-708dced184bc/metadata/os_distro HTTP/1.1 Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 30 Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6LKXztX_5wCTS0erl1oqBSO5iSSS1HJkTzb_azp2tmPbclWKLltxlJOUdgVPuxT2VxFiP6rFsFU-fa7gGavLr7U2mnAegfg4Qqjeju9JI1Lgmf6WdWPhzG-Cua2PlAHf_Q9z0EacnnP-0PB1Cx0VTl6wOP8ZQfdyuZCky0hXNzhTs Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:12.201507 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06c2f4d74ca24b00a96701e4a46318fe", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}] Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 688b31b20dc9414e99ad2086aec30965 Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: {"meta": {"os_distro": "alt"}} Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:40:12.202760 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'image_id': 'a2776646-59b4-4f7b-a530-708dced184bc', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:12.203643 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a2776646-59b4-4f7b-a530-708dced184bc Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:12.206527 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2776646-59b4-4f7b-a530-708dced184bc could not be found. Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:12.207662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:40:12.208841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.210066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5153ae4d-ab8e-4026-9ace-557839273448 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:12.210066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5153ae4d-ab8e-4026-9ace-557839273448 tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] 10.222.0.78 "PUT /compute/v2.1/images/a2776646-59b4-4f7b-a530-708dced184bc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.095325 Aug 23 10:40:12.210066 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 475/890] 10.222.0.78 () {60 vars in 1310 bytes} [Tue Aug 23 10:40:12 2022] PUT /compute/v2.1/images/a2776646-59b4-4f7b-a530-708dced184bc/metadata/os_distro => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:40:12.213460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97f8e8fe-c18e-4609-9e03-68c09c41b17a tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Action: 'create', calling method: .version_select at 0x7fdc9cded280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:12.256522 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-97f8e8fe-c18e-4609-9e03-68c09c41b17a tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] HTTP exception thrown: Image not found. Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97f8e8fe-c18e-4609-9e03-68c09c41b17a tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Request method failure captured: Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/images/4e02e661-5ffd-4ce3-9a80-66196d60de9d/metadata HTTP/1.1 Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 57 Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6LKXztX_5wCTS0erl1oqBSO5iSSS1HJkTzb_azp2tmPbclWKLltxlJOUdgVPuxT2VxFiP6rFsFU-fa7gGavLr7U2mnAegfg4Qqjeju9JI1Lgmf6WdWPhzG-Cua2PlAHf_Q9z0EacnnP-0PB1Cx0VTl6wOP8ZQfdyuZCky0hXNzhTs Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:40:12.260658 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_06c2f4d74ca24b00a96701e4a46318fe", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/06c2f4d74ca24b00a96701e4a46318fe"}]}] Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 06c2f4d74ca24b00a96701e4a46318fe Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930 Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 688b31b20dc9414e99ad2086aec30965 Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-2088659930-project Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:40:12.262333 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'image_id': '4e02e661-5ffd-4ce3-9a80-66196d60de9d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:12.263368 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4e02e661-5ffd-4ce3-9a80-66196d60de9d Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:40:12.265095 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e02e661-5ffd-4ce3-9a80-66196d60de9d could not be found. Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:12.266312 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:40:12.267461 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:12.274031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97f8e8fe-c18e-4609-9e03-68c09c41b17a tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:12.276540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-97f8e8fe-c18e-4609-9e03-68c09c41b17a tempest-ImagesMetadataNegativeTestJSON-2088659930 tempest-ImagesMetadataNegativeTestJSON-2088659930-project] 10.222.0.78 "POST /compute/v2.1/images/4e02e661-5ffd-4ce3-9a80-66196d60de9d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065841 Aug 23 10:40:12.277795 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 476/891] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Aug 23 10:40:12 2022] POST /compute/v2.1/images/4e02e661-5ffd-4ce3-9a80-66196d60de9d/metadata => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:40:12.337403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9cd312fe-5ed8-46d2-8951-634256c7d26d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:12.350510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9cd312fe-5ed8-46d2-8951-634256c7d26d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1279 microversion: 2.1 time: 0.266797 Aug 23 10:40:12.365366 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 416/892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:12 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:13.385045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:13.386620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:13.403077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:13.406020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:13.407138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:13.410994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:13.411847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:13.412978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:13.814145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:13.834373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2dface1d-e147-4989-b1da-54689e8b303b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1283 microversion: 2.1 time: 0.457225 Aug 23 10:40:13.837054 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 477/893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:13 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1283 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:14.861231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:14.862189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:14.878880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:14.882344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:14.882876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:14.883956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:14.885767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:14.886712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:15.046461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:15.058930 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c242a33-2b39-4974-b70a-e1c69863b181 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1339 microversion: 2.1 time: 0.201874 Aug 23 10:40:15.060531 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 417/894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:14 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1339 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:16.082988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:16.084395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:16.091888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:16.105754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:16.126374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:16.128911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:16.130498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:16.132343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:16.134308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:16.409920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:16.427185 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-995193ad-96e6-4a5d-8c77-2c21ee248460 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1337 microversion: 2.1 time: 0.351340 Aug 23 10:40:16.430438 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 478/895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:16 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1337 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:17.133957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-985534366", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "7b449e6f-509a-4a8d-a8cd-87fd09ee4594"}], "security_groups": [{"name": "tempest-securitygroup--267964799"}], "key_name": "tempest-keypair-85876398", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:17.367997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] validate_networks() for [('7b449e6f-509a-4a8d-a8cd-87fd09ee4594', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:17.448806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:17.449991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:17.467118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:17.471491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:17.473310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:17.475196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:17.476571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:17.481411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:17.875635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:17.890588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb3f682d-01f7-48c2-9289-1550c735bd58 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1337 microversion: 2.1 time: 0.445639 Aug 23 10:40:17.891171 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 479/896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:17 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1337 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:18.005743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:18.006224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:18.006664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:18.007357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:18.007962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:18.015679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=45 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:18.023849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:18.025005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:18.026249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:18.027796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:18.029470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:18.031703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:18.057169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:18.068219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for user 04d5d44e84d5459ab1a59c13bcf69012 and project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:18.097497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:18.105771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:18.195247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5708d807-aa80-4a35-8585-d7b74c69e7b3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.071919 Aug 23 10:40:18.197234 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 418/897] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:40:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:40:18.210998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b68ab18b-e6bf-48e3-a111-178e98efcdc8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:18.212045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b68ab18b-e6bf-48e3-a111-178e98efcdc8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:18.781686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b68ab18b-e6bf-48e3-a111-178e98efcdc8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:18.799938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b68ab18b-e6bf-48e3-a111-178e98efcdc8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:18.803260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b68ab18b-e6bf-48e3-a111-178e98efcdc8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:18.804544 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b68ab18b-e6bf-48e3-a111-178e98efcdc8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1283 microversion: 2.25 time: 0.599922 Aug 23 10:40:18.821540 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 480/898] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:18 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1283 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:18.912319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:18.913729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:18.941541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:18.947179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:18.949078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:18.953194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:18.955543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:18.956829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:19.459369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:19.477934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75880689-6ce2-4717-9d08-2935e8607ac3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.570031 Aug 23 10:40:19.484396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 419/899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:18 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:19.837606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:19.839480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:19.852395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:19.854444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:19.861002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:19.862602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:19.863286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:19.863827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:20.172708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:20.187572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:20.199343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:20.204193 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d87c25c0-3a1b-4787-a162-1f948c58b625 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1335 microversion: 2.25 time: 0.370595 Aug 23 10:40:20.206015 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 481/900] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:19 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1335 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:20.345930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-608296530", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:20.472317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:20.503981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:20.504597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:20.512551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:20.515709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:20.517901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:20.518864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:20.522461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:20.523346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:21.145378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:21.163909 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80425575-d305-46ec-a44a-e73b0ef36871 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.663813 Aug 23 10:40:21.165826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 482/901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:20 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:21.236352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:21.237266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:21.255695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:21.262771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:21.265698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:21.268559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:21.270505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:21.271160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:21.356692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:21.357231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:21.358050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:21.358697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:21.359351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:21.387709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:21.393409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:21.394801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:21.400590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:21.402898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:21.403286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:21.449884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Getting quotas for project 2fea1ec49dc540d5ac895803d3bec1f4. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:21.465777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Getting quotas for user caf26dcae82b4835a0c0514945dd7882 and project 2fea1ec49dc540d5ac895803d3bec1f4. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:21.501340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:21.506091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:21.594014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:21.609039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:21.615851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:21.620280 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df445484-93d3-4a02-84ff-4c63dcd7eac9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1335 microversion: 2.25 time: 0.394729 Aug 23 10:40:21.643432 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 483/902] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:21 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1335 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:21.654101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b699d8da-f497-4d2f-8d0d-ec8e5bc83ed8 req-c062d58f-a8c2-4106-8d2e-32de1748dd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:21.669707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b699d8da-f497-4d2f-8d0d-ec8e5bc83ed8 req-c062d58f-a8c2-4106-8d2e-32de1748dd6c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:21.671012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b699d8da-f497-4d2f-8d0d-ec8e5bc83ed8 req-c062d58f-a8c2-4106-8d2e-32de1748dd6c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:21.671614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b699d8da-f497-4d2f-8d0d-ec8e5bc83ed8 req-c062d58f-a8c2-4106-8d2e-32de1748dd6c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:21.678906 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b99165ce-55ed-4d7d-966c-e9a488b9763a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602515 Aug 23 10:40:21.690099 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 420/903] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:40:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:40:21.696901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c31c2fe-9ba4-4c73-8c9d-536fbec4a9d5 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:21.697727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c31c2fe-9ba4-4c73-8c9d-536fbec4a9d5 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:21.701973 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b699d8da-f497-4d2f-8d0d-ec8e5bc83ed8 req-c062d58f-a8c2-4106-8d2e-32de1748dd6c service nova] Creating event network-changed:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:40:21.706683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=4,nova_api:INSERT=9 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:21.727411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b699d8da-f497-4d2f-8d0d-ec8e5bc83ed8 req-c062d58f-a8c2-4106-8d2e-32de1748dd6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082202 Aug 23 10:40:21.743712 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 484/904] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:21.900320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c31c2fe-9ba4-4c73-8c9d-536fbec4a9d5 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:21.965965 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c31c2fe-9ba4-4c73-8c9d-536fbec4a9d5 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1218 microversion: 2.1 time: 0.268991 Aug 23 10:40:21.976831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 421/905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:21 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:22.188462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:22.189832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:22.200147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:22.200636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:22.216593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:22.219227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:22.219784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:22.220291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:22.647125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:22.648572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:22.677791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:22.678393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:22.681004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:22.682086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:22.682742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:22.684471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:23.091627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:23.099912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7966b31a-fbfd-4a51-9987-13ebea600bd0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.916527 Aug 23 10:40:23.113103 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 485/906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:22 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:23.149749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:23.150381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:23.220249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:23.220853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:23.221225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:23.231147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:23.231643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:23.234977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:23.359228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:23.381803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:23.384370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:23.385865 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52115b53-e46e-4c9b-a852-cec5d00f521a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.743002 Aug 23 10:40:23.402225 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 422/907] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:22 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:23.448561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:23.458882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5864fad-187f-4d4b-a1f5-82cc7cec5412 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1214 microversion: 2.1 time: 0.327478 Aug 23 10:40:23.459806 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 486/908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:23 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1214 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:24.124197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:24.125768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:24.133618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:24.134357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:24.134950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:24.135807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:24.136465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:24.137084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:24.413836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:24.414252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:24.422466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:24.423355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:24.424056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:24.425122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:24.425811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:24.426427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:24.490259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:24.499845 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9adcb256-c01a-44a8-8478-ada400b4e46f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.380030 Aug 23 10:40:24.501119 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 423/909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:24 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:24.506247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:24.507067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:24.513415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:24.514277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:24.515219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:24.516098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:24.516716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:24.517331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:24.721924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:24.733636 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65d88565-bed8-4d89-b0e3-3199858082ac tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1270 microversion: 2.1 time: 0.230481 Aug 23 10:40:24.734477 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 424/910] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:24 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:24.854408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:24.864170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:24.865709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:24.878299 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f8aaac8d-dc97-4dc2-8ab9-7510f873cb16 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.469049 Aug 23 10:40:24.879502 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 487/911] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:24 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:40:25.521084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:25.521768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:25.543583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:25.544091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:25.544537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:25.546068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:25.546795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:25.547230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:25.829961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ab485cd5-d507-4878-88c6-46af084f13db"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:25.839869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:25.849835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:25.852149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:25.854367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:25.859281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:25.860046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:25.861264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:26.159197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:26.175742 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13b6995c-a4fc-4e12-9ad9-0d839396af52 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.658661 Aug 23 10:40:26.176809 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 425/912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:25 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:26.183632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:26.184443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:26.198420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:26.199828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:26.199828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:26.202870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:26.203586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:26.207836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:26.310051 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] HTTP exception thrown: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Request method failure captured: Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments/010aa2da-9154-4f4d-8105-10c842b451af HTTP/1.1 Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 74 Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4eFyqVATmbD3tvhxvRoQ-7frEvhX5KPX37xcyiP-VRdOfS0Ta4OhTzaBqxYOU5Kt40jMsgOwKh-ACwv99nyuhDVYNWNlnqUuEYgU3ADcGqp0oMajkZuSChOmchInm5zUwZU7tnuv2tBOXHrxXXgIDl0NRpVyRrLUDKV2sY6L-5jTQ Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 40ffd5a82c3840b190ba422abdb2d9b9 Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesAdminNegativeTest-400952510 Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:40:26.316495 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/40ffd5a82c3840b190ba422abdb2d9b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_40ffd5a82c3840b190ba422abdb2d9b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/40ffd5a82c3840b190ba422abdb2d9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/40ffd5a82c3840b190ba422abdb2d9b9"}]}] Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesAdminNegativeTest-400952510 Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 40ffd5a82c3840b190ba422abdb2d9b9 Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-400952510 Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesAdminNegativeTest-400952510-project-admin Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 26dea4109ab046f59ba2d7202a1c4b53 Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesAdminNegativeTest-400952510-project-admin Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: {"volumeAttachment": {"volumeId": "ab485cd5-d507-4878-88c6-46af084f13db"}} Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:40:26.318158 n-d-847009-13 devstack@n-api.service[128859]: exception: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '1054768a-2e3f-4247-ada1-fd6ab4fb46e3', 'id': '010aa2da-9154-4f4d-8105-10c842b451af', 'body': {'volumeAttachment': {'volumeId': 'ab485cd5-d507-4878-88c6-46af084f13db'}}} Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 10:40:26.319065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. (HTTP 404) (Request-ID: req-2f084b2a-9c3d-4cc7-96bd-7a5ac15fd8d4) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 10:40:26.320125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:26.324010 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. Aug 23 10:40:26.327381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:26.331367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Returning 400 to user: Volume ab485cd5-d507-4878-88c6-46af084f13db could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:26.331367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-661faed8-3529-444c-9165-76473589befa tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments/010aa2da-9154-4f4d-8105-10c842b451af" status: 400 len: 107 microversion: 2.1 time: 0.711745 Aug 23 10:40:26.331367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 488/913] 10.222.0.78 () {60 vars in 1433 bytes} [Tue Aug 23 10:40:25 2022] PUT /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments/010aa2da-9154-4f4d-8105-10c842b451af => generated 107 bytes in 716 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:40:26.362858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:26.367975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:26.409635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:26.410455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:26.412074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:26.418083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:26.420865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:26.423727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.293006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:27.306855 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13705a2e-36c1-46d0-9e73-def13de9bcce tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1270 microversion: 2.1 time: 1.127238 Aug 23 10:40:27.308081 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 426/914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:26 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1270 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:27.313804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:27.314656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:27.325893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.328282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.329793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.332144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.333354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.336230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.528349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:27.540772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:27.551831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:27.553163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2869b71-9225-4180-a475-b960cc104eae tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 1.229874 Aug 23 10:40:27.553822 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 489/915] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:26 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:27.577639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:27.585119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:27.614692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lazy-loading 'services' on Instance uuid 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:40:27.627243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.627742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.628186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.628997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.629397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.638301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.899087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbbd2291-6c2e-4603-b078-784186891263 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments/010aa2da-9154-4f4d-8105-10c842b451af" status: 202 len: 0 microversion: 2.1 time: 0.588489 Aug 23 10:40:27.902380 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 427/916] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 10:40:27 2022] DELETE /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments/010aa2da-9154-4f4d-8105-10c842b451af => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:27.908643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-444c394f-1896-4e6b-92e1-07a83aa03d6c req-b24dcda2-b5b0-4cf3-a4c7-e15c6e9acbad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465d3faa-5cc1-4087-9589-d137378f09ad", "tag": "ef0de150-72f9-464f-a35d-16625dc95f35"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:27.928541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-444c394f-1896-4e6b-92e1-07a83aa03d6c req-b24dcda2-b5b0-4cf3-a4c7-e15c6e9acbad service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.929322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-444c394f-1896-4e6b-92e1-07a83aa03d6c req-b24dcda2-b5b0-4cf3-a4c7-e15c6e9acbad service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.929936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-444c394f-1896-4e6b-92e1-07a83aa03d6c req-b24dcda2-b5b0-4cf3-a4c7-e15c6e9acbad service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.948039 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-444c394f-1896-4e6b-92e1-07a83aa03d6c req-b24dcda2-b5b0-4cf3-a4c7-e15c6e9acbad service nova] Creating event network-changed:ef0de150-72f9-464f-a35d-16625dc95f35 for instance 465d3faa-5cc1-4087-9589-d137378f09ad on n-h2-847009-13 Aug 23 10:40:27.959467 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-444c394f-1896-4e6b-92e1-07a83aa03d6c req-b24dcda2-b5b0-4cf3-a4c7-e15c6e9acbad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054938 Aug 23 10:40:27.960515 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 428/917] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:27.983707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:27.986364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:27.993542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.994341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.994971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:27.995867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:27.996486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:27.997906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:28.035314 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff9eb0a5-605b-4cb5-bc65-79622e65cb16 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066994 Aug 23 10:40:28.036522 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 429/918] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:27 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:28.317763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:28.330653 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d0576b05-c0cb-43ff-962d-1cdbe5368661 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.775487 Aug 23 10:40:28.330890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:28.331344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:28.331662 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 490/919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:27 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:28.357389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:28.358477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:28.359325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:28.360957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:28.363046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:28.363800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:28.477742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:28.510050 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e556ff8-84a1-475b-8823-07b2f3907386 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1276 microversion: 2.1 time: 0.183691 Aug 23 10:40:28.512633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 430/920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:28 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:28.582245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:28.583118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:28.598842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:28.600203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:28.611052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:28.622472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:28.625581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:28.626338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:28.786991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:29.050500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:29.053205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:29.080477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.086815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.087877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:29.092585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.094305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.096102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:29.194080 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4ee4287-de7a-4271-bf5f-e9b5be5e15f0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150252 Aug 23 10:40:29.195069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 431/921] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:29 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:29.262794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:29.275956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:29.277502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:29.278637 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5640fe8e-cbae-4ea8-8ca8-cf115e94e9f8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.703770 Aug 23 10:40:29.313338 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 491/922] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:28 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:29.357532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:29.360229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:29.384539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.387207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.389511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:29.390484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.391460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.405110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:29.537524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:29.539106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:29.547923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.548988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.549708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:29.551071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.552892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.553559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:29.653059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:29.656865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:29.664958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-206143ce-c9ab-47fe-afd1-3b7c0c1c1ef4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1276 microversion: 2.1 time: 0.133976 Aug 23 10:40:29.666857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 492/923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:29 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:29.933101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6ce8be15-a3d8-4c3c-94ae-e76b7d48bd38 req-cbd0ea4d-2108-43e2-a04e-07d3c2988223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "name": "network-vif-plugged", "status": "completed", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:29.968562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ce8be15-a3d8-4c3c-94ae-e76b7d48bd38 req-cbd0ea4d-2108-43e2-a04e-07d3c2988223 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:29.970284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ce8be15-a3d8-4c3c-94ae-e76b7d48bd38 req-cbd0ea4d-2108-43e2-a04e-07d3c2988223 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:29.970756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ce8be15-a3d8-4c3c-94ae-e76b7d48bd38 req-cbd0ea4d-2108-43e2-a04e-07d3c2988223 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:30.007885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6ce8be15-a3d8-4c3c-94ae-e76b7d48bd38 req-cbd0ea4d-2108-43e2-a04e-07d3c2988223 service nova] Creating event network-vif-plugged:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:40:30.032062 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6ce8be15-a3d8-4c3c-94ae-e76b7d48bd38 req-cbd0ea4d-2108-43e2-a04e-07d3c2988223 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104544 Aug 23 10:40:30.037002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 493/924] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:40:30.066025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:30.078567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b37fa7d-b08b-4f30-89f8-f34899465d37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 0.722256 Aug 23 10:40:30.082293 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 432/925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:29 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:30.208727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:30.212611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:30.227874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:30.228721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:30.229554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:30.230501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:30.231209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:30.231865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:30.276708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80b98efd-02a8-4d43-bf3a-9a2e89c36488 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072274 Aug 23 10:40:30.284164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 494/926] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:30 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:30.307283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:30.308970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:30.331194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:30.331932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:30.338237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:30.339261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:30.340379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:30.343346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:30.567888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-606338292", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "f3c62108-8f19-4a8d-8de7-8cbb5b2b0858"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:30.682904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] validate_networks() for [('f3c62108-8f19-4a8d-8de7-8cbb5b2b0858', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:30.909090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:30.919307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:30.924864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:30.929399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4498db76-0597-43c0-b01b-7de2c0dd8d5f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.626273 Aug 23 10:40:30.931506 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 433/927] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:30 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:30.946608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:30.947550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:30.970923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:30.977991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:30.986570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:30.987755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:30.989217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:30.990446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:31.425011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:31.608013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:31.610961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:31.621413 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df8d15a2-edb0-4cea-a925-c794cac75025 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.687534 Aug 23 10:40:31.628572 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 434/928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:30 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:31.646074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:31.648197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:31.658567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:31.659135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:31.659644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:31.661464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:31.663220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:31.664127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:31.948769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=13 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:31.968967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:31.969425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:31.969861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:31.970277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:31.970700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:31.995793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:31.996302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:31.996783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:32.006171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:32.006667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:32.007118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:32.051226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:32.077626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for user a2f47ead9ba342b2b1456305289c6188 and project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:32.114094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:32.116835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:32.238009 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7668c69b-70e7-4100-b268-eb6808ee630c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.821601 Aug 23 10:40:32.239519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 495/929] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:40:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:40:32.250497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:32.258036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:32.292083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:32.293551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:32.294254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:32.295921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:32.300266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:32.307424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:32.389141 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-190d4676-6fdb-490a-99b7-49f97d2e0d15 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148157 Aug 23 10:40:32.395423 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 496/930] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:32 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:32.415010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:32.425958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:32.446540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:32.447374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:32.448048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:32.456227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:32.456986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:32.458082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:32.688851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:32.705338 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-100bbf2c-e13a-45ec-9d9c-e9e38977aaaf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1379 microversion: 2.1 time: 1.068704 Aug 23 10:40:32.705893 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 435/931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:31 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1379 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:32.718529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25a1dd36-ddcb-4a96-a304-cf76669f242b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:32.719039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25a1dd36-ddcb-4a96-a304-cf76669f242b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:33.129503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25a1dd36-ddcb-4a96-a304-cf76669f242b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:33.132041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:33.139340 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25a1dd36-ddcb-4a96-a304-cf76669f242b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1207 microversion: 2.1 time: 0.430938 Aug 23 10:40:33.139915 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 436/932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:32 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1207 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:33.153317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:33.154957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:33.156368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ba60378-9f90-45cd-bbfa-8090360504e4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.759590 Aug 23 10:40:33.158743 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 497/933] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:32 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:33.163570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:33.169565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:33.174099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f220d91f-6f5b-4d13-ae82-ebe9305bf11f req-793b1f94-bd55-405d-b09e-d8c8b6608125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ade5aa1-eab4-433d-9bc6-a3d6658e05da", "tag": "0e2a14dd-81c8-488b-99d9-bf2bdecb6657"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:33.184922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.185997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.187762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:33.188763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.195010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.195547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:33.213358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f220d91f-6f5b-4d13-ae82-ebe9305bf11f req-793b1f94-bd55-405d-b09e-d8c8b6608125 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.214582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f220d91f-6f5b-4d13-ae82-ebe9305bf11f req-793b1f94-bd55-405d-b09e-d8c8b6608125 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.223917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f220d91f-6f5b-4d13-ae82-ebe9305bf11f req-793b1f94-bd55-405d-b09e-d8c8b6608125 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:33.265435 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f220d91f-6f5b-4d13-ae82-ebe9305bf11f req-793b1f94-bd55-405d-b09e-d8c8b6608125 service nova] Creating event network-changed:0e2a14dd-81c8-488b-99d9-bf2bdecb6657 for instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da on n-h1-847009-13 Aug 23 10:40:33.278632 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f220d91f-6f5b-4d13-ae82-ebe9305bf11f req-793b1f94-bd55-405d-b09e-d8c8b6608125 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108701 Aug 23 10:40:33.280495 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 437/934] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:33.404113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:33.406511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:33.427355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.432597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.434125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:33.434890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.435413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.436436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:33.551200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abb579f4-3157-4273-9a97-8c2f0b9326f6 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151675 Aug 23 10:40:33.551802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 438/935] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:33 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:40:33.727441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:33.728072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:33.738649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.739167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.739740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:33.750664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:33.751411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:33.752016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.018908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:34.059475 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b5852f4-4f96-4730-82a7-aafb26b5a733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.899239 Aug 23 10:40:34.065414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 498/936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:33 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:34.161819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:34.163329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:34.174852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.175665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.177975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.180036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.182064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.197216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.346287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:34.359622 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a29343bf-98cf-4926-b81a-dc22b0c4270c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1259 microversion: 2.1 time: 0.202696 Aug 23 10:40:34.378923 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 499/937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:34 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:34.385338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:34.386304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:34.395065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.395918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.396615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.399377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.400172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.400856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.728233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:34.741319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd67c7ca-a680-4f73-b963-340e35170fa0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1528 microversion: 2.1 time: 1.017606 Aug 23 10:40:34.758763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 439/938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:33 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1528 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:34.771303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:34.779222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:34.798309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.806642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.809768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.811077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.817124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.817856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.898266 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-185503d5-1312-4f5c-a8b4-c7df2d0f6f29 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138295 Aug 23 10:40:34.899599 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 440/939] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:34 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:34.907225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:34.908951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:34.917561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.918010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:34.919204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.921005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.922882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:34.923859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:34.924498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:34.932794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:34.934338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:34.935578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1ac4314-42d4-4332-bfcc-2d025085b4bc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.555265 Aug 23 10:40:34.947362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 500/940] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:34 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:35.084584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:35.085395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:35.102913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.103598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.104064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.104839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.109547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.112985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.386320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:35.400235 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec5b5420-aab8-466b-9e55-a03c772c5439 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1528 microversion: 2.1 time: 0.497627 Aug 23 10:40:35.403063 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 441/941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:34 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1528 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:35.413150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:35.417003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:35.425775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.427375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.428384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.429475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.430260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.431144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.511614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:35.528501 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0ea54b1-fe7d-4b9f-b4c2-0b2ee05e6fdc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.448140 Aug 23 10:40:35.532808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 501/942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:35 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:35.542760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:35.547258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a623d08-48ac-4888-90d1-b049673cd6fd tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:35.552587 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:35.552587 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:40:35.555463 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53185104-eb58-44ee-809c-228c635ee966 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1265 microversion: 2.1 time: 0.150324 Aug 23 10:40:35.556277 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 442/943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:35 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:35.587094 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a623d08-48ac-4888-90d1-b049673cd6fd tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/02ce3e65-aa08-477d-ac56-a793091f4861" status: 202 len: 0 microversion: 2.1 time: 0.052126 Aug 23 10:40:35.588073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 502/944] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:40:35 2022] DELETE /compute/v2.1/flavors/02ce3e65-aa08-477d-ac56-a793091f4861 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:35.599510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70d95d3e-2b82-40fb-953a-c86058b854ec tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:35.631856 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70d95d3e-2b82-40fb-953a-c86058b854ec tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038376 Aug 23 10:40:35.632490 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 443/945] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:40:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:35.651239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:35.653665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:35.667851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.670883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.671442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.672198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.672674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.676153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.844951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:35.853918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Old instance type tempest-test_resize_flavor_-325051207, new instance type m1.heat {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 10:40:35.865499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:35.867299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:35.867984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:35.869560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:35.870222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:35.911390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:35.913751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:35.929563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.930232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.930720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.931481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:35.931960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:35.932486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:35.997690 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2d4b6cc-0853-4078-a83c-41f2e88b9cfc tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090426 Aug 23 10:40:36.006826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 444/946] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:35 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:36.018925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:36.019575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:36.041914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.043503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.045622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.046811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.049497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.049978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.067566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c3fac4f9-a0fa-411c-9e9a-2a33b8f9de3c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd/action" status: 202 len: 0 microversion: 2.1 time: 0.420548 Aug 23 10:40:36.069661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 503/947] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:40:35 2022] POST /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:36.078435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:36.079646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:36.091066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.092725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.094567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.095282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.095914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.096907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.427798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:36.437165 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-63526312-fd6a-4b70-8429-c0946c0a01dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1537 microversion: 2.1 time: 0.363375 Aug 23 10:40:36.441743 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 504/948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:36 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1537 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:36.444797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:36.459346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:36.461097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:36.466978 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41624b2b-24b1-491f-a32e-a4529cbc6556 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.457736 Aug 23 10:40:36.471999 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 445/949] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:36 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:36.555316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:36.556583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:36.572210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.579211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:36.580070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:36.585533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.590636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.592415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.596681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.601864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.602340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.608555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.609180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.609937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:36.610421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:36.610860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:36.857276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:36.870669 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10e1391e-b55d-4a80-b850-fc8a33dc0b0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1265 microversion: 2.1 time: 0.295757 Aug 23 10:40:36.871493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 446/950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:36 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:36.897848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:36.911428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-923a1baf-6602-484a-93df-08ff2425d4f3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.360716 Aug 23 10:40:36.916191 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 505/951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:36 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:37.011469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:37.014764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:37.026709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:37.027218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:37.027685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:37.028408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:37.028903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:37.035150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:37.121702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40af62c3-a927-403b-8b92-e8a7dc8463c4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114645 Aug 23 10:40:37.126563 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 447/952] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:37 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:37.460327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:37.461277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:37.469506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:37.469996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:37.470641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:37.471376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:37.471923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:37.472364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:37.496124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:37.496780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:37.528567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:37.533390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:37.537764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:37.548217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:37.550422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:37.552208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:37.946897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:37.971324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a5cfec3-1a43-4277-9182-33af8401baeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1537 microversion: 2.1 time: 0.516370 Aug 23 10:40:37.992894 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 506/953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:37 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1537 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:38.008082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b6468825-7a41-4ae6-98dc-3e06978d3a53 req-ef8ec83e-9c61-4926-bf53-337374dabccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465d3faa-5cc1-4087-9589-d137378f09ad", "name": "network-vif-plugged", "status": "completed", "tag": "ef0de150-72f9-464f-a35d-16625dc95f35"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:38.035933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b6468825-7a41-4ae6-98dc-3e06978d3a53 req-ef8ec83e-9c61-4926-bf53-337374dabccc service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.036508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b6468825-7a41-4ae6-98dc-3e06978d3a53 req-ef8ec83e-9c61-4926-bf53-337374dabccc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.037659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b6468825-7a41-4ae6-98dc-3e06978d3a53 req-ef8ec83e-9c61-4926-bf53-337374dabccc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.069810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b6468825-7a41-4ae6-98dc-3e06978d3a53 req-ef8ec83e-9c61-4926-bf53-337374dabccc service nova] Creating event network-vif-plugged:ef0de150-72f9-464f-a35d-16625dc95f35 for instance 465d3faa-5cc1-4087-9589-d137378f09ad on n-h2-847009-13 Aug 23 10:40:38.076640 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b6468825-7a41-4ae6-98dc-3e06978d3a53 req-ef8ec83e-9c61-4926-bf53-337374dabccc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080443 Aug 23 10:40:38.079808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 507/954] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:38.094655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:38.097564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:38.099861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:38.109443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:38.111111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.111620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.112065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.112816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.113283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.113713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.114073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:38.115359 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08b1af71-a9e5-40b3-8df6-d00c122f962e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.628767 Aug 23 10:40:38.118591 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 448/955] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:37 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:38.167765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:38.168415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:38.191605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.192541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.193703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.196431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.197333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.197965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.627422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:38.643009 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58fb4945-d198-493c-9112-1b267eb388fc tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.509032 Aug 23 10:40:38.645367 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 449/956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:38 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:38.658379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:38.661121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:38.679352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.680122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.680778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.682019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:38.685746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:38.688456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:38.752675 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b22270d-86ba-4932-883b-8adbde42308a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104840 Aug 23 10:40:38.753307 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 450/957] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:40:38 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:40:38.788022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:38.805709 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-817d2384-e3fd-4c63-968a-bdbfa7e70185 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.724226 Aug 23 10:40:38.809873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 508/958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:38 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:39.000382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:39.001042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:39.011777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:39.020933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:39.022780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:39.023578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:39.024150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:39.024547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:39.109055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-283676714", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "ab02a44d-a7f4-4f61-a71c-9ea478b0f99f"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:39.199707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] validate_networks() for [('ab02a44d-a7f4-4f61-a71c-9ea478b0f99f', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:39.503721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:39.511846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6214630-0b63-40d7-884d-76cb47a9fca4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1537 microversion: 2.1 time: 0.516129 Aug 23 10:40:39.512426 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 451/959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:38 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1537 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:39.530042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:39.531023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:39.549226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:39.549745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:39.550191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:39.551543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:39.552171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:39.552622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.108261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:40.126782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:40.128313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:40.141530 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c55641e2-8747-45b7-8a13-a9316ba1684e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1408 microversion: 2.25 time: 0.607770 Aug 23 10:40:40.142216 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 452/960] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:39 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:40.146977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:40.147632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:40.177759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:40.178275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:40.178722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.189790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:40.190529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:40.191143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.245304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:40.246371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:40.247341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:40.247996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:40.249389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:40.261067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:40.261864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:40.262569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.264038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:40.265069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:40.265662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.292973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Getting quotas for project 5dfc4e7196d34e709a5a869216864151. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:40.299597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Getting quotas for user 92552bd027104cdc879b59446df626ce and project 5dfc4e7196d34e709a5a869216864151. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:40.333683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:40.336763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:40.374050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:40.408034 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bbe3d52-4aee-4bc1-bd4d-6541a22148ad tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303772 Aug 23 10:40:40.410775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 509/961] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 10:40:40.417483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:40.418433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:40.431244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:40.432392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:40.433034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.433903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:40.434520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:40.434952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:40.851220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:40.866155 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85c9c181-8814-46a9-a5d8-57c47edb2b1a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.451297 Aug 23 10:40:40.874427 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 510/962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:40 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:40.886202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c14fe7e9-4def-427c-869b-d236a7a3c49e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:40.886868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c14fe7e9-4def-427c-869b-d236a7a3c49e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:41.013098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c14fe7e9-4def-427c-869b-d236a7a3c49e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:41.022418 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c14fe7e9-4def-427c-869b-d236a7a3c49e tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1217 microversion: 2.1 time: 0.146948 Aug 23 10:40:41.023701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 511/963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:40 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:41.036729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:41.037554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:41.046179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.046686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.047130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.047851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.048598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.048809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.290345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:41.292721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:41.314506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5c12d9f-99b0-4af2-9c2e-b80576434919 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.285268 Aug 23 10:40:41.315120 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 512/964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:41 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:41.319957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:41.320608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:41.336112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.336630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.339288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:41.343317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.344375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.347493 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d139548-8051-43a7-95e7-16eb60034fb2 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 1.204203 Aug 23 10:40:41.355686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.355820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.363219 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 453/965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:40 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:41.381671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-76ea6264-04bf-4b4f-82ee-54ff01d79969 req-4098ca2e-acc7-4c5d-92d6-2f12c4a1f96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ee006f-9d99-49b9-9c30-15237f120050", "tag": "9cb83c3a-f3de-454f-a964-b0b1d8456674"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:41.429001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76ea6264-04bf-4b4f-82ee-54ff01d79969 req-4098ca2e-acc7-4c5d-92d6-2f12c4a1f96f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.430281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76ea6264-04bf-4b4f-82ee-54ff01d79969 req-4098ca2e-acc7-4c5d-92d6-2f12c4a1f96f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.430734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76ea6264-04bf-4b4f-82ee-54ff01d79969 req-4098ca2e-acc7-4c5d-92d6-2f12c4a1f96f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.438406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:41.457224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-76ea6264-04bf-4b4f-82ee-54ff01d79969 req-4098ca2e-acc7-4c5d-92d6-2f12c4a1f96f service nova] Creating event network-changed:9cb83c3a-f3de-454f-a964-b0b1d8456674 for instance 73ee006f-9d99-49b9-9c30-15237f120050 on n-h2-847009-13 Aug 23 10:40:41.482780 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-76ea6264-04bf-4b4f-82ee-54ff01d79969 req-4098ca2e-acc7-4c5d-92d6-2f12c4a1f96f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110807 Aug 23 10:40:41.483478 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 454/966] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:41.593697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:41.602802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:41.605932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:41.609470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc9dab57-cacd-4217-8c25-bc57018c71fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1604 microversion: 2.25 time: 0.293262 Aug 23 10:40:41.610749 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 513/967] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:41 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1604 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:41.637088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:41.637806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:41.658073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.658909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.659970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.662133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.663030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.663940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.826963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Calling method '.version_select at 0x7fdc9ce51af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:41.827867 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:41.827867 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:40:41.829153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.829845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.830451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.861672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.862588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.863408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.882163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.882862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.883423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.893456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eaf8fe08-e2f7-4540-bd0f-94b09ff92194 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.248096 Aug 23 10:40:41.894470 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 514/968] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:40:41 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:40:41.906941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:41.907609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:41.921327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.922724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.923327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.924350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:41.925197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:41.925784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:41.933189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b85d006d-f444-4061-9abf-aa351b14c119 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.300545 Aug 23 10:40:41.935450 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 455/969] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 10:40:41 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:40:42.225741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d29936df-f96e-465c-815e-753ef334c055 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Calling method '.version_select at 0x7fdc9d084430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.226974 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:42.226974 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:40:42.230724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d29936df-f96e-465c-815e-753ef334c055 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1250832772074cd79e925e3510897dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2feb94473e694c0a8979f5cfe6682abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d29936df-f96e-465c-815e-753ef334c055 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Request method failure captured: Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/n-h1-847009-13/search HTTP/1.1 Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6okThRVIIdd6RQnH8AcjNWJDwIWJf7CTbsAxmBqJa3u4V0SLlOVufxyHBZ5bHTN5uCByvfqqzgk_i0f10OjIkWkfZO81tCP98ZgIsaEiTKG-GUXNeuXEiFG-KUQC9VDiuodPDaoN2AAqU1maRAnBUG5ExYhncIcQaivaNoo9vxQ0U Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 2feb94473e694c0a8979f5cfe6682abf Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-254259581 Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:40:42.233951 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2feb94473e694c0a8979f5cfe6682abf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2feb94473e694c0a8979f5cfe6682abf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2feb94473e694c0a8979f5cfe6682abf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2feb94473e694c0a8979f5cfe6682abf"}]}] Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-254259581 Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 2feb94473e694c0a8979f5cfe6682abf Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-254259581 Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-254259581-project Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1250832772074cd79e925e3510897dec Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-254259581-project Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 23 10:40:42.235701 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'n-h1-847009-13'} Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:40:42.236647 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 23 10:40:42.238106 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.245183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d29936df-f96e-465c-815e-753ef334c055 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:42.246418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d29936df-f96e-465c-815e-753ef334c055 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h1-847009-13/search" status: 403 len: 117 microversion: 2.1 time: 0.299482 Aug 23 10:40:42.247564 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 456/970] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Aug 23 10:40:41 2022] GET /compute/v2.1/os-hypervisors/n-h1-847009-13/search => generated 117 bytes in 311 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:42.261501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.262654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:42.281163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.281692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.282138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.282879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.283517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.283959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.349965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:42.366657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36f6d9a4-9e38-4e67-a28f-bf13d77b6d9b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.470598 Aug 23 10:40:42.371832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:42.376067 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 515/971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:41 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:42.385001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Calling method '.version_select at 0x7fdc9d2720d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.388157 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:42.388157 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:40:42.390842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.391540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.398510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-66a4ac55-4aae-4f5b-8df4-c7627ae749e0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1269 microversion: 2.1 time: 0.147982 Aug 23 10:40:42.399976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.413955 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 10:40:42.415862 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 457/972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Request method failure captured: Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6pYtInCFr4-N7xs0ORYN_cHCGtvhndZwMzqjj519Gpbsb5phE2iVC24FuV9Ab_8cncG-8miUHwjQqVwUUE6StFwXTGC58fTO5Sfb7GVqkkp4OxLYEAVTJVr3AmDnDxqbYQW7H5SqhEohOCxKZDzuek0Cs_rCVTJiI_ZaofZ1iuDi8 Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: a2ba293b54934f618b7983f9480bc2cf Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1057850403 Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:40:42.415990 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2ba293b54934f618b7983f9480bc2cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2ba293b54934f618b7983f9480bc2cf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2ba293b54934f618b7983f9480bc2cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2ba293b54934f618b7983f9480bc2cf"}]}] Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1057850403 Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: a2ba293b54934f618b7983f9480bc2cf Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1057850403 Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 104ae2638e274d6397a3c6e019d82746 Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 10:40:42.417288 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.418024 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.419250 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.419250 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:42.419250 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:42.419250 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 10:40:42.419250 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.421394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:42.422822 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6f03b78-e830-4464-8834-b0f93a7b4f00 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.044969 Aug 23 10:40:42.428270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.429242 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 516/973] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:42.429761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:42.434089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.434773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:42.440032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.440824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.441461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.442476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.442759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.443321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.443579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.443878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.444400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.445241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.445780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.446273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.732996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:42.742731 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8b4fa0e-adf6-43b9-85f7-3625a32441b6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.325695 Aug 23 10:40:42.747027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 458/974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:42.752816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Calling method '.version_select at 0x7fdc9cf9c0d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.756409 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:42.756409 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:40:42.757958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.758697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.759373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.813482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.817808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.818322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.863956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.865452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.865952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.878438 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c59d6a4-cdf0-4674-9981-d49d8e3e8a71 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.129411 Aug 23 10:40:42.879043 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 459/975] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:42.905981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3f97e91-31bf-4610-854a-c4073a7246c2 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Calling method '.version_select at 0x7fdc9d153d30>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.906937 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:42.906937 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:40:42.908103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3f97e91-31bf-4610-854a-c4073a7246c2 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1250832772074cd79e925e3510897dec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2feb94473e694c0a8979f5cfe6682abf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3f97e91-31bf-4610-854a-c4073a7246c2 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Request method failure captured: Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6okThRVIIdd6RQnH8AcjNWJDwIWJf7CTbsAxmBqJa3u4V0SLlOVufxyHBZ5bHTN5uCByvfqqzgk_i0f10OjIkWkfZO81tCP98ZgIsaEiTKG-GUXNeuXEiFG-KUQC9VDiuodPDaoN2AAqU1maRAnBUG5ExYhncIcQaivaNoo9vxQ0U Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 2feb94473e694c0a8979f5cfe6682abf Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-254259581 Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:40:42.917664 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2feb94473e694c0a8979f5cfe6682abf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2feb94473e694c0a8979f5cfe6682abf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2feb94473e694c0a8979f5cfe6682abf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2feb94473e694c0a8979f5cfe6682abf"}]}] Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-254259581 Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 2feb94473e694c0a8979f5cfe6682abf Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-254259581 Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-254259581-project Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1250832772074cd79e925e3510897dec Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-254259581-project Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 23 10:40:42.919310 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1'} Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:40:42.920819 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 23 10:40:42.922170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.925540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3f97e91-31bf-4610-854a-c4073a7246c2 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:42.926739 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3f97e91-31bf-4610-854a-c4073a7246c2 tempest-HypervisorAdminNegativeUnderV252Test-254259581 tempest-HypervisorAdminNegativeUnderV252Test-254259581-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.034582 Aug 23 10:40:42.928177 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 460/976] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:42.939136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Calling method '.version_select at 0x7fdc9cd16b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:42.946815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:42.947498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:42.950446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:42.976005 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] HTTP exception thrown: No hypervisor matching '11fa7375-6389-4e4f-8e40-c43cc4ad468f' could be found. Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Request method failure captured: Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-hypervisors/11fa7375-6389-4e4f-8e40-c43cc4ad468f/servers HTTP/1.1 Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6pYtInCFr4-N7xs0ORYN_cHCGtvhndZwMzqjj519Gpbsb5phE2iVC24FuV9Ab_8cncG-8miUHwjQqVwUUE6StFwXTGC58fTO5Sfb7GVqkkp4OxLYEAVTJVr3AmDnDxqbYQW7H5SqhEohOCxKZDzuek0Cs_rCVTJiI_ZaofZ1iuDi8 Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: a2ba293b54934f618b7983f9480bc2cf Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1057850403 Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:40:42.984510 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2ba293b54934f618b7983f9480bc2cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2ba293b54934f618b7983f9480bc2cf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2ba293b54934f618b7983f9480bc2cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2ba293b54934f618b7983f9480bc2cf"}]}] Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1057850403 Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: a2ba293b54934f618b7983f9480bc2cf Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1057850403 Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 104ae2638e274d6397a3c6e019d82746 Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: exception: No hypervisor matching '11fa7375-6389-4e4f-8e40-c43cc4ad468f' could be found. Aug 23 10:40:42.985947 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '11fa7375-6389-4e4f-8e40-c43cc4ad468f'} Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '11fa7375-6389-4e4f-8e40-c43cc4ad468f' could be found. Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.986773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:42.988000 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:42.988000 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:42.988000 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:42.988000 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:42.988000 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '11fa7375-6389-4e4f-8e40-c43cc4ad468f' could be found. Aug 23 10:40:42.988000 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:40:42.991541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] Returning 404 to user: No hypervisor matching '11fa7375-6389-4e4f-8e40-c43cc4ad468f' could be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:42.994384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa09cb9f-822a-414e-978f-050d08d5d9a6 tempest-HypervisorAdminNegativeUnderV252Test-1057850403 tempest-HypervisorAdminNegativeUnderV252Test-1057850403-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/11fa7375-6389-4e4f-8e40-c43cc4ad468f/servers" status: 404 len: 123 microversion: 2.1 time: 0.059072 Aug 23 10:40:42.996121 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 461/977] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/os-hypervisors/11fa7375-6389-4e4f-8e40-c43cc4ad468f/servers => generated 123 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:40:43.024580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:43.041537 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b8cf6fd-a41d-4eee-82fc-13bcba1bc4d6 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.611082 Aug 23 10:40:43.042469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 517/978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:42 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:43.357457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7c884ac8-edfb-4de4-96fb-5e8670621cb9 req-4e5befae-3f8c-4dc2-bdf5-b41e5bf3233b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ade5aa1-eab4-433d-9bc6-a3d6658e05da", "name": "network-vif-plugged", "status": "completed", "tag": "0e2a14dd-81c8-488b-99d9-bf2bdecb6657"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:43.366542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:43.380915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7c884ac8-edfb-4de4-96fb-5e8670621cb9 req-4e5befae-3f8c-4dc2-bdf5-b41e5bf3233b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.382296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7c884ac8-edfb-4de4-96fb-5e8670621cb9 req-4e5befae-3f8c-4dc2-bdf5-b41e5bf3233b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.382975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7c884ac8-edfb-4de4-96fb-5e8670621cb9 req-4e5befae-3f8c-4dc2-bdf5-b41e5bf3233b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.398695 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7c884ac8-edfb-4de4-96fb-5e8670621cb9 req-4e5befae-3f8c-4dc2-bdf5-b41e5bf3233b service nova] Creating event network-vif-plugged:0e2a14dd-81c8-488b-99d9-bf2bdecb6657 for instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da on n-h1-847009-13 Aug 23 10:40:43.400672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:43.401862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:43.407972 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7c884ac8-edfb-4de4-96fb-5e8670621cb9 req-4e5befae-3f8c-4dc2-bdf5-b41e5bf3233b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055621 Aug 23 10:40:43.409608 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 462/979] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:43.431986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.432720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.434708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.436836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.440630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:43.441571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.443820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:43.444496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.475715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.477310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.494824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.495865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.497535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.501111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.672267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:43.682523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b15c832f-c382-43ff-ad7d-30ce05937bb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1275 microversion: 2.1 time: 0.254754 Aug 23 10:40:43.683392 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 463/980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:43 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:43.704236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8ca3b25-45f1-4f77-ae99-a92a005aa0c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Action: 'create', calling method: .version_select at 0x7fdc9cd169d0>, body: {"keypair": {"name": "tempest-keypair-1120629805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzyPX/4d/jpVX1Cmv8dgtDmHfWjhBykM3VCPL0s9zhbsBDUlz9lOcVx2IU/Fl3dlqhgKw/kjYvWdOhiaxdlhNZjEnoQxsifeKzbs5NfhmSAtd6kAPxNmLyHU68277IrZg=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:43.723549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f8ca3b25-45f1-4f77-ae99-a92a005aa0c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Getting quotas for project 4366507f35354b8aa9c0aa47c2083242. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:43.729727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f8ca3b25-45f1-4f77-ae99-a92a005aa0c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Getting quotas for user 096919930bd0421b878f7d5e32f1ec8e and project 4366507f35354b8aa9c0aa47c2083242. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:43.766598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8ca3b25-45f1-4f77-ae99-a92a005aa0c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.070145 Aug 23 10:40:43.767460 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 464/981] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:40:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 10:40:43.774039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:43.774871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:43.781753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.782265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.783200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.784083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:43.784939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:43.785534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:43.978737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:43.989306 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de792b6a-10d9-43b1-a125-1d94f07b9613 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.593382 Aug 23 10:40:43.990768 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 518/982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:43 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:44.070188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:44.070957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:44.081213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:44.083102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:44.084619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:44.086617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:44.088522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:44.089720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:44.196804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:44.207566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffae3239-d35c-409c-8aed-bb432e4bf8e3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.438821 Aug 23 10:40:44.208704 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 465/983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:43 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:44.532935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:44.543042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d70b8f0-d9f6-4ec1-8ce5-4c0b765bea37 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.478357 Aug 23 10:40:44.543912 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 519/984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:44 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:44.710425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:44.711298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:44.717372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:44.723978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:44.724491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:44.724963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:44.725883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:44.726351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:44.726785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:44.842638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:44.851972 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-47431edc-c6eb-474b-b43d-621ab9b86f92 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1275 microversion: 2.1 time: 0.146493 Aug 23 10:40:44.852966 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 466/985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:44 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1275 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:45.018718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:45.019348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:45.038432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.039124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.039821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.049368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6c4d6706-73fd-43bb-81a9-a4e929cda4c7 req-b83d1378-51b9-464f-8611-a8770c80215f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465d3faa-5cc1-4087-9589-d137378f09ad", "tag": "ef0de150-72f9-464f-a35d-16625dc95f35"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:45.067368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.070269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.072606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.078292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6c4d6706-73fd-43bb-81a9-a4e929cda4c7 req-b83d1378-51b9-464f-8611-a8770c80215f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.080866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6c4d6706-73fd-43bb-81a9-a4e929cda4c7 req-b83d1378-51b9-464f-8611-a8770c80215f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.081885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6c4d6706-73fd-43bb-81a9-a4e929cda4c7 req-b83d1378-51b9-464f-8611-a8770c80215f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.129595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6c4d6706-73fd-43bb-81a9-a4e929cda4c7 req-b83d1378-51b9-464f-8611-a8770c80215f service nova] Creating event network-changed:ef0de150-72f9-464f-a35d-16625dc95f35 for instance 465d3faa-5cc1-4087-9589-d137378f09ad on n-h2-847009-13 Aug 23 10:40:45.137895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6c4d6706-73fd-43bb-81a9-a4e929cda4c7 req-b83d1378-51b9-464f-8611-a8770c80215f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093282 Aug 23 10:40:45.139104 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 467/986] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:45.237316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:45.240948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:45.251843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.253190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.253821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.254905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.256468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.257355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.342868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:45.355738 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17cb7c9c-618e-4496-b071-7cbddcb5d298 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.343711 Aug 23 10:40:45.356707 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 520/987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:45 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:45.568079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:45.568793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:45.574944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.575440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.575911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.576687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.589573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.590435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.702138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:45.715864 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d72bc9f-42a7-404c-9959-8f8ab108f940 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.490061 Aug 23 10:40:45.733694 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 468/988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:45 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:45.849608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:45.861941 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7306a51c-6bd5-4a9e-86d7-1c7427260a47 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1318 microversion: 2.1 time: 0.298030 Aug 23 10:40:45.862865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 521/989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:45 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:45.874632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:45.875248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:45.890539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.891035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.894400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:45.896725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:45.898618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:45.899085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.172729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:46.181004 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d30a9f40-1b20-4b3f-a838-4ead7b338c77 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.311158 Aug 23 10:40:46.190827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 469/990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:45 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:46.383702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:46.384326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:46.393760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:46.394258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:46.395833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.396578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:46.397081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:46.398397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.711539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:46.722874 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08c96921-77ad-4ede-ae05-0c5200905725 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.343132 Aug 23 10:40:46.739555 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 522/991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:46 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:46.743220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:46.743915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:46.751927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:46.752517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:46.753114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.758078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:46.759018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:46.759466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.885088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:46.885945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:46.892147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:46.892733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:46.893341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.894129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:46.894824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:46.895362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:46.962704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:46.987887 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90a3ec80-5d72-4e94-8084-8c39054fa97f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.249063 Aug 23 10:40:46.988561 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 470/992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:46 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:47.168574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b65e502c-7ebc-45fe-8833-2075977010b2 req-55684d22-976f-42ac-8b29-f36292802e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0ad8267-7788-47f9-b7a0-e71f2dc9b45a", "tag": "56776c36-bc6d-415d-8c79-82c1f7ed0a87"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:47.187158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b65e502c-7ebc-45fe-8833-2075977010b2 req-55684d22-976f-42ac-8b29-f36292802e01 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.187873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b65e502c-7ebc-45fe-8833-2075977010b2 req-55684d22-976f-42ac-8b29-f36292802e01 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.189158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b65e502c-7ebc-45fe-8833-2075977010b2 req-55684d22-976f-42ac-8b29-f36292802e01 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.192181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:47.199924 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa6c87bb-2eff-4fe3-834c-efaf79005f7d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1468 microversion: 2.1 time: 0.319859 Aug 23 10:40:47.202957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b65e502c-7ebc-45fe-8833-2075977010b2 req-55684d22-976f-42ac-8b29-f36292802e01 service nova] Creating event network-changed:56776c36-bc6d-415d-8c79-82c1f7ed0a87 for instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a on n-h1-847009-13 Aug 23 10:40:47.206965 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 523/993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:46 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1468 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:47.209241 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b65e502c-7ebc-45fe-8833-2075977010b2 req-55684d22-976f-42ac-8b29-f36292802e01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046972 Aug 23 10:40:47.209928 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 471/994] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:47.217075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:47.218476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:47.241226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.241962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.242592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.243456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.244056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.245270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.419137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:47.430366 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96d92aba-7a95-4c30-afd7-f930742edcc4 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.219085 Aug 23 10:40:47.431171 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 472/995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:47 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:47.566699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1252655933", "block_migration": true, "disk_over_commit": false}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:47.576424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:47.585658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.586410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.586846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.588442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.588948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.589377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.627301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lazy-loading 'flavor' on Instance uuid 2ade5aa1-eab4-433d-9bc6-a3d6658e05da {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:40:47.642893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Going to try to live migrate instance to tempest-host-1252655933 {{(pid=128859) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:40:47.650732 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] HTTP exception thrown: Compute host tempest-host-1252655933 could not be found. Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Request method failure captured: Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da/action HTTP/1.1 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 107 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6T2Rrs74Xow6v7rOteKQ3TFtavpu1JXYWa3bnhLaB6JkayGQ0F4iEpYbZGGBWpFBDHVPM2uWHzBlke27-KW4q6_huidJyWV-lXESYUG4BoEKz5Lkm56OYvp6gUvsvH9RYz4aldYoYMp3PvvtGKMPKR-Ay3-b4okKpCiLTa97AUum0 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 929b94fed2284f568562ac5843aa7b15 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveMigrationNegativeTest-1855376189 Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:40:47.656713 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/929b94fed2284f568562ac5843aa7b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_929b94fed2284f568562ac5843aa7b15", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/929b94fed2284f568562ac5843aa7b15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/929b94fed2284f568562ac5843aa7b15"}]}] Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveMigrationNegativeTest-1855376189 Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 929b94fed2284f568562ac5843aa7b15 Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1855376189 Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveMigrationNegativeTest-1855376189-project-admin Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9ce615378a4941a485d79e502fc155d6 Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveMigrationNegativeTest-1855376189-project-admin Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: {"os-migrateLive": {"host": "tempest-host-1252655933", "block_migration": true, "disk_over_commit": false}} Aug 23 10:40:47.658083 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: exception: Compute host tempest-host-1252655933 could not be found. Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2ade5aa1-eab4-433d-9bc6-a3d6658e05da', 'body': {'os-migrateLive': {'host': 'tempest-host-1252655933', 'block_migration': True, 'disk_over_commit': False}}} Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:40:47.658853 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5483, in live_migrate Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1252655933 could not be found. Aug 23 10:40:47.660000 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1252655933 could not be found. Aug 23 10:40:47.661287 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1252655933 could not be found. Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Returning 400 to user: Compute host tempest-host-1252655933 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e15de82-f421-4f6e-8dc1-177fa951049f tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da/action" status: 400 len: 100 microversion: 2.1 time: 0.436486 Aug 23 10:40:47.662518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 524/996] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Aug 23 10:40:47 2022] POST /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da/action => generated 100 bytes in 438 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:40:47.668062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:47.669049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:47.695272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.696115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.697079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.698228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.698730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.699498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.771264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ceb8b9f-3c1f-4e13-bd79-480e7fed38a4 tempest-InstanceUsageAuditLogTestJSON-223485361 tempest-InstanceUsageAuditLogTestJSON-223485361-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:47.772105 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:47.772105 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:40:47.793951 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ceb8b9f-3c1f-4e13-bd79-480e7fed38a4 tempest-InstanceUsageAuditLogTestJSON-223485361 tempest-InstanceUsageAuditLogTestJSON-223485361-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23 10:40:47" status: 200 len: 318 microversion: 2.1 time: 0.172826 Aug 23 10:40:47.795364 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 473/997] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 10:40:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23%2010%3A40%3A47 => generated 318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:40:47.808360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:47.809171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:47.816431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.817350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.817980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.818983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:47.819673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:47.820502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:47.882324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:47.895373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f79a7865-e9a5-4172-a61f-049a310ab087 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1468 microversion: 2.1 time: 0.231699 Aug 23 10:40:47.896539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 525/998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:47 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1468 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:47.903155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d81e153-0f99-4719-b908-246a5b7d9d67 tempest-InstanceUsageAuditLogTestJSON-223485361 tempest-InstanceUsageAuditLogTestJSON-223485361-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:47.904190 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:40:47.904190 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:40:47.926023 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d81e153-0f99-4719-b908-246a5b7d9d67 tempest-InstanceUsageAuditLogTestJSON-223485361 tempest-InstanceUsageAuditLogTestJSON-223485361-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027234 Aug 23 10:40:47.927279 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 526/999] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 10:40:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:47.932629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-690415395", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ac724746-7f6f-4a6c-bb81-5c1ba63e0643"}, {"port": "b108b97c-f9c8-4c77-997a-5a189cf75689", "tag": "port-1"}, {"port": "24a4b2f8-56ea-40b9-8b30-133cd135fb5b", "tag": "port-2"}, {"uuid": "7d9cc347-b112-459c-92e5-bf503dedbddf", "tag": "net-1"}, {"uuid": "7d9cc347-b112-459c-92e5-bf503dedbddf"}, {"uuid": "4d245936-a1d3-434b-b5b4-1a37b568ead8", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4d245936-a1d3-434b-b5b4-1a37b568ead8", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "abf94c50-0133-42bc-986e-b73ca0c151d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bb5a9f30-7723-4dae-b192-b1395647c614", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1ae2f7b3-662f-4483-a065-b6b63e06829e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1891861848"}], "key_name": "tempest-keypair-1120629805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:48.018335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:48.026635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11705b7c-4e90-498b-8cb8-b2ffb1b401d5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.222458 Aug 23 10:40:48.035835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 474/1000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:47 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:48.044277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:48.046218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:48.053329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:48.054273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:48.054729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:48.057441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:48.058296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:48.058928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:48.082926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] validate_networks() for [('ac724746-7f6f-4a6c-bb81-5c1ba63e0643', None, None, None, None, None), (None, None, 'b108b97c-f9c8-4c77-997a-5a189cf75689', None, None, None), (None, None, '24a4b2f8-56ea-40b9-8b30-133cd135fb5b', None, None, None), ('7d9cc347-b112-459c-92e5-bf503dedbddf', None, None, None, None, None), ('7d9cc347-b112-459c-92e5-bf503dedbddf', None, None, None, None, None), ('4d245936-a1d3-434b-b5b4-1a37b568ead8', '10.2.2.100', None, None, None, None), ('4d245936-a1d3-434b-b5b4-1a37b568ead8', '10.2.2.200', None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:48.239248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:48.250281 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1c2cf6c-a9b6-4c43-8414-836657ae0057 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.213271 Aug 23 10:40:48.251127 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 475/1001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:48 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:48.255782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1711185949", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:48.311223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:40:48.606125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:48.607067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:48.608224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:48.609791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:48.610367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:48.621802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:48.622361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:48.622990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:48.624294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:48.624971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:48.625401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:48.647909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Getting quotas for project 2fea1ec49dc540d5ac895803d3bec1f4. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:48.655957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Getting quotas for user caf26dcae82b4835a0c0514945dd7882 and project 2fea1ec49dc540d5ac895803d3bec1f4. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:48.672563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:48.672563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:48.721397 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab728ce4-bb23-4213-ac59-6ddb7332f3f4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469035 Aug 23 10:40:48.722626 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 476/1002] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:40:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:40:48.727515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:48.728369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:48.735773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:48.736540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:48.737535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:48.738140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:48.738519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:48.738951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:48.889058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:48.898406 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf3668da-fe91-46be-b61b-e47f4fd1ca06 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.174819 Aug 23 10:40:48.913383 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 477/1003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:48 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:48.913383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e488b1e6-e908-45b1-887f-67661907bd54 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:48.913383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e488b1e6-e908-45b1-887f-67661907bd54 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:48.989033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e488b1e6-e908-45b1-887f-67661907bd54 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:48.999159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e488b1e6-e908-45b1-887f-67661907bd54 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1219 microversion: 2.1 time: 0.097153 Aug 23 10:40:49.000673 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 478/1004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:48 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:49.049761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:49.050405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:49.057853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.058644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.059239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:49.061898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.062556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.063187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:49.251869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:49.261987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3ea974f-1b9e-4ff3-8bdd-7b0dad853bf1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.218574 Aug 23 10:40:49.262921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 479/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:49 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:49.272580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:49.273240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:49.283842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.284575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.285330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:49.293742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.294644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.296810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:49.301671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:49.473240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:49.485456 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d25633d6-ef92-47ec-9bf9-3e3441d27506 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.217871 Aug 23 10:40:49.486046 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 480/1006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:49 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:49.501054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-de24b311-c222-4d3b-a04a-4346680020fc req-c8a0e789-f9f2-43e2-9e0a-2850ccf5910f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee006f-9d99-49b9-9c30-15237f120050", "name": "network-vif-plugged", "status": "completed", "tag": "9cb83c3a-f3de-454f-a964-b0b1d8456674"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:49.513294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de24b311-c222-4d3b-a04a-4346680020fc req-c8a0e789-f9f2-43e2-9e0a-2850ccf5910f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.513977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de24b311-c222-4d3b-a04a-4346680020fc req-c8a0e789-f9f2-43e2-9e0a-2850ccf5910f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.514587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de24b311-c222-4d3b-a04a-4346680020fc req-c8a0e789-f9f2-43e2-9e0a-2850ccf5910f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:49.538160 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-de24b311-c222-4d3b-a04a-4346680020fc req-c8a0e789-f9f2-43e2-9e0a-2850ccf5910f service nova] Creating event network-vif-plugged:9cb83c3a-f3de-454f-a964-b0b1d8456674 for instance 73ee006f-9d99-49b9-9c30-15237f120050 on n-h2-847009-13 Aug 23 10:40:49.553518 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-de24b311-c222-4d3b-a04a-4346680020fc req-c8a0e789-f9f2-43e2-9e0a-2850ccf5910f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065719 Aug 23 10:40:49.554955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 481/1007] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:49.921687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:49.922450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:49.928483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.929009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.929447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:49.930141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:49.930596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:49.931017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.082555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:50.091083 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0bf91ef-3d69-4d5b-9bdc-c0b289a5ac26 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.175298 Aug 23 10:40:50.092358 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 482/1008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:49 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:50.096979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:50.097789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:50.112246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:50.113301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:50.113424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.114328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:50.114958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:50.115553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.183682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:50.192656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-517ed827-25a4-44ab-a4be-bd33539b3ada tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1271 microversion: 2.1 time: 0.099224 Aug 23 10:40:50.193284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 483/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:50 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:50.275349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:50.285244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:50.286356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:50.292881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:50.293386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:50.293833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.294772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:50.295236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:50.295669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.454643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:50.465828 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59594876-88b1-4fb3-8c51-500e736f8b50 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.184619 Aug 23 10:40:50.467510 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 484/1010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:50 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:50.510572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:50.511302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:50.518183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:50.518824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:50.519276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.519983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:50.520450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:50.520990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:50.679665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:50.688265 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0872d94-bf13-47c1-abe3-fa070cba6e2e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.182700 Aug 23 10:40:50.688933 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 485/1011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:50 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:51.111408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:51.112691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:51.119667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.120159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.120594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.121506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.122337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.123452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.142700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:40:51.143127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:40:51.143926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:40:51.144875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:40:51.145542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:40:51.155857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.156542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.157013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.158390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.159029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.159633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.188291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Getting quotas for project 4366507f35354b8aa9c0aa47c2083242. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:40:51.194273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Getting quotas for user 096919930bd0421b878f7d5e32f1ec8e and project 4366507f35354b8aa9c0aa47c2083242. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:40:51.270426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.279459 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c64e7ddc-3ae4-422a-a636-f346a48c8b31 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.170877 Aug 23 10:40:51.280449 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 486/1012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:51 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:51.285028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:51.285644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:51.291817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.292597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.293083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.293813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.294409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.295065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.404650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.413744 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ec3f6e4-b8d6-4126-93ce-94feca30150a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1271 microversion: 2.1 time: 0.132168 Aug 23 10:40:51.414473 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 487/1013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:51 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:51.430660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:40:51.433702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='abf94c50-0133-42bc-986e-b73ca0c151d0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bb5a9f30-7723-4dae-b192-b1395647c614',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ae2f7b3-662f-4483-a065-b6b63e06829e',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:40:51.488872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:51.489913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:51.496037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.496599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.497159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.498906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.499720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.499852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.683466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.693375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44f1c378-b733-4a6a-a732-10c8b125b25e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1307 microversion: 2.1 time: 0.209041 Aug 23 10:40:51.694666 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 488/1014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:51 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:51.715096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:51.716609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:51.723431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.723950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.724377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.725147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:51.725781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:51.726410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:51.855640 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c807966b-3591-4e81-a9c3-735364024e18 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 3.927004 Aug 23 10:40:51.857041 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 527/1015] 10.222.0.78 () {62 vars in 1189 bytes} [Tue Aug 23 10:40:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 3929 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:40:51.869729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f506ba1-4da2-4735-a30f-af4a33a3b7c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:51.870784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f506ba1-4da2-4735-a30f-af4a33a3b7c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:51.892291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.901685 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44f2c7e3-2c01-4b20-ba3b-1e7b66a53228 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.191543 Aug 23 10:40:51.903319 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 489/1016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:51 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:51.944910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f506ba1-4da2-4735-a30f-af4a33a3b7c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.957243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f506ba1-4da2-4735-a30f-af4a33a3b7c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.965955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f506ba1-4da2-4735-a30f-af4a33a3b7c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:51.970241 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f506ba1-4da2-4735-a30f-af4a33a3b7c9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1285 microversion: 2.32 time: 0.106420 Aug 23 10:40:51.970902 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 528/1017] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:51 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:52.071371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9cd631f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:52.171743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.172524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.173122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.174003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.174537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.175114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.236973 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2629d11-73f4-4191-b2ab-54a57f505825 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb" status: 200 len: 148 microversion: 2.57 time: 0.316363 Aug 23 10:40:52.237866 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 490/1018] 10.222.0.78 () {62 vars in 1303 bytes} [Tue Aug 23 10:40:51 2022] PUT /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb => generated 148 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:40:52.248110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Calling method '.version_select at 0x7fdc9ce22700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:52.333813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.334521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.334966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.335714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.336320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.336957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.358575 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56f827a4-ca1e-4628-878e-f7719530f5c8 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb/detail" status: 200 len: 463 microversion: 2.57 time: 0.114220 Aug 23 10:40:52.359063 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 529/1019] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Aug 23 10:40:52 2022] GET /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb/detail => generated 463 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:40:52.364791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:52.365442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:52.371537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.372027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.372687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.373851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.374521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.375115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.435708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:52.436411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:52.445430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.446107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.446708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.447583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.448336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.449071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.541047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:52.555502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0e116cf-9e63-4dff-9a5f-1ee61f208350 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1277 microversion: 2.1 time: 0.123878 Aug 23 10:40:52.556075 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 530/1020] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:52 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:52.565026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d33e160>, body: {"quota_set": {"ram": "2048"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:52.631392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:52.640077 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04dc0a6d-a740-4e22-a5e9-5051271c11ba tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.279005 Aug 23 10:40:52.641201 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 491/1021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:52 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:52.658699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.659395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.659984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.661067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.661596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.662074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.704091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.704492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.704980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.705719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.706445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.706885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.715062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:52.715928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:52.723254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.724004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.724600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.725508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.726126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.726981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.792703 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0d38cef-edeb-4112-8952-99dfdf244df6 tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb?user_id=a1d62e5dcd734ca9921228fec65f7b00" status: 200 len: 148 microversion: 2.57 time: 0.234831 Aug 23 10:40:52.793862 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 531/1022] 10.222.0.78 () {62 vars in 1384 bytes} [Tue Aug 23 10:40:52 2022] PUT /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb?user_id=a1d62e5dcd734ca9921228fec65f7b00 => generated 148 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:40:52.804588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1ff3adc-30e0-4575-8b8a-3ebd0ccc4b4b tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] Calling method '.version_select at 0x7fdc9d272f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:52.901657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1ff3adc-30e0-4575-8b8a-3ebd0ccc4b4b tempest-QuotasAdminTestV257-505733603 tempest-QuotasAdminTestV257-505733603-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb?user_id=a1d62e5dcd734ca9921228fec65f7b00" status: 200 len: 190 microversion: 2.57 time: 0.100795 Aug 23 10:40:52.903615 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 532/1023] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Aug 23 10:40:52 2022] GET /compute/v2.1/os-quota-sets/6f6eae362d7043618fc16d43370755bb?user_id=a1d62e5dcd734ca9921228fec65f7b00 => generated 190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:40:52.940025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:52.942914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:52.970034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.980045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.980927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:52.982092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:52.985158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:52.985857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.204388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.217529 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1a78e1e0-508a-40ab-8751-5efbf80b52f2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.287379 Aug 23 10:40:53.231190 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 533/1024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:52 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:53.231542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:53.232227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:53.240299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.241087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.241532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.242321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.242714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.243184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.250959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.266897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce953bfa-1c4c-4d9d-a701-17ca28f5c7fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1487 microversion: 2.1 time: 0.555622 Aug 23 10:40:53.267484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 492/1025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:52 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1487 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:53.290204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:53.291366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:53.299555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:53.303339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.304114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.305005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.305973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.306549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.307309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.398482 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69720446-86c9-4707-99d9-4e6de86c6604 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050/action" status: 202 len: 0 microversion: 2.1 time: 0.112930 Aug 23 10:40:53.399590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 493/1026] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:40:53 2022] POST /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:40:53.419396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:53.421573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:53.440178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.441921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.445316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.454501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.455391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.456391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.458533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.471608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.480681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.481183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32793127-e9b4-4384-b2cc-d808d7d11e32 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1575 microversion: 2.32 time: 0.260986 Aug 23 10:40:53.481775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 534/1027] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:53 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:53.582282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:53.582944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:53.594131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:53.596938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.599606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.599606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.600326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.609108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.610081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.767284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.788204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4524793a-1c8a-4477-a0a7-326ee8270cb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1492 microversion: 2.1 time: 0.384322 Aug 23 10:40:53.807557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 494/1028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:53 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1492 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:53.811108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:53.813100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:53.826321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.826821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.827373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.828788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:53.829776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:53.830257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:53.947347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:53.957053 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b9cc58f-176e-47cc-90e7-b6c4cdc164b0 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.381116 Aug 23 10:40:53.957603 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 535/1029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:53 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:54.146483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:54.156186 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8fd48947-3ccf-4176-aa96-ca41393ef805 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.359980 Aug 23 10:40:54.156828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 495/1030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:53 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:54.239242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:54.239843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:54.246135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.246629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.247067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.248498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.249407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.249841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.493441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:54.502255 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bcedb6e4-099d-4489-923f-73d7bd563c16 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.266906 Aug 23 10:40:54.502834 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 536/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:54 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:54.510408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:54.511100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:54.520048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.520542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.521015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.521725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.522187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.522615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.673039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:54.682691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:54.684169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:54.693635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9d1bfa5-21fd-4d20-9c90-bd576756dd4d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1593 microversion: 2.32 time: 0.187314 Aug 23 10:40:54.694311 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 496/1032] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:54 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1593 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:54.817077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:54.817710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:54.834110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-698a943f-fb3b-4880-8e8e-6830e6f08cf0 req-a0b492c5-271a-419a-bd68-af8a20fb93bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "553a8db0-0b98-417c-8d38-0d7718f419d7", "tag": "b86b50ce-95cc-4d28-bfa3-390ae29f7318"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:54.839790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.840349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.840753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.842152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.847967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.848424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.856617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-698a943f-fb3b-4880-8e8e-6830e6f08cf0 req-a0b492c5-271a-419a-bd68-af8a20fb93bd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.857537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-698a943f-fb3b-4880-8e8e-6830e6f08cf0 req-a0b492c5-271a-419a-bd68-af8a20fb93bd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.858262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-698a943f-fb3b-4880-8e8e-6830e6f08cf0 req-a0b492c5-271a-419a-bd68-af8a20fb93bd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.864517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:54.877300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-698a943f-fb3b-4880-8e8e-6830e6f08cf0 req-a0b492c5-271a-419a-bd68-af8a20fb93bd service nova] Creating event network-changed:b86b50ce-95cc-4d28-bfa3-390ae29f7318 for instance 553a8db0-0b98-417c-8d38-0d7718f419d7 on n-h2-847009-13 Aug 23 10:40:54.899960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-698a943f-fb3b-4880-8e8e-6830e6f08cf0 req-a0b492c5-271a-419a-bd68-af8a20fb93bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071922 Aug 23 10:40:54.901642 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 497/1033] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:54.979886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:54.981033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:54.995029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.995773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.996499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:54.998019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:54.998920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:54.999526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.237569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:55.250112 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c63afc28-547a-4209-8ac2-398d18e63dc2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 200 len: 1472 microversion: 2.1 time: 0.438655 Aug 23 10:40:55.252443 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 537/1034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:54 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:55.269376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:55.269915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:55.293511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.296618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.298471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.300562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.301259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.302245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.427740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:55.441574 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5702a4e3-6d60-498e-8334-14985c6e3de1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.466271 Aug 23 10:40:55.444794 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 498/1035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:54 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:55.459390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-667584269"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:55.464512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:55.481433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.482175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.482788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.483785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.484444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.485068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.734086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:55.745019 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f37c3a5-344b-4b36-a7fd-a4101e94fa10 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.489228 Aug 23 10:40:55.749838 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 538/1036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:55 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:55.759497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-eddb313a-518e-4d35-bb91-9c28490e69a1 req-3a1c50d7-9580-472d-8f83-256b61ee3946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ad8267-7788-47f9-b7a0-e71f2dc9b45a", "name": "network-vif-plugged", "status": "completed", "tag": "56776c36-bc6d-415d-8c79-82c1f7ed0a87"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:40:55.785497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eddb313a-518e-4d35-bb91-9c28490e69a1 req-3a1c50d7-9580-472d-8f83-256b61ee3946 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.785993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eddb313a-518e-4d35-bb91-9c28490e69a1 req-3a1c50d7-9580-472d-8f83-256b61ee3946 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.786429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eddb313a-518e-4d35-bb91-9c28490e69a1 req-3a1c50d7-9580-472d-8f83-256b61ee3946 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.819774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-eddb313a-518e-4d35-bb91-9c28490e69a1 req-3a1c50d7-9580-472d-8f83-256b61ee3946 service nova] Creating event network-vif-plugged:56776c36-bc6d-415d-8c79-82c1f7ed0a87 for instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a on n-h1-847009-13 Aug 23 10:40:55.835958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-eddb313a-518e-4d35-bb91-9c28490e69a1 req-3a1c50d7-9580-472d-8f83-256b61ee3946 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086078 Aug 23 10:40:55.836566 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 539/1037] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:40:55.839026 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f71d063-ffa9-4a2c-b2f0-7e044633f04e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050/action" status: 202 len: 0 microversion: 2.1 time: 0.391798 Aug 23 10:40:55.841634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 499/1038] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:40:55 2022] POST /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:40:55.858012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:55.859324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:55.863862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:55.864510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:55.882452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.883606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.884833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.886007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.887777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.888659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.890064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.890590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.891022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:55.891806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:55.892268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:55.897123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:56.114481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:56.125862 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6dcc59cd-10be-4cb0-916e-129a559f5881 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.288049 Aug 23 10:40:56.126661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 540/1039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:55 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:56.146954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0631981c-5852-4606-911e-358dd5fae25d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc8c940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:56.175919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:56.187997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:56.190838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:56.193035 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85c2d945-4d6d-41e8-8b8a-e06b30c9ebb8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1661 microversion: 2.32 time: 0.349664 Aug 23 10:40:56.193601 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 500/1040] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:55 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1661 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:56.217332 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0631981c-5852-4606-911e-358dd5fae25d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.074506 Aug 23 10:40:56.218170 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 541/1041] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:40:56 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:56.470686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:56.471623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:56.479778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:56.480453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:56.481091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:56.483129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:56.483753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:56.484357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:56.641257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:56.651474 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a3f8102b-893e-46c5-ac11-10b1c3fd2167 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.185730 Aug 23 10:40:56.652505 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 501/1042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:56 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:56.769440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:56.770093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:56.776580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:56.777104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:56.777546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:56.778293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:56.779623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:56.780370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:56.935117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:56.943521 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc859507-8132-42e8-8963-ce3a2e7b091c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.178675 Aug 23 10:40:56.944103 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 542/1043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:56 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:57.148420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:57.149701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:57.158180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.158908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.159515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.160427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.161261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.162047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.217411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:57.218353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:57.229814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.233985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.234641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.235700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.237563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.238249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.369278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:57.380724 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f922838-b9a3-4ec5-9c63-e8ff44e2e36e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1542 microversion: 2.1 time: 0.235552 Aug 23 10:40:57.382573 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 502/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:57 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1542 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:57.389749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ea15afc-a21b-4f5d-8ba4-5c3b1a150031 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb9b160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:57.455763 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ea15afc-a21b-4f5d-8ba4-5c3b1a150031 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.071704 Aug 23 10:40:57.456674 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 503/1045] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:40:57 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:57.685725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:57.729178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:57.752711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:40:57.754681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.755601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.756088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.756977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.757926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.758460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.759382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:57.773555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:57.775059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:57.776258 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a5ab2e3b-77af-434a-9edb-846bdbdce223 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1661 microversion: 2.32 time: 0.563960 Aug 23 10:40:57.782207 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 543/1046] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:57 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1661 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:40:57.971126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:57.972121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:57.993753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.994325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.994836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:57.995622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:57.996156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:57.996652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:58.025708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:58.041602 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea47d3ab-903a-4d78-a6b3-bcc12515d957 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.370484 Aug 23 10:40:58.042255 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 504/1047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:57 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:58.330503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:58.349090 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-869d78df-cf01-4ac5-a052-1ecd4cca3dc7 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1317 microversion: 2.1 time: 0.386389 Aug 23 10:40:58.349776 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 544/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:57 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:58.403360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:58.405399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:58.422297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:58.423255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:58.423865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:58.424801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:58.425426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:58.437461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:58.470817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a138d5b-09fd-4129-b237-3b9e19ed608b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc37820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:58.554314 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a138d5b-09fd-4129-b237-3b9e19ed608b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.088058 Aug 23 10:40:58.555150 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 545/1049] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:40:58 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:40:58.764237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:58.772783 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-102e2459-4c8a-4771-a418-e23b2ea6c2c0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1541 microversion: 2.1 time: 0.374798 Aug 23 10:40:58.773366 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 505/1050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:58 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1541 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:58.803991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:58.804979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:58.812283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:58.812804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:58.813516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:58.814324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:58.815239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:58.816473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:59.065959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:59.074236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:59.082200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:59.085750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:59.087442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:59.095059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:59.095831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:59.096490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:59.194596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:59.242266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:59.246845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:59.252689 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41ebe802-c004-491c-a71e-244e93f7323f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1708 microversion: 2.32 time: 0.450484 Aug 23 10:40:59.259495 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 546/1051] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:40:58 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1708 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:40:59.380383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:59.381408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:59.391672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:59.393826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:59.394671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:59.395874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:59.396918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:59.397653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:59.403042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:40:59.428044 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-203edd25-a77b-44d0-ae26-dd2f1a897456 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.366639 Aug 23 10:40:59.441371 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 506/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:59 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:59.577479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c024659-aacc-4b77-973f-eb1499683e69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb8a3a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:59.674699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c024659-aacc-4b77-973f-eb1499683e69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.106500 Aug 23 10:40:59.675620 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 507/1053] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:40:59 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:40:59.797011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:40:59.797971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:40:59.817050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:59.818766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:59.819432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:40:59.821843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:40:59.823275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:40:59.824525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:00.000880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:00.008535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3d95132-44db-41c2-9989-8580caa45a6b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1505 microversion: 2.1 time: 0.637959 Aug 23 10:41:00.021075 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 547/1054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:59 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1505 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:00.115266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:00.129337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-258cf06d-27b1-483e-bb36-cbf38c38c89a tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1541 microversion: 2.1 time: 0.337234 Aug 23 10:41:00.143191 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 508/1055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:40:59 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1541 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:00.287889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:00.288511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:00.300501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:00.301033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:00.301477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:00.302202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:00.303020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:00.305287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:00.472478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:00.477086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:00.523383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:00.527697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:00.531691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:00.536643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:00.547097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:00.548199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:00.797983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:00.817143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:00.818669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:00.819856 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b39a4db7-f51c-4f63-bf3b-e95ad0246cce tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1755 microversion: 2.32 time: 0.536056 Aug 23 10:41:00.838825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:00.845735 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 548/1056] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:00 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1755 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:00.849782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9c7e505-4998-4f1d-96d7-dac983f6288d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.394098 Aug 23 10:41:00.850978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3672c624-218d-4fd4-910a-4f8886a0bd8b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc9b820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:00.858257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 509/1057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:00 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:00.931064 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3672c624-218d-4fd4-910a-4f8886a0bd8b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.083892 Aug 23 10:41:00.932358 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 549/1058] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:00 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:01.151912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:01.152918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:01.164668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.165220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.165672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:01.166416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.166889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.167339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:01.192021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "name": "network-vif-unplugged", "status": "completed", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:01.206760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.207263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.207710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:01.237396 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] Creating event network-vif-unplugged:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:41:01.255134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:41:01.268574 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-525c5832-2ccb-4d7e-833c-4623180159b5 req-df1fd74f-449e-40d4-a6bf-905b8b57c9de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080685 Aug 23 10:41:01.269220 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 550/1059] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:01.487533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:01.497248 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12b3c57d-c454-4468-abaf-c1761e6dae97 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1473 microversion: 2.1 time: 0.350010 Aug 23 10:41:01.500617 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 510/1060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:01 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:01.852729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:01.853575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:01.862220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.862999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.863646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:01.866679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.867447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.868266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:01.883125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:01.884054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:01.893304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.894058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.894874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:01.895782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:01.896414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:01.897063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:02.101793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:02.111674 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-282507a8-ccbc-4e06-8045-d2ea8e971733 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.233359 Aug 23 10:41:02.112251 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 511/1061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:01 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:02.131539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e885750-7431-4e04-87de-f0efac775de6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc52700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:02.158769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:02.172676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:02.174612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:02.177028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20e47b52-d791-4efd-a682-affa85451064 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1755 microversion: 2.32 time: 0.331062 Aug 23 10:41:02.177508 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 551/1062] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:01 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1755 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:02.184206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:02.208519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e885750-7431-4e04-87de-f0efac775de6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.082202 Aug 23 10:41:02.213231 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 512/1063] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:02 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:02.535772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:02.537267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:02.560574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:02.561406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:02.562450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:02.563731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:02.566157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:02.567001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:02.722574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=9 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:02.817484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:02.827131 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7c0384a-9c5c-4d1d-8a0e-646441fcd77e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1473 microversion: 2.1 time: 0.309043 Aug 23 10:41:02.827976 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 552/1064] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:02 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:02.895062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=24 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:02.900897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b679bd86-7110-4698-8612-f4197d0bb1c7"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:02.905820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:02.915733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:02.916544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:02.917200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:02.918109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:02.918790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:02.920111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:02.989527 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] HTTP exception thrown: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Request method failure captured: Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a/os-volume_attachments/c7d6969c-2d5c-4e20-8cce-96648c9d2729 HTTP/1.1 Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 74 Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4eFyqVATmbD3tvhxvRoQ-7frEvhX5KPX37xcyiP-VRdOfS0Ta4OhTzaBqxYOU5Kt40jMsgOwKh-ACwv99nyuhDVYNWNlnqUuEYgU3ADcGqp0oMajkZuSChOmchInm5zUwZU7tnuv2tBOXHrxXXgIDl0NRpVyRrLUDKV2sY6L-5jTQ Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 40ffd5a82c3840b190ba422abdb2d9b9 Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesAdminNegativeTest-400952510 Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:41:02.994126 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/40ffd5a82c3840b190ba422abdb2d9b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_40ffd5a82c3840b190ba422abdb2d9b9", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/40ffd5a82c3840b190ba422abdb2d9b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/40ffd5a82c3840b190ba422abdb2d9b9"}]}] Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesAdminNegativeTest-400952510 Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 40ffd5a82c3840b190ba422abdb2d9b9 Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-400952510 Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesAdminNegativeTest-400952510-project-admin Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 26dea4109ab046f59ba2d7202a1c4b53 Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesAdminNegativeTest-400952510-project-admin Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: {"volumeAttachment": {"volumeId": "b679bd86-7110-4698-8612-f4197d0bb1c7"}} Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:41:02.995492 n-d-847009-13 devstack@n-api.service[128860]: exception: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'server_id': 'a0ad8267-7788-47f9-b7a0-e71f2dc9b45a', 'id': 'c7d6969c-2d5c-4e20-8cce-96648c9d2729', 'body': {'volumeAttachment': {'volumeId': 'b679bd86-7110-4698-8612-f4197d0bb1c7'}}} Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 10:41:02.996314 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. (HTTP 404) (Request-ID: req-4a3498e0-3400-4b47-a53a-9e33f01cdaf0) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 10:41:02.998046 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:02.999482 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. Aug 23 10:41:03.000624 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:03.003787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] Returning 404 to user: Volume c7d6969c-2d5c-4e20-8cce-96648c9d2729 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:03.004822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3208815-ab76-4d01-a1d3-5557c304610e tempest-VolumesAdminNegativeTest-400952510 tempest-VolumesAdminNegativeTest-400952510-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a/os-volume_attachments/c7d6969c-2d5c-4e20-8cce-96648c9d2729" status: 404 len: 109 microversion: 2.1 time: 0.110472 Aug 23 10:41:03.010736 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 513/1065] 10.222.0.78 () {60 vars in 1433 bytes} [Tue Aug 23 10:41:02 2022] PUT /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a/os-volume_attachments/c7d6969c-2d5c-4e20-8cce-96648c9d2729 => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:03.137311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:03.138955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:03.145641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=44 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:03.147937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.148863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.149570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:03.150529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.151196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.151969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:03.202414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:03.203282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:03.213928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.214508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.217771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:03.218664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.219232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.219792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:03.461570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:03.476187 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6077adf-4357-4deb-b0c1-df58f10cdaa7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.341863 Aug 23 10:41:03.488763 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 553/1066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:03 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:03.488763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-45b9475f-15f7-4b9b-98a0-117c13048036 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc47700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:03.529697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:03.541285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:03.542802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:03.543997 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f9435ec-88e5-4b21-b268-ae3bc35becdb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1802 microversion: 2.32 time: 0.345957 Aug 23 10:41:03.546212 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-45b9475f-15f7-4b9b-98a0-117c13048036 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.067222 Aug 23 10:41:03.546782 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 554/1067] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:03 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:03.557870 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 514/1068] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:03 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1802 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:03.565346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d7d66364-c545-477c-a41f-13a892e1f667 req-c3aaf2c8-c719-424a-ac36-a3b23b116592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "553a8db0-0b98-417c-8d38-0d7718f419d7", "name": "network-vif-plugged", "status": "completed", "tag": "b86b50ce-95cc-4d28-bfa3-390ae29f7318"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:03.614795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d7d66364-c545-477c-a41f-13a892e1f667 req-c3aaf2c8-c719-424a-ac36-a3b23b116592 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.615226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d7d66364-c545-477c-a41f-13a892e1f667 req-c3aaf2c8-c719-424a-ac36-a3b23b116592 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.615675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d7d66364-c545-477c-a41f-13a892e1f667 req-c3aaf2c8-c719-424a-ac36-a3b23b116592 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:03.628227 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d7d66364-c545-477c-a41f-13a892e1f667 req-c3aaf2c8-c719-424a-ac36-a3b23b116592 service nova] Creating event network-vif-plugged:b86b50ce-95cc-4d28-bfa3-390ae29f7318 for instance 553a8db0-0b98-417c-8d38-0d7718f419d7 on n-h2-847009-13 Aug 23 10:41:03.633640 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d7d66364-c545-477c-a41f-13a892e1f667 req-c3aaf2c8-c719-424a-ac36-a3b23b116592 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079248 Aug 23 10:41:03.639183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 555/1069] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:03.847832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:03.848630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:03.861291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.864780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.865375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:03.867332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:03.869339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:03.873024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:04.153236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:04.163681 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89e72129-fa67-4f5a-8af1-24fa3b995611 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1473 microversion: 2.1 time: 0.319950 Aug 23 10:41:04.168731 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 515/1070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:03 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:04.175567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1930196112", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": "none"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:04.276333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:41:04.277009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:41:04.277674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:41:04.278254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:41:04.279447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:41:04.288800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:04.289506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:04.290139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:04.291109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:04.291739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:04.292527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:04.314809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Getting quotas for project a24c1dbfc8cd4622b7f4ffe6e99f0e92. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:41:04.320856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Getting quotas for user 9847b47a03d848b2b1d5c23a3e74ba63 and project a24c1dbfc8cd4622b7f4ffe6e99f0e92. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:41:04.335024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:41:04.337718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:41:04.397479 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7a4b2df-8bfb-4767-9b80-35952c2ddf51 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.485723 Aug 23 10:41:04.406296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 556/1071] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:41:04.411486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a462e70-1fac-46c9-b1d2-7a5c34741272 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:04.432436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a462e70-1fac-46c9-b1d2-7a5c34741272 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:04.503821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:04.504704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:04.520682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:04.522472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:04.536009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:04.543363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:04.548014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:04.554285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:04.638274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:04.784389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a462e70-1fac-46c9-b1d2-7a5c34741272 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:04.799215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a462e70-1fac-46c9-b1d2-7a5c34741272 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:04.801014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a462e70-1fac-46c9-b1d2-7a5c34741272 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:04.835367 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a462e70-1fac-46c9-b1d2-7a5c34741272 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "PUT /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1359 microversion: 2.75 time: 0.428663 Aug 23 10:41:04.838731 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 516/1072] 10.222.0.78 () {62 vars in 1297 bytes} [Tue Aug 23 10:41:04 2022] PUT /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1359 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:04.853110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8925ee4a-c5e0-4ac9-87fb-34e09633e289 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb7f0d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:04.918802 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8925ee4a-c5e0-4ac9-87fb-34e09633e289 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.078200 Aug 23 10:41:04.922548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 517/1073] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:04 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:04.941473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:04.943027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:05.002199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:05.003515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:05.004716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:05.006962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:05.008474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:05.009588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:05.066479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:05.086010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.135178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8183c9b-e3f5-4867-8be0-1bce1d13bdbb tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1319 microversion: 2.1 time: 0.634176 Aug 23 10:41:05.150537 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 557/1074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:04 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:05.180959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c3da974-558e-43d5-8bbe-7d02a979563b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:05.181831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c3da974-558e-43d5-8bbe-7d02a979563b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:05.527366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c3da974-558e-43d5-8bbe-7d02a979563b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.566470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c3da974-558e-43d5-8bbe-7d02a979563b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.585749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c3da974-558e-43d5-8bbe-7d02a979563b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.618164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c3da974-558e-43d5-8bbe-7d02a979563b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1359 microversion: 2.75 time: 0.454117 Aug 23 10:41:05.633536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 558/1075] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:05 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:05.635722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.644615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:05.646862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:05.664104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:05.670481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.671087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:05.671848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:05.672928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:05.673564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:05.674285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:05.676228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:05.689630 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3507c934-113e-4578-a7bc-f2a4c7a537e5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1802 microversion: 2.32 time: 0.761520 Aug 23 10:41:05.693802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 518/1076] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:04 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1802 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:05.731608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6623be58-7e83-4ffd-967c-3fa24c6b7baa req-97ef64cc-d1a4-4ab1-9343-41a903fdf08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee006f-9d99-49b9-9c30-15237f120050", "name": "network-vif-plugged", "status": "completed", "tag": "9cb83c3a-f3de-454f-a964-b0b1d8456674"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:05.782911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6623be58-7e83-4ffd-967c-3fa24c6b7baa req-97ef64cc-d1a4-4ab1-9343-41a903fdf08f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:05.785853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6623be58-7e83-4ffd-967c-3fa24c6b7baa req-97ef64cc-d1a4-4ab1-9343-41a903fdf08f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:05.791404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6623be58-7e83-4ffd-967c-3fa24c6b7baa req-97ef64cc-d1a4-4ab1-9343-41a903fdf08f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:05.850297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6623be58-7e83-4ffd-967c-3fa24c6b7baa req-97ef64cc-d1a4-4ab1-9343-41a903fdf08f service nova] Creating event network-vif-plugged:9cb83c3a-f3de-454f-a964-b0b1d8456674 for instance 73ee006f-9d99-49b9-9c30-15237f120050 on n-h2-847009-13 Aug 23 10:41:05.892963 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6623be58-7e83-4ffd-967c-3fa24c6b7baa req-97ef64cc-d1a4-4ab1-9343-41a903fdf08f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192589 Aug 23 10:41:05.898397 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 519/1077] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:05.954609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc9cf02f-11f3-4380-918c-3ac613b0eeef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9caf59d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:06.043345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:06.055656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc9cf02f-11f3-4380-918c-3ac613b0eeef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.108466 Aug 23 10:41:06.057392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24f2b74f-da11-4b4b-a508-b1b3abc6dad3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1470 microversion: 2.1 time: 0.420872 Aug 23 10:41:06.057813 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 520/1078] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:05 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:06.067312 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 559/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:05 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1470 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:06.093918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:06.095072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:06.127254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.128092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.130506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.135393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.136979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.137946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.188015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:06.188961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:06.202111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.204875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.207168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.209371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.210945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.213916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.234778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.235870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.237149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.238173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.238920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.239587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.321382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:41:06.329538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for user 9574ff57c9474f7fb5ec4567bc06d531 and project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:41:06.648318 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9f10860-50cb-4c81-a8f5-37f828f6d69e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd/action" status: 202 len: 0 microversion: 2.1 time: 0.557899 Aug 23 10:41:06.650089 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 521/1080] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:41:06 2022] POST /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:41:06.686991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:06.687900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:06.716844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.720147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.725375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.726992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.729727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.732637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.864465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:06.879464 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9dccaacb-9e26-49c2-a414-16b5956c88e4 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1469 microversion: 2.1 time: 0.697105 Aug 23 10:41:06.880064 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 560/1081] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:06 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1469 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:06.900759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:06.901943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:06.917527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.925376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.926194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:06.928599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:06.929263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:06.930451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:07.069813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.083382 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-357ce216-35a4-4831-873d-041876ed33cc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.427549 Aug 23 10:41:07.085889 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 522/1082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:06 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:07.101724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:07.102359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:07.124961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:07.125538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:07.131391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:07.134130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:07.135183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:07.135784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:07.536073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.559130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.565579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.582987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2ae6b3c6-15bc-4640-b18e-206f57bd1d3d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1411 microversion: 2.75 time: 0.686127 Aug 23 10:41:07.605270 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 561/1083] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:06 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1411 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:07.620956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:07.625334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:07.651188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:07.651880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:07.652488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:07.653989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:07.656273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:07.660789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:07.729885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lazy-loading 'flavor' on Instance uuid 553a8db0-0b98-417c-8d38-0d7718f419d7 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:07.746121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.767281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.772813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:07.775590 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6922579-1d67-4487-9c1d-7a2f89ede579 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1849 microversion: 2.32 time: 0.688429 Aug 23 10:41:07.777824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 523/1084] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:07 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1849 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:07.786198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b3697bf-78bd-4545-824b-f522e369c1e2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb7fd30>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:07.910848 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b3697bf-78bd-4545-824b-f522e369c1e2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.129985 Aug 23 10:41:07.917610 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 524/1085] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:07 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:07.947226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:07.948810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:07.976483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:07.978042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:07.978659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:07.979693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:07.980322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:07.981208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.008641 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7bb33a92-ed95-4f4a-be60-5679a36fecbf tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7/action" status: 202 len: 0 microversion: 2.1 time: 0.393964 Aug 23 10:41:08.023736 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 562/1086] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:41:07 2022] POST /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:41:08.044455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:08.048648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:08.077555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.082051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.082770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.083226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:41:08.085712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.086208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.088941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.350519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d1b7fb0-f556-4bea-b924-b8e9541a6829 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 204 len: 0 microversion: 2.1 time: 0.426777 Aug 23 10:41:08.351960 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 525/1087] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:07 2022] DELETE /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:08.361806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:08.362813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:08.383687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.384891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.386480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.387234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.388277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.392048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.727816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:08.749085 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e06003b-4640-4c49-b00f-81a9658c0a0f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1477 microversion: 2.1 time: 0.722997 Aug 23 10:41:08.761107 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 563/1088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:08 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1477 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:08.772081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:08.782167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:08.809310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.814548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.815131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.816019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.816605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.817171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.817834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:08.833859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed0d04da-dd6d-462c-93c2-a1ec841ea374 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.480374 Aug 23 10:41:08.842482 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 526/1089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:08 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:08.858983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:08.877883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:08.892012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.892760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.893363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:08.894878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:08.895506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:08.896115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.048656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.066735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.068441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.075455 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df71b340-1388-454e-bb64-967fd2af4ca4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1417 microversion: 2.75 time: 0.231536 Aug 23 10:41:09.098225 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 527/1090] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:08 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1417 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:09.103734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:09.104595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:09.114891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.116133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.116787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.118017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.118662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.119271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.284225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.296433 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea6817a7-fb23-4136-a43d-bb14cf6aba83 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1511 microversion: 2.1 time: 0.532407 Aug 23 10:41:09.300039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 564/1091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:08 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:09.313903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22f4a27b-2e97-416e-bfa7-8d2cba000947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9d3d3430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:09.387355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22f4a27b-2e97-416e-bfa7-8d2cba000947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.085786 Aug 23 10:41:09.389410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 565/1092] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:09 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:09.460662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.474997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.480867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:09.480867 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e08359e3-dbc4-48f0-93b6-c159f1966268 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1849 microversion: 2.32 time: 0.378235 Aug 23 10:41:09.480867 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 528/1093] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:09 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1849 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:09.571835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-43abdd98-0211-46e2-a20b-32a7e4d24289 req-ecffceec-f947-4fd8-a077-ddb989561ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "d7fc2d75-be2d-4fc6-8f63-c92af11191c8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:09.589137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-43abdd98-0211-46e2-a20b-32a7e4d24289 req-ecffceec-f947-4fd8-a077-ddb989561ea8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.589830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-43abdd98-0211-46e2-a20b-32a7e4d24289 req-ecffceec-f947-4fd8-a077-ddb989561ea8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.590424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-43abdd98-0211-46e2-a20b-32a7e4d24289 req-ecffceec-f947-4fd8-a077-ddb989561ea8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.603553 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-43abdd98-0211-46e2-a20b-32a7e4d24289 req-ecffceec-f947-4fd8-a077-ddb989561ea8 service nova] Creating event network-changed:d7fc2d75-be2d-4fc6-8f63-c92af11191c8 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:09.639695 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-43abdd98-0211-46e2-a20b-32a7e4d24289 req-ecffceec-f947-4fd8-a077-ddb989561ea8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071513 Aug 23 10:41:09.640694 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 566/1094] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:09.781807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:09.782433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:09.804888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.805946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.806393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.807264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.807724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.808152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.863773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:09.866064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:09.894060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.896028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.899168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:09.901598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:09.904372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:09.905278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.024895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:10.039141 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5fc13d2-ebcd-461f-a922-a8829761f14f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1460 microversion: 2.1 time: 0.262280 Aug 23 10:41:10.041156 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 529/1095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:09 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1460 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:10.071584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:10.078603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:10.087820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.088543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.089286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.090253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.091641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.092442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.447267 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e05e90c4-5dd7-4b7a-a79c-996843400d55 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1613 microversion: 2.1 time: 0.391385 Aug 23 10:41:10.462131 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 530/1096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:10 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1613 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:10.474416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:10.474976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:10.490419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.492382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.493244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.493984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.494458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.494895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.655075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:10.667158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:10.669481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:10.680477 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10a97389-9d8f-4c03-8b25-5417c3710b20 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1417 microversion: 2.75 time: 0.216381 Aug 23 10:41:10.686178 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 531/1097] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:10 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1417 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:10.697006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:10.697319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:10.707592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:10.716767 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5252711e-d637-4537-a847-bc79c75263dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.857276 Aug 23 10:41:10.719377 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 567/1098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:09 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:10.723659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.724422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.727097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.728604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.729647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.731297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.734463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad0be255-2449-4fe3-961e-dbb48a11bd91 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ce22310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:10.805937 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad0be255-2449-4fe3-961e-dbb48a11bd91 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.085300 Aug 23 10:41:10.806511 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 568/1099] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:10 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:10.814400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:10.817477 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:41:10.817477 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:41:10.818947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.819618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.820239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.821169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.821802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.822392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.849213 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88396816-daa2-4057-b55a-467136411548 tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039376 Aug 23 10:41:10.850144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 569/1100] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:41:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:10.862080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:10.862891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:10.869290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.870021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.870620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.871489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:10.872632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:10.873299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:10.967499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:10.986712 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc2c616c-af8e-4167-8bf9-336b1f4ecbef tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1511 microversion: 2.1 time: 0.299399 Aug 23 10:41:10.987658 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 532/1101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:10 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:11.005996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "name": "network-vif-plugged", "status": "completed", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:11.023929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.025145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.026681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.032578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:11.054139 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] Creating event network-vif-plugged:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:41:11.066298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:41:11.076805 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8a7eb2a7-fbfe-4034-a7a2-d1ece120493b req-9bfecc2d-4caa-404c-be8f-5cf299eefcc5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078189 Aug 23 10:41:11.082093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 533/1102] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:11.088178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-13", "block_migration": true, "disk_over_commit": false}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:11.091851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:11.100105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.101126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.101833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.102889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.103587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.104248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.139092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Lazy-loading 'flavor' on Instance uuid 553a8db0-0b98-417c-8d38-0d7718f419d7 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:11.150796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.154581 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 553a8db0-0b98-417c-8d38-0d7718f419d7 while it is in vm_state suspended Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Request method failure captured: Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7/action HTTP/1.1 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 98 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6T2Rrs74Xow6v7rOteKQ3TFtavpu1JXYWa3bnhLaB6JkayGQ0F4iEpYbZGGBWpFBDHVPM2uWHzBlke27-KW4q6_huidJyWV-lXESYUG4BoEKz5Lkm56OYvp6gUvsvH9RYz4aldYoYMp3PvvtGKMPKR-Ay3-b4okKpCiLTa97AUum0 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 929b94fed2284f568562ac5843aa7b15 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-LiveMigrationNegativeTest-1855376189 Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 10:41:11.157192 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/929b94fed2284f568562ac5843aa7b15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_929b94fed2284f568562ac5843aa7b15", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/929b94fed2284f568562ac5843aa7b15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/929b94fed2284f568562ac5843aa7b15"}]}] Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-LiveMigrationNegativeTest-1855376189 Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 929b94fed2284f568562ac5843aa7b15 Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1855376189 Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-LiveMigrationNegativeTest-1855376189-project-admin Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9ce615378a4941a485d79e502fc155d6 Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-LiveMigrationNegativeTest-1855376189-project-admin Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: {"os-migrateLive": {"host": "n-h1-847009-13", "block_migration": true, "disk_over_commit": false}} Aug 23 10:41:11.158590 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'os-migrateLive' instance 553a8db0-0b98-417c-8d38-0d7718f419d7 while it is in vm_state suspended Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '553a8db0-0b98-417c-8d38-0d7718f419d7', 'body': {'os-migrateLive': {'host': 'n-h1-847009-13', 'block_migration': True, 'disk_over_commit': False}}} Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 23 10:41:11.159337 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:41:11.160457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 553a8db0-0b98-417c-8d38-0d7718f419d7 while it is in vm_state suspended Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 553a8db0-0b98-417c-8d38-0d7718f419d7 while it is in vm_state suspended Aug 23 10:41:11.163742 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:11.165296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.167378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.167878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 553a8db0-0b98-417c-8d38-0d7718f419d7 while it is in vm_state suspended {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:11.168594 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-656f3bbe-18c7-42f4-ad27-79dc38ce1f85 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1849 microversion: 2.32 time: 0.310260 Aug 23 10:41:11.169251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 570/1103] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:10 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1849 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:11.184349 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c42d31ad-2bb8-49b2-956d-f7297e1d0aec tempest-LiveMigrationNegativeTest-1855376189 tempest-LiveMigrationNegativeTest-1855376189-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7/action" status: 409 len: 155 microversion: 2.1 time: 0.085501 Aug 23 10:41:11.184349 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 534/1104] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:41:11 2022] POST /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7/action => generated 155 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:41:11.184349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:11.184349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:11.188061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.188679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.189253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.190076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.190655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.191195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.220685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:41:11.358164 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e6cb156-1149-47a6-9685-2a83db913d09 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "DELETE /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 204 len: 0 microversion: 2.1 time: 0.181535 Aug 23 10:41:11.362044 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 535/1105] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:11 2022] DELETE /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:11.367509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:11.368183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:11.377060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.377460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.378059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.378911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.379425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.379860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.615894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.629431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78137277-30da-4771-86ce-c0d84b2143a7 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1466 microversion: 2.1 time: 0.263834 Aug 23 10:41:11.630362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 571/1106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:11 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1466 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:11.706667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:11.707707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:11.728660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.731799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.732574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.735913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.736467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.737090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.739724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:11.740352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:11.748626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.749162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.749607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.750331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.750795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.751295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.866970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.899994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.907428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.927136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-715e34db-2fca-4ddc-bd62-ed30fa83289d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1417 microversion: 2.75 time: 0.224539 Aug 23 10:41:11.941790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 536/1107] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:11 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1417 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:11.953657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-99587418-2f74-40f8-8e82-4c3bbdc1dbb9 req-f70d0d47-feca-4b41-be26-99a7d39ec3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "b108b97c-f9c8-4c77-997a-5a189cf75689"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:11.978734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-99587418-2f74-40f8-8e82-4c3bbdc1dbb9 req-f70d0d47-feca-4b41-be26-99a7d39ec3c2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:11.982087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-99587418-2f74-40f8-8e82-4c3bbdc1dbb9 req-f70d0d47-feca-4b41-be26-99a7d39ec3c2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:11.982621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:11.983115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-99587418-2f74-40f8-8e82-4c3bbdc1dbb9 req-f70d0d47-feca-4b41-be26-99a7d39ec3c2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:11.990752 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f3156df-1908-4b30-a8f9-467a11ced7a5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.254756 Aug 23 10:41:11.996067 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 572/1108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:11 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:12.001122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3e4a84d-f015-4bd1-8dac-b147abf14862 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9d272ca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:12.022002 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-99587418-2f74-40f8-8e82-4c3bbdc1dbb9 req-f70d0d47-feca-4b41-be26-99a7d39ec3c2 service nova] Creating event network-changed:b108b97c-f9c8-4c77-997a-5a189cf75689 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:12.026967 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-99587418-2f74-40f8-8e82-4c3bbdc1dbb9 req-f70d0d47-feca-4b41-be26-99a7d39ec3c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083703 Aug 23 10:41:12.027871 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 537/1109] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:12.036607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:12.037878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:12.046505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.046683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.047068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.047777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.048234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.048657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.078516 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3e4a84d-f015-4bd1-8dac-b147abf14862 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.081141 Aug 23 10:41:12.080540 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 573/1110] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:11 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:12.191763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:12.192933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:12.200112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.205075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.206550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.208573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.211764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.212443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.236281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:12.246089 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-815a0fa7-8a41-43c1-b759-1080a526282b tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1511 microversion: 2.1 time: 0.216013 Aug 23 10:41:12.248316 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 538/1111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:12 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:12.558545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:12.577537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:12.579965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:12.581875 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5394ab6-1c65-434a-810e-f3ed03142dc1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1870 microversion: 2.32 time: 0.393938 Aug 23 10:41:12.598068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 574/1112] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:12 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1870 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:12.658361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:12.658895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:12.673815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:12.688551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.689169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.689545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.690235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.690699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.693049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.910045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:12.919566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24e32d69-e5ad-49b0-80c1-11da018d400a tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1466 microversion: 2.1 time: 0.267619 Aug 23 10:41:12.922839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 539/1113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:12 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1466 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:12.962318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:12.963044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:12.989666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:12.995108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:12.996339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:12.997313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.001549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.002170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.016351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:13.017155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:13.023788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.024410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.025536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.026387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.027016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.027569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.133519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:13.148331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:13.150339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:13.167974 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9aaf36d2-d5ae-4d36-8535-33341b162393 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1417 microversion: 2.75 time: 0.216060 Aug 23 10:41:13.171493 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 575/1114] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:12 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1417 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:13.187322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69c48e3e-07bd-47b5-a5ef-1fb693459d6d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc37c10>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:13.234527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:13.243601 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54f6fd18-9fac-4735-822d-6e7124fb727d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.231610 Aug 23 10:41:13.244355 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 540/1115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:13 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:13.273512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:13.274615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:13.282485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.283001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.283444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.284350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.284861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.285299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.286043 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69c48e3e-07bd-47b5-a5ef-1fb693459d6d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.112033 Aug 23 10:41:13.286825 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 576/1116] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:13 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:13.473038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:13.482381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15259b4e-b05f-4617-a2ee-7f23c32e6085 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1511 microversion: 2.1 time: 0.217974 Aug 23 10:41:13.496303 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 541/1117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:13 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:13.610891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:13.612267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:13.629861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.630678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.631387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.632571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.633284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.634151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.946029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:13.947298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:13.961105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.962222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.967751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:13.968653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:13.969323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:13.969827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:14.696775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:14.715086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:14.719421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:14.720917 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f118fb6d-28e2-43ee-8942-76945c988123 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1870 microversion: 2.32 time: 1.117175 Aug 23 10:41:14.722168 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 577/1118] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:13 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1870 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:14.727240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:14.727994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:14.741718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:14.743465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:14.745412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:14.746296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:14.748052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:14.748832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:14.789411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:14.819440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:14.967504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:14.981811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:14.983849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:14.990944 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a3ed09a-a880-4b7c-8ec7-2783fc028b8e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1417 microversion: 2.75 time: 0.267629 Aug 23 10:41:14.992638 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 578/1119] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:14 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1417 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:14.999645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:15.000399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:15.006641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.007339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.007913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:15.008770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.009375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.010022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:15.112118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:15.131836 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-735f2f49-5aef-4116-b792-b1eff391ac1d tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1466 microversion: 2.1 time: 1.191360 Aug 23 10:41:15.134079 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 542/1120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:13 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1466 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:15.151941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1e06f33-9e95-41f6-af91-82a61494e0fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cd16a60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:15.270487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1e06f33-9e95-41f6-af91-82a61494e0fd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.134730 Aug 23 10:41:15.271857 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 543/1121] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:15 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:15.282579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:15.283803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:15.307089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.307855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.308488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:15.310142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.311207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.311813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:15.467848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:15.487389 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee027b96-0e2d-4e07-94af-82ccaa9b5fb8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1469 microversion: 2.1 time: 0.205521 Aug 23 10:41:15.501388 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 544/1122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:15 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:15.507557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9dbb80ab-0aaf-4b5d-b20d-07cac337b564 req-f970e5e9-b5f7-42cc-b6ae-a0173ccb4f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0ad8267-7788-47f9-b7a0-e71f2dc9b45a", "name": "network-vif-deleted", "tag": "56776c36-bc6d-415d-8c79-82c1f7ed0a87"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:15.520708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9dbb80ab-0aaf-4b5d-b20d-07cac337b564 req-f970e5e9-b5f7-42cc-b6ae-a0173ccb4f0f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.522735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9dbb80ab-0aaf-4b5d-b20d-07cac337b564 req-f970e5e9-b5f7-42cc-b6ae-a0173ccb4f0f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.523430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9dbb80ab-0aaf-4b5d-b20d-07cac337b564 req-f970e5e9-b5f7-42cc-b6ae-a0173ccb4f0f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:15.544537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:15.550505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:15.561915 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9dbb80ab-0aaf-4b5d-b20d-07cac337b564 req-f970e5e9-b5f7-42cc-b6ae-a0173ccb4f0f service nova] Creating event network-vif-deleted:56776c36-bc6d-415d-8c79-82c1f7ed0a87 for instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a on n-h1-847009-13 Aug 23 10:41:15.564609 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-562c9c1e-87cf-489f-a63c-b51fcc5ab6a7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.570738 Aug 23 10:41:15.580888 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 579/1123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:14 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:15.587157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9dbb80ab-0aaf-4b5d-b20d-07cac337b564 req-f970e5e9-b5f7-42cc-b6ae-a0173ccb4f0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084091 Aug 23 10:41:15.588154 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 545/1124] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:15.746963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:15.748177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:15.757668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:15.778142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.779324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.779770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:15.780492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:15.789684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:15.790466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.025621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:16.026406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:16.040989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.041500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.041942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.042666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.043136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.043568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.235420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.251017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.253993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.264385 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b65e9b1e-8496-44c3-86ed-fbe1c0ede750 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1438 microversion: 2.75 time: 0.243646 Aug 23 10:41:16.269550 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 546/1125] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:16 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1438 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:16.270308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.285166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.289514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.290184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:16.291483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e788a5a2-6c00-4c61-b916-4596c63948c2 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1891 microversion: 2.32 time: 0.550500 Aug 23 10:41:16.304773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:16.304970 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 580/1126] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:15 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1891 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:16.328193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:16.334745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.335253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.335692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.336405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.336886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.337321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.338639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9c74af02-7c63-4161-9f74-2f6845571a9c req-7e9a1888-2efc-49c9-b2b1-9bf724394b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "24a4b2f8-56ea-40b9-8b30-133cd135fb5b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:16.364545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9c74af02-7c63-4161-9f74-2f6845571a9c req-7e9a1888-2efc-49c9-b2b1-9bf724394b0f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.368425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9c74af02-7c63-4161-9f74-2f6845571a9c req-7e9a1888-2efc-49c9-b2b1-9bf724394b0f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.369145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9c74af02-7c63-4161-9f74-2f6845571a9c req-7e9a1888-2efc-49c9-b2b1-9bf724394b0f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.381156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.381649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.382090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.382238 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9c74af02-7c63-4161-9f74-2f6845571a9c req-7e9a1888-2efc-49c9-b2b1-9bf724394b0f service nova] Creating event network-changed:24a4b2f8-56ea-40b9-8b30-133cd135fb5b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:16.382733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lazy-loading 'fault' on Instance uuid 553a8db0-0b98-417c-8d38-0d7718f419d7 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:16.389008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9c74af02-7c63-4161-9f74-2f6845571a9c req-7e9a1888-2efc-49c9-b2b1-9bf724394b0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083732 Aug 23 10:41:16.390206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 581/1127] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:16.396517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90c0b82b-9199-4d59-86c8-ef05ff5d15dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb613a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:16.451424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.466605 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90c0b82b-9199-4d59-86c8-ef05ff5d15dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.074763 Aug 23 10:41:16.467236 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 582/1128] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:16 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:16.477041 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94ce5ba0-7bf2-4d3e-8f0d-36ec8defeda8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 200 len: 1309 microversion: 2.1 time: 0.205740 Aug 23 10:41:16.477560 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 547/1129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:16 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:16.478361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:16.481832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:16.489547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.490047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.490489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.491198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.491651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.492426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.521601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:16.522246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:16.556579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.557169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.557618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.558353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.558973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.561559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.669460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:41:16.670310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:41:16.670948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:41:16.672144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:41:16.674709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:41:16.702385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.714224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0b1f2b6-abb0-4926-b67b-249f28be13a0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1469 microversion: 2.1 time: 0.206403 Aug 23 10:41:16.721937 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 548/1130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:16 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:16.740126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:16.740900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:16.752975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.754754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.755342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.757267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.758051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.759091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.776531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:16.784717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.785608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.786398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.787984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:16.788898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:16.789574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:16.958539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.979640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:16.982992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.008330 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-45dde720-e4da-4722-a0b0-e80e7139a51d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "POST /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5/action" status: 202 len: 1495 microversion: 2.75 time: 0.539395 Aug 23 10:41:17.011335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 583/1131] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:41:16 2022] POST /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5/action => generated 1495 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 23 10:41:17.049421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.058041 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d003f0a-b57f-465e-a9ad-f8d81ee6e511 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.334577 Aug 23 10:41:17.062725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:17.085470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 549/1132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:16 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:17.085973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:17.100133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.100733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.101418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.102376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.103031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.103673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.297086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.315566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.317036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:17.317922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:17.322189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.327275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.328578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.329397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.330501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.331162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.332014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.334923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e1c15e1-89dd-43d3-bc42-86b7ccd34130 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.289698 Aug 23 10:41:17.348940 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 584/1133] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:17 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:17.376348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:17.487968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1192247e-a510-4d8f-94fc-965be598f43d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cbb95e0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:17.589912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1192247e-a510-4d8f-94fc-965be598f43d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.111477 Aug 23 10:41:17.611423 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 585/1134] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:17 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:17.627958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:17.630038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 553a8db0-0b98-417c-8d38-0d7718f419d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:17.666907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.667440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.667995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.671035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.671545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.672276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.695985 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] HTTP exception thrown: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 could not be found. Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Request method failure captured: Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 HTTP/1.1 Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6SIT0Mu_x-QiH3_ji_ZnqA5lQkPHLp3FOUhTVmjbk7P1XBU1LHj8fMi-B8WMskrC707N_4lmoZmIpKGb4q2yFFK7TkKYA49Mb0j15Z0WVSOq3jSHtqMno1Hbf3n5MBZnjokB2sQaPmJTqEqmrPdZnRb6ZOpWTSunh0Hq5mabGQ3Sc Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 2fea1ec49dc540d5ac895803d3bec1f4 Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveMigrationNegativeTest-1950640574 Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:41:17.698639 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2fea1ec49dc540d5ac895803d3bec1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2fea1ec49dc540d5ac895803d3bec1f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2fea1ec49dc540d5ac895803d3bec1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2fea1ec49dc540d5ac895803d3bec1f4"}]}] Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveMigrationNegativeTest-1950640574 Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 2fea1ec49dc540d5ac895803d3bec1f4 Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1950640574 Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveMigrationNegativeTest-1950640574-project Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: caf26dcae82b4835a0c0514945dd7882 Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveMigrationNegativeTest-1950640574-project Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 could not be found. Aug 23 10:41:17.700574 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '553a8db0-0b98-417c-8d38-0d7718f419d7'} Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 could not be found. Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:17.701384 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 could not be found. Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 could not be found. Aug 23 10:41:17.702589 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:17.703693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Returning 404 to user: Instance 553a8db0-0b98-417c-8d38-0d7718f419d7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:17.703693 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-70bbe50a-b497-4a43-88e1-a691922a39da tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7" status: 404 len: 111 microversion: 2.1 time: 0.087440 Aug 23 10:41:17.705593 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 586/1135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:17 2022] GET /compute/v2.1/servers/553a8db0-0b98-417c-8d38-0d7718f419d7 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:17.711297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d07a6802-5e8e-41c2-aad7-2c488ad42ea6 req-0f12c146-b87e-4b79-9206-cb3dd59f79dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "553a8db0-0b98-417c-8d38-0d7718f419d7", "name": "network-vif-deleted", "tag": "b86b50ce-95cc-4d28-bfa3-390ae29f7318"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:17.740463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d07a6802-5e8e-41c2-aad7-2c488ad42ea6 req-0f12c146-b87e-4b79-9206-cb3dd59f79dd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.741655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d07a6802-5e8e-41c2-aad7-2c488ad42ea6 req-0f12c146-b87e-4b79-9206-cb3dd59f79dd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.742217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d07a6802-5e8e-41c2-aad7-2c488ad42ea6 req-0f12c146-b87e-4b79-9206-cb3dd59f79dd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.744325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.758739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.759350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d07a6802-5e8e-41c2-aad7-2c488ad42ea6 req-0f12c146-b87e-4b79-9206-cb3dd59f79dd service nova] Creating event network-vif-deleted:b86b50ce-95cc-4d28-bfa3-390ae29f7318 for instance 553a8db0-0b98-417c-8d38-0d7718f419d7 on n-h2-847009-13 Aug 23 10:41:17.761100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:17.763079 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3391e1f-7d5d-49a4-a508-e0a35d10bda5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1891 microversion: 2.32 time: 0.451148 Aug 23 10:41:17.765827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 550/1136] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:17 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1891 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:17.772559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:17.776299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:17.801774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d07a6802-5e8e-41c2-aad7-2c488ad42ea6 req-0f12c146-b87e-4b79-9206-cb3dd59f79dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094695 Aug 23 10:41:17.802639 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 587/1137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:17.812549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:17.813369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:17.833854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.835595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.836068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.838763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.840276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.844341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.848343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.849225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.849795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.853573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.855250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.855701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.917662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:41:17.926895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:17.927402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:17.928427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:17.928994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lazy-loading 'fault' on Instance uuid a0ad8267-7788-47f9-b7a0-e71f2dc9b45a {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:18.086557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:18.101931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4842363e-f430-4bcf-8216-83e752e66c61 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1307 microversion: 2.1 time: 0.298028 Aug 23 10:41:18.104122 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 588/1138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:17 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:18.117936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:18.118759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:18.143132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.150924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.151385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.154325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.155036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.157327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.213051 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58c018db-a11a-4c1a-ae68-2635c0cacad1 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 204 len: 0 microversion: 2.1 time: 0.444992 Aug 23 10:41:18.215075 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 551/1139] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:17 2022] DELETE /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:18.229943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:18.237476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:18.258000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.259242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.260694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.261479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.261950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.262439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.601897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:18.605880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:18.614614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ca3a049-dc9d-4dd6-823d-e3fc6b8cd1e3 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1474 microversion: 2.1 time: 0.394916 Aug 23 10:41:18.632842 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d268d04-cc7c-498a-97c1-94d1fa16dca5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.527031 Aug 23 10:41:18.634408 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 589/1141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:18 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:18.634528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 552/1141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:18 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:18.640266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74eea2a5-332f-48c1-829b-853880195360 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cab73a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:18.640690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:18.641339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:18.650934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.655964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.656316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.661386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.661902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.664522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.729132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74eea2a5-332f-48c1-829b-853880195360 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.086385 Aug 23 10:41:18.731438 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 553/1142] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:18 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:18.788409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:18.788409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:18.805816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.806322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.806774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.807496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.807960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.808393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.850144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:18.864180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:18.866729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:18.884420 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2bc3b043-984d-44b7-86b0-c8adda3be160 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.248837 Aug 23 10:41:18.901212 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 590/1143] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:18 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:18.901212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d655a41b-e193-433a-be0b-3a33057ba655 req-28d0e1ed-047f-4107-ac57-efaa66d5c44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "c9fa7fb8-824f-4206-aef0-a342042e747c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:18.918475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d655a41b-e193-433a-be0b-3a33057ba655 req-28d0e1ed-047f-4107-ac57-efaa66d5c44f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:18.921334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d655a41b-e193-433a-be0b-3a33057ba655 req-28d0e1ed-047f-4107-ac57-efaa66d5c44f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:18.921980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d655a41b-e193-433a-be0b-3a33057ba655 req-28d0e1ed-047f-4107-ac57-efaa66d5c44f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:18.941997 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d655a41b-e193-433a-be0b-3a33057ba655 req-28d0e1ed-047f-4107-ac57-efaa66d5c44f service nova] Creating event network-changed:c9fa7fb8-824f-4206-aef0-a342042e747c for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:18.957078 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d655a41b-e193-433a-be0b-3a33057ba655 req-28d0e1ed-047f-4107-ac57-efaa66d5c44f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061720 Aug 23 10:41:18.957832 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 591/1144] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:19.093148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:19.103762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:19.105293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:19.107316 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c0c3c23-3171-4609-a0bd-703a6986363c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1891 microversion: 2.32 time: 0.323839 Aug 23 10:41:19.108328 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 554/1145] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:18 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1891 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:19.131999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:19.132624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:19.143653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.144559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.145500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.146662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.147139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.147570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.185039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.185936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.186544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.187329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lazy-loading 'fault' on Instance uuid a0ad8267-7788-47f9-b7a0-e71f2dc9b45a {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:19.234171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:19.244674 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7fa84b13-2525-4777-9080-07c540ad0338 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1307 microversion: 2.1 time: 0.116929 Aug 23 10:41:19.257252 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 592/1146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:19 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:19.646477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:19.647134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:19.654891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:19.655922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:19.689798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.690823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.690823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.691740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.692414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.692414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.693428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.696243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.704601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.708927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:19.710197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:19.716372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:19.973623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:19.982459 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f85ae090-b661-49b0-a50b-e0bc4b2bf0e8 tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1474 microversion: 2.1 time: 0.345455 Aug 23 10:41:19.989170 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 555/1147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:19 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:19.995959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19d7c311-bf74-4428-bb52-4edf4c74f187 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ca539d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:20.058991 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19d7c311-bf74-4428-bb52-4edf4c74f187 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1413 microversion: 2.1 time: 0.068650 Aug 23 10:41:20.068348 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 556/1148] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:19 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:20.074579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:20.077976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:20.086677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.087747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.088616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.089788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.090705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.091723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.160129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.169012 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5fe15f67-8404-4abc-8dc9-3a2ef05f075c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1469 microversion: 2.1 time: 0.518743 Aug 23 10:41:20.169726 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 593/1149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:19 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1469 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:20.177453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:20.178121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:20.186055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.186555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.187005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.187731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.188231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.188854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.223408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.234890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.236583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.242486 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5f5f176-9c90-4232-8e3c-840d75af32af tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.172172 Aug 23 10:41:20.244821 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 557/1150] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:20 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:20.270068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:20.270693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:20.277413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.277909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.279588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.280301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.280788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.281243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.318304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.318787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.319237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.319704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lazy-loading 'fault' on Instance uuid a0ad8267-7788-47f9-b7a0-e71f2dc9b45a {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:20.365164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.374245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76399704-30f9-4f59-89f3-d23081c87677 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 200 len: 1307 microversion: 2.1 time: 0.108054 Aug 23 10:41:20.375136 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 558/1151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:20 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:20.583247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "name": "network-vif-unplugged", "status": "completed", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:20.601154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:20.601648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:20.602157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:20.621273 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] Creating event network-vif-unplugged:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:41:20.630314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:41:20.640314 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b65aa81a-6063-4a98-8385-dbce04c9ffcb req-68603eaf-10af-4ff5-b0d8-745ed4ffa0c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060596 Aug 23 10:41:20.641334 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 559/1152] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:20.750397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.763212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.765043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:20.766506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90c2149e-b518-4b8b-aaeb-882b9ad4ebe3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1891 microversion: 2.32 time: 0.595850 Aug 23 10:41:20.782112 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 594/1153] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:20 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1891 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:21.008471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:21.009999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:21.021765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:21.026054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:21.032821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:21.033924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:21.034774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:21.035847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:21.075991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae44f44c-fd8f-42d1-8cae-659373cc05cd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cbb93a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:21.092004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:21.154642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae44f44c-fd8f-42d1-8cae-659373cc05cd tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1422 microversion: 2.1 time: 0.079924 Aug 23 10:41:21.156485 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 595/1154] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:21 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:21.176124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb605276-36b4-40fa-b969-0a4134194b17 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc9baf0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:21.257708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb605276-36b4-40fa-b969-0a4134194b17 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 200 len: 1422 microversion: 2.1 time: 0.092867 Aug 23 10:41:21.261140 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 596/1155] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:41:21 2022] GET /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:21.272726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:21.273227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:21.293060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:21.296633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:21.298381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:21.299401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:21.303305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:21.305290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:21.589729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caf26dcae82b4835a0c0514945dd7882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fea1ec49dc540d5ac895803d3bec1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:21.600107 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89fb81f8-bda7-4403-bbca-e7dbd2168a3f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 200 len: 1474 microversion: 2.1 time: 0.597788 Aug 23 10:41:21.601308 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 560/1156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:20 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 1474 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:21.606791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-70cdd248-c307-4168-b08e-3557cc1e60a7 req-9c4d7120-dcb3-4a4d-ae76-9c8b560cf088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "c543dece-200b-4b28-bad8-de92bd67034b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:21.616981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70cdd248-c307-4168-b08e-3557cc1e60a7 req-9c4d7120-dcb3-4a4d-ae76-9c8b560cf088 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:21.618065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70cdd248-c307-4168-b08e-3557cc1e60a7 req-9c4d7120-dcb3-4a4d-ae76-9c8b560cf088 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:21.618782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70cdd248-c307-4168-b08e-3557cc1e60a7 req-9c4d7120-dcb3-4a4d-ae76-9c8b560cf088 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:21.632404 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-70cdd248-c307-4168-b08e-3557cc1e60a7 req-9c4d7120-dcb3-4a4d-ae76-9c8b560cf088 service nova] Creating event network-changed:c543dece-200b-4b28-bad8-de92bd67034b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:21.639222 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-70cdd248-c307-4168-b08e-3557cc1e60a7 req-9c4d7120-dcb3-4a4d-ae76-9c8b560cf088 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035170 Aug 23 10:41:21.640438 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 561/1157] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:21.646149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba2e60c4-986f-46ec-acdf-b5e987b384b4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cab79d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:22.182431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:22.193631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-084e5c91-af06-4f6a-b8cc-b151a63dcd7b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1535 microversion: 2.1 time: 0.926552 Aug 23 10:41:22.194729 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 597/1158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:21 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1535 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:22.217125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:22.217792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:22.236416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.237260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.237978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.238988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.239452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.239948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.362330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:22.371033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:22.383354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:22.386167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:22.398157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1030cb1a-4313-4b96-956b-676c3260c516 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.202090 Aug 23 10:41:22.398882 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 598/1159] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:22 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:22.407073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:22.408018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: a0ad8267-7788-47f9-b7a0-e71f2dc9b45a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:22.414883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.415826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.416467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.417411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.418092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.419038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.436512 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] HTTP exception thrown: Instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a could not be found. Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Request method failure captured: Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a HTTP/1.1 Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4ToHNTd0LP2llmPvcwzXK0hVZCC18mTqR5PQpGrBi9ThiYVa6WiZh4yVndAIpgKhI511aHvzFrQ8BFmedv5HlLOgZ5QhSYUCuoTNBXqrVysFq8Q5M9CFLGSL6ZtmV-YI1gnvTeY0uiQHJ6p1dsIrfsZcTGt_KVPXqW9GokR0vrykc Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 5dfc4e7196d34e709a5a869216864151 Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesAdminNegativeTest-1539773885 Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:41:22.438368 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5dfc4e7196d34e709a5a869216864151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5dfc4e7196d34e709a5a869216864151", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5dfc4e7196d34e709a5a869216864151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5dfc4e7196d34e709a5a869216864151"}]}] Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesAdminNegativeTest-1539773885 Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 5dfc4e7196d34e709a5a869216864151 Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1539773885 Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesAdminNegativeTest-1539773885-project Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 92552bd027104cdc879b59446df626ce Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesAdminNegativeTest-1539773885-project Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a could not be found. Aug 23 10:41:22.440465 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'a0ad8267-7788-47f9-b7a0-e71f2dc9b45a'} Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a could not be found. Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:22.441526 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a could not be found. Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a could not be found. Aug 23 10:41:22.443088 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.444441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Returning 404 to user: Instance a0ad8267-7788-47f9-b7a0-e71f2dc9b45a could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:22.445362 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06b50373-4f35-4d7f-a054-134f80d9821c tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a" status: 404 len: 111 microversion: 2.1 time: 0.042251 Aug 23 10:41:22.446339 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 599/1160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:22 2022] GET /compute/v2.1/servers/a0ad8267-7788-47f9-b7a0-e71f2dc9b45a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:22.453331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:22.454086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:22.460667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.461302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.461853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.462682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.463271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.463810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.487246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba2e60c4-986f-46ec-acdf-b5e987b384b4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 204 len: 0 microversion: 2.1 time: 0.844742 Aug 23 10:41:22.487953 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 562/1161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:21 2022] DELETE /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:22.494857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-faaa79b3-a5fb-4230-880f-b1e7e3c7890e req-233778b8-5c50-46ef-a76d-124ef1747622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ade5aa1-eab4-433d-9bc6-a3d6658e05da", "name": "network-vif-deleted", "tag": "0e2a14dd-81c8-488b-99d9-bf2bdecb6657"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:22.522253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-faaa79b3-a5fb-4230-880f-b1e7e3c7890e req-233778b8-5c50-46ef-a76d-124ef1747622 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.525706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-faaa79b3-a5fb-4230-880f-b1e7e3c7890e req-233778b8-5c50-46ef-a76d-124ef1747622 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.526682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-faaa79b3-a5fb-4230-880f-b1e7e3c7890e req-233778b8-5c50-46ef-a76d-124ef1747622 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.548775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-faaa79b3-a5fb-4230-880f-b1e7e3c7890e req-233778b8-5c50-46ef-a76d-124ef1747622 service nova] Creating event network-vif-deleted:0e2a14dd-81c8-488b-99d9-bf2bdecb6657 for instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da on n-h1-847009-13 Aug 23 10:41:22.556611 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-faaa79b3-a5fb-4230-880f-b1e7e3c7890e req-233778b8-5c50-46ef-a76d-124ef1747622 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067035 Aug 23 10:41:22.564115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 563/1162] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:22.571357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:22.572339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:22.580441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.581608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.582477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.583363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.583978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.584607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.625153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:41:22.773891 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b11c0cce-b916-4d06-ae47-1402a271a847 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 204 len: 0 microversion: 2.1 time: 0.206004 Aug 23 10:41:22.780881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 564/1163] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:22 2022] DELETE /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:22.796277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:22.797328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] [instance: 2ade5aa1-eab4-433d-9bc6-a3d6658e05da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:22.814658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.815166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.815613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.816331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:22.821667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:22.822444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:22.873105 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] HTTP exception thrown: Instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da could not be found. Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Request method failure captured: Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da HTTP/1.1 Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6SIT0Mu_x-QiH3_ji_ZnqA5lQkPHLp3FOUhTVmjbk7P1XBU1LHj8fMi-B8WMskrC707N_4lmoZmIpKGb4q2yFFK7TkKYA49Mb0j15Z0WVSOq3jSHtqMno1Hbf3n5MBZnjokB2sQaPmJTqEqmrPdZnRb6ZOpWTSunh0Hq5mabGQ3Sc Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 2fea1ec49dc540d5ac895803d3bec1f4 Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-LiveMigrationNegativeTest-1950640574 Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:41:22.875715 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2fea1ec49dc540d5ac895803d3bec1f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2fea1ec49dc540d5ac895803d3bec1f4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2fea1ec49dc540d5ac895803d3bec1f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2fea1ec49dc540d5ac895803d3bec1f4"}]}] Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-LiveMigrationNegativeTest-1950640574 Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 2fea1ec49dc540d5ac895803d3bec1f4 Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1950640574 Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-LiveMigrationNegativeTest-1950640574-project Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: caf26dcae82b4835a0c0514945dd7882 Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-LiveMigrationNegativeTest-1950640574-project Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da could not be found. Aug 23 10:41:22.877330 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '2ade5aa1-eab4-433d-9bc6-a3d6658e05da'} Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da could not be found. Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:22.878261 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da could not be found. Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da could not be found. Aug 23 10:41:22.879729 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:22.885132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] Returning 404 to user: Instance 2ade5aa1-eab4-433d-9bc6-a3d6658e05da could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:22.886375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca2ad089-4f57-4a1f-8958-4478d240bc8f tempest-LiveMigrationNegativeTest-1950640574 tempest-LiveMigrationNegativeTest-1950640574-project] 10.222.0.78 "GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da" status: 404 len: 111 microversion: 2.1 time: 0.103979 Aug 23 10:41:22.890825 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 565/1164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:22 2022] GET /compute/v2.1/servers/2ade5aa1-eab4-433d-9bc6-a3d6658e05da => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:23.013534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1340811408", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "f3c62108-8f19-4a8d-8de7-8cbb5b2b0858"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:23.083374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] validate_networks() for [('f3c62108-8f19-4a8d-8de7-8cbb5b2b0858', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:41:23.223604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.243648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.245247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.246649 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d158fedf-e8bb-44e4-98f8-3d601b0f131c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1891 microversion: 2.32 time: 0.799253 Aug 23 10:41:23.247213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 600/1165] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:22 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1891 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:23.252156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:23.252694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:23.276790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:23.277275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:23.277714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:23.278488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:23.278946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:23.279374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:23.688703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:41:23.689843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:41:23.692311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:41:23.693159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:41:23.694023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:41:23.708898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:23.709519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:23.710366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:23.711191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:23.713565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:23.714102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:23.735607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:41:23.741587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for user a2f47ead9ba342b2b1456305289c6188 and project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:41:23.757359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:41:23.759908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:41:23.812164 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49d99716-96ea-423e-adc1-253ada932191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803266 Aug 23 10:41:23.813013 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 566/1166] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:41:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:41:23.817973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:23.819040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:23.825440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:23.826251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:23.826946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:23.827917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:23.828626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:23.829295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:23.912896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.922420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.925144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.931163 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f352f9cb-4fb5-4b77-88fa-ae84db5af8be tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.116809 Aug 23 10:41:23.934237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:23.950449 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 567/1167] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:23 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:23.955862 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-585c51f7-e8d7-4873-bdbe-fed118ed41c2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1535 microversion: 2.1 time: 0.707470 Aug 23 10:41:23.956657 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 601/1168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:23 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1535 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:23.956969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2928047a-3681-4601-a143-2ea8663bd126 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:23.957847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2928047a-3681-4601-a143-2ea8663bd126 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:24.037567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-99159778-c193-4ac6-afdc-3460505e9ede req-7412b0e2-b5c7-4f6b-a772-d74fc945e1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "92e6c454-69c8-4403-a85d-d026ca05400b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:24.045773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2928047a-3681-4601-a143-2ea8663bd126 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:24.052048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99159778-c193-4ac6-afdc-3460505e9ede req-7412b0e2-b5c7-4f6b-a772-d74fc945e1a0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:24.056129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2928047a-3681-4601-a143-2ea8663bd126 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1208 microversion: 2.1 time: 0.103701 Aug 23 10:41:24.057688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99159778-c193-4ac6-afdc-3460505e9ede req-7412b0e2-b5c7-4f6b-a772-d74fc945e1a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:24.058277 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 568/1169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:23 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:24.059350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99159778-c193-4ac6-afdc-3460505e9ede req-7412b0e2-b5c7-4f6b-a772-d74fc945e1a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:24.089983 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-99159778-c193-4ac6-afdc-3460505e9ede req-7412b0e2-b5c7-4f6b-a772-d74fc945e1a0 service nova] Creating event network-changed:92e6c454-69c8-4403-a85d-d026ca05400b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:24.108228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-99159778-c193-4ac6-afdc-3460505e9ede req-7412b0e2-b5c7-4f6b-a772-d74fc945e1a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075388 Aug 23 10:41:24.109531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 602/1170] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:24.274001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:24.274675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:24.285047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:24.285827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:24.286243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:24.287187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:24.287851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:24.288482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:24.642393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:24.655421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:24.658195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:24.661024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd898360-334b-4166-a0d9-8e1c34697aee tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.392413 Aug 23 10:41:24.662600 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 569/1171] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:24 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:24.717355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a92f6167-0582-42ae-b505-27b0a11d0f71 req-3404ef85-dffa-4469-8051-1349ec3a4bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee006f-9d99-49b9-9c30-15237f120050", "name": "network-vif-unplugged", "status": "completed", "tag": "9cb83c3a-f3de-454f-a964-b0b1d8456674"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:24.765793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a92f6167-0582-42ae-b505-27b0a11d0f71 req-3404ef85-dffa-4469-8051-1349ec3a4bf7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:24.774794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a92f6167-0582-42ae-b505-27b0a11d0f71 req-3404ef85-dffa-4469-8051-1349ec3a4bf7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:24.775553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a92f6167-0582-42ae-b505-27b0a11d0f71 req-3404ef85-dffa-4469-8051-1349ec3a4bf7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:24.798770 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a92f6167-0582-42ae-b505-27b0a11d0f71 req-3404ef85-dffa-4469-8051-1349ec3a4bf7 service nova] Creating event network-vif-unplugged:9cb83c3a-f3de-454f-a964-b0b1d8456674 for instance 73ee006f-9d99-49b9-9c30-15237f120050 on n-h2-847009-13 Aug 23 10:41:24.808942 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a92f6167-0582-42ae-b505-27b0a11d0f71 req-3404ef85-dffa-4469-8051-1349ec3a4bf7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098668 Aug 23 10:41:24.811009 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 603/1172] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:24.962483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:24.962483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:24.969297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:24.971324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:24.972068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:24.973085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:24.973780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:24.974477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:24.986206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:24.987699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:25.000909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:25.008542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:25.020903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:25.022457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:25.023155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:25.023727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:25.054675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:25.129200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:25.141203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:25.142735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:25.149036 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da08412f-6821-418b-972a-3513bfe0b512 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.196128 Aug 23 10:41:25.165493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 570/1173] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:24 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:25.172359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:25.173022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:25.180333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:25.181523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:25.181982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:25.183068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:25.183737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:25.184911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:25.255352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:25.276792 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2294e8ad-b3ae-488a-8cc7-a6878f70b47f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1212 microversion: 2.1 time: 0.110079 Aug 23 10:41:25.282041 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 571/1174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:25 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:25.351869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:25.361174 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c45549e2-32b1-42ef-8c29-193c4e42f9c8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1535 microversion: 2.1 time: 0.380290 Aug 23 10:41:25.368932 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 604/1175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:24 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1535 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:25.690935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:25.692203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:25.699140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:25.700215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:25.701611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:25.702575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:25.703259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:25.704053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.033796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.047586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.049849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.051339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c185e63d-f09b-4044-8dd9-b0f6ff05e151 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.365999 Aug 23 10:41:26.052469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 572/1176] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:25 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:26.178750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:26.179368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:26.181542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9de900e8-b59e-49d7-a9f4-9c0d2ba00090 req-d9a3e36d-5e22-4e66-b364-d1f580b4b8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "8c852214-7d06-4732-b9da-d47803940a50"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:26.186841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:26.192164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.194020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.195263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.196575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.197508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.198241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.205021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9de900e8-b59e-49d7-a9f4-9c0d2ba00090 req-d9a3e36d-5e22-4e66-b364-d1f580b4b8e0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.205845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9de900e8-b59e-49d7-a9f4-9c0d2ba00090 req-d9a3e36d-5e22-4e66-b364-d1f580b4b8e0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.206497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9de900e8-b59e-49d7-a9f4-9c0d2ba00090 req-d9a3e36d-5e22-4e66-b364-d1f580b4b8e0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.242176 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9de900e8-b59e-49d7-a9f4-9c0d2ba00090 req-d9a3e36d-5e22-4e66-b364-d1f580b4b8e0 service nova] Creating event network-changed:8c852214-7d06-4732-b9da-d47803940a50 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:41:26.247812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9de900e8-b59e-49d7-a9f4-9c0d2ba00090 req-d9a3e36d-5e22-4e66-b364-d1f580b4b8e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070011 Aug 23 10:41:26.248660 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 573/1177] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:26.299191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.305210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:26.306429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:26.317680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.319650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.322723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.323219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.327763 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6983d766-174f-4781-af8a-b20c0cec85ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.153021 Aug 23 10:41:26.328607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.329654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.330300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.331511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.341807 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 605/1178] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:26 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:26.353418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-fa2d6924-f828-40b9-8a64-b4da43318f9c req-f8e7e915-b2a0-4fd1-b9e2-d64ebfa2523c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ee006f-9d99-49b9-9c30-15237f120050", "name": "network-vif-deleted", "tag": "9cb83c3a-f3de-454f-a964-b0b1d8456674"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:26.364170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fa2d6924-f828-40b9-8a64-b4da43318f9c req-f8e7e915-b2a0-4fd1-b9e2-d64ebfa2523c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.364981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fa2d6924-f828-40b9-8a64-b4da43318f9c req-f8e7e915-b2a0-4fd1-b9e2-d64ebfa2523c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.374430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fa2d6924-f828-40b9-8a64-b4da43318f9c req-f8e7e915-b2a0-4fd1-b9e2-d64ebfa2523c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.387872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-fa2d6924-f828-40b9-8a64-b4da43318f9c req-f8e7e915-b2a0-4fd1-b9e2-d64ebfa2523c service nova] Creating event network-vif-deleted:9cb83c3a-f3de-454f-a964-b0b1d8456674 for instance 73ee006f-9d99-49b9-9c30-15237f120050 on n-h2-847009-13 Aug 23 10:41:26.393167 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-fa2d6924-f828-40b9-8a64-b4da43318f9c req-f8e7e915-b2a0-4fd1-b9e2-d64ebfa2523c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043859 Aug 23 10:41:26.394076 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 606/1179] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:26.399711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:26.400482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:26.407641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.408415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.409049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.409956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.410616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.411235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.451606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.468794 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1840c82-e43e-40f1-aa0d-c6031ec2d20a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1260 microversion: 2.1 time: 0.168059 Aug 23 10:41:26.470612 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 574/1180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:26 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:26.607126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:26.621043 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6264ff41-fd56-4b48-8da3-348fea8153ac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1535 microversion: 2.1 time: 0.223377 Aug 23 10:41:26.628631 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 607/1181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:26 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1535 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:26.955745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:26.956246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:26.963864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.964288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.964784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.965739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:26.966364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:26.966621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:26.993395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:41:27.074557 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-700c2fee-174f-4a15-9277-bf9974c5eff8 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 204 len: 0 microversion: 2.1 time: 0.122432 Aug 23 10:41:27.075263 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 575/1182] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:26 2022] DELETE /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:27.080608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.081401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:27.087281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.089310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.089772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.091083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.091724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.092354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.093159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6cc76f16-1318-4208-9509-fca345f201bb tempest-NetworksTest-782118476 tempest-NetworksTest-782118476-project-admin] Calling method '.version_select at 0x7fdc9cb6ec10>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.265708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6cc76f16-1318-4208-9509-fca345f201bb tempest-NetworksTest-782118476 tempest-NetworksTest-782118476-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 9433 microversion: 2.1 time: 0.306118 Aug 23 10:41:27.266660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 608/1183] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:26 2022] GET /compute/v2.1/os-networks => generated 9433 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:27.273317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.273934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:27.280457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.280987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.281431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.282141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.282605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.283036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.402402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.423679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.426440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.428178 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70877b3f-aaa8-4e5b-883f-70cfb468383d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.351773 Aug 23 10:41:27.429485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 576/1184] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:27.436069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff12dbd8-23e6-46e6-8410-b5f06bca237e tempest-NetworksTest-782118476 tempest-NetworksTest-782118476-project-admin] Calling method '.version_select at 0x7fdc9ca90280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.441723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.454711 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-001fc4ad-dbed-46d2-af7a-edaf3e463bdb tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1677 microversion: 2.1 time: 0.186700 Aug 23 10:41:27.456985 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 609/1185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:27.463195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.464009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:27.472303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.473263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.473892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.475300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.475933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.476652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.557615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.566994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.568541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.573962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-102b6e7f-dfa9-40b2-873d-ab3fc0eb974e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.115742 Aug 23 10:41:27.575679 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 610/1186] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:27.582680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.583901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:27.593406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.594254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.594922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.596591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.597136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.597576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.618197 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff12dbd8-23e6-46e6-8410-b5f06bca237e tempest-NetworksTest-782118476 tempest-NetworksTest-782118476-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks/a57c3463-0e0e-4f09-8699-1fe402d2368f" status: 200 len: 652 microversion: 2.1 time: 0.186270 Aug 23 10:41:27.619195 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 577/1187] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/os-networks/a57c3463-0e0e-4f09-8699-1fe402d2368f => generated 652 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:27.631471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2831bab-aac2-4f9c-8a46-ef849a88d68e tempest-NetworksTest-782118476 tempest-NetworksTest-782118476-project-admin] Calling method '.version_select at 0x7fdc9ca90ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.673868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.681764 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-871f6852-5c96-495f-8c68-43a6e7088073 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1266 microversion: 2.1 time: 0.104799 Aug 23 10:41:27.682340 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 611/1188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:27.688775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:27.689580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:27.698742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.699336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.700300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.701411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:27.702050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:27.702631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:27.941374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:27.950490 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90aaba5b-df7b-4ea0-91e1-7c917e50f872 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1535 microversion: 2.1 time: 0.266244 Aug 23 10:41:27.963970 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 612/1189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1535 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:27.979668 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2831bab-aac2-4f9c-8a46-ef849a88d68e tempest-NetworksTest-782118476 tempest-NetworksTest-782118476-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 9433 microversion: 2.1 time: 0.353665 Aug 23 10:41:27.980932 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 578/1190] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:27 2022] GET /compute/v2.1/os-networks => generated 9433 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:28.452217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:28.453530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:28.472231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.478113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:28.478623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.478971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:28.479097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.480124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.480618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.481678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.493372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.498652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.499393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.500387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.501551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.502088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.762239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.788968 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33b0ea5d-9097-462c-afa3-bad69d2d1927 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1677 microversion: 2.1 time: 0.314920 Aug 23 10:41:28.790075 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 579/1191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:28 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:28.805647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:28.806268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:28.812970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.813467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.814283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.814997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.815464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.815892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.838687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.853777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.855734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.857950 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0dbb42f9-7ff1-4426-af68-5f5ac4e041df tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.410202 Aug 23 10:41:28.858995 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 613/1192] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:28 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:28.877193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:28.877826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:28.884035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.884529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.884994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.885770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.886154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.886583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.898905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.912957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.914910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:28.923627 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7189f7be-17fe-44a4-af17-08381e076381 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.131673 Aug 23 10:41:28.937262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 580/1193] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:28 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:28.981139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:28.982464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:28.992496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.993552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.994193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:28.994936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:28.995903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:28.997083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.147441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:29.159942 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-627e6f64-c974-4195-9813-ca53dd5d84e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.299060 Aug 23 10:41:29.160196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:29.161068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 614/1194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:28 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:29.181065 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e101ae7-a34b-46ab-aa05-127b7b969e4b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1528 microversion: 2.1 time: 0.212688 Aug 23 10:41:29.197216 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 581/1195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:28 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1528 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:29.204311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:29.205171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:29.211348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.212037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.212637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.213594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.214218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.214804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.249540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:29.250426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:29.262613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.265738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.266201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.266934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.269800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.270436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.560121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-053e0d9e-c6a3-4c10-9c47-a925d16423d0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1813 microversion: 2.1 time: 0.315021 Aug 23 10:41:29.564557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 582/1196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:29 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1813 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:29.582320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:29.585550 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:41:29.585550 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:41:29.586781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.587270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.587707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.588436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.589216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.589646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.617012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7235db7-cc6c-4c24-9702-45caef35eae0 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038902 Aug 23 10:41:29.617663 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 583/1197] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:41:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:29.812331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:29.813245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:29.823723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.825163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.825805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.826789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.827472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.828163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.928521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:29.943922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d9e36b5-53b9-4506-af1f-be9e38b1666d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1528 microversion: 2.1 time: 0.744005 Aug 23 10:41:29.958401 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 615/1198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:29 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1528 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:29.971551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:29.972502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:29.980632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.985026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.985874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:29.986862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:29.987566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:29.989178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:30.353423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.380872 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb293e3d-b5a2-4249-8c68-94db3a07dbca tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1677 microversion: 2.1 time: 0.571918 Aug 23 10:41:30.389535 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 584/1199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:29 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1677 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:30.391070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.400496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:30.403260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:30.403402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.406165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.407416 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b17fd70-a8be-4a05-a30b-a5dba10c710d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.447570 Aug 23 10:41:30.420976 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 616/1200] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:29 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:30.426002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f2809da-1a52-46eb-b610-31ffdd461124 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:30.427073 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:41:30.427073 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:41:30.436288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2f2809da-1a52-46eb-b610-31ffdd461124 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] HTTP exception thrown: Flavor 02ce3e65-aa08-477d-ac56-a793091f4861 could not be found. Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f2809da-1a52-46eb-b610-31ffdd461124 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Request method failure captured: Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/flavors/02ce3e65-aa08-477d-ac56-a793091f4861 HTTP/1.1 Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3dzHWxrYwaCJQaKE277W3poxcqoY-7Sw9kDZuRlehc2E0-PK8MZf7M5ABNX0BvgYYBXHenhneqs34VceT2HudwpNaQfUU5u12eqgaI0hhLbzC1E576SBTLcTE6wChj1LnG17fIKxNEpqLyT2BeHHZE2Le4toF3ZUTRHwr4Bkyy9Sk Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6f01fc09301d47359592d4df1ed9c962 Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-MigrationsAdminTest-862103239 Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:41:30.443570 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6f01fc09301d47359592d4df1ed9c962"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6f01fc09301d47359592d4df1ed9c962", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f01fc09301d47359592d4df1ed9c962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f01fc09301d47359592d4df1ed9c962"}]}] Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-MigrationsAdminTest-862103239 Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6f01fc09301d47359592d4df1ed9c962 Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-MigrationsAdminTest-862103239 Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-MigrationsAdminTest-862103239-project-admin Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ccce31992b2b48e488ef42ca535f468a Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-MigrationsAdminTest-862103239-project-admin Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: exception: Flavor 02ce3e65-aa08-477d-ac56-a793091f4861 could not be found. Aug 23 10:41:30.445322 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '02ce3e65-aa08-477d-ac56-a793091f4861'} Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 02ce3e65-aa08-477d-ac56-a793091f4861 could not be found. Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:30.446264 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 02ce3e65-aa08-477d-ac56-a793091f4861 could not be found. Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 02ce3e65-aa08-477d-ac56-a793091f4861 could not be found. Aug 23 10:41:30.447845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:30.449797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f2809da-1a52-46eb-b610-31ffdd461124 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Returning 404 to user: Flavor 02ce3e65-aa08-477d-ac56-a793091f4861 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:30.449797 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f2809da-1a52-46eb-b610-31ffdd461124 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/02ce3e65-aa08-477d-ac56-a793091f4861" status: 404 len: 109 microversion: 2.1 time: 0.022795 Aug 23 10:41:30.449797 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 617/1201] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:30 2022] DELETE /compute/v2.1/flavors/02ce3e65-aa08-477d-ac56-a793091f4861 => generated 109 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:30.457605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:30.462085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:30.464856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:30.465960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:30.466744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:30.473348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:30.474020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:30.474757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:30.495334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:30.502273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:30.504339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:30.505311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:30.515352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:30.517047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:30.632884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.645793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.647670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.662452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a6e5051-1575-4f3e-a838-d1016cf92ef9 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.270579 Aug 23 10:41:30.663829 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 585/1202] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:30 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:30.765750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1364715738", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:30.849408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:41:30.970674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:30.978973 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4207288-8b6e-4ea7-bfa9-724ae11a9cea tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.529393 Aug 23 10:41:30.982973 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 618/1203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:30 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:31.007932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8db48f12-9848-4f9d-9313-ad34dafa1290 req-4b4dfcb3-1e3a-4384-a30b-64eefcf6c5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "name": "network-vif-plugged", "status": "completed", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:31.034862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8db48f12-9848-4f9d-9313-ad34dafa1290 req-4b4dfcb3-1e3a-4384-a30b-64eefcf6c5b3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.035656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8db48f12-9848-4f9d-9313-ad34dafa1290 req-4b4dfcb3-1e3a-4384-a30b-64eefcf6c5b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.036539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8db48f12-9848-4f9d-9313-ad34dafa1290 req-4b4dfcb3-1e3a-4384-a30b-64eefcf6c5b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.056302 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8db48f12-9848-4f9d-9313-ad34dafa1290 req-4b4dfcb3-1e3a-4384-a30b-64eefcf6c5b3 service nova] Creating event network-vif-plugged:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:41:31.064712 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8db48f12-9848-4f9d-9313-ad34dafa1290 req-4b4dfcb3-1e3a-4384-a30b-64eefcf6c5b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068775 Aug 23 10:41:31.066697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 619/1204] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:31.208424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-479fce9f-f1e0-44f1-a627-a33f52d7b72e req-513d8b73-1aec-4a27-832c-c82df6d3a6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c55817a-7f2f-4d09-9f3e-d3428bbed107", "tag": "088689b9-d59f-42c1-9193-62fdab23084d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:31.228037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-479fce9f-f1e0-44f1-a627-a33f52d7b72e req-513d8b73-1aec-4a27-832c-c82df6d3a6e1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.228509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-479fce9f-f1e0-44f1-a627-a33f52d7b72e req-513d8b73-1aec-4a27-832c-c82df6d3a6e1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.233215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-479fce9f-f1e0-44f1-a627-a33f52d7b72e req-513d8b73-1aec-4a27-832c-c82df6d3a6e1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.268483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-479fce9f-f1e0-44f1-a627-a33f52d7b72e req-513d8b73-1aec-4a27-832c-c82df6d3a6e1 service nova] Creating event network-changed:088689b9-d59f-42c1-9193-62fdab23084d for instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 on n-h2-847009-13 Aug 23 10:41:31.274886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-479fce9f-f1e0-44f1-a627-a33f52d7b72e req-513d8b73-1aec-4a27-832c-c82df6d3a6e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072910 Aug 23 10:41:31.277884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 620/1205] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:31.406034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:31.406925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:31.419456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.422677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.425491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.429686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.430410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.431262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.472711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:31.693962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:31.695435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:41:31.696634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:41:31.697454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:41:31.698628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:41:31.699334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:41:31.705541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b4356caf-b935-4e16-9cd5-2ba7f5e130e1 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1677 microversion: 2.1 time: 0.305723 Aug 23 10:41:31.716796 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 621/1206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:31 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1677 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:31.717254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:31.717696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:31.726248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.727164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.728325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.729369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.730546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.733425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.734036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.734670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.735213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.736390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.737129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.737964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.792851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:41:31.810780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Getting quotas for user 9574ff57c9474f7fb5ec4567bc06d531 and project 81dd6dd624b14701860deb0d33332e83. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:41:31.828233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:41:31.830846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:41:31.905916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64a8fe3c-388f-4d59-9139-4bf242b26e9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144172 Aug 23 10:41:31.908998 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 586/1207] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:41:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:41:31.922761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:31.938331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:31.953297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.953925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.954469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:31.955784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:31.956785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:31.957631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.146746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.162102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.167018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.177732 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-821aa4ac-bc1b-4578-bebe-0d66ccad89d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.266160 Aug 23 10:41:32.194334 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 587/1208] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:31 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:32.207330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed19abbb-3b9d-4c1a-bf81-29919f4f3ea0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:32.208189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed19abbb-3b9d-4c1a-bf81-29919f4f3ea0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:32.260048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.306877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.313394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.319235 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-97162caf-b66b-4834-909f-2699f075d07c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.608248 Aug 23 10:41:32.320925 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 622/1209] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:31 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:32.332774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:32.339973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:32.357841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.358375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.360139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.361864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.362618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.363277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.365766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed19abbb-3b9d-4c1a-bf81-29919f4f3ea0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.375143 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed19abbb-3b9d-4c1a-bf81-29919f4f3ea0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1213 microversion: 2.1 time: 0.179473 Aug 23 10:41:32.385617 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 588/1210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:32 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:32.406003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:32.406833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:32.426038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.431359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.432051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.436101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.436930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.437585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.666353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:32.694774 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8831e9c6-b557-4a7f-8437-906112bd3c45 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 2343 microversion: 2.25 time: 0.308107 Aug 23 10:41:32.696678 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 589/1211] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:32 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 2343 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:32.706673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0063810-4466-4826-806d-e3cbc7dd5025", "device": "/dev/xvdb"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:32.723073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:32.733033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.733548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.734001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.734984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.743132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.743942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.749176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:32.884172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:32.893164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90ca4a55-44f3-4f5d-a42e-1c5a6bc263fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.570226 Aug 23 10:41:32.894013 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 623/1212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:32 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:32.913777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:32.916724 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:41:32.916724 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:41:32.918109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.919231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.919864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.920768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.921502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.922107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.942127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:32.951178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a9eceed-e6df-418b-8cfa-1cf5751d4d6e tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.040545 Aug 23 10:41:32.953600 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 624/1213] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Aug 23 10:41:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:41:32.964584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:32.966557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:32.974996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.975815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.976710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:32.977844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:32.978513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:32.979014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.128513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.137155 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fa27d41f-f35b-43c4-a08a-0da98693ce1a tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1610 microversion: 2.1 time: 0.182015 Aug 23 10:41:33.152214 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 625/1214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:32 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1610 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:33.175858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8bd0298-8cae-40c7-8762-41c76516311c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "POST /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472083 Aug 23 10:41:33.183317 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 590/1215] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:41:32 2022] POST /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:33.217980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:33.221314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:33.232515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.233957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.236801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.239256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.241649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.243150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.380053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.391777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.393627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.399750 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52ce578f-af3f-4f34-a6f4-40ebf8717778 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.193690 Aug 23 10:41:33.403099 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 591/1216] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:33 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:33.408612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-39a1c8a3-88e9-46de-b336-56f4f4122755 req-9c43c4e9-cf62-49c6-bdf7-88435622b03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1054768a-2e3f-4247-ada1-fd6ab4fb46e3", "name": "network-vif-deleted", "tag": "8c12973d-00fc-4c00-8796-b7c9651575f9"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:33.437332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-39a1c8a3-88e9-46de-b336-56f4f4122755 req-9c43c4e9-cf62-49c6-bdf7-88435622b03c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.440344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-88230412", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:33.441455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-39a1c8a3-88e9-46de-b336-56f4f4122755 req-9c43c4e9-cf62-49c6-bdf7-88435622b03c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.442972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-39a1c8a3-88e9-46de-b336-56f4f4122755 req-9c43c4e9-cf62-49c6-bdf7-88435622b03c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.459782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-39a1c8a3-88e9-46de-b336-56f4f4122755 req-9c43c4e9-cf62-49c6-bdf7-88435622b03c service nova] Creating event network-vif-deleted:8c12973d-00fc-4c00-8796-b7c9651575f9 for instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 on n-h2-847009-13 Aug 23 10:41:33.478356 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-39a1c8a3-88e9-46de-b336-56f4f4122755 req-9c43c4e9-cf62-49c6-bdf7-88435622b03c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073764 Aug 23 10:41:33.487463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 592/1217] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:33.497641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:33.499985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:33.515618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.516330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.517000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.518174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.518802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.519420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.535303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:41:33.819159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:41:33.819659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:41:33.820205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:41:33.820688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:41:33.821280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:41:33.836030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.837715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.838449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.839101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.840844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.842162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.843656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.852781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.861327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.863330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ffcb9d3-2935-4fdf-8cd2-c65726f83abd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.374275 Aug 23 10:41:33.865697 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 593/1218] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:33 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:33.867563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Getting quotas for project e5fe64230f9a4b0cadbc81a71ed5adf7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:41:33.878213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:33.879664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:33.888194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.888809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.889505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.890526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:33.891202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:33.892258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:33.895940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Getting quotas for user 675a9a61246a4b1e9b1a8e01b35e2054 and project e5fe64230f9a4b0cadbc81a71ed5adf7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:41:33.914341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:41:33.917059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:41:33.970734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:33.990211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83d9cfa4-e845-4ace-b649-6d38c3451d79 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1217 microversion: 2.1 time: 0.123086 Aug 23 10:41:33.991610 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 594/1219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:33 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:33.998990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:33.999915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:34.024011 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6edb0853-6d7e-48a0-b0c2-95285e874851 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863768 Aug 23 10:41:34.032096 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 626/1220] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:41:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:41:34.037432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad3b04f0-ffd8-4d6c-aed4-e404c7f28836 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:34.038419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad3b04f0-ffd8-4d6c-aed4-e404c7f28836 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:34.047402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.047909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.048382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.057531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.058047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.100120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.131232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ad3b04f0-ffd8-4d6c-aed4-e404c7f28836 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:34.143065 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad3b04f0-ffd8-4d6c-aed4-e404c7f28836 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1221 microversion: 2.1 time: 0.109443 Aug 23 10:41:34.145008 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 627/1221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:34 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:34.164623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:34.165633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:34.174040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.174917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.175592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.176532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.177254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.177968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.298100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:34.307177 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ecd6abc-da68-4fa0-bec5-4ac842e14380 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1323 microversion: 2.1 time: 0.147363 Aug 23 10:41:34.320040 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 628/1222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:34 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:34.437135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:34.438440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:34.449037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.451730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.453333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.455997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.457394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.458830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.646616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:34.668722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:34.671455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:34.698384 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f10f18d-d8bf-42aa-abff-6985c4a40446 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.264698 Aug 23 10:41:34.704009 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 629/1223] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:34 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:34.768677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:34.783549 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f67f33f-b070-46c3-acec-b9366c6df53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.785636 Aug 23 10:41:34.784293 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 595/1224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:33 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:34.909214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:34.910094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:34.918223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.931278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.932248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:34.933267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:34.935577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:34.936337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.014960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:35.016198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:35.023433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.023787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.024529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.025364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.026376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.026376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.194820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.204876 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cccde23-3ef9-440b-babe-8bac5e8b8c9f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1265 microversion: 2.1 time: 0.194220 Aug 23 10:41:35.214549 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 596/1225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:35 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:35.221493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:35.223013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:35.230646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.231332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.232199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.233071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.234186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.235121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.310449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.319383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64b54014-a6f7-4c10-98fa-3c1786fe354a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1225 microversion: 2.1 time: 0.102386 Aug 23 10:41:35.332766 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 597/1226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:35 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:35.341371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:35.342191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:35.347762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.349477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.350359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.350817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.351642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.352219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.353000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.362301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.363931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.365417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9362b666-e930-4592-ab64-341a547bc1c8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.460526 Aug 23 10:41:35.382107 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 630/1227] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:34 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:35.391094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.391773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.392288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.392862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lazy-loading 'fault' on Instance uuid 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:35.489252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92552bd027104cdc879b59446df626ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dfc4e7196d34e709a5a869216864151', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.503205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1e6ffcd-ef8e-4596-953a-80c6f7b27bc0 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 200 len: 1328 microversion: 2.1 time: 0.166406 Aug 23 10:41:35.504058 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 598/1228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:35 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 1328 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:35.738695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:35.743541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:35.797948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.805455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5116d7ef-e6c8-4e08-a97a-fb468a188092", "device": "/dev/xvdb"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:35.808084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:35.812581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.816629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.817697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.821737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.826239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.839132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.844021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.844872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.845849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:35.850100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:35.853956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:35.953630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.969073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.976357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:35.988542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2857b24a-f06e-4d7c-865c-e17cd5a52950 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.261973 Aug 23 10:41:35.989156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 631/1229] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:35 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:35.993605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:35.994165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:36.012930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.013442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.013888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.014625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.015088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.015599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.174676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:36.182444 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d77f4ac-bf93-4881-a887-f1a0f845c991 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.192326 Aug 23 10:41:36.183019 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 632/1230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:35 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:36.226646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:36.227263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:36.234038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.234531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.234982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.235689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.236153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.236586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.304506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:36.315908 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5443aa1e-2b94-4036-b8dd-c1bdadf68d31 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1265 microversion: 2.1 time: 0.093043 Aug 23 10:41:36.329325 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 633/1231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:36 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:36.343792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:36.344844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:36.351181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.351760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.352237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.353042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.353598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.354037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.437887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:36.448675 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc631e86-6c7a-4780-a91a-bdc7a9e6ba64 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1273 microversion: 2.1 time: 0.109313 Aug 23 10:41:36.449321 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 634/1232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:36 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:36.454420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:36.455037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:36.467505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.468005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.468446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.469204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.469674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.470168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.781216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:36.786157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9059da32-3be2-49d8-add5-adf1eb3af99d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "POST /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.984241 Aug 23 10:41:36.787248 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 599/1233] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Aug 23 10:41:35 2022] POST /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:41:36.795209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:36.796605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:36.797796 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73aaa6fe-9efd-4226-9efe-d0421dfb574b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.347362 Aug 23 10:41:36.798346 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 635/1234] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:36 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:36.800698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:36.804478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] [instance: 1054768a-2e3f-4247-ada1-fd6ab4fb46e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:36.813547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.817394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.821476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.823255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:36.824004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:36.824620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:36.852094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] HTTP exception thrown: Instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 could not be found. Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Request method failure captured: Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 HTTP/1.1 Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK4ToHNTd0LP2llmPvcwzXK0hVZCC18mTqR5PQpGrBi9ThiYVa6WiZh4yVndAIpgKhI511aHvzFrQ8BFmedv5HlLOgZ5QhSYUCuoTNBXqrVysFq8Q5M9CFLGSL6ZtmV-YI1gnvTeY0uiQHJ6p1dsIrfsZcTGt_KVPXqW9GokR0vrykc Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5dfc4e7196d34e709a5a869216864151 Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesAdminNegativeTest-1539773885 Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:41:36.854136 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5dfc4e7196d34e709a5a869216864151"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5dfc4e7196d34e709a5a869216864151", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5dfc4e7196d34e709a5a869216864151"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5dfc4e7196d34e709a5a869216864151"}]}] Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesAdminNegativeTest-1539773885 Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5dfc4e7196d34e709a5a869216864151 Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1539773885 Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesAdminNegativeTest-1539773885-project Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 92552bd027104cdc879b59446df626ce Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesAdminNegativeTest-1539773885-project Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 could not be found. Aug 23 10:41:36.856290 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1054768a-2e3f-4247-ada1-fd6ab4fb46e3'} Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 could not be found. Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:36.857205 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 could not be found. Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 could not be found. Aug 23 10:41:36.858763 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:41:36.860128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Returning 404 to user: Instance 1054768a-2e3f-4247-ada1-fd6ab4fb46e3 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:36.860128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bfb2186d-14db-41b1-a613-6b44a3af99a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3" status: 404 len: 111 microversion: 2.1 time: 0.069656 Aug 23 10:41:36.860569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 600/1235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:36 2022] GET /compute/v2.1/servers/1054768a-2e3f-4247-ada1-fd6ab4fb46e3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:36.874414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91e81811-270d-4af1-8743-00e69a87c0a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] Calling method '.version_select at 0x7fdc9cb41e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:36.896524 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91e81811-270d-4af1-8743-00e69a87c0a5 tempest-VolumesAdminNegativeTest-1539773885 tempest-VolumesAdminNegativeTest-1539773885-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627388710" status: 202 len: 0 microversion: 2.1 time: 0.030347 Aug 23 10:41:36.897222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 636/1236] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:41:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627388710 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:41:37.020065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:37.021826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:37.033028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.033879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.035746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.036661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.037477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.038102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.124799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:37.155085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:37.157203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:37.165373 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffee34b5-f501-480e-a11d-6dc46114a746 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.154449 Aug 23 10:41:37.179080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 601/1237] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:37 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:37.204202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:37.204851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:37.222112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.222635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.224000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.224769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.225233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.225673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.339407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:37.340107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:37.353245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.353751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.354277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.354958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.355417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.355878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.489046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:37.499997 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5dff33d-6815-4652-a23c-55aee73ba2f8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1271 microversion: 2.1 time: 0.165312 Aug 23 10:41:37.501118 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 602/1238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:37 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:37.506345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6ab93ad9-2442-4fef-9d49-b0575b0f98df req-800b55ed-459c-4e4e-93c1-b24eb55fd823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c55817a-7f2f-4d09-9f3e-d3428bbed107", "name": "network-vif-plugged", "status": "completed", "tag": "088689b9-d59f-42c1-9193-62fdab23084d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:37.520125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6ab93ad9-2442-4fef-9d49-b0575b0f98df req-800b55ed-459c-4e4e-93c1-b24eb55fd823 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.526387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6ab93ad9-2442-4fef-9d49-b0575b0f98df req-800b55ed-459c-4e4e-93c1-b24eb55fd823 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.527262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6ab93ad9-2442-4fef-9d49-b0575b0f98df req-800b55ed-459c-4e4e-93c1-b24eb55fd823 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.550024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6ab93ad9-2442-4fef-9d49-b0575b0f98df req-800b55ed-459c-4e4e-93c1-b24eb55fd823 service nova] Creating event network-vif-plugged:088689b9-d59f-42c1-9193-62fdab23084d for instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 on n-h2-847009-13 Aug 23 10:41:37.570683 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6ab93ad9-2442-4fef-9d49-b0575b0f98df req-800b55ed-459c-4e4e-93c1-b24eb55fd823 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068075 Aug 23 10:41:37.574032 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 603/1239] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:37.583749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:37.585903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:37.613212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.613853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.614393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.615452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.620018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.620018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.637892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:37.649973 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c246d85-844f-4824-a477-29f729ae9a9c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.450303 Aug 23 10:41:37.655917 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 637/1240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:37 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:37.873599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:37.884323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:37.884323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:37.887201 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8256e4e3-e321-4a1b-9d90-bef55308a1bd tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1281 microversion: 2.1 time: 0.306116 Aug 23 10:41:37.892145 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 604/1241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:37 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1281 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:37.913711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.917689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.918175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:37.922073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:37.926229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:37.926886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:38.194457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:38.195550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:38.210158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:38.213823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:38.215036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:38.216733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:38.222556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:38.223512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:38.373897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:38.376502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:38.394643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:38.399198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:38.411554 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc58f5fe-125d-4cbb-8684-6b0058508c5d tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.221983 Aug 23 10:41:38.413098 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 605/1242] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:38 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:38.488280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:38.499330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:38.503339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:38.506602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eea307cd-6ac1-49cb-a323-5da66f2f28ec tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.626937 Aug 23 10:41:38.513531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 638/1243] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:37 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:38.526114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:38.526989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:38.541295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:38.543192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:38.544582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:38.545228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:38.546123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:38.546771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:38.547364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:38.671768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:38.672393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:38.687806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:38.688510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:38.690143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:38.691238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:38.692994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:38.694572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.155171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:39.167543 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc07325e-00ab-486a-bc57-2be02a2ebd5c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1308 microversion: 2.1 time: 0.499817 Aug 23 10:41:39.169945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 639/1244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:38 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1308 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:39.187884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:39.189766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:39.200366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.201183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.202098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.203004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.203628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.204905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.373848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:39.389095 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c799fcf7-90c6-430c-a09f-e0f249fd7d1c tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1279 microversion: 2.1 time: 0.217749 Aug 23 10:41:39.390151 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 640/1245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:39 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1279 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:39.444398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:39.450881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:39.455957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:39.460788 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ef82066-c9de-4681-b000-667b177a6b98 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.938369 Aug 23 10:41:39.476795 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 606/1246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:38 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:39.477003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.477003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.477003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.477003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.477341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.477341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.524405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:39.538300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:39.539073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:39.551559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.552076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.552515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.553306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.553773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.554204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.592202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:39.602260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:39.604123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:39.615852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f29d25e-379e-4eb0-a1b1-7fef35d85a59 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.179772 Aug 23 10:41:39.616454 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 641/1247] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:39 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:39.850486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6ad994ac-ba7b-4a2c-826e-662ffb946769 req-d1153bc4-33f8-4c44-9a2d-9f3900ce72c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:39.868815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ad994ac-ba7b-4a2c-826e-662ffb946769 req-d1153bc4-33f8-4c44-9a2d-9f3900ce72c9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:39.869544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ad994ac-ba7b-4a2c-826e-662ffb946769 req-d1153bc4-33f8-4c44-9a2d-9f3900ce72c9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:39.870632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ad994ac-ba7b-4a2c-826e-662ffb946769 req-d1153bc4-33f8-4c44-9a2d-9f3900ce72c9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:39.889807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6ad994ac-ba7b-4a2c-826e-662ffb946769 req-d1153bc4-33f8-4c44-9a2d-9f3900ce72c9 service nova] Creating event network-changed:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h2-847009-13 Aug 23 10:41:39.898736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6ad994ac-ba7b-4a2c-826e-662ffb946769 req-d1153bc4-33f8-4c44-9a2d-9f3900ce72c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050978 Aug 23 10:41:39.900309 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 642/1248] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:40.049137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:40.062652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:40.066740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:40.071135 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d63fa8c-2dd9-4fff-b4e9-7890c1fbbc0a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.535589 Aug 23 10:41:40.088662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 607/1249] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:39 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:40.191195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:40.192073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:40.207999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.208758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.209485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:40.210578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.211264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.211908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:40.409952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:40.410750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:40.417490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.418892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.419707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:40.420804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.421480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.422185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:40.575473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:40.585401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e61d64fa-fbe3-4efe-9da2-6baabe8e0569 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1487 microversion: 2.1 time: 0.399113 Aug 23 10:41:40.605507 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 643/1250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:40 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1487 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:40.614068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:40.615724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:40.626018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.626961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.627634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:40.629178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.629963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.630721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:40.838139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:40.855107 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73fcdf0f-7177-40ad-a166-60e4e7456c75 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.449056 Aug 23 10:41:40.857683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 608/1251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:40 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:40.863179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73e47ac3-2044-431f-b5d7-c39e22462446 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:40.882677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73e47ac3-2044-431f-b5d7-c39e22462446 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:40.888099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73e47ac3-2044-431f-b5d7-c39e22462446 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:40.889322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73e47ac3-2044-431f-b5d7-c39e22462446 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.017762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73e47ac3-2044-431f-b5d7-c39e22462446 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 10:41:41.036169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.049139 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-099cd066-4e85-4fdb-985d-2ab46ff2fbe4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.441849 Aug 23 10:41:41.051155 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 644/1252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:40 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:41.067427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:41.068469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:41.084105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.086513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.087509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.088862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.090966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.093390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.128808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73e47ac3-2044-431f-b5d7-c39e22462446 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107/action" status: 202 len: 0 microversion: 2.1 time: 0.269284 Aug 23 10:41:41.133972 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 609/1253] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:41:40 2022] POST /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:41:41.146185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:41.147967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:41.169359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.170629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.171284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.174769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.176086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.177140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.257045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.274382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.276555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.284434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ace2695e-b918-4f29-b2e3-a06562bd6500 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.230214 Aug 23 10:41:41.300008 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 645/1254] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:41 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:41.313679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:41.314533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:41.325060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.325728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.326351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.327244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.327807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.328581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.620878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.638210 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7829def-66dd-4211-8890-dc42de650f23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.328733 Aug 23 10:41:41.638973 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 646/1255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:41 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:41.751037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:41.857505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.868184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.870093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:41.872073 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4a8f503-972b-4e65-a921-f399b58e13d5 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.735502 Aug 23 10:41:41.878956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:41.879926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:41.889314 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 610/1256] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:41 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:41.891622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.892389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.893114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:41.894105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:41.894820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:41.895488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.071397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:42.072427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:42.084859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.085514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.086107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.087067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.088295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.091808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.299513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:42.314052 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92b34cac-1d6a-41fa-a470-12eb1908e40e tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.439452 Aug 23 10:41:42.314638 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 647/1257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:41 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:42.319039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9e9f40d0-fb99-423b-ad30-d898e2a20d90 req-68eaa4e8-f22a-4997-b983-2eab26678f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4c9924-aa06-4991-b84a-4373f25bbf38", "tag": "5f282edd-c53f-4f8b-96cb-0f7435f36c3c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:42.334198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9e9f40d0-fb99-423b-ad30-d898e2a20d90 req-68eaa4e8-f22a-4997-b983-2eab26678f8c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.335375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9e9f40d0-fb99-423b-ad30-d898e2a20d90 req-68eaa4e8-f22a-4997-b983-2eab26678f8c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.335825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9e9f40d0-fb99-423b-ad30-d898e2a20d90 req-68eaa4e8-f22a-4997-b983-2eab26678f8c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.352468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9e9f40d0-fb99-423b-ad30-d898e2a20d90 req-68eaa4e8-f22a-4997-b983-2eab26678f8c service nova] Creating event network-changed:5f282edd-c53f-4f8b-96cb-0f7435f36c3c for instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 on n-h2-847009-13 Aug 23 10:41:42.357977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9e9f40d0-fb99-423b-ad30-d898e2a20d90 req-68eaa4e8-f22a-4997-b983-2eab26678f8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042220 Aug 23 10:41:42.358929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 648/1258] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:42.364147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:42.364866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:42.370572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:42.373401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.374370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.374370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.375018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.375403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:42.375525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.375882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.386004 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-619afc99-36da-45b1-9da2-2645176257d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.317897 Aug 23 10:41:42.400999 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 611/1259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:42 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:42.460867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:42.470312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:42.471889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:42.476931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13407897-e80b-48e3-a6c3-09832c2a197e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.116673 Aug 23 10:41:42.481104 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 649/1260] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:42 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:42.659555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:42.660183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:42.669482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.670762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.671440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.672371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.673161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.673993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.912014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:42.912633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:42.922088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.922667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.923169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.924006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:42.924677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:42.926031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:42.964055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:42.977651 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9829948a-e1c2-476d-9c3a-ac8ae8a97fe2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.321878 Aug 23 10:41:42.979986 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 612/1261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:42 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:43.193628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.205675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.207399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.208642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e590d6b-f9ac-4af6-8638-9176c1c166d1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.302001 Aug 23 10:41:43.209627 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 650/1262] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:42 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:43.337319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:43.338186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:43.346998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:43.347739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:43.348381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:43.349254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:43.350022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:43.350707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:43.412335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:43.413685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:43.422932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:43.423711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:43.424521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:43.425502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:43.426189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:43.426872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:43.589731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.599364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41c2ceca-49e0-4137-a04e-fb20a2cc7f6e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.192543 Aug 23 10:41:43.600379 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 651/1263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:43 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:43.605345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:43.606609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:43.617552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:43.618056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:43.618722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:43.619759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:43.620293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:43.620842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:43.709944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.720314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.722243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.728306 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5455b414-7fd6-46c3-84af-378bfe01dc6a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.126741 Aug 23 10:41:43.729152 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 652/1264] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:43 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:43.990756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:43.996929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:44.004362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:44.005156 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d4dae39-ad2a-452b-b4a2-7dc0ea9b8f3a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.673223 Aug 23 10:41:44.005367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:44.016466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 613/1265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:43 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:44.035008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:44.036020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:44.036915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:44.038201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:44.039104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:44.039984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:44.141413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:44.242128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:44.243920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:44.253412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:44.254304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:44.254951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:44.255919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:44.256544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:44.257297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:44.717617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:44.739003 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd892223-3b93-4fbd-ad8c-d3323228229e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.742897 Aug 23 10:41:44.740329 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 653/1266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:43 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:44.756755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:44.757774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:44.768279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:44.769668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:44.770338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:44.771246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:44.771974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:44.773124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:45.100688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.110256 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ac40fc6-1f3f-4c3d-a614-ba384136053d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.368144 Aug 23 10:41:45.112814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.125382 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 654/1267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:44 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:45.131603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:45.132475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:45.140294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:45.141117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:45.141724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:45.142927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:45.143558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:45.144284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:45.157546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.160501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.162372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5f052d6-6869-454e-81d3-6ba4f4c7027e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.930578 Aug 23 10:41:45.168825 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 614/1268] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:44 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:45.178576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:45.179455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:45.195952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:45.196459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:45.196946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:45.197681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:45.198142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:45.198578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:45.260306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.272238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.274045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.282980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0d762dcc-d6c6-4d95-a6c2-d702a4eb15b3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.155034 Aug 23 10:41:45.283652 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 655/1269] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:45 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:45.399787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:45.412948 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67d6805d-940b-41d8-b308-6c49fd5fe10f tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.242527 Aug 23 10:41:45.415492 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 615/1270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:45 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:45.760284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:45.761547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:45.776993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:45.778066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:45.778731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:45.779694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:45.780317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:45.780940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.071586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.080776 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15d8308f-cb40-4128-bc8e-a44b538c7ff3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.324437 Aug 23 10:41:46.092304 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 656/1271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:45 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:46.138135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:46.139355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:46.146511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.147016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.147678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.148560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.149200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.149788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.190045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:46.190665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:46.197007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.197498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.197936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.201617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.202185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.202734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.327692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.341623 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04c0d4b7-bb43-425d-87e5-33b55d892295 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.207960 Aug 23 10:41:46.344698 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 616/1272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:46 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:46.350817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:46.351767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:46.360500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.361466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.362122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.363844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.365231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.365832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.452758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.462457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.464537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.472319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d739b9f-0123-47d3-9e7f-7c65a426f49e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.125692 Aug 23 10:41:46.488773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 617/1273] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:46 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:46.493520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:46.494164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:46.514366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.514878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.515320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.524778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:46.525586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:46.526033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:46.632850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.647804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.649871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.651313 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7aba17d-799f-4155-9acd-817b12aa5705 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.465173 Aug 23 10:41:46.653284 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 657/1274] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:46 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:46.716017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:46.724758 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30359f92-c334-4f35-86a9-5c2b3c9a84ef tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.250284 Aug 23 10:41:46.725957 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 618/1275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:46 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:47.102803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:47.103513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:47.108370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:47.112876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.113780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.113904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.114688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.115217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.115893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.363664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:47.364466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:47.371590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.372211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.372730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.373845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.374377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.374876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.375574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:47.384072 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6fd2a406-2591-43a4-a737-d59fa65043a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.285141 Aug 23 10:41:47.384661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 658/1276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:47 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:47.500711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:47.501520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:47.507941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.509879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.509879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.509879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.510445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.510942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.534499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:47.591412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:47.599761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:47.601228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:47.606929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f23d8d6-047a-4edc-a780-06bd6e46f2bd tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.113214 Aug 23 10:41:47.607705 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 659/1277] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:47 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:47.614751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:47.623985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-459a1b82-d58c-4cb9-afba-f70ee62e0ace tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.264206 Aug 23 10:41:47.624784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 619/1278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:47 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:47.677955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:47.678563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:47.686385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.687132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.687741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.688449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.689067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.689543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.745913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:47.759647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:47.767941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.768766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.769385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.770422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:47.771059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:47.771659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:47.960944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:47.970897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-541103e6-71d8-4707-9b88-ebb1e57dfc15 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.228742 Aug 23 10:41:47.984508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 620/1279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:47 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:48.041385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.051413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.053351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.054718 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bf6e342c-9d6c-4d52-bbc8-7e1503376e0d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.382900 Aug 23 10:41:48.071477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 660/1280] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:47 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:48.128101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4d499d5a-a2a4-49ff-8129-3199f8220e44 req-765cee3c-e130-4b3f-95cd-263b3c8dc5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "name": "network-vif-plugged", "status": "completed", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:48.139475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4d499d5a-a2a4-49ff-8129-3199f8220e44 req-765cee3c-e130-4b3f-95cd-263b3c8dc5ef service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.139876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4d499d5a-a2a4-49ff-8129-3199f8220e44 req-765cee3c-e130-4b3f-95cd-263b3c8dc5ef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.140311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4d499d5a-a2a4-49ff-8129-3199f8220e44 req-765cee3c-e130-4b3f-95cd-263b3c8dc5ef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.156443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4d499d5a-a2a4-49ff-8129-3199f8220e44 req-765cee3c-e130-4b3f-95cd-263b3c8dc5ef service nova] Creating event network-vif-plugged:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h2-847009-13 Aug 23 10:41:48.161571 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4d499d5a-a2a4-49ff-8129-3199f8220e44 req-765cee3c-e130-4b3f-95cd-263b3c8dc5ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037184 Aug 23 10:41:48.162496 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 621/1281] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:48.406862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:48.408642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:48.414968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.415465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.415910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.416617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.417112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.417547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.608664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.622524 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a87d003-6d55-407a-a6fb-d7f54f126614 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.219738 Aug 23 10:41:48.623814 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 661/1282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:48 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:48.635754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:48.636464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:48.645885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.646300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.646922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:48.647120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.647535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:48.648373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.649034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.649724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.655056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.655542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.655855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:48.656409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.657169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:48.657636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:48.658065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:48.758344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.770139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.771950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.782143 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef934ced-2261-4017-a19e-9c67ff227536 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.150524 Aug 23 10:41:48.786780 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 622/1283] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:48 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:48.849781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:48.861394 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43796644-24a5-4a2b-a038-79fb8527f790 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.216953 Aug 23 10:41:48.862383 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 662/1284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:48 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:48.992918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:48.993549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:49.000674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.001324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.001937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.002689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.007745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.007890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.079109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:49.079995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:49.086590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.086972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.087397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.088096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.088589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.088999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.160207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.169769 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-526f63a6-00ca-4016-a537-78f50eb8f376 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.181237 Aug 23 10:41:49.170447 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 623/1285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:48 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:49.295967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.306236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.307815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.309310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03a53af5-b74e-45fa-8ee6-107867558620 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.233944 Aug 23 10:41:49.309921 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 663/1286] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:49 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:49.646837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:49.647470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:49.654800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.655297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.655752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.656457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.657031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.657462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.797266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.807056 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02c6d895-a334-45cd-8284-66093a61cbbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.164272 Aug 23 10:41:49.807205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:49.807815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:49.809407 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 624/1287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:49 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:49.815380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.815873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.816310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.817046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.817508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.817930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.883478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:49.884278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:49.891717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.892397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.893096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.894209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:49.894616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.894803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:49.895292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:49.904917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.906549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:49.912508 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a7f9936d-d15c-4cd7-8b3e-31861e8222a3 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1447 microversion: 2.75 time: 0.108635 Aug 23 10:41:49.912903 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 664/1288] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:49 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:50.048869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:50.049834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:50.057890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.058759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.059399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.060300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.060961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.061553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.085114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:50.099827 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee389b3b-8427-4027-848d-8cf591c14fd4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1313 microversion: 2.1 time: 0.217356 Aug 23 10:41:50.099827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 625/1289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:49 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:50.201191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:50.207042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:50.219651 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93005cf9-b333-48a5-897e-a93c19529f0f tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1859 microversion: 2.1 time: 0.174200 Aug 23 10:41:50.222199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.222969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.223528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.224397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.224993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.227156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.236733 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 665/1290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:50 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1859 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:50.242830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-847009-13", "block_migration": true, "disk_over_commit": false}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:50.245788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:50.255617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.256461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.257161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.258131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.258940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.259671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.294440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lazy-loading 'flavor' on Instance uuid 4b74d026-1d35-4393-95b4-2ac77f28b3d1 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:50.334624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Going to try to live migrate instance to n-h2-847009-13 {{(pid=128859) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:41:50.447011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:50.455212 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11f2de08-7a06-4983-8209-a73c043b47ea tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.268186 Aug 23 10:41:50.456479 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 626/1291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:50 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:50.466639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:50.467495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:50.475797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.476296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.476968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.477860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.478586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.479201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.693685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:50.703607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:50.705137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:50.706332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d100485d-3ef1-4afe-adae-d7f68da0f7c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.248678 Aug 23 10:41:50.706841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 627/1292] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:50 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:50.847823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d38369f0-6c78-44b5-8528-eefdd41ab984 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:50.862457 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d38369f0-6c78-44b5-8528-eefdd41ab984 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.154153 Aug 23 10:41:50.863151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 628/1293] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:50.868085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:50.869108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:50.878090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.879071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.879937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:50.881288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:50.881987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:50.882608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.045277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.053109 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15e67f97-553d-43ad-bd24-44206483c212 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.188725 Aug 23 10:41:51.053688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 629/1294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:50 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.058292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7bf4d8c-4e6a-4416-9b77-623ccdee37af tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.079719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7bf4d8c-4e6a-4416-9b77-623ccdee37af tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.024910 Aug 23 10:41:51.080287 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 630/1295] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.085125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.085849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.093089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.093595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.094171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.094949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.095415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.095851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.162406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.171056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.172592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.177519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2880e293-9df6-4483-849c-882d97a1dafb tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1453 microversion: 2.75 time: 0.096256 Aug 23 10:41:51.178088 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 631/1296] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:51.184869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3f616c1-2483-496f-ad27-835f30478403 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.190908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3f616c1-2483-496f-ad27-835f30478403 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011830 Aug 23 10:41:51.198441 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 632/1297] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:51.198441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.198441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.203280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.203772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.204210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.204939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.205396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.205819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.349420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.357953 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b20ac3c-8f7c-4b4c-859a-314f6789dfd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1462 microversion: 2.1 time: 0.165569 Aug 23 10:41:51.358528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 633/1298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1462 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.363183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddcf5fa2-c5ce-4df8-afa6-e2bf25b23a48 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.372576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddcf5fa2-c5ce-4df8-afa6-e2bf25b23a48 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012774 Aug 23 10:41:51.376362 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 634/1299] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:51.381086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.381719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.389076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.389603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.390053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.390754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.391217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.391647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.489163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92dbaad9-5834-48e1-bad9-1dc078a4fe57 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/action" status: 202 len: 0 microversion: 2.1 time: 1.250610 Aug 23 10:41:51.492978 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 666/1300] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:41:50 2022] POST /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/action => generated 0 bytes in 1255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:41:51.497803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48f06dc9-c214-49bd-a302-5e256a530894 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.524917 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad0eb0db-6878-431b-8beb-57250d1f688f tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1615 microversion: 2.1 time: 0.147264 Aug 23 10:41:51.525478 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 635/1301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.528905 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48f06dc9-c214-49bd-a302-5e256a530894 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.031590 Aug 23 10:41:51.539608 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 667/1302] 10.222.0.78 () {58 vars in 1165 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.539779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.539779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.539971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.539971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.540152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.540152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.540152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.540152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.540525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.540525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.544175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.544669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.545170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.545898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.546381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.546812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.678117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.686079 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18cf580d-8163-4f58-9bf0-e73e623f2c07 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.159521 Aug 23 10:41:51.686668 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 636/1303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.687397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.695666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de982d66-4e72-453f-839a-3feb0ac34643 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.165196 Aug 23 10:41:51.696214 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 668/1304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:51.698451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:51.700205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.702101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59d65076-65e2-4622-a8e9-73dd806babc1 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.706315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.706959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.707506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.708343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.708907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.709496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.710329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59d65076-65e2-4622-a8e9-73dd806babc1 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012418 Aug 23 10:41:51.710885 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 669/1305] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:51.723138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88327c09-df0b-4b62-8a5b-91b3e3a972d6 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.738367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ccce31992b2b48e488ef42ca535f468a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f01fc09301d47359592d4df1ed9c962', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.738959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] flavor_id is None. Assuming migration. {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 10:41:51.739413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 10:41:51.747581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88327c09-df0b-4b62-8a5b-91b3e3a972d6 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.027960 Aug 23 10:41:51.748421 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 670/1306] 10.222.0.78 () {58 vars in 1169 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:51.753101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.753722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:51.761147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.762199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.762674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.763407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:51.763875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:51.764311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:51.955467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.966469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.968919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:51.969588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f74a315-e416-4ccf-aee6-1e0ee0299b45 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.220050 Aug 23 10:41:51.970874 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 671/1307] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:51.981926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d4b171d-69fd-4b28-af1b-d5300ae34746 tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76/action" status: 202 len: 0 microversion: 2.1 time: 0.286631 Aug 23 10:41:51.982544 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 637/1308] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:41:51 2022] POST /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:41:51.987053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e976b1f-229b-419a-ad69-e7352eec1b91 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.994692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:51.995845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:52.005265 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e976b1f-229b-419a-ad69-e7352eec1b91 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.032983 Aug 23 10:41:52.005955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 672/1309] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:52.012441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.014704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.014704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.014704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.014704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.015249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.020967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61b5fcfd-53d1-4d04-83bf-977f3cf2fd7c tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.030871 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61b5fcfd-53d1-4d04-83bf-977f3cf2fd7c tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014406 Aug 23 10:41:52.031453 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 673/1310] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:52.042672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f5e6fec-30d8-4548-a1ca-81a082e26f9a tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.079926 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f5e6fec-30d8-4548-a1ca-81a082e26f9a tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.040829 Aug 23 10:41:52.080518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 674/1311] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:52.085189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.085740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:52.095784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.096284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.096728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.097470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.097930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.098360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.187312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:52.198419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0cc3a47f-4d4b-48b4-8200-706cfd4acefa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1471 microversion: 2.1 time: 0.209209 Aug 23 10:41:52.199508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 638/1312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:51 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:52.205349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7d4e011-33b7-4e8c-b8f2-d6da4000aba9 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.217409 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7d4e011-33b7-4e8c-b8f2-d6da4000aba9 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015582 Aug 23 10:41:52.220938 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 639/1313] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:52.223196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.223663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:52.229787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.231149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.231982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.232188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.232614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.233094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.259290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:52.268698 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-427d3189-7fa9-4c86-8347-66563667d8b0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.187100 Aug 23 10:41:52.269429 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 675/1314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:52.275864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b421a53e-945a-4116-9345-2520530588e5 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.296227 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b421a53e-945a-4116-9345-2520530588e5 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.025504 Aug 23 10:41:52.297311 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 676/1315] 10.222.0.78 () {58 vars in 1144 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:52.303113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:52.311898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81a59842-566d-48e2-8e40-d65fa5236163 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.313243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:52.314803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:52.321039 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81a59842-566d-48e2-8e40-d65fa5236163 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013240 Aug 23 10:41:52.322022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 677/1316] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:52.325929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-465d43d8-13f0-4a89-8cd6-e0c4b24ce332 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1453 microversion: 2.75 time: 0.106550 Aug 23 10:41:52.334282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 640/1317] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:52.337095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-147630a6-137f-4262-a3a5-7cda43b01811 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.356278 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-147630a6-137f-4262-a3a5-7cda43b01811 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.025368 Aug 23 10:41:52.357291 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 678/1318] 10.222.0.78 () {58 vars in 1148 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:52.372081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb18c342-66d2-44a0-b1d7-5805160edd72 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.385080 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb18c342-66d2-44a0-b1d7-5805160edd72 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.016860 Aug 23 10:41:52.385822 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 641/1319] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:52.401390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-066791ec-87e7-424e-9da9-8954e1b9dd0f tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.410379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-066791ec-87e7-424e-9da9-8954e1b9dd0f tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014542 Aug 23 10:41:52.411090 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 679/1320] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:52.423934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf6ebffb-40fc-44e7-8dda-c4c7552bd88c tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.462473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf6ebffb-40fc-44e7-8dda-c4c7552bd88c tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.043272 Aug 23 10:41:52.463242 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 642/1321] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:52.476829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-acda43c8-d2d4-438a-9f8b-7e448c72a378 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.502584 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-acda43c8-d2d4-438a-9f8b-7e448c72a378 tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029508 Aug 23 10:41:52.503539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 680/1322] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:52.513969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9ad2279d-e874-4893-aed7-c19e20299e0a req-a2562c15-b83f-42e9-86e3-3a5a971d3fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4c9924-aa06-4991-b84a-4373f25bbf38", "name": "network-vif-plugged", "status": "completed", "tag": "5f282edd-c53f-4f8b-96cb-0f7435f36c3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:52.523149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e957c8d-bd55-4f3f-bcd2-234e0d4da6bf tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.525540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9ad2279d-e874-4893-aed7-c19e20299e0a req-a2562c15-b83f-42e9-86e3-3a5a971d3fd8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.526129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9ad2279d-e874-4893-aed7-c19e20299e0a req-a2562c15-b83f-42e9-86e3-3a5a971d3fd8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.526634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9ad2279d-e874-4893-aed7-c19e20299e0a req-a2562c15-b83f-42e9-86e3-3a5a971d3fd8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.535442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e957c8d-bd55-4f3f-bcd2-234e0d4da6bf tempest-FlavorsV2TestJSON-2129722534 tempest-FlavorsV2TestJSON-2129722534-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017823 Aug 23 10:41:52.536198 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 681/1323] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:41:52.543090 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9ad2279d-e874-4893-aed7-c19e20299e0a req-a2562c15-b83f-42e9-86e3-3a5a971d3fd8 service nova] Creating event network-vif-plugged:5f282edd-c53f-4f8b-96cb-0f7435f36c3c for instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 on n-h2-847009-13 Aug 23 10:41:52.547994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9ad2279d-e874-4893-aed7-c19e20299e0a req-a2562c15-b83f-42e9-86e3-3a5a971d3fd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038158 Aug 23 10:41:52.548956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 643/1324] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:41:52.706800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.707913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:52.717599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.718294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.718975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.719443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.720405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:52.720729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.721484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.722019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.731531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.732390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.732972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.733866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:52.734532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:52.735131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:52.910395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:52.916152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:52.924342 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1fd80ba5-c948-4846-b15f-0ef627643f92 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.210850 Aug 23 10:41:52.925616 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 644/1325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:52.995734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:52.997097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:53.004899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.005786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.006230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.007425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.008051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.008651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.204825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.216602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2db0e07b-0409-4b92-a296-bd9119bbf94a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.513730 Aug 23 10:41:53.217501 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 682/1326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:41:53.222668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:53.223456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:53.234885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.235401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.236068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.236904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.237369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.237801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.359095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.370551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.372788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.374221 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a743bf07-47ed-4f57-92b7-c2152e72f918 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.382545 Aug 23 10:41:53.374894 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 645/1327] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:52 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:53.380080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:53.381042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:53.390030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.390898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.391664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.392567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.393065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.393500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.407079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.430886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a068efb8-2a4a-462b-b8a6-d1c677711a60 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1471 microversion: 2.1 time: 0.211993 Aug 23 10:41:53.435745 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 683/1328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:53 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:53.453089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:53.453836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:53.461357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.462083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.462537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.463255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.463723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.464184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.564558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.573216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf91257a-ccd4-4c08-bd4c-bfe68c37f53d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.197086 Aug 23 10:41:53.573793 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 646/1329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:53 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:53.584807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.596361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.597945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:53.605318 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aea5f3d4-348a-400c-8f04-7bb6974ce465 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1453 microversion: 2.75 time: 0.167312 Aug 23 10:41:53.606942 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 684/1330] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:53 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:53.949022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:53.949520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:53.956376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.956958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.961484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:53.961484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:53.961484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:53.961484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.124060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:54.135863 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79d45083-bc98-4791-8df6-7cb87ffce033 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.191514 Aug 23 10:41:54.137115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 647/1331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:53 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:54.238781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:54.239620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:54.248667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:54.249542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:54.255028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.255897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.256201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.256531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.257204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.257435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.258273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.258636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.258874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.259429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.259556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.260127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.431666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:54.446416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2abcd99-3a2a-467f-8247-0c315fb1eaf4 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 2421 microversion: 2.25 time: 0.203050 Aug 23 10:41:54.446997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 648/1332] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:54 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 2421 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:41:54.452698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:54.453346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:54.459255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.459975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.460423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.461155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.461619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.462048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.501520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:54.509666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0997bcc-35f2-42b5-bc61-3e6150bd6af4 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1321 microversion: 2.1 time: 0.275568 Aug 23 10:41:54.523673 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 685/1333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:54 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:54.529674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:54.530291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:54.536459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.537002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.537440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.538143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.538601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.539025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.544358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:54.671969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:54.685858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:54.687396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:54.688610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e1e220a-8b63-4a8c-85a6-d30619e976a9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.240314 Aug 23 10:41:54.689211 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 649/1334] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:54 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:54.693814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-13", "block_migration": "auto"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:41:54.696284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:54.699921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:54.704149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.704916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.705352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.706242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.707259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.707865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.734722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'flavor' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:41:54.748229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Going to try to live migrate instance to n-h1-847009-13 {{(pid=128860) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:41:54.757436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:54.768481 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47189a2e-8c0f-477c-abc8-a94feed1d978 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1471 microversion: 2.1 time: 0.243272 Aug 23 10:41:54.769093 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 686/1335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:54 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:54.793932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:54.794563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:54.812329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.814344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.814852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:54.817138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:54.819179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:54.819921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.024856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.037067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adf73e89-84b2-4c1f-903a-63c8741b3dc7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.266671 Aug 23 10:41:55.038132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 687/1336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:54 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:55.045280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:55.051711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:55.060061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.061173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.061944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.062690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.063159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.063590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.142698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.153629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.155579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.161344 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d77c5f2-efd9-4bae-8926-c7306717121e tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1453 microversion: 2.75 time: 0.121986 Aug 23 10:41:55.162036 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 688/1337] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:55 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:55.181801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:55.182711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:55.188577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.189112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.189564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.190273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.190740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.191172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.338493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.348632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef5bc574-18ba-4d5c-a381-44e84d54a2dc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.185301 Aug 23 10:41:55.349244 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 689/1338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:55 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:55.531809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:55.532474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:55.538884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.539352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.540095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.540883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.541405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.542024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.704989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.714378 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c1644389-9e08-448d-96bc-74950f5880b5 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1471 microversion: 2.1 time: 0.186988 Aug 23 10:41:55.730938 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 690/1339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:55 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:55.737416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:55.738050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:55.748509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.749123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.749616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.750439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:55.750906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:55.751372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:55.963254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.967591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.969141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:55.970326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34acf2e5-9b6a-487a-ba59-676cd320b4f4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.237844 Aug 23 10:41:55.986829 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 691/1340] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:55 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:55.993360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:55.994616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:56.003184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.003879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.004326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.005076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.005547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.005981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.029837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Request method failure captured: Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38/diagnostics HTTP/1.1 Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK7b_5oH3BbG7fUMxYZf2L3hucRfvcTd22WBQEIrVzj6_tRhwbGdV62xFPPL1ezO3Lr4Cdt5eKTSi_ZfY1DUy_uUqBrXmmHZtn013ZXoco1V3THl0Q8egHIZxhT4ms_8fJBK8KPW8mrMA9xlUhRKLIq0SRoDcvxXFPGcf6J4g8-Fibs Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: e5fe64230f9a4b0cadbc81a71ed5adf7 Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-45544619 Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:41:56.031762 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e5fe64230f9a4b0cadbc81a71ed5adf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e5fe64230f9a4b0cadbc81a71ed5adf7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5fe64230f9a4b0cadbc81a71ed5adf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5fe64230f9a4b0cadbc81a71ed5adf7"}]}] Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-45544619 Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: e5fe64230f9a4b0cadbc81a71ed5adf7 Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-45544619 Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiagnosticsNegativeTest-45544619-project Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 675a9a61246a4b1e9b1a8e01b35e2054 Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-45544619-project Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:41:56.033390 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '9e4c9924-aa06-4991-b84a-4373f25bbf38'} Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:41:56.034272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:41:56.035822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:41:56.037271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f3fe772-430d-48c4-b9b4-a7270b5a817a tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.045283 Aug 23 10:41:56.037271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 692/1341] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:41:55 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38/diagnostics => generated 117 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:41:56.039165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:56.041381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:56.047523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.048043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.048489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.049234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.049702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.050137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.365577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:56.387918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb0bb307-d743-4e74-89dc-43a21091c551 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1471 microversion: 2.1 time: 0.351877 Aug 23 10:41:56.391580 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 693/1342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:56 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:56.398121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:56.398811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:56.408481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.409187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.409795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.410714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.411355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.411952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.442763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:41:56.560308 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0918590d-44ca-46e5-8986-227b82efd9a1 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 204 len: 0 microversion: 2.1 time: 0.166359 Aug 23 10:41:56.561583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 694/1343] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:41:56 2022] DELETE /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:41:56.571562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:56.572280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:56.580359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.581266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.581947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.582742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.583225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.583650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.748214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:56.766768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33cbf110-414d-432a-8ff4-de3556031ed1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.200328 Aug 23 10:41:56.767626 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 695/1344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:56 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:56.778656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:56.780295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:56.787632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.788798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.789508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.791156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.792193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.793972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.898310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:56.914331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:56.916267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:56.924836 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1d838321-b224-480a-baeb-7626daffb5d4 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1453 microversion: 2.75 time: 0.155669 Aug 23 10:41:56.926052 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 696/1345] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:56 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:56.936224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:56.937087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:56.945009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.945868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.948025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:56.949038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:56.949913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:56.950523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.156550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:57.166583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f1d6e38e-3667-4548-ae2a-23a611ed54f6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.238506 Aug 23 10:41:57.167167 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 697/1346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:56 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:57.193501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:57.194126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:57.202515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.203132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.203575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.204417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.204952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.205636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.364297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:57.375133 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de23849e-c8ea-4062-aace-4613b683c653 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1477 microversion: 2.1 time: 0.205502 Aug 23 10:41:57.376040 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 698/1347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:57 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1477 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:57.382359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:57.384590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:57.392627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:57.394682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.395367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.396974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.398010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.398476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.398907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.635371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:57.654010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:57.655997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:57.657286 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0df31c5e-2186-4d6a-b4f7-3c2f1ab5e098 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.279679 Aug 23 10:41:57.657857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 699/1348] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:57 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:57.663043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:57.663806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:57.671074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.671578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.672018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.672752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.673363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.673805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.851477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:57.862530 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adf9aaa4-5f4d-4c98-9359-963a699963b8 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1471 microversion: 2.1 time: 0.203180 Aug 23 10:41:57.876763 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 700/1349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:57 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:57.876763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:57.876763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:57.884334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.884864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.885308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.886026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:57.887042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:57.887917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:57.913208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:41:58.104205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:58.113761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5040b181-f5e1-4f7b-b74a-c3f3605e22ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.247840 Aug 23 10:41:58.114547 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 701/1350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:57 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:58.130900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:58.131821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:58.139549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:58.142114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:58.142783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:58.143680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:58.147735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:58.148394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:58.259194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:58.268849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:58.270365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:58.281279 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ce834c5-d9b9-4e6a-af48-196bcc945e6b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1453 microversion: 2.75 time: 0.158144 Aug 23 10:41:58.282674 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 702/1351] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:58 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:58.288845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:58.289940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:58.297345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:58.298217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:58.298892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:58.299841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:58.303061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:58.303925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:58.478280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:58.491659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66ace1a9-4f96-4b18-9f79-cf1cd06798e9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.207653 Aug 23 10:41:58.507836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 703/1352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:58 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:58.513625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:58.514448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:58.524446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:58.526032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:58.527435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:58.529666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:58.530194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:58.530644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:58.970576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:58.987357 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b22bbd6-2390-4c91-91ae-418b9f0c9ee7 tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1477 microversion: 2.1 time: 0.478102 Aug 23 10:41:58.987951 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 704/1353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:58 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:41:59.003675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:59.004296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:59.012454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:59.013105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:59.013550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:59.014337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:59.014959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:59.015402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:59.483706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:59.506726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:59.511008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:41:59.515725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d153e50-51f2-4972-bf7b-11928f2fec9f tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.525344 Aug 23 10:41:59.516700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 705/1354] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:41:58 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:41:59.526362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:41:59.527478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:41:59.548128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:59.548640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:59.549177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:41:59.549971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:41:59.550632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:41:59.551070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.137219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:00.152949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10b21e3e-2ea6-40c7-a52d-381c6b37bc06 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1471 microversion: 2.1 time: 0.631708 Aug 23 10:42:00.156627 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 706/1355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:41:59 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1471 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:00.172928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:00.176007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:00.190550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:00.193719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:00.196384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.197528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:00.198177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:00.200962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.653463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:00.690813 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-898e6f37-a934-4e9a-ba05-8001f67cc7e4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.523679 Aug 23 10:42:00.714043 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 707/1356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:00 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:00.732841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:00.733501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:00.743597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:00.744097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:00.744543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.745477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:00.746336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:00.747342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.833829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b721fe8-8f10-4e25-9e41-9011bb7c233c tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/action" status: 202 len: 0 microversion: 2.25 time: 6.143440 Aug 23 10:42:00.836639 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 650/1357] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:41:54 2022] POST /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/action => generated 0 bytes in 6146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:42:00.843242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:00.846231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:00.881379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:00.882490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:00.883633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.886038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:00.889285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:00.892817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:00.940823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:00.992102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:00.999186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:01.025408 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac186743-a18d-4435-b342-6c33a2c82c65 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1438 microversion: 2.75 time: 0.315554 Aug 23 10:42:01.026592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 708/1358] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:00 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1438 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:01.045064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:01.045818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:01.060560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.061414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.062104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.063396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.064219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.065038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.142408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.142910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.143353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.143809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lazy-loading 'fault' on Instance uuid 9e4c9924-aa06-4991-b84a-4373f25bbf38 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:01.226141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675a9a61246a4b1e9b1a8e01b35e2054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5fe64230f9a4b0cadbc81a71ed5adf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:01.237684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-544b288e-21d3-4cf2-9125-a82f936953bc tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 200 len: 1311 microversion: 2.1 time: 0.206586 Aug 23 10:42:01.249711 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 709/1359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:01 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 1311 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:01.249711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9463de49-1558-46f6-80ba-a0e19d705f2a req-bce2fc7d-fdde-41d7-b5df-7d28be809ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4c9924-aa06-4991-b84a-4373f25bbf38", "name": "network-vif-deleted", "tag": "5f282edd-c53f-4f8b-96cb-0f7435f36c3c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:01.258398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9463de49-1558-46f6-80ba-a0e19d705f2a req-bce2fc7d-fdde-41d7-b5df-7d28be809ba3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.258888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9463de49-1558-46f6-80ba-a0e19d705f2a req-bce2fc7d-fdde-41d7-b5df-7d28be809ba3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.259436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9463de49-1558-46f6-80ba-a0e19d705f2a req-bce2fc7d-fdde-41d7-b5df-7d28be809ba3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.281364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9463de49-1558-46f6-80ba-a0e19d705f2a req-bce2fc7d-fdde-41d7-b5df-7d28be809ba3 service nova] Creating event network-vif-deleted:5f282edd-c53f-4f8b-96cb-0f7435f36c3c for instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 on n-h2-847009-13 Aug 23 10:42:01.287434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9463de49-1558-46f6-80ba-a0e19d705f2a req-bce2fc7d-fdde-41d7-b5df-7d28be809ba3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047451 Aug 23 10:42:01.289099 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 710/1360] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:01.294902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:01.295605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:01.302841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.303340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.303779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.304611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.305096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.305522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.368799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:01.380016 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0099985-23f3-4659-a5e6-2d3ceef72122 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.541951 Aug 23 10:42:01.383880 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 651/1361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:00 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:01.394446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:01.399534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:01.416464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.417010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.417461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.418708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.419179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.419619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.630647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:01.647226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:01.649071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:01.651027 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddd55342-234c-4009-a15e-9bfc5751698b tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.360812 Aug 23 10:42:01.652980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 711/1362] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:01 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:01.937674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:01.942270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:01.969509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.970029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.976061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:01.976061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:01.976061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:01.976061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.080119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:02.095979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:02.097907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:02.099133 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7fed8bc-ac22-4abd-a18e-e072458d35fc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.714055 Aug 23 10:42:02.106272 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 652/1363] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:01 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:02.117988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:02.119190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:02.138720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.139429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.139846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.145897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.146403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.147041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.179121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:42:02.179839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:42:02.180112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:42:02.180527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:42:02.180985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:42:02.351689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:02.358981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.359484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.359923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.360641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.362868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.363309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.552293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:02.582685 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70aff0c5-3d32-447f-a9e7-4a29ec4d2dd5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.474907 Aug 23 10:42:02.594779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:02.599301 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 653/1364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:02 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:02.604877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:02.605107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:02.612879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.613743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.614368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.615364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.616183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.616923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.654232 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b9192705-1b90-424b-801a-6b3339a3a34e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5/action" status: 202 len: 1944 microversion: 2.75 time: 0.999629 Aug 23 10:42:02.664436 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 712/1365] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:42:01 2022] POST /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5/action => generated 1944 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 23 10:42:02.664436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:02.664436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] [instance: 9e4c9924-aa06-4991-b84a-4373f25bbf38] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:02.682964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.683561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.684048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.684792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.685261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.685694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.702334 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] HTTP exception thrown: Instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 could not be found. Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Request method failure captured: Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 HTTP/1.1 Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK7b_5oH3BbG7fUMxYZf2L3hucRfvcTd22WBQEIrVzj6_tRhwbGdV62xFPPL1ezO3Lr4Cdt5eKTSi_ZfY1DUy_uUqBrXmmHZtn013ZXoco1V3THl0Q8egHIZxhT4ms_8fJBK8KPW8mrMA9xlUhRKLIq0SRoDcvxXFPGcf6J4g8-Fibs Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: e5fe64230f9a4b0cadbc81a71ed5adf7 Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-45544619 Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:42:02.704811 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e5fe64230f9a4b0cadbc81a71ed5adf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e5fe64230f9a4b0cadbc81a71ed5adf7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5fe64230f9a4b0cadbc81a71ed5adf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5fe64230f9a4b0cadbc81a71ed5adf7"}]}] Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-45544619 Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: e5fe64230f9a4b0cadbc81a71ed5adf7 Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-45544619 Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiagnosticsNegativeTest-45544619-project Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 675a9a61246a4b1e9b1a8e01b35e2054 Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-45544619-project Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 could not be found. Aug 23 10:42:02.706457 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9e4c9924-aa06-4991-b84a-4373f25bbf38'} Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 could not be found. Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:42:02.707379 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 could not be found. Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 could not be found. Aug 23 10:42:02.708920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:02.722506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] Returning 404 to user: Instance 9e4c9924-aa06-4991-b84a-4373f25bbf38 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:42:02.723812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-57ee40f4-dbf2-423a-91fa-3bca6fef8bfa tempest-ServerDiagnosticsNegativeTest-45544619 tempest-ServerDiagnosticsNegativeTest-45544619-project] 10.222.0.78 "GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38" status: 404 len: 111 microversion: 2.1 time: 0.067411 Aug 23 10:42:02.728272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 713/1366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:02 2022] GET /compute/v2.1/servers/9e4c9924-aa06-4991-b84a-4373f25bbf38 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:42:02.736633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:02.737553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:02.754748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.755488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.756113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:02.757094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:02.757722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:02.758379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.019358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.038733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e8b0275a-81d2-43ab-a2c0-65be6145dddc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.438237 Aug 23 10:42:03.040306 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 654/1367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:02 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:03.053312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:03.054200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:03.070448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.071389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.072062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.073036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.073748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.074779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.225663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.247704 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-475f6cb5-a109-400d-94be-697a23a5dc2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.511620 Aug 23 10:42:03.265158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 714/1368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:02 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:03.270447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:03.271066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:03.290857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.291366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.291796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.293858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.297881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.298352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.408424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:03.448077 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f0fcdc3-ae64-4986-9025-d5f93c8f2c4a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.181739 Aug 23 10:42:03.469176 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 715/1369] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:03 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:03.482308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:03.485813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:03.506284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.506953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.510458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.511433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.512081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.512671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.519053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:03.537973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.553130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.555729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.563842 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c2ad962-e474-4c9e-a69b-95959018d2ac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.515935 Aug 23 10:42:03.586665 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 655/1370] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:03 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:03.843275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-354717742", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "7380efd3-97d2-489c-88db-bb3014da90df"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:03.860371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.870717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.879803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:03.897849 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e92c3a78-49e4-4dd8-9c5c-5630a361cd1a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.417676 Aug 23 10:42:03.899280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 716/1371] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:03 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:03.922527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:03.923715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:03.937689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.938460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.942167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.943258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:03.945710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:03.946426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:03.954806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] validate_networks() for [('7380efd3-97d2-489c-88db-bb3014da90df', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:42:04.273513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:04.283466 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec5021bb-3300-43aa-b398-e27ddebafd63 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.382811 Aug 23 10:42:04.284065 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 717/1372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:03 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:04.297182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:04.297182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:04.304164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:04.304164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:04.304164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:04.305840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:04.306497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:04.307019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:04.670122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:04.681439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b33cc774-fb56-4020-b211-49071d8fc232 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.395915 Aug 23 10:42:04.682744 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 718/1373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:04 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:04.688816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:04.689852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:04.697359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:04.698192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:04.698930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:04.700565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:04.701352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:04.702188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:04.799966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:42:04.801192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:42:04.801829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:42:04.802407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:42:04.803010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:42:04.838363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:04.838864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:04.839335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:04.840080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:04.856113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:04.856824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:04.926160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Getting quotas for project 47a750024d634a43b5f854401d5afa43. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:42:04.938757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Getting quotas for user 45ac7be54bb940b9b2e0cb4559c64019 and project 47a750024d634a43b5f854401d5afa43. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:42:04.953568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:42:04.956185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:42:05.028100 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3274290d-ac21-446a-9933-7f3fc332c933 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439715 Aug 23 10:42:05.029463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 656/1374] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:42:05.035598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:05.036852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:05.048213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.049079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.049805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.051253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.052185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.052893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.190407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:05.208923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e8ecd3cc-56c1-4422-bced-11584a636bd3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.522843 Aug 23 10:42:05.209837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 719/1375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:04 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:05.221027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:05.225987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:05.242650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.243612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.244275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.246311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.249469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.250191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.595497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:05.627932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:05.638833 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48d68bcf-64c5-42ee-ab09-f5befdf4768f tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.608040 Aug 23 10:42:05.647569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:05.654426 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 657/1376] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:05 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:05.656782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:05.666569 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e08e2d9-5fe2-4d9c-9e1b-55f1e02b0179 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.447057 Aug 23 10:42:05.667373 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 720/1377] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:05 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:05.680802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:05.685689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:05.687390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3df0d9ea-37d2-4d67-b449-8791865cab4e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:05.688574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3df0d9ea-37d2-4d67-b449-8791865cab4e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:05.694505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.695022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.695516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.696315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.696922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.697403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.789561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3df0d9ea-37d2-4d67-b449-8791865cab4e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:05.802007 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3df0d9ea-37d2-4d67-b449-8791865cab4e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1223 microversion: 2.1 time: 0.132832 Aug 23 10:42:05.803459 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 721/1378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:05 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:05.810228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:05.811334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:05.818693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.819637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.820387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:05.821242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:05.821939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:05.822725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.147903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:06.161250 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa168a64-55b5-41b8-9afe-bfc8c7e82279 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.356047 Aug 23 10:42:06.162251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 722/1379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:05 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:06.169214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:06.170472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:06.177892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.178872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.179357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.180159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.180622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.181174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.426448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:06.440970 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5820d8d7-763d-48f8-aaf0-fbddac948084 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.276843 Aug 23 10:42:06.442117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 723/1380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:06 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:06.447804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:06.448451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:06.457047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.457605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.458056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.458940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.459408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.460496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.527861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:06.543128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:06.546733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:06.549326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7ee955b-24d1-429e-bdd4-2e1386054b37 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.892511 Aug 23 10:42:06.549917 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 658/1381] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:05 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:06.668463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:06.669365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:06.682013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:06.687803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.689662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.690318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.691129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.691679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.692037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.728555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:06.741047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2504b254-ee41-4f79-a73c-9916445831af tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.293038 Aug 23 10:42:06.743653 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 724/1382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:06 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:06.756323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:06.761841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:06.786633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.798022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.806580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.810682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.812491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.813188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.859791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:06.895358 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03738e6e-d8bf-4cff-baef-c6c9f854e4fb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.231223 Aug 23 10:42:06.896133 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 659/1383] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:06 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:06.902787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:06.903684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:06.923513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.924120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.929241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:06.930332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:06.930914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:06.931879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.079150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:07.090749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c1585f1-cdf8-4d13-8d8b-2d8b075bddcb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1275 microversion: 2.1 time: 0.191304 Aug 23 10:42:07.092868 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 660/1384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:06 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:07.150863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:07.163418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:07.167011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:07.169221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0855ac81-76ec-4661-84ab-56bb7cacbea7 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.424026 Aug 23 10:42:07.170024 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 725/1385] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:06 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:07.193668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:07.194526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:07.213250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.216404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.217337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.219404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.220895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.223278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.464767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:07.465626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:07.467275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:07.477311 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2edabd5d-7fa5-480c-956a-6658d71a2d47 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.293075 Aug 23 10:42:07.477819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 661/1386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:07 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:07.497685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.499642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.500112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.500864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.501330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.501762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.573379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:07.574121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:07.585119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.588899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.593322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.594208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.594714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.595162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.794082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:07.810511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3aa440fe-e4b5-4f77-a8f5-58b5831d8019 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.348297 Aug 23 10:42:07.814212 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 726/1387] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:07 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:07.837272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:07.841257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:07.871855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.875901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.879613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:07.880619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:07.885271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:07.887475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.200774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:08.218595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:08.222456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:08.231453 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ab768ca-b9b1-4bcd-9f16-1fb0178e7cbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.662280 Aug 23 10:42:08.232624 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 662/1388] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:07 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:08.252551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:08.253541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:08.263666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.264181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.264632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.266928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:08.273175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.273645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.274072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.281824 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b18de92-29bd-4b6a-a3b4-7bce070ef6e2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.461451 Aug 23 10:42:08.282845 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 727/1389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:07 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:08.301035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:08.302676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:08.313875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.314861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.315781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.316807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.318474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.319657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.461222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:08.470484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1939c507-df7f-4e1f-bf31-b1423df6d88f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1281 microversion: 2.1 time: 0.186237 Aug 23 10:42:08.483526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 728/1390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:08 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:08.492281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:08.505450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:08.506409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:08.532321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.538398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.539454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.540408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.541100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.541711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.554322 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0130cb5e-32cd-47fe-a90e-4bc2159c83b3 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.320518 Aug 23 10:42:08.556098 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 663/1391] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:08 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:08.567595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:08.568233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:08.584931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.586586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.587048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:08.587789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:08.590904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:08.591401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.066310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.074479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf6e6d4c-2a5c-4e79-9882-c8ddbde20104 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.517193 Aug 23 10:42:09.089996 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 664/1392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:08 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:09.095332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5e66f2d9-4918-4d13-843c-5b16c268cf7c req-32e53f3b-ea87-413f-8afc-bc11ff118274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "8c852214-7d06-4732-b9da-d47803940a50"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:09.108266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e66f2d9-4918-4d13-843c-5b16c268cf7c req-32e53f3b-ea87-413f-8afc-bc11ff118274 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.108790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e66f2d9-4918-4d13-843c-5b16c268cf7c req-32e53f3b-ea87-413f-8afc-bc11ff118274 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.109244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e66f2d9-4918-4d13-843c-5b16c268cf7c req-32e53f3b-ea87-413f-8afc-bc11ff118274 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.121830 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5e66f2d9-4918-4d13-843c-5b16c268cf7c req-32e53f3b-ea87-413f-8afc-bc11ff118274 service nova] Creating event network-vif-plugged:8c852214-7d06-4732-b9da-d47803940a50 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:09.127473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5e66f2d9-4918-4d13-843c-5b16c268cf7c req-32e53f3b-ea87-413f-8afc-bc11ff118274 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036158 Aug 23 10:42:09.128379 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 665/1393] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:09.133726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:09.134436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:09.141090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.141594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.142036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.143049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.143677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.144266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.290711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.303633 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1e65e42-0969-46aa-9288-7950548a46fa tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.173779 Aug 23 10:42:09.305097 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 666/1394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:09 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:09.316607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:09.317449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:09.325794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.326512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.327157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.328092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.329124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.329988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.390474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.403377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.406535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.408019 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cdd5a1d0-3aa2-4648-9cde-211741700fac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.923058 Aug 23 10:42:09.431301 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 729/1395] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:08 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:09.438441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:09.441224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:09.449166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.450615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.451447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.452837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.453558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.454179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.554016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.568234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.571095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.572659 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57c5c92d-16cb-4c35-8ba3-1b7fffffda24 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.266434 Aug 23 10:42:09.573840 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 667/1396] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:09 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:09.581382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:09.582479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:09.590998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.592273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.593016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.593985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.594738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.596057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.769209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.778362 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dfa182e3-1d41-4ad2-a30c-786b364ab322 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.203218 Aug 23 10:42:09.779169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 668/1397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:09 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:09.784543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:09.785535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:09.791944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.793260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.793922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.794926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:09.795520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:09.795956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:09.871116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:09.881601 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fad753dc-405c-475c-8e6b-9ee0dc7ec55f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.448786 Aug 23 10:42:09.896818 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 730/1398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:09 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:09.911300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:09.931107 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d25c3f4f-bbf2-4f8e-90d0-34cc2895b399 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.150610 Aug 23 10:42:09.941916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 669/1399] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:09 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:10.094618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:10.095134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:10.104522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.106896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.107655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.109801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.110294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.110775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.327743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:10.328377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:10.339990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.344578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.345199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.345855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.347587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.348063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.370559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:10.379723 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15ef3508-2928-41e9-a2ad-228623f6be9c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.289044 Aug 23 10:42:10.384910 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 731/1400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:10 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:10.450507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:10.451921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:10.466960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.467596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.468122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.470512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.472430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.474018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.640436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:10.653031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7a8df1a-22fa-4d0d-9f0c-a6404d9979ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.329360 Aug 23 10:42:10.666892 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 670/1401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:10 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:10.689855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:10.691263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:10.699845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.700858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.701540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.702626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.703272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.704484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.855501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:10.868813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:10.877042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:10.879714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bf6d3605-e660-4029-8ad3-b133db546dc4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.439783 Aug 23 10:42:10.895721 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 732/1402] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:10 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:10.917229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:10.918995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:10.935421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.936102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.936719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:10.938580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:10.939224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:10.939820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:11.064165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:11.079313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:11.083025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:11.084536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22503c07-40de-4f95-9403-0bec8f6fb7a9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.415464 Aug 23 10:42:11.087909 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 671/1403] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:10 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:11.102192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:11.103120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:11.116467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:11.117561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:11.118683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:11.119405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:11.120133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:11.122233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:11.402622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:11.411189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55cd59e0-8b24-4b6c-a65b-81880c013a04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.321999 Aug 23 10:42:11.412085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 672/1404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:11 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:11.429942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:11.430834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:11.447127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:11.448458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:11.450821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:11.458276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:11.459035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:11.459683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:11.656639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:11.899137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:11.903342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:11.911151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c69b5034-bc1f-4578-aa0d-b37aa7ac8ce4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 1.013945 Aug 23 10:42:11.920965 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 733/1405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:10 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:11.937326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-00a5ae84-df33-4fce-95e6-69cb6eaf63fc req-b5182362-a011-47f6-8646-d3382d77f6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "c9fa7fb8-824f-4206-aef0-a342042e747c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:11.954004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-00a5ae84-df33-4fce-95e6-69cb6eaf63fc req-b5182362-a011-47f6-8646-d3382d77f6fa service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:11.954552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-00a5ae84-df33-4fce-95e6-69cb6eaf63fc req-b5182362-a011-47f6-8646-d3382d77f6fa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:11.959827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-00a5ae84-df33-4fce-95e6-69cb6eaf63fc req-b5182362-a011-47f6-8646-d3382d77f6fa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:11.993737 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-00a5ae84-df33-4fce-95e6-69cb6eaf63fc req-b5182362-a011-47f6-8646-d3382d77f6fa service nova] Creating event network-vif-plugged:c9fa7fb8-824f-4206-aef0-a342042e747c for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:12.012417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-00a5ae84-df33-4fce-95e6-69cb6eaf63fc req-b5182362-a011-47f6-8646-d3382d77f6fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087701 Aug 23 10:42:12.014871 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 734/1406] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:12.127478 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbd994ef-4a0b-48d7-8c5d-34489c1d7fcb tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.713307 Aug 23 10:42:12.130175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 673/1407] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:11 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:12.145206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:12.146174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:12.157652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.159775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.159775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.160179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.161052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.161677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.261010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d473cde8-1ba3-423e-b9da-5f0c5f7db6e5 req-d559db3d-dba7-44b1-8fce-e555c2e93a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:12.273445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d473cde8-1ba3-423e-b9da-5f0c5f7db6e5 req-d559db3d-dba7-44b1-8fce-e555c2e93a83 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.274275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d473cde8-1ba3-423e-b9da-5f0c5f7db6e5 req-d559db3d-dba7-44b1-8fce-e555c2e93a83 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.274928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d473cde8-1ba3-423e-b9da-5f0c5f7db6e5 req-d559db3d-dba7-44b1-8fce-e555c2e93a83 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.287896 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d473cde8-1ba3-423e-b9da-5f0c5f7db6e5 req-d559db3d-dba7-44b1-8fce-e555c2e93a83 service nova] Creating event network-changed:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:42:12.293573 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d473cde8-1ba3-423e-b9da-5f0c5f7db6e5 req-d559db3d-dba7-44b1-8fce-e555c2e93a83 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276879 Aug 23 10:42:12.295052 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 735/1408] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:12.304656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:12.305725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:12.314491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.315241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.315917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.316885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.317551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.318182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.556369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:12.569818 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d242d0fa-e12f-42ea-a560-84b0e9b0ddd0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.273311 Aug 23 10:42:12.570703 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 736/1409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:12 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:12.581168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:12.584253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:12.598124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.599017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.600051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.601201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.601891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.605644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.737331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:12.747689 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-929b2855-b63c-4c69-9584-6156661aaec6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.616195 Aug 23 10:42:12.768373 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 674/1410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:12 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:12.768373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:12.768373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:12.783703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.785915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.786462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.787278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:12.789870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:12.790426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:12.852603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:12.961694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:12.975977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:12.978023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:12.979386 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ec92afe-b555-4a9b-86ab-562c5544aaf8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.402990 Aug 23 10:42:12.980714 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 737/1411] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:12 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:13.005868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:13.006729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:13.014220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.014953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.015794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.016689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.017434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.018083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.281719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:13.294213 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c78a3c7d-962a-492d-8d18-94a23aea6c04 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.292006 Aug 23 10:42:13.295723 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 738/1412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:13 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:13.305266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:13.306333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:13.317216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.318315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.319869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.322029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.322845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.324249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.462288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:13.472800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:13.474373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:13.475595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d1e10ea-a492-4296-ba6a-fdfdd684990c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.719174 Aug 23 10:42:13.476155 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 675/1413] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:12 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:13.489562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:13.490399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:13.498177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.498698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.499142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.500148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.500838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.501422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.569663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:13.580611 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f476054-aa94-459a-a422-0be8e61082be tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.282996 Aug 23 10:42:13.581825 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 739/1414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:13 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:13.591169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-db961f41-83a1-44af-8e73-2237c66057a0 req-c3df9437-249e-4404-a539-b6479fd11d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b74d026-1d35-4393-95b4-2ac77f28b3d1", "name": "network-vif-unplugged", "status": "completed", "tag": "ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:13.602364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-db961f41-83a1-44af-8e73-2237c66057a0 req-c3df9437-249e-4404-a539-b6479fd11d40 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.602959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-db961f41-83a1-44af-8e73-2237c66057a0 req-c3df9437-249e-4404-a539-b6479fd11d40 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.603464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-db961f41-83a1-44af-8e73-2237c66057a0 req-c3df9437-249e-4404-a539-b6479fd11d40 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.617620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-db961f41-83a1-44af-8e73-2237c66057a0 req-c3df9437-249e-4404-a539-b6479fd11d40 service nova] Creating event network-vif-unplugged:ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b for instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 on n-h1-847009-13 Aug 23 10:42:13.622659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-db961f41-83a1-44af-8e73-2237c66057a0 req-c3df9437-249e-4404-a539-b6479fd11d40 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038733 Aug 23 10:42:13.623518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 740/1415] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:13.629132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:13.629850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:13.631786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:13.637595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.638093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.638534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.639235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.639692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.640122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.743387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:13.767111 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cc3838d8-bd9b-41a0-83a3-b43eb1809ea1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.281444 Aug 23 10:42:13.768078 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 676/1416] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:13 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:13.783361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:13.788451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:13.789362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:13.792604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8565f7a-89bc-4df7-845e-95f24fa5560a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.167550 Aug 23 10:42:13.793626 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 741/1417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:13 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:13.796475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.797034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.797483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:13.798205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:13.798845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:13.799440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.009837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:14.010563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:14.016920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.017412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.017855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.018562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.019026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.019455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.219344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.232093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.233635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.234817 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-855efe96-5e55-42cf-b661-53fe0b28e63a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.229131 Aug 23 10:42:14.248982 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 742/1418] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:14 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:14.252174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.263900 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e689c4c0-c483-44e4-8b0a-80534d5dbba6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.491929 Aug 23 10:42:14.265182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 677/1419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:13 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:14.317229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:14.318559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:14.326537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.327278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.327925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.329521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.330192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.330969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.500096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:14.500787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:14.507747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.508687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.509171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.509900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.510361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.510798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.669736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.682221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92e4dd7b-9bb0-408e-afc3-4e0c840eb474 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.369770 Aug 23 10:42:14.683783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 743/1420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:14 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:14.701280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:14.702114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:14.707688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.718785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.719446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.720056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.722340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.722964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.724321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.724968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.726535 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cc942a0-da34-4e45-b34a-996a33beedc3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.231355 Aug 23 10:42:14.726879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.727745 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 678/1421] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:14 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:14.791915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:14.793318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:14.817339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.818659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.819392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.820836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.821615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.822376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.895133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:14.915611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:14.934498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-588915de-d891-4298-b809-353f0961c706 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.146353 Aug 23 10:42:14.935367 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 679/1422] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:14 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:14.940232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:14.940958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:14.947073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.947801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.949023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.949974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:14.950668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:14.951344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:14.952038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:14.982112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:14.991428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae82e24c-5113-401d-bbfb-244c306c4d2f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.306300 Aug 23 10:42:14.996798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 744/1423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:14 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:15.143835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.155131 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fed179c2-ceb6-4188-b6aa-31711df36bc1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.218379 Aug 23 10:42:15.155727 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 680/1424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:14 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:15.258684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:15.259854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:15.266540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.267042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.267482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.268193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.268654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.269106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.289272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:15.290069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:15.297955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.298742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.299269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.300252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.301151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.301715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.467684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.475908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b38dfe68-a733-4115-aae5-14fa2c6e6ce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.193457 Aug 23 10:42:15.478222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 681/1425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:15 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:15.666886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.686663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-00d7534a-6a84-4763-8ea4-08989f74de73 req-ff7c5ddd-cabf-4141-982c-02d7105ee47e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b74d026-1d35-4393-95b4-2ac77f28b3d1", "tag": "ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:15.688395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.692354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.693996 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc4ffc28-d11e-419f-a70f-a1bf45eee978 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.439950 Aug 23 10:42:15.695989 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 745/1426] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:15 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:15.709986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-00d7534a-6a84-4763-8ea4-08989f74de73 req-ff7c5ddd-cabf-4141-982c-02d7105ee47e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.710699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-00d7534a-6a84-4763-8ea4-08989f74de73 req-ff7c5ddd-cabf-4141-982c-02d7105ee47e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.711163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-00d7534a-6a84-4763-8ea4-08989f74de73 req-ff7c5ddd-cabf-4141-982c-02d7105ee47e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.724808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-00d7534a-6a84-4763-8ea4-08989f74de73 req-ff7c5ddd-cabf-4141-982c-02d7105ee47e service nova] Creating event network-changed:ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b for instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 on n-h1-847009-13 Aug 23 10:42:15.730532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-00d7534a-6a84-4763-8ea4-08989f74de73 req-ff7c5ddd-cabf-4141-982c-02d7105ee47e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053503 Aug 23 10:42:15.731651 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 682/1427] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:15.738098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:15.738934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:15.747114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.747708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.748642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.749669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.750295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.750880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.757631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:15.758354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:15.766092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.766632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.767031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.767951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:15.768424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:15.769024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:15.796132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:15.956349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.971222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.972914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:15.974396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50f50a4b-f8f9-440e-8e38-b68fcd3dc66f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.223721 Aug 23 10:42:15.985082 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 683/1428] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:15 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:15.987954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:15.989009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:16.001400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.001400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.001400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.001400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.001814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.002184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.101823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:16.122661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:16.124611 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc3273e4-61a6-41df-a0c4-fd019c4f47a2 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.141280 Aug 23 10:42:16.125374 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 684/1429] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:15 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:16.130670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:16.131535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:16.135194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:16.145824 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e40ba803-579e-4e4d-8fd1-1d6a90785fd6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.421982 Aug 23 10:42:16.147493 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 746/1430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:15 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:16.152369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.153254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.153959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.154917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.155593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.156273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.168689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7ada87eb-62c6-47e2-a289-ba73c2efa114 req-51fce635-31f2-43cd-b4a4-3941d1e52bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "b108b97c-f9c8-4c77-997a-5a189cf75689"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:16.181975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7ada87eb-62c6-47e2-a289-ba73c2efa114 req-51fce635-31f2-43cd-b4a4-3941d1e52bf4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.182470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7ada87eb-62c6-47e2-a289-ba73c2efa114 req-51fce635-31f2-43cd-b4a4-3941d1e52bf4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.182979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7ada87eb-62c6-47e2-a289-ba73c2efa114 req-51fce635-31f2-43cd-b4a4-3941d1e52bf4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.195592 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7ada87eb-62c6-47e2-a289-ba73c2efa114 req-51fce635-31f2-43cd-b4a4-3941d1e52bf4 service nova] Creating event network-vif-plugged:b108b97c-f9c8-4c77-997a-5a189cf75689 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:16.203024 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7ada87eb-62c6-47e2-a289-ba73c2efa114 req-51fce635-31f2-43cd-b4a4-3941d1e52bf4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054002 Aug 23 10:42:16.204271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 747/1431] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:16.209903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:16.210833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:16.224021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.224919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.226032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.227639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.228567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.229195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.329336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:16.338329 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-243e2fa0-7ce1-4bce-9f40-dc1d9820bdf6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.211196 Aug 23 10:42:16.340082 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 685/1432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:16 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:16.497551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:16.499937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:16.508079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.508768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.510013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.511112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.511759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.512349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.614504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:16.640207 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc5c1d0b-94ef-482a-a20c-d7fded7f863c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.434142 Aug 23 10:42:16.655290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 748/1433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:16 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:16.692560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:16.706789 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a09ea96e-7c0c-4d4e-8930-0e15c79705bf tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.213003 Aug 23 10:42:16.721228 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 686/1434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:16 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:16.726877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:16.727476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:16.744463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.745012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.746229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:16.747188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:16.748112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:16.748705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.004786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:17.006353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:17.014328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.014835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.015272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.017337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.018304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.019569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.209515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.223325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.224925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.226760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20ec7f73-9aee-4af0-acc4-83caaf806124 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.229327 Aug 23 10:42:17.227333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 687/1435] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:16 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:17.232113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:17.233215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:17.240234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.241010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.241645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.242738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.243382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.243984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.343825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:17.374858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c640b347-5812-428e-97d4-bbf660cc431e tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.146156 Aug 23 10:42:17.375729 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 688/1436] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:17 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:17.381019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:17.382677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:17.392124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.392641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.393151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.393880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.394352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.394790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.593217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.603113 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4d3f12c-f6b2-4232-964f-34d86b80ed5a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.226120 Aug 23 10:42:17.603583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.604371 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 689/1437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:17 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:17.610885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:17.612393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:17.619162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.620182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.620600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.634578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.638300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.638300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.638808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.639092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.640590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-619389a6-8953-4423-823b-9167be6986c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.917837 Aug 23 10:42:17.657836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 749/1438] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:16 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:17.669742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:17.671171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:17.679062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.679771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.680379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.681347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.681958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.682692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.903161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:17.915109 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd4a40d8-301f-48ab-a7c6-8039f087e12b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.308826 Aug 23 10:42:17.929703 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 690/1439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:17 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:17.935850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:17.936650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:17.943999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.944818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.945361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.946263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:17.946832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:17.947369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:17.982460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:18.061256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:18.069462 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec6ff1f6-3a46-4ee5-b7d7-5733f413ebe9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.406597 Aug 23 10:42:18.070755 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 750/1440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:17 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:18.172699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-823caf20-0e44-4997-810d-bd3a6c94a6b5 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Action: 'create', calling method: .version_select at 0x7fdca1da23a0>, body: {"pool": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:18.304892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:18.331201 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5010baa5-d346-4a6b-b2b9-8913feb63222 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.399978 Aug 23 10:42:18.343153 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 691/1441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:17 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:18.351307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:18.352355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:18.360797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.361423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.361982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:18.364080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.364870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.365926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:18.562823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:18.577930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:18.579543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:18.580862 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58be48c0-95e5-4e64-9f7c-b1f6f14cf745 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.236491 Aug 23 10:42:18.581719 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 692/1442] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:18 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:18.586347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "92e6c454-69c8-4403-a85d-d026ca05400b"}, {"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "d7fc2d75-be2d-4fc6-8f63-c92af11191c8"}, {"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "c543dece-200b-4b28-bad8-de92bd67034b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:18.602408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.602981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.603502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:18.627128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Creating event network-vif-plugged:92e6c454-69c8-4403-a85d-d026ca05400b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:18.627674 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Creating event network-vif-plugged:d7fc2d75-be2d-4fc6-8f63-c92af11191c8 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:18.628771 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] Creating event network-vif-plugged:c543dece-200b-4b28-bad8-de92bd67034b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:18.637602 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-aea581a7-0074-4839-a0da-2eb3c0fc6407 req-e55b57eb-1e5a-4cd8-9aa7-806a6412706c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053409 Aug 23 10:42:18.638452 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 693/1443] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:18.645828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:18.646551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:18.654115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.654629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.655406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:18.655849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.656314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.656772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:18.759120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:18.804951 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f039ee61-6855-4369-aee1-cf1f3dac7e7c tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.161887 Aug 23 10:42:18.806088 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 694/1444] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:18 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:18.813998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:18.814956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:18.831064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.831833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.832520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:18.833928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:18.834685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:18.835492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.017159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.034082 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cb35972-6bbd-4925-a922-2f1e2d475d58 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.226737 Aug 23 10:42:19.034924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 695/1445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:18 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:19.039641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:19.040473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:19.049629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.050384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.050984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.051862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.052492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.053031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.346114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.357338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.359532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.361004 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64297a47-beff-42b6-86d2-f232f382dbbb tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.324960 Aug 23 10:42:19.361670 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 696/1446] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:19 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:19.366779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:19.367255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:19.388183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.389041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.389701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.390675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.391339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.391990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.537294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.545458 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78ca5920-075f-4707-bdc4-b56156be2f30 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.182436 Aug 23 10:42:19.546252 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 697/1447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:19 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:19.551422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:19.552052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:19.559435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.559914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.560232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.561077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.561637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.562071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.706780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.717082 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3af0d2b7-0e74-4380-808a-27a5b3efa242 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.169872 Aug 23 10:42:19.718500 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 698/1448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:19 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:19.726639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:19.727279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:19.735263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.735767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.736200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.737033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.737493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.737924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.810236 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-823caf20-0e44-4997-810d-bd3a6c94a6b5 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.739085 Aug 23 10:42:19.811156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 751/1449] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:42:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:19.816231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:19.817175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:19.826254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.826744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.828947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.829687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:19.830338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:19.830807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:19.887186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.897739 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35399de9-3de4-4653-a81f-ecd28bc14fac tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.178892 Aug 23 10:42:19.898332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 699/1450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:19 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:19.904327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14e4ff3f-ae7a-4e1e-97eb-f0a0852f0b97 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Calling method '.version_select at 0x7fdca1dacf70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:19.988364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:19.999076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.001007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.002209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88858ac4-3856-46ac-a08f-50dc7483eff2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.189963 Aug 23 10:42:20.002980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 752/1451] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:19 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:20.019279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.019998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:20.026197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.027884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.028425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.029227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.029767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.030291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.085070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14e4ff3f-ae7a-4e1e-97eb-f0a0852f0b97 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/1299316b-b4af-462f-a3d0-fdce23ef9384" status: 200 len: 142 microversion: 2.1 time: 0.185639 Aug 23 10:42:20.086433 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 700/1452] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:42:19 2022] GET /compute/v2.1/os-floating-ips/1299316b-b4af-462f-a3d0-fdce23ef9384 => generated 142 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:20.092654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.093435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:20.100950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.101478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.102257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.103009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.103803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.104414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.115668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:20.118838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:20.137593 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79480218-130e-48fb-808c-20f5a5729934 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.122027 Aug 23 10:42:20.138527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 753/1453] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:20 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:20.143741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-113ec3c3-962c-4018-aabf-725dadafb5d8 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Calling method '.version_select at 0x7fdca1d87d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.286516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.295427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8621df2-49e8-48aa-b5b8-8037c386a4d6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.207665 Aug 23 10:42:20.296337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 701/1454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:20 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:20.340495 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-113ec3c3-962c-4018-aabf-725dadafb5d8 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.200421 Aug 23 10:42:20.341311 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 754/1455] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:42:20 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:20.353982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c076a1eb-4b02-4a0a-9df1-c8b20b282177 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Calling method '.version_select at 0x7fdca1dd3160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.385015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.386486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:20.393364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.394170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.394722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.395521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.396217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.396770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.595583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.609053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.610680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.612201 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-289cae0a-8886-4591-a56f-692a8872c002 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.231411 Aug 23 10:42:20.613001 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 755/1456] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:20 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:20.626129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.630298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:20.636134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.636914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.637619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.638531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.639169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.639776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.809429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:20.818724 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d946ab29-5e2c-49e8-b808-2088c56fbb9f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.204571 Aug 23 10:42:20.832903 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 756/1457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:20 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:20.834564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-plugged", "status": "completed", "tag": "24a4b2f8-56ea-40b9-8b30-133cd135fb5b"}, {"server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "name": "network-vif-plugged", "status": "completed", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:20.863500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.865830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.866451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.886132 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] Creating event network-vif-plugged:24a4b2f8-56ea-40b9-8b30-133cd135fb5b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:20.888261 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] Creating event network-vif-plugged:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:42:20.913271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b1c5ad39-19d6-47d8-ba91-360fa27b2d1c req-7a4e82aa-f28e-4c2f-a783-97d1b896e460 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082236 Aug 23 10:42:20.915108 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 757/1458] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:20.923167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:20.924129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:20.931983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.933612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.934302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:20.935173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:20.935730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:20.936480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.128520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.147181 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e11b503-e953-49c3-91e0-bfd2cbe6b73f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.230002 Aug 23 10:42:21.148055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 758/1459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:20 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:21.167070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:21.168619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:21.175122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.175746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.176283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.177277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.178038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.178727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.186589 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c076a1eb-4b02-4a0a-9df1-c8b20b282177 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/1299316b-b4af-462f-a3d0-fdce23ef9384" status: 202 len: 0 microversion: 2.1 time: 0.836696 Aug 23 10:42:21.187383 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 702/1460] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:42:20 2022] DELETE /compute/v2.1/os-floating-ips/1299316b-b4af-462f-a3d0-fdce23ef9384 => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:42:21.193741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:21.194769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:21.203721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.204352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.204956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.205777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.206338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.206993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.333874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.342389 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c690250-8821-4885-b13f-4aef6b45d42f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.192142 Aug 23 10:42:21.342966 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 759/1461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:21 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:21.347733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:21.348551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:21.354671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.355541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.356199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.357217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.357535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.358015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.358129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.366741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.368363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.369644 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db9795c8-56e9-420d-a8e1-799853ae538a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.179742 Aug 23 10:42:21.370720 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 703/1462] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:21 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:21.375880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e504068a-bfbe-4be8-bd84-e78fa6c33efb tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Action: 'create', calling method: .version_select at 0x7fdca1dd3d30>, body: {"pool": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:21.455800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:21.474669 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46e829f2-67be-4507-848f-b350ea74d1de tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1931 microversion: 2.75 time: 0.130483 Aug 23 10:42:21.489375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 760/1463] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:21 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1931 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:21.494425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:21.495318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:21.502445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.503764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.504391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.505358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.505822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.506427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.675402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.686167 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce8b2663-7155-4d11-b173-7de35d35cf38 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.195346 Aug 23 10:42:21.687091 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 761/1464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:21 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:21.692279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:21.692930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:21.704280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.704807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.705257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.706038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:21.708762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:21.708762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:21.963428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.982623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.984765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:21.986209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ed6baad7-e841-4c51-808f-1a86757c9fd6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.297613 Aug 23 10:42:21.986752 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 762/1465] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:21 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:21.992237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:21.993116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:22.000191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.000980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.001855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.002819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.003685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.004693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.150103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:22.160072 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e299dab5-31b6-427e-852e-cac09c16913f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.171787 Aug 23 10:42:22.160828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 763/1466] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:21 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:22.171383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:22.171995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:22.180954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.181452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.181895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.182630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.183828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.184259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.331813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:22.341136 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79f537e9-e264-4e2f-b217-f7e20eec676f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1497 microversion: 2.1 time: 0.174467 Aug 23 10:42:22.345200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 764/1467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:22 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:22.363691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:22.364302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:22.371478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.371974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.372715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.373734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.374205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.374638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.551092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:22.562763 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4be70883-d7b7-4499-86aa-9dc5cbfa88b4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.202576 Aug 23 10:42:22.562763 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 765/1468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:22 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:22.575868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:22.575868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:22.575868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.575868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.576268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.582080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.582589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.583037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.689494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e504068a-bfbe-4be8-bd84-e78fa6c33efb tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.317476 Aug 23 10:42:22.690077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 704/1469] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:42:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:22.694621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:22.695240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:22.709225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.710190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.710859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.711656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.712873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.713473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.762578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:22.772188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:22.774421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:22.775871 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36de223e-197b-4039-ba33-6c623d584803 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.212143 Aug 23 10:42:22.793817 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 766/1470] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:22 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:22.799120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-155f5514-0c74-48ec-89f1-c12719750c86 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Calling method '.version_select at 0x7fdca1e09790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:22.827077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:22.847410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2ecbd08-ed19-4677-b67a-51d26fc3b04a tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1949 microversion: 2.75 time: 0.156240 Aug 23 10:42:22.848523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 705/1471] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:22 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1949 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:22.853573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:22.854576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:22.861539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.862265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.863018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:22.863929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:22.865242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:22.865849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.006350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.017213 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-516d8f65-dbef-45f2-a08d-17967d418d87 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.167203 Aug 23 10:42:23.017896 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 706/1472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:22 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:23.023993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:23.025307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:23.034355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.034937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.035962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.036949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.037484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.037999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.235613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.245821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.247439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.248929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebd5236b-93e6-4dfa-9e94-24b976b21c63 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.229637 Aug 23 10:42:23.249494 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 707/1473] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:23 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:23.253940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:23.254503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:23.260378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.261150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.261595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.262305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.262770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.263205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.406852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.414676 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f6072c8-5615-4bdf-807a-58a9313b9c07 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.164182 Aug 23 10:42:23.415487 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 708/1474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:23 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:23.421170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:23.422039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:23.428054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.428597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.429079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.429777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.430258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.430685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.572689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.584334 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1fa9635-c497-4363-9ea5-b63e6f14daa9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 200 len: 1474 microversion: 2.1 time: 0.167437 Aug 23 10:42:23.585256 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 709/1475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:23 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 1474 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:23.590321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:23.591017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:23.597069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.597655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.598164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.599470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.600400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.600957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.646130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-155f5514-0c74-48ec-89f1-c12719750c86 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3" status: 202 len: 0 microversion: 2.1 time: 0.850808 Aug 23 10:42:23.647002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 767/1476] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:42:22 2022] DELETE /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3 => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:42:23.654978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1961969378"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:23.658055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:23.664200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.664688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.665157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.665856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.666310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.666735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.750233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:23.758419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c02a5cc-7235-479d-95c4-61e0040fbebc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.171956 Aug 23 10:42:23.758987 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 710/1477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:23 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:23.763659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-367202d7-f48b-4dab-b606-99b151adeba0 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Calling method '.version_select at 0x7fdca1ec9e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:23.821834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-367202d7-f48b-4dab-b606-99b151adeba0 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 08eafa98-c876-456d-a82f-6a8a325f8bc3 could not be found", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:42:23.822552 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-367202d7-f48b-4dab-b606-99b151adeba0 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] HTTP exception thrown: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-367202d7-f48b-4dab-b606-99b151adeba0 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Request method failure captured: Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3 HTTP/1.1 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK8J1rOxzGkOAq0u5LkKyPSDKIGdBetp8XomoZUzUwUN03A6ZZoOTmtxA1eZkEF3s-0l1cqxvzGyymykv__5_vPd1oKlChxnO2HmwP5UEkrX172Tz-TRk5Xa_MXPblxfF0Bg-xgXtv_Oj5hBeCk5DcExZThrkYZ5lUkcVKGQj5id98E Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 990d39f725364da58da743748016d3a6 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsTestJSON-1758303521 Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:42:23.824932 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/990d39f725364da58da743748016d3a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_990d39f725364da58da743748016d3a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/990d39f725364da58da743748016d3a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/990d39f725364da58da743748016d3a6"}]}] Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsTestJSON-1758303521 Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 990d39f725364da58da743748016d3a6 Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1758303521 Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsTestJSON-1758303521-project Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 52d3bdbf82d343ebb43e2cd0a4fdd93c Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsTestJSON-1758303521-project Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: exception: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '08eafa98-c876-456d-a82f-6a8a325f8bc3'} Aug 23 10:42:23.826651 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:42:23.827857 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 08eafa98-c876-456d-a82f-6a8a325f8bc3 could not be found Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39222fb8-188a-44fb-9a0a-a73ed01ce9bd'] Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3. Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:23.829142 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:42:23.830662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:42:23.832418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:23.832418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:23.832418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-367202d7-f48b-4dab-b606-99b151adeba0 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Returning 404 to user: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:42:23.832418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-367202d7-f48b-4dab-b606-99b151adeba0 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3" status: 404 len: 111 microversion: 2.1 time: 0.066501 Aug 23 10:42:23.832418 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 711/1478] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:42:23 2022] GET /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:42:23.832880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:23.833898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:23.841779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.842295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.842748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.843477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:23.843949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:23.844387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:23.850183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:23.900123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-395fc0a7-dd9c-4d37-922a-581b32fa0ab5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107/action" status: 202 len: 0 microversion: 2.1 time: 0.249002 Aug 23 10:42:23.905864 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 768/1479] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:42:23 2022] POST /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:42:23.913023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68588268-bb5e-468d-9485-6e98d8c4ec87 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Calling method '.version_select at 0x7fdca1e09700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.001543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-68588268-bb5e-468d-9485-6e98d8c4ec87 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 08eafa98-c876-456d-a82f-6a8a325f8bc3 could not be found", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:42:24.002643 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-68588268-bb5e-468d-9485-6e98d8c4ec87 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] HTTP exception thrown: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:24.003682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68588268-bb5e-468d-9485-6e98d8c4ec87 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Request method failure captured: Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3 HTTP/1.1 Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK8J1rOxzGkOAq0u5LkKyPSDKIGdBetp8XomoZUzUwUN03A6ZZoOTmtxA1eZkEF3s-0l1cqxvzGyymykv__5_vPd1oKlChxnO2HmwP5UEkrX172Tz-TRk5Xa_MXPblxfF0Bg-xgXtv_Oj5hBeCk5DcExZThrkYZ5lUkcVKGQj5id98E Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 990d39f725364da58da743748016d3a6 Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FloatingIPsTestJSON-1758303521 Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:42:24.005214 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/990d39f725364da58da743748016d3a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_990d39f725364da58da743748016d3a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/990d39f725364da58da743748016d3a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/990d39f725364da58da743748016d3a6"}]}] Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FloatingIPsTestJSON-1758303521 Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 990d39f725364da58da743748016d3a6 Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1758303521 Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FloatingIPsTestJSON-1758303521-project Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 52d3bdbf82d343ebb43e2cd0a4fdd93c Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FloatingIPsTestJSON-1758303521-project Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: exception: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '08eafa98-c876-456d-a82f-6a8a325f8bc3'} Aug 23 10:42:24.006572 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:42:24.007426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 08eafa98-c876-456d-a82f-6a8a325f8bc3 could not be found Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78d3d07-687a-491f-bc6e-4731e072f9fa'] Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3. Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:24.008807 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:42:24.010962 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:42:24.013444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 Aug 23 10:42:24.013444 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:42:24.013444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68588268-bb5e-468d-9485-6e98d8c4ec87 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] Returning 404 to user: Floating IP not found for ID 08eafa98-c876-456d-a82f-6a8a325f8bc3 {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:42:24.013444 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68588268-bb5e-468d-9485-6e98d8c4ec87 tempest-FloatingIPsTestJSON-1758303521 tempest-FloatingIPsTestJSON-1758303521-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3" status: 404 len: 111 microversion: 2.1 time: 0.099217 Aug 23 10:42:24.013444 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 769/1480] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:42:23 2022] DELETE /compute/v2.1/os-floating-ips/08eafa98-c876-456d-a82f-6a8a325f8bc3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:42:24.016452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.017305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.018027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:24.019402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.021361 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8706c038-1507-4101-a15e-bfd12e0c527e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.193084 Aug 23 10:42:24.022325 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 712/1481] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:23 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:24.026282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.026908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.027379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87135fe6-b242-449c-98e3-1cf7f12a75c8 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1e96f70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.027494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.028194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.028656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.029110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.081482 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87135fe6-b242-449c-98e3-1cf7f12a75c8 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.058192 Aug 23 10:42:24.090280 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 713/1482] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:24 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:24.095338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.096034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:24.102629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.103199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.103711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.104558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.106211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.106712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.154240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:24.173149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-338fc3bb-49ad-49cc-83f0-9aed7505a361 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1937 microversion: 2.75 time: 0.160308 Aug 23 10:42:24.173735 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 770/1483] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:24 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1937 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:24.271993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.272723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:24.279945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.280700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.281411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.282284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.283113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.283695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.379804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.391072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6be5b5c4-80f7-4ecf-882f-d4387d201c84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.299551 Aug 23 10:42:24.400839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 714/1484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:24 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:24.438647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.439262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:24.445990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.446798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.447412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.448451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.449418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.450031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.520826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.533129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.534633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.535899 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2925ebce-4941-4bf3-8d30-3c3395e4e207 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.268350 Aug 23 10:42:24.545334 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 771/1485] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:24 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:24.727744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.736888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db2dcb66-6f04-427e-95cd-fa69abd39f6d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.301998 Aug 23 10:42:24.737790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 715/1486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:24 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:24.780809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:24.781431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:24.793305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.794087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.794858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.795805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:24.796546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:24.797220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:24.803309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:24.974415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:24.987623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb21c707-a03f-4aac-870a-b45ade8e8d7c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.211892 Aug 23 10:42:25.001917 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 772/1487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:24 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:25.047255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:25.047876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:25.054368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.054863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.055300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.055997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.056458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.056913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.096292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3a39f2c-60fb-4c86-ab54-aa3b3b9b3664 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1d6b430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:25.184095 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3a39f2c-60fb-4c86-ab54-aa3b3b9b3664 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.090351 Aug 23 10:42:25.194704 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 773/1488] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:25 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:25.202003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:25.202724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:25.212005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.212617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.213181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.215414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.216019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.216530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.317801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:25.348361 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4fb01fa7-2e13-418a-a51f-52fdb4b8fcaf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1937 microversion: 2.75 time: 0.152232 Aug 23 10:42:25.349768 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 774/1489] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:25 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1937 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:25.362026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:25.382151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:25.389893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:25.391191 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-882f837b-e57a-48fb-af1c-d15ef633a615 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.350025 Aug 23 10:42:25.395831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 716/1490] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:25 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:25.414240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:25.414881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:25.423518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.424854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.425199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.426765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.427359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.427800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.562526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:25.563494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:25.570592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.571209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.571943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.572693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.573420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.574365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.613722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:25.623684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1423fd3-14fe-4faf-a99f-44aa99559712 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.214628 Aug 23 10:42:25.624189 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 775/1491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:25 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:25.759064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:25.759685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:25.766313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.766814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.767257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.768005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:25.768470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:25.768925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:25.906545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:25.914454 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be777bc8-582f-4846-96a0-de22a4b5963f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1323 microversion: 2.1 time: 0.159338 Aug 23 10:42:25.915029 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 776/1492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:25 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:26.008386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:26.009024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:26.015853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.016340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.016836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.017535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.017995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.018424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.157136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:26.164992 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3768ad85-8cd0-4693-ace0-a12cf36bc5d5 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.160593 Aug 23 10:42:26.165558 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 777/1493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:26 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:26.191258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:26.200100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0c4f0c45-bf28-49d0-9912-82b17fc70b3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1d4c790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:26.203029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:26.204832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:26.211101 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0ff2ac9-6c6c-4fc1-988a-810e8cbcaf26 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.654329 Aug 23 10:42:26.212148 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 717/1494] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:25 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:26.266135 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0c4f0c45-bf28-49d0-9912-82b17fc70b3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.070370 Aug 23 10:42:26.273465 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 778/1495] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:26 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:26.379318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:26.380170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:26.395136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.395822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.396366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.397216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.398092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.400377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.418113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:26.418818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:26.439388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.442403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.443892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.447266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.447918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.449801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.559442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:26.601929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e178cab-df83-4209-9b3e-9ffa1ccb7bc1 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1937 microversion: 2.75 time: 0.226041 Aug 23 10:42:26.613902 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 718/1496] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:26 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1937 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:26.646864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:26.647887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:26.656362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.657085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.657725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.658826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.659422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.659846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.875941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:26.885674 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-943efdc2-ef44-47ab-824a-f7ef83d10235 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.244011 Aug 23 10:42:26.901147 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 719/1497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:26 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:26.906634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fc647c3a-e25d-428c-83a9-c2f9298a361c req-7f927f01-6d69-457f-a1c7-1dbe7febc045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465d3faa-5cc1-4087-9589-d137378f09ad", "name": "network-vif-unplugged", "status": "completed", "tag": "ef0de150-72f9-464f-a35d-16625dc95f35"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:26.918329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fc647c3a-e25d-428c-83a9-c2f9298a361c req-7f927f01-6d69-457f-a1c7-1dbe7febc045 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.918975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fc647c3a-e25d-428c-83a9-c2f9298a361c req-7f927f01-6d69-457f-a1c7-1dbe7febc045 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.919663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fc647c3a-e25d-428c-83a9-c2f9298a361c req-7f927f01-6d69-457f-a1c7-1dbe7febc045 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.936844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fc647c3a-e25d-428c-83a9-c2f9298a361c req-7f927f01-6d69-457f-a1c7-1dbe7febc045 service nova] Creating event network-vif-unplugged:ef0de150-72f9-464f-a35d-16625dc95f35 for instance 465d3faa-5cc1-4087-9589-d137378f09ad on n-h2-847009-13 Aug 23 10:42:26.944507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fc647c3a-e25d-428c-83a9-c2f9298a361c req-7f927f01-6d69-457f-a1c7-1dbe7febc045 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041571 Aug 23 10:42:26.946740 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 720/1498] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:26.952393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:26.953416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:26.961188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.961188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.963490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:26.963490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:26.963490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:26.963490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:27.194604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.202188 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee48d5e1-ca71-4289-8268-3bf29ac936a4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1518 microversion: 2.1 time: 0.254066 Aug 23 10:42:27.205640 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 721/1499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:26 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1518 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:27.212019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:27.214632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:27.218254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.235550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:27.236132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:27.236640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:27.236911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.237628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:27.238045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:27.238542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:27.241651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.250083 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f56bba00-a639-400e-9c17-20e462e5110b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.836932 Aug 23 10:42:27.250943 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 779/1500] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:26 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:27.256262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f41a4aa-e3e8-43f9-834c-f729a40e8dd3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'create', calling method: .version_select at 0x7fdca1da29d0>, body: {"pool": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:27.532122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.541244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67081f08-9076-4361-b50b-c1ddc133372d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.333275 Aug 23 10:42:27.544458 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 722/1501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:27 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:27.551254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:27.556543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:27.564175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:27.565016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:27.565695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:27.566664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:27.576135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:27.576869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:27.892076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.912260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.914084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:27.922278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69f15f5f-bad0-4fd4-9e78-f95ae893c41e tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1879 microversion: 2.32 time: 0.374788 Aug 23 10:42:27.922993 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 723/1502] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:27 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1879 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:27.927856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50e6f211-d0d3-4e9f-98e7-a74dd5b55332 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1ec9dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:28.004599 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50e6f211-d0d3-4e9f-98e7-a74dd5b55332 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.080142 Aug 23 10:42:28.005523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 724/1503] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:27 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:28.013288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:28.014236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:28.023458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:28.024822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:28.025451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:28.027507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:28.028084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:28.028907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:28.156283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:28.180280 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db4fcaa8-fbc9-4b45-a339-c1e782e5ef50 tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1937 microversion: 2.75 time: 0.173178 Aug 23 10:42:28.181618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 725/1504] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:28 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1937 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:28.201536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:28.203851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:28.210621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:28.211274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:28.212134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:28.213228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:28.214756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:28.215471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:28.528622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:28.542503 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b612d09c-06b0-4458-9237-5fcc1cc6a851 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.358912 Aug 23 10:42:28.551470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 726/1505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:28 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:28.565657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:28.567503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:28.597403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:28.597922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:28.598378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:28.599111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:28.599578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:28.600010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:29.078262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:29.091214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:29.096515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:29.097949 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-048443c6-a26b-47a8-9b90-587bde5f72e3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.545218 Aug 23 10:42:29.127189 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 727/1506] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:28 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:29.152332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:29.153206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:29.162583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:29.163102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:29.163554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:29.166432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:29.169286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:29.170749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:29.711827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:29.732393 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16c4acdb-5920-4273-baae-b08f011771fa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.599769 Aug 23 10:42:29.735682 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 728/1507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:29 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:29.746721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:29.748962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:29.769824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:29.771578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:29.772195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:29.773123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:29.777902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:29.778782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.185137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:30.196635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:30.199703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:30.201451 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7355092-58db-444a-b3e0-60b49f50c498 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2830 microversion: 2.32 time: 0.463571 Aug 23 10:42:30.203100 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 729/1508] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:29 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2830 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:30.209464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d3da10b-c998-4918-95ea-1252caa4b17f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1eee280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:30.273579 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d3da10b-c998-4918-95ea-1252caa4b17f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.069016 Aug 23 10:42:30.278347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 730/1509] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:30 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:30.283621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-18956650-8dcd-4f2d-8b16-7a307b585d7d req-4ecb4b17-683c-42d5-99c4-873aa8b6176d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "465d3faa-5cc1-4087-9589-d137378f09ad", "tag": "ef0de150-72f9-464f-a35d-16625dc95f35"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:30.297095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-18956650-8dcd-4f2d-8b16-7a307b585d7d req-4ecb4b17-683c-42d5-99c4-873aa8b6176d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.297887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-18956650-8dcd-4f2d-8b16-7a307b585d7d req-4ecb4b17-683c-42d5-99c4-873aa8b6176d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.298506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-18956650-8dcd-4f2d-8b16-7a307b585d7d req-4ecb4b17-683c-42d5-99c4-873aa8b6176d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.311511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-18956650-8dcd-4f2d-8b16-7a307b585d7d req-4ecb4b17-683c-42d5-99c4-873aa8b6176d service nova] Creating event network-changed:ef0de150-72f9-464f-a35d-16625dc95f35 for instance 465d3faa-5cc1-4087-9589-d137378f09ad on n-h2-847009-13 Aug 23 10:42:30.317960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-18956650-8dcd-4f2d-8b16-7a307b585d7d req-4ecb4b17-683c-42d5-99c4-873aa8b6176d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037117 Aug 23 10:42:30.319628 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 731/1510] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:30.327683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:30.328691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:30.335310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.336182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.336846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.337926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.338553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.339191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.363387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:30.467155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:30.494730 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e42966a-4141-4cbd-8980-9889e647f42b tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1937 microversion: 2.75 time: 0.173168 Aug 23 10:42:30.496808 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 732/1511] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:30 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1937 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:30.502925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:30.503867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:30.511750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.512827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.514778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.516485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.517219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.517884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.607974 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f41a4aa-e3e8-43f9-834c-f729a40e8dd3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.355704 Aug 23 10:42:30.610026 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 780/1512] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:42:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:30.842891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-12a88eef-18bc-4e9c-ad2a-6a49df74abdf req-df638200-3345-4c59-9c33-f0b005e2be32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c55817a-7f2f-4d09-9f3e-d3428bbed107", "name": "network-vif-plugged", "status": "completed", "tag": "088689b9-d59f-42c1-9193-62fdab23084d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:30.863735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-12a88eef-18bc-4e9c-ad2a-6a49df74abdf req-df638200-3345-4c59-9c33-f0b005e2be32 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.864720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-12a88eef-18bc-4e9c-ad2a-6a49df74abdf req-df638200-3345-4c59-9c33-f0b005e2be32 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.865472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-12a88eef-18bc-4e9c-ad2a-6a49df74abdf req-df638200-3345-4c59-9c33-f0b005e2be32 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.880415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-12a88eef-18bc-4e9c-ad2a-6a49df74abdf req-df638200-3345-4c59-9c33-f0b005e2be32 service nova] Creating event network-vif-plugged:088689b9-d59f-42c1-9193-62fdab23084d for instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 on n-h2-847009-13 Aug 23 10:42:30.889496 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-12a88eef-18bc-4e9c-ad2a-6a49df74abdf req-df638200-3345-4c59-9c33-f0b005e2be32 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277199 Aug 23 10:42:30.890569 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 781/1513] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:30.899973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:30.900820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:30.911109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.911709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.912218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:30.913426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:30.914107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:30.914743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:31.062932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:31.083213 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8756f057-16cd-413a-8052-07986823b1a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.584922 Aug 23 10:42:31.084100 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 733/1514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:30 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:31.091387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:31.092344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:31.100070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:31.100842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:31.101650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:31.103129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:31.103760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:31.105583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:31.196455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:31.208504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:31.211452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:31.212931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f745a845-658b-41cb-b0cc-db92baf4aa51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.320982 Aug 23 10:42:31.213586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 782/1515] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:30 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:31.220870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:31.221815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:31.231689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:31.232883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:31.233533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:31.234491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:31.235180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:31.235837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:31.443093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:31.451765 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c70eaf5b-c821-43fd-a4c1-5bfe8773f2a2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.235952 Aug 23 10:42:31.467578 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 783/1516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:31 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:31.473341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1661932257", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "7380efd3-97d2-489c-88db-bb3014da90df"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:31.555890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] validate_networks() for [('7380efd3-97d2-489c-88db-bb3014da90df', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:42:31.664338 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4557b45-7395-4d95-9598-1b50c12c7534 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.578776 Aug 23 10:42:31.675294 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 734/1517] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 10:42:31 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06/os-interface => generated 1831 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:31.675294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3383470-6cf6-4764-a189-fa834f6e72a0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1e96550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:31.802477 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3383470-6cf6-4764-a189-fa834f6e72a0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.135501 Aug 23 10:42:31.803135 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 735/1518] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:31 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:31.813741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:31.814642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:31.821569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:31.843149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:31.843927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:31.844631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:31.845641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:31.846276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:31.846873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.028400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] Lazy-loading 'services' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:32.073278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f2245f0-1df6-4582-a8fa-2d427d5f2abf tempest-ServersAdmin275Test-42285192 tempest-ServersAdmin275Test-42285192-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1922 microversion: 2.75 time: 0.263344 Aug 23 10:42:32.075005 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 736/1519] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:31 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1922 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:32.108891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:32.109780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:32.123287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:32.123790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:32.124507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.125291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:32.125755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:32.126204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.543067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:32.557642 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2dbb2806-1166-4470-a5e6-816574e8950e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1716 microversion: 2.1 time: 0.453678 Aug 23 10:42:32.574939 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 737/1520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:32 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1716 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:32.585118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:32.587758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:32.599867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:32.600560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:32.601196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.602296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:32.603075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:32.603761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.643865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:42:32.757549 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98543666-bb67-4f86-abca-43681d65a068 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 204 len: 0 microversion: 2.75 time: 0.180394 Aug 23 10:42:32.766186 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 738/1521] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:42:32 2022] DELETE /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:42:32.772691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:32.773472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:32.781913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:32.782572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:32.783604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.783754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:32.784187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:32.784619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:32.964533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:32.983229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:32.985386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:32.986656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-946617ab-a52e-4c98-af44-f26960bc80f6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.219219 Aug 23 10:42:32.987618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 739/1522] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:32 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:33.002299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:33.007935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:33.019744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.020515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.021233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.022462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.023364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.024180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.195875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:42:33.197100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:42:33.199291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:42:33.200265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:42:33.200772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:42:33.220347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.220981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.221385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:33.221912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.222387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.222949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.226894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.232185 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe1b8d68-964e-40c6-a552-f6c0e012b323 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.243201 Aug 23 10:42:33.245296 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 740/1523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:32 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:33.245296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:33.245296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:33.246395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.246894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.247334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.248892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.248892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.249199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.267898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Getting quotas for project 47a750024d634a43b5f854401d5afa43. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:42:33.273592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Getting quotas for user 45ac7be54bb940b9b2e0cb4559c64019 and project 47a750024d634a43b5f854401d5afa43. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:42:33.287357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:42:33.289874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:42:33.345284 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ed77d47-b83c-497e-a0b1-4e9f895e7b9d tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875819 Aug 23 10:42:33.346039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 784/1524] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:42:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:42:33.350826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0c119a07-b931-45e7-884d-e3610630fdd5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1daeb80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:33.356591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:33.366308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:33.367832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:33.373954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34c07b33-7c01-4fe3-9f07-8844eca543ae tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1444 microversion: 2.75 time: 0.139670 Aug 23 10:42:33.374841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 741/1525] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:33 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:33.398224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7972e2a6-d3f9-4691-aa65-cc54734724b5 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:33.399164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7972e2a6-d3f9-4691-aa65-cc54734724b5 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:33.434011 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0c119a07-b931-45e7-884d-e3610630fdd5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.086845 Aug 23 10:42:33.435519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 785/1526] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:33 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:33.467612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7972e2a6-d3f9-4691-aa65-cc54734724b5 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:33.477593 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7972e2a6-d3f9-4691-aa65-cc54734724b5 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1224 microversion: 2.1 time: 0.101675 Aug 23 10:42:33.489013 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 742/1527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:33 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:33.589775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:33.590621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:33.610488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.610989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.612013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:33.612783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:33.613292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:33.613669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.016903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.017833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:34.027168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.028186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.029262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.030189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.030864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.032437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.197485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.207378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.210571 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-332d2965-f8c9-4d24-b4b9-895d3f457b4e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1706 microversion: 2.1 time: 0.625449 Aug 23 10:42:34.223722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.225015 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 786/1528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:33 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1706 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:34.228790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.228790 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63909660-70f0-42dd-a7b4-db81592df349 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.217539 Aug 23 10:42:34.228790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 743/1529] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:34.257799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0604fc35-a8f5-44b7-91ab-3a9967625e8e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '.version_select at 0x7fdca1d5c160>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.258660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.259293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:34.263196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0604fc35-a8f5-44b7-91ab-3a9967625e8e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.263697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0604fc35-a8f5-44b7-91ab-3a9967625e8e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.264142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0604fc35-a8f5-44b7-91ab-3a9967625e8e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.268981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.269834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.270522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.271518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.273019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.273725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.289092 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0604fc35-a8f5-44b7-91ab-3a9967625e8e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3928 microversion: 2.1 time: 0.034874 Aug 23 10:42:34.302335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 787/1530] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/os-migrations => generated 3928 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:34.309708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.310409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:34.316808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.317324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.317811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.318522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.318977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.319661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.511143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.521647 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9da69a89-f0bc-4fc6-8720-7384fc4c684e tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1476 microversion: 2.1 time: 0.267480 Aug 23 10:42:34.538360 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 744/1531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:34.545660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.546553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:34.553166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.553881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.554514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.555400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.556031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.556626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.636509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.647643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.649490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:34.658590 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a74ef12-7552-43d6-bf1f-8d9da797e5b5 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1444 microversion: 2.75 time: 0.118669 Aug 23 10:42:34.660106 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 745/1532] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:34.682015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f21273d-4002-4d97-a566-b89e1354d36a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ca4a550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.740640 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f21273d-4002-4d97-a566-b89e1354d36a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.062447 Aug 23 10:42:34.752112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 746/1533] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:34.758429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.759136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:34.767052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.767374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.767872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.768621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.769229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.769742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.809488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ccdcb98-5ac4-4906-a540-43b9e37ce613 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1859 microversion: 2.1 time: 0.504452 Aug 23 10:42:34.817632 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 788/1534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1859 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:34.848301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:34.849364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:34.853980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:34.865994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.866864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.868590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.873653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:34.874719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:34.878767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:34.989978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:35.000547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a2c8982-da12-4b8d-b266-c88fb0812a14 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1228 microversion: 2.1 time: 0.247438 Aug 23 10:42:35.003286 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 747/1535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1228 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:35.070010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-620b8362-7569-4410-b52e-055bf9332847 req-0db14b9e-0c7a-4ad3-8c19-436402cfe024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "tag": "d7fc2d75-be2d-4fc6-8f63-c92af11191c8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:35.089781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-620b8362-7569-4410-b52e-055bf9332847 req-0db14b9e-0c7a-4ad3-8c19-436402cfe024 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.090351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-620b8362-7569-4410-b52e-055bf9332847 req-0db14b9e-0c7a-4ad3-8c19-436402cfe024 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.095131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-620b8362-7569-4410-b52e-055bf9332847 req-0db14b9e-0c7a-4ad3-8c19-436402cfe024 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.119332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-620b8362-7569-4410-b52e-055bf9332847 req-0db14b9e-0c7a-4ad3-8c19-436402cfe024 service nova] Creating event network-changed:d7fc2d75-be2d-4fc6-8f63-c92af11191c8 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:42:35.131222 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-620b8362-7569-4410-b52e-055bf9332847 req-0db14b9e-0c7a-4ad3-8c19-436402cfe024 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065088 Aug 23 10:42:35.134468 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 748/1536] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:35.254370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:35.255270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:35.270165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.270919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.277920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.282574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.283573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.284435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.476240 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14b620b0-063e-43e0-8eda-2c9f21baebac tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1859 microversion: 2.1 time: 0.627173 Aug 23 10:42:35.477696 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 789/1537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:34 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1859 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:35.544276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:35.544931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:35.557959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.558782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.559415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.560346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.561071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.561687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.693559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:35.708549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:35.710083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:35.711272 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c580794f-a796-4f8d-835c-48a351405c1d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.463341 Aug 23 10:42:35.713245 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 749/1538] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:35 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:35.724403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:35.729956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:35.740708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.741530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.742136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.743024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:35.743801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:35.744417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:35.878284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:35.896011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lazy-loading 'services' on Instance uuid 4b74d026-1d35-4393-95b4-2ac77f28b3d1 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:35.943667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:35.975037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b64c2a94-2430-40f6-b67c-f1e26aad5370 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1475 microversion: 2.1 time: 0.435354 Aug 23 10:42:35.990460 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 790/1539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:35 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1475 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:36.014530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:36.019342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:36.032456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.033199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.034171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.035004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.035630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.036219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.133410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-606ae9a5-88e5-401d-b453-159b98ab6a9b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments/a0063810-4466-4826-806d-e3cbc7dd5025" status: 202 len: 0 microversion: 2.1 time: 0.418363 Aug 23 10:42:36.137563 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 750/1540] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 10:42:35 2022] DELETE /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments/a0063810-4466-4826-806d-e3cbc7dd5025 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:42:36.147115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21567a77-0113-48b1-a7d9-37c29e6c3673 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ca3fd30>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:36.203152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:36.218211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:36.223347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:36.239950 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f67c8cc6-c920-4b57-9734-012b4dffc18a tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1444 microversion: 2.75 time: 0.237208 Aug 23 10:42:36.245665 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 791/1541] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:35 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1444 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:36.253749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:36.263310 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21567a77-0113-48b1-a7d9-37c29e6c3673 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.123856 Aug 23 10:42:36.264867 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 751/1542] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:36 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:36.267439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:36.280524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:36.286141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.293645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.294168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:36.297755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.298850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.299479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.300900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.311755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.319581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.324126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.325388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.326125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.328288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.414224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa23dd5a-bada-42bf-aba1-9ab7e9f21ffc tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148209 Aug 23 10:42:36.416050 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 752/1543] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:36 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:36.740918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:36.741558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:36.762777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.763290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.763736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:36.781063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:36.783644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:36.783644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.098218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:37.117576 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ad56726-3898-4da2-8da8-9d3a4a441b85 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1276 microversion: 2.1 time: 0.865855 Aug 23 10:42:37.132933 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 792/1544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:36 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1276 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:37.138167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:37.143221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:37.160563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.162089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.163284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.174625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.175389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.176022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.440870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:37.465800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:37.471603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:37.477713 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20a35dd7-19fb-4e4c-a24a-4987cc726324 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.745182 Aug 23 10:42:37.498841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 753/1545] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:36 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:37.515954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ac8a63b-79f0-48a8-aa3d-b34b0e5e16ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1ed9af0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:37.629075 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ac8a63b-79f0-48a8-aa3d-b34b0e5e16ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.129293 Aug 23 10:42:37.636522 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 754/1546] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:37 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:37.641811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:37.654907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:37.674166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.678386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.684262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.687449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.687916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.688368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.813127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.813630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.824022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.824300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lazy-loading 'fault' on Instance uuid ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:42:37.841674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:37.852010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15f1be41-e17c-4757-97f8-88144ae32ee2 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1475 microversion: 2.1 time: 0.717622 Aug 23 10:42:37.856187 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 793/1547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:37 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1475 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:37.868712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:37.874741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:37.891889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.892664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.893309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.894198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:37.894815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:37.896757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:37.934211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:37.991446 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d547f7ff-f4fa-491f-b4fd-271fc21f410a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125225 Aug 23 10:42:37.992376 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 794/1548] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:37 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:38.066406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:38.082956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:38.084487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9847b47a03d848b2b1d5c23a3e74ba63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24c1dbfc8cd4622b7f4ffe6e99f0e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:38.112119 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-664ce47b-6c42-48a9-86d7-5b20fe6b294b tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 200 len: 1449 microversion: 2.75 time: 0.474139 Aug 23 10:42:38.112725 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 755/1549] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:37 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 1449 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:38.140067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:38.140681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:38.163194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.163689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.164131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:38.164880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.165350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.165775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:38.245083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "name": "network-vif-unplugged", "status": "completed", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:38.290861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.290861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.292311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:38.335709 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] Creating event network-vif-unplugged:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h1-847009-13 Aug 23 10:42:38.354545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:42:38.387302 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7b385338-4cca-421b-a0ac-bbde7d13e95d req-4c80ec73-04c4-4267-a5f5-a8a5cf151b43 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147797 Aug 23 10:42:38.388626 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 756/1550] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:42:38.512318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:38.513244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:38.528352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.530197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.530924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:38.532612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.537170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.538286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:38.538855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:38.553949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d521938b-0b4d-4284-8c6f-e1048c1193a2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1282 microversion: 2.1 time: 0.418407 Aug 23 10:42:38.558002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 795/1551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:38 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1282 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:38.643988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea03d462-59a3-40fd-8911-186a94627a32 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1da20d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:38.800164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea03d462-59a3-40fd-8911-186a94627a32 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.160491 Aug 23 10:42:38.801536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 796/1552] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:38 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:38.886697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:38.887683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:38.902210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.905295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.907250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:38.913026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:38.913864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:38.915104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.215629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:39.241137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:39.248319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:39.261594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f00d951-7b58-4927-be7a-db270e570a61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.749507 Aug 23 10:42:39.282019 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 757/1553] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:38 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:39.321273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:39.332311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:39.347342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:39.350183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:39.350864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.351953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:39.352606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:39.353864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.457308 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59f88596-dbae-405e-92bb-72d39b2dd613 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172699 Aug 23 10:42:39.466075 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 758/1554] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:39 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:39.473072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:39.473965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] [instance: ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:39.480859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:39.481609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:39.482228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.483118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:39.483799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:39.484406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.515720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] HTTP exception thrown: Instance ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 could not be found. Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Request method failure captured: Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 HTTP/1.1 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6-vmdVv1kT1uuK7hQj_XZcNXLUWjKB0tPmGa8_kqPonFVICCr93z1sSz-DSpBwpI9OuY7GTMyeaEf2r4KhjWHizSxwaHRMWeS1tBfAUAhecNmhA38F6amihkIYj0GdkChecWFKsrOkyyxQuBb7WBLHdtrG6fDHZT4GjAserMBIJ3o Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.75 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: a24c1dbfc8cd4622b7f4ffe6e99f0e92 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersAdmin275Test-1084043341 Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:42:39.520030 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a24c1dbfc8cd4622b7f4ffe6e99f0e92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a24c1dbfc8cd4622b7f4ffe6e99f0e92", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a24c1dbfc8cd4622b7f4ffe6e99f0e92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a24c1dbfc8cd4622b7f4ffe6e99f0e92"}]}] Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersAdmin275Test-1084043341 Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: a24c1dbfc8cd4622b7f4ffe6e99f0e92 Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersAdmin275Test-1084043341 Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersAdmin275Test-1084043341-project Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9847b47a03d848b2b1d5c23a3e74ba63 Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersAdmin275Test-1084043341-project Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 could not be found. Aug 23 10:42:39.521974 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5'} Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 could not be found. Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:42:39.522943 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 could not be found. Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 could not be found. Aug 23 10:42:39.524579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:42:39.530190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] Returning 404 to user: Instance ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:42:39.531544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-058d87c1-c056-4549-95fb-4c2433518400 tempest-ServersAdmin275Test-1084043341 tempest-ServersAdmin275Test-1084043341-project] 10.222.0.78 "GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5" status: 404 len: 111 microversion: 2.75 time: 0.063073 Aug 23 10:42:39.538206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 759/1555] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:39 2022] GET /compute/v2.1/servers/ccc93606-aaf7-43dc-b1e7-c5e6c3714dc5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:42:39.578324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:39.579786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:39.594591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:39.595367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:39.596055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.597206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:39.598037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:39.599780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:39.725098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:39.786426 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d90d4de-fde9-4d19-8df2-f9b11c4a38dc tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1475 microversion: 2.1 time: 0.903920 Aug 23 10:42:39.787459 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 797/1556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:38 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1475 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:39.816358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e8d89971-d913-44d0-82d5-0e5f4b513d43 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1d2b670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:39.914897 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e8d89971-d913-44d0-82d5-0e5f4b513d43 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.102621 Aug 23 10:42:39.915774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 798/1557] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:39 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:40.001165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:40.020136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cec5dfc5-8aad-4aa1-bc2f-668cc2c6dfdf tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1282 microversion: 2.1 time: 0.445854 Aug 23 10:42:40.027719 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 760/1558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:39 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1282 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:40.295029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:40.295913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:40.311527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.312320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.312988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:40.316275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.317016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.317733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:40.474879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:40.477297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:40.495618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.498483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.499130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:40.499958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.501632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.504925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:40.569587 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c63d663-9872-44c0-8760-3fe2d919e78e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099175 Aug 23 10:42:40.576835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 761/1559] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:40 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:40.593106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:40.616868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.617641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.618077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:40.647614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] Creating event network-changed:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h1-847009-13 Aug 23 10:42:40.663310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:42:40.692692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-eff80a16-b925-48f0-8ccd-fedc2e09ac6f req-c0f8a0a6-614e-4da1-bf0a-b30397bde4a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112478 Aug 23 10:42:40.697924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 762/1560] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:40.813926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:40.815340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:40.828611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.831819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.832486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:40.833435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:40.834944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:40.837284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:41.050835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:41.073447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:41.083958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:41.091583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3cb9b7fc-ec3f-4f2a-ae8e-d3538c50153f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.796247 Aug 23 10:42:41.109449 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 799/1561] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:40 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:41.134929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac1b0548-797f-4e31-8046-837a6f9c7ca6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1e0e700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:41.223283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac1b0548-797f-4e31-8046-837a6f9c7ca6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.112292 Aug 23 10:42:41.232313 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 800/1562] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:41 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:41.238604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:41.239625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:41.248124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:41.248893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:41.249718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:41.250610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:41.251235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:41.251896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:41.768444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:41.785815 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e105515-e7d0-4457-8a2b-c8208353117b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.550567 Aug 23 10:42:41.786934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 801/1563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:41 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:41.803617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:41.807159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:41.819335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:41.822194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:41.822528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:41.825889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:41.828428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:41.829042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:41.886585 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67695ce2-c8d8-4cb1-bffb-7cb5bde15a5b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097265 Aug 23 10:42:41.893665 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 802/1564] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:41 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:41.901573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:41.909735 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dd5e88c-2965-465d-81ef-663e00b30684 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1475 microversion: 2.1 time: 1.100282 Aug 23 10:42:41.910320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 763/1565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:40 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1475 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:42.125395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:42.125949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:42.137583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:42.140245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:42.140712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:42.145566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:42.146129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:42.147395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:42.243640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82c1ce31-605e-44ce-82e3-285245a1a6f8 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cf97b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:42.336723 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82c1ce31-605e-44ce-82e3-285245a1a6f8 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.101083 Aug 23 10:42:42.346502 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 764/1566] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:42 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:42.454837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:42.468196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:42.482845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:42.484375 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e31733bf-5960-4b87-af25-e8125a711bcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.365207 Aug 23 10:42:42.485556 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 803/1567] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:42 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:42.812480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:42.813296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:42.834009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:42.834581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:42.835040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:42.839320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:42.841350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:42.841881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:42.902536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:42.909728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:42.924773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:42.929897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:42.931896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:42.933712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:42.942931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:42.945123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:43.017339 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36b91bf8-750b-477d-aa39-da41fd794f84 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119785 Aug 23 10:42:43.023770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 804/1568] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:42 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:42:43.034639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:43.035698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:43.043926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:43.044830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:43.045545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:43.046520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:43.047214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:43.047900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:43.207947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:43.226309 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b13bf9b-294b-4554-b94d-55c2647acf7b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.423179 Aug 23 10:42:43.227360 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 765/1569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:42 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:43.248973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:43.282321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:43.358245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5b55b9f-74bc-4819-8e18-00ff70c16de4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1dd3e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:43.450053 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5b55b9f-74bc-4819-8e18-00ff70c16de4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.097606 Aug 23 10:42:43.460067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 766/1570] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:43 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:43.527040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:43.527997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:43.541192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:43.548478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:43.550800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:43.551278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:43.552520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:43.555364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:43.556021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:43.837037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:43.850037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5545aa38-e35f-4034-acd2-4f0337f8c59c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1473 microversion: 2.1 time: 0.819508 Aug 23 10:42:43.853557 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 805/1571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:43 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1473 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:44.251217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3764e2d7-0b28-4fab-a4f9-1eaf6b2a70ea req-013e248c-9918-42fb-afae-23061dc8ff7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916eb643-8e14-4230-8587-56faf3c8c6bc", "tag": "2cf3a722-9639-4d09-9c55-4aea7029cde3"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:44.276403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3764e2d7-0b28-4fab-a4f9-1eaf6b2a70ea req-013e248c-9918-42fb-afae-23061dc8ff7f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.277546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3764e2d7-0b28-4fab-a4f9-1eaf6b2a70ea req-013e248c-9918-42fb-afae-23061dc8ff7f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.281527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3764e2d7-0b28-4fab-a4f9-1eaf6b2a70ea req-013e248c-9918-42fb-afae-23061dc8ff7f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:44.299341 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3764e2d7-0b28-4fab-a4f9-1eaf6b2a70ea req-013e248c-9918-42fb-afae-23061dc8ff7f service nova] Creating event network-changed:2cf3a722-9639-4d09-9c55-4aea7029cde3 for instance 916eb643-8e14-4230-8587-56faf3c8c6bc on n-h2-847009-13 Aug 23 10:42:44.311757 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3764e2d7-0b28-4fab-a4f9-1eaf6b2a70ea req-013e248c-9918-42fb-afae-23061dc8ff7f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.454680 Aug 23 10:42:44.314905 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 806/1572] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:44.329961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:44.332475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:44.357131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.359073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.361379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:44.362331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.365166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.367863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:44.500026 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5282d279-81ac-4c79-a5af-5554a308cf2e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183338 Aug 23 10:42:44.513272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 807/1573] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:44 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:44.522855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:44.523971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:44.546797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:44.564197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:44.567118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.567680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.568135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:44.568904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.569098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:44.569367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.570980 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5907d0be-ab49-4055-8774-ddc383d85628 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 1.061038 Aug 23 10:42:44.572072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 767/1574] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:43 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:44.581609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:44.599717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe493e3a-029d-4ffd-bbaa-857112cae076 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ca3fdc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:44.711720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe493e3a-029d-4ffd-bbaa-857112cae076 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.137815 Aug 23 10:42:44.712558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 768/1575] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:44 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:44.883243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:44.884616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:44.913834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.918149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.920442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:44.923982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:44.929468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:44.931062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:45.016302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:45.047714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6ad7550-aea0-4669-9aa8-effea3c50a52 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.526720 Aug 23 10:42:45.050530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 808/1576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:44 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:45.394832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:45.405439 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ec24e23-9ad8-4519-9135-4fefab87fc0d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1473 microversion: 2.1 time: 0.531533 Aug 23 10:42:45.411159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 769/1577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:44 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1473 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:45.518269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:45.521934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:45.541082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:45.542781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:45.545507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:45.546679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:45.549514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:45.550650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:45.602949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:45.604288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:45.616781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:45.617520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:45.617976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:45.619982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:45.620529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:45.621016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:45.632322 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-baac4c2a-3d56-4e4c-a693-d541a0e3d9b6 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121024 Aug 23 10:42:45.634018 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 809/1578] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:45 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:45.731206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a19d16d5-ab36-42d3-a890-fd658509a340 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1ee8f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:45.855761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a19d16d5-ab36-42d3-a890-fd658509a340 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.132305 Aug 23 10:42:45.856767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 810/1579] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:45 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:45.899888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:45.910859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:45.913293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:45.914824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bdea31b-f95e-4cbf-b9c8-0924ae1b8026 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.316893 Aug 23 10:42:45.916002 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 770/1580] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:45 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:46.092075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:46.093056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:46.103841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:46.109367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:46.118643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:46.119852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:46.122046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:46.123012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:46.426764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:46.427398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:46.443054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:46.443558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:46.444011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:46.444767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:46.445241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:46.445675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:46.871028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:46.882605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:46.898494 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8b9beffb-c929-427b-bd0e-e651207d94f9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.826043 Aug 23 10:42:46.908369 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7bef01f6-4a59-44ac-8163-b43978681eeb tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1470 microversion: 2.1 time: 0.485490 Aug 23 10:42:46.909360 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 811/1581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:46 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:46.910695 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 771/1582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:46 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1470 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:46.947072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c9e57d3-41b9-421f-aaa4-ae90cb41278b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cf97ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:47.054054 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c9e57d3-41b9-421f-aaa4-ae90cb41278b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.137890 Aug 23 10:42:47.054871 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 772/1583] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:46 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:47.064230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:47.069241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:47.086931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:47.087863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:47.088761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:47.096584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:47.097352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:47.098050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:47.192685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:47.390808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:47.391327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:47.405109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:47.409410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:47.410269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:47.411227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:47.411900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:47.416238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:47.455479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-033c6d35-a60f-4172-a35d-2d59839f9805 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "POST /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76/action" status: 202 len: 0 microversion: 2.1 time: 0.398756 Aug 23 10:42:47.456792 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 773/1584] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:42:47 2022] POST /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:42:47.465564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:47.466850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:47.487403 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ee987fc-017b-4ebf-a67a-65855351e43b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.572402 Aug 23 10:42:47.488205 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 812/1585] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:46 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 197 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:47.549278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:47.549792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:47.555654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:47.560885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:47.561287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:47.562532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:47.683990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1381375432", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:47.842090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:42:48.227262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:48.241100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:48.242830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:48.245812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f23f0e2-de5a-48e8-9035-5a7aa48048da tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.787661 Aug 23 10:42:48.256824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 774/1586] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:47 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:48.256824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:48.256824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:48.265771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:48.265771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:48.265771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:48.266544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:48.267199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:48.267856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:48.556269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:42:48.559525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:42:48.560095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:42:48.561671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:42:48.562120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:42:48.563970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:48.572469 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-922445ad-6916-4f3e-a0ae-6a524d6ecce0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.324890 Aug 23 10:42:48.581924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 775/1587] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:48 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:48.589744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:48.590382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:48.595318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:48.595930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:48.596491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:48.597384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:48.597970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:48.598562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:48.604314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:48.605095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:48.605511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:48.606243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:48.606719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:48.607155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:48.630544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Getting quotas for project 6e6d1fb6028648d08c102f897e00bc7a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:42:48.648472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Getting quotas for user 76e6a58c430c4b9089e6d60633ca1ca8 and project 6e6d1fb6028648d08c102f897e00bc7a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:42:48.675809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:42:48.678475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:42:48.792201 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8bcde7eb-2531-4651-8474-56ed19e743e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295315 Aug 23 10:42:48.803546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 813/1588] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:42:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:42:48.814448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-055a8a6a-10db-4442-ba81-4d5d7c1ced77 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1d37f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:48.991919 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-055a8a6a-10db-4442-ba81-4d5d7c1ced77 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.187938 Aug 23 10:42:48.996110 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 814/1589] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:48 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:49.017123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:49.019822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:49.030790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:49.031530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:49.033679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:49.039042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:49.039418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:49.040153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:49.040862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:49.054319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17ae7198-1db9-4fd0-a2be-8a5fb73e60d2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.471214 Aug 23 10:42:49.074941 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 776/1590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:48 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:49.093107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f05abf8-8f40-474e-8841-8194cd746943 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:49.094074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f05abf8-8f40-474e-8841-8194cd746943 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:49.134329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49ef2270-422c-4baa-bdb5-7fbf3094255a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136309 Aug 23 10:42:49.134931 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 815/1591] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:42:48 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:42:49.274082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:49.276639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:49.279151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f05abf8-8f40-474e-8841-8194cd746943 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:49.290967 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f05abf8-8f40-474e-8841-8194cd746943 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1214 microversion: 2.1 time: 0.214545 Aug 23 10:42:49.292947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:49.294853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:49.296458 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 777/1592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:49 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:49.297998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:49.299832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:49.301342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:49.303366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:49.645783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:49.649444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:49.667423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:49.669321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:49.671870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:49.672673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:49.673185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:49.673630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:49.920433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:49.951462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:49.962998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:49.964674 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8fc9d6a6-00e5-447b-b26e-5f60127ed1ca tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.694908 Aug 23 10:42:49.969466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 816/1593] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:49 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:50.010426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3240a80-229c-4be2-84fd-f39e665c4da4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1d37ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:50.072404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:50.086290 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2eb8e1f-c421-4bf2-be21-1c167fbe5971 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.457360 Aug 23 10:42:50.100797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 778/1594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:49 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:50.106756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:50.107470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:50.115293 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3240a80-229c-4be2-84fd-f39e665c4da4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1414 microversion: 2.1 time: 0.111188 Aug 23 10:42:50.115875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 817/1595] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:50 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:50.127089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:50.127736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:50.128196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:50.132569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:50.133100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:50.137125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:50.316492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:50.317402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:50.330534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:50.331332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:50.336895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:50.337943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:50.339512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:50.340179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:50.395668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:50.519883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:50.535112 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f1a017a-c75d-46b1-b3c0-5dbf2d1d5cd6 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.441262 Aug 23 10:42:50.536070 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 779/1596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:50 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:50.683491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:50.697279 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9763daed-2834-4036-b94a-e002f4b7b13d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1210 microversion: 2.1 time: 0.384794 Aug 23 10:42:50.708771 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 818/1597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:50 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1210 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:50.729431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "name": "network-vif-plugged", "status": "completed", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:50.768926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:50.770042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:50.770773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:50.801469 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] Creating event network-vif-plugged:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h1-847009-13 Aug 23 10:42:50.816216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:42:50.859941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-eb3172f0-39a1-44a9-9663-d59386bd2fcc req-a7d0b243-f3eb-4e62-8b02-6dfe63cf9285 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158232 Aug 23 10:42:50.864471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 780/1598] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:42:50.991899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:50.994916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:51.016034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.016622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.018957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.020084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.021301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.022683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.113837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:51.114679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:51.122199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:51.124466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.125197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.125826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.126736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.127605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.128212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.378701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:51.394442 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ec613cb-352b-4819-8701-e9ca07ecdd2d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.283847 Aug 23 10:42:51.395203 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 781/1599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:51 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:51.400189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f851da9-b6b9-4bf9-ba21-1ea7d565cfb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb8a700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:51.459877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:51.469614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:51.471149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:51.471541 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f851da9-b6b9-4bf9-ba21-1ea7d565cfb0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1423 microversion: 2.1 time: 0.074283 Aug 23 10:42:51.472145 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 782/1600] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:51 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:51.472625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fbef6fc4-6386-4fa2-844b-1d79571bdbe3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.485295 Aug 23 10:42:51.473978 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 819/1601] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:50 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:51.493638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fef9d621-61f9-4631-a6d9-42fdbcf551c0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb09dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:51.564180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:51.564856 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fef9d621-61f9-4631-a6d9-42fdbcf551c0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 200 len: 1423 microversion: 2.1 time: 0.077353 Aug 23 10:42:51.565323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:51.569137 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 783/1602] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:42:51 2022] GET /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 1423 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:51.576381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.577240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.577937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.578906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.579595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.580168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00aae49c-bb56-44c2-95d5-08f205c3301c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cb8ae50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:51.580571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.861192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:51.873314 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-42d26566-d366-4fc6-a096-1b7579d3a51a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.312437 Aug 23 10:42:51.874098 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 820/1603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:51 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:51.889546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:51.890895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:51.899982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.901523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.902261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:51.903790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:51.904519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:51.905395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:52.003341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:52.013301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4a3ff8d-5e23-4c0c-890c-34661a857a2b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1266 microversion: 2.1 time: 0.137930 Aug 23 10:42:52.020593 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 821/1604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:51 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:52.089469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1143475718", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "74cc3c7c-cbc5-4030-9fbd-cd64a9917347"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:52.504470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00aae49c-bb56-44c2-95d5-08f205c3301c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 204 len: 0 microversion: 2.1 time: 0.928445 Aug 23 10:42:52.505253 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 784/1605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:51 2022] DELETE /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:42:52.511015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:52.512033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:52.534630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:52.540162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:52.540908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:52.543235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:52.545263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:52.545919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:52.606672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] validate_networks() for [('74cc3c7c-cbc5-4030-9fbd-cd64a9917347', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:42:52.767384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:52.778129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76d38421-79da-4133-a904-6cb828568827 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.271509 Aug 23 10:42:52.789230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 785/1606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:52 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:52.800376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:52.801312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:52.808366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:52.809286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:52.810000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:52.810977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:52.811670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:52.812724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.171558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:42:53.172709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:42:53.173230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:42:53.173667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:42:53.174081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:42:53.187298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.188642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.189514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.190944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.191598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.192203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.217866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Getting quotas for project d7758f6b11c1401ba1157f9c55afe615. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:42:53.224286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Getting quotas for user d6eec3ace5364b24bd7a466eef0ad082 and project d7758f6b11c1401ba1157f9c55afe615. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:42:53.230660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:53.248236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:53.253244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:53.254507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d1474ee-0c04-40bd-84a0-9236abeda2e1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.461565 Aug 23 10:42:53.255064 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 786/1607] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:52 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:53.278887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:53.279316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:53.280608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:42:53.284257 n-d-847009-13 devstack@n-api.service[128859]: WARNING nova.utils [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1143475718 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-114347571 Aug 23 10:42:53.285767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:42:53.289863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.290375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.291069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.291841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.292313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.292768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.327641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:42:53.368793 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7304558c-4f32-4049-9e9c-9fbda1283648 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346656 Aug 23 10:42:53.370188 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 822/1608] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:42:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:42:53.377608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:53.378337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:53.389493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.391349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.392252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.393458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.394105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.395237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.460941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-313fda9c-2e45-47b6-8a0b-731f4b7370e0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 204 len: 0 microversion: 2.1 time: 0.187838 Aug 23 10:42:53.462129 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 787/1609] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:42:53 2022] DELETE /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:42:53.475382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:53.480602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:53.490166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.490166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.490680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.491805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.492462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.493144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.662895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:53.671115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:53.683162 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86d58881-6873-4f10-a117-cdff00ad7cfd tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1266 microversion: 2.1 time: 0.217459 Aug 23 10:42:53.692995 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5362bf5b-0c87-4f26-b3eb-069bff0465e8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.314307 Aug 23 10:42:53.693337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 788/1610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:53 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:53.701020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 823/1611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:53 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:53.706253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d1fb3ad-88e6-4012-8162-f9bf69cc0c4e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:53.708898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d1fb3ad-88e6-4012-8162-f9bf69cc0c4e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:53.728833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f68fa2bb-45db-4dee-afee-4fdd6ce8d6be req-578ac2eb-1a48-4cb4-88b7-bc2abadbe16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916eb643-8e14-4230-8587-56faf3c8c6bc", "name": "network-vif-plugged", "status": "completed", "tag": "2cf3a722-9639-4d09-9c55-4aea7029cde3"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:53.754029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f68fa2bb-45db-4dee-afee-4fdd6ce8d6be req-578ac2eb-1a48-4cb4-88b7-bc2abadbe16d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.754534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f68fa2bb-45db-4dee-afee-4fdd6ce8d6be req-578ac2eb-1a48-4cb4-88b7-bc2abadbe16d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.754973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f68fa2bb-45db-4dee-afee-4fdd6ce8d6be req-578ac2eb-1a48-4cb4-88b7-bc2abadbe16d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.784301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f68fa2bb-45db-4dee-afee-4fdd6ce8d6be req-578ac2eb-1a48-4cb4-88b7-bc2abadbe16d service nova] Creating event network-vif-plugged:2cf3a722-9639-4d09-9c55-4aea7029cde3 for instance 916eb643-8e14-4230-8587-56faf3c8c6bc on n-h2-847009-13 Aug 23 10:42:53.794086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f68fa2bb-45db-4dee-afee-4fdd6ce8d6be req-578ac2eb-1a48-4cb4-88b7-bc2abadbe16d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087668 Aug 23 10:42:53.797546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 824/1612] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:53.802535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9d1fb3ad-88e6-4012-8162-f9bf69cc0c4e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:53.823820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-935363034", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "f3c62108-8f19-4a8d-8de7-8cbb5b2b0858"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:53.826813 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d1fb3ad-88e6-4012-8162-f9bf69cc0c4e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1232 microversion: 2.1 time: 0.138114 Aug 23 10:42:53.829364 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 789/1613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:53 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1232 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:53.834246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:53.835723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:53.846562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.847655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.848312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.849267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:53.850132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:53.850767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:53.977603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] validate_networks() for [('f3c62108-8f19-4a8d-8de7-8cbb5b2b0858', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:42:54.158399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:54.173581 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-141e7e7b-9b23-41e8-bc03-ac2a6f8944cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.342882 Aug 23 10:42:54.174169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 790/1614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:53 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:54.280091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:54.280882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:54.295368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.296160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.296839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.297788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.298252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.298809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.560228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:54.575847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:54.577922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:54.579593 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4601ecaf-70f2-4600-b770-b8000dbd2836 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.304498 Aug 23 10:42:54.580733 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 791/1615] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:54 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:54.710058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:54.712018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:54.721440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.722036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.722686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.723837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.724470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.725365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.734278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:54.844047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:54.860375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26f95c6b-49ad-42a4-a00d-2d9179a58280 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1272 microversion: 2.1 time: 0.156043 Aug 23 10:42:54.876967 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 792/1616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:54 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:54.883160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:54.884118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:54.885581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:42:54.887590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:42:54.888901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:42:54.889288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:42:54.890227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:42:54.896616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.897390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.897923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.898662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.899335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.899943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.906428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.909101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.909768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.910905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:54.911570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:54.912186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:54.953086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:42:54.999779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for user a2f47ead9ba342b2b1456305289c6188 and project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:42:55.020417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:42:55.028123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:42:55.032075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:42:55.129952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32c378f5-2398-4646-a39c-4cd3eb148638 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.316699 Aug 23 10:42:55.138459 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 825/1617] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:42:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:42:55.146144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:55.146792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:55.170848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:55.174282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:55.174808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:55.175580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:55.179725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:55.180679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:55.214091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:55.227056 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0944fb55-eb5a-4b85-b72a-4f81147dc045 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 0.348583 Aug 23 10:42:55.232471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 793/1618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:54 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:55.239653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e339c2ff-eb1a-4e81-adcf-21abafe29e23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:55.243938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e339c2ff-eb1a-4e81-adcf-21abafe29e23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:55.382138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:55.397239 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c83a19ac-435e-4a55-9971-d3099eafb07c tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1284 microversion: 2.1 time: 0.262129 Aug 23 10:42:55.411227 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 826/1619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:55 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:55.411227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:55.415448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:55.423217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e339c2ff-eb1a-4e81-adcf-21abafe29e23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:55.431263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:55.434024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:55.434619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:55.435323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:55.435797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:55.436237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:55.442775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e339c2ff-eb1a-4e81-adcf-21abafe29e23 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1207 microversion: 2.1 time: 0.203094 Aug 23 10:42:55.452949 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 794/1620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:55 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1207 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:55.606779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:55.607491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:55.626628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:55.627134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:55.629765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:55.630454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:55.630928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:55.631363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.002844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.027543 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-101d5d2c-6d6e-4273-a954-f54e96b3a8ee tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.625610 Aug 23 10:42:56.041734 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 827/1621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:55 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:56.056561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:56.058840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:56.089833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.094317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.094834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.095606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.105820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.106538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.393914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.405766 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba658e1d-d3f8-410b-be17-c87d907ca7af tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1272 microversion: 2.1 time: 0.361942 Aug 23 10:42:56.407566 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 828/1622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:56 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:56.414353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:56.415396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:56.423818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.424876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.426288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.427275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.427986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.428621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.565534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.576072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.577993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.579432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8a108f3-0953-4c5d-a983-7f1002f9448b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.977989 Aug 23 10:42:56.580339 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 795/1623] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:55 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:42:56.585509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:56.586415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:56.594069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.595042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.595698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.596720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.597421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.598061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.697019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.708907 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c9f083c-55d8-4a88-b898-7a069d8074c1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1284 microversion: 2.1 time: 0.127149 Aug 23 10:42:56.710214 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 796/1624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:56 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:56.715845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:56.716732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:56.723345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.724091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.724813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.725747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:56.726417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:56.727056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:56.885244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:56.897321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8798916c-11c5-4496-99d2-1a8d375d45b6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1203 microversion: 2.1 time: 0.185223 Aug 23 10:42:56.901132 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 797/1625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:56 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:57.047998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:57.048638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:57.061885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.062408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.062903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.071507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.074284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.074850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.515423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:57.526743 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee2ffeb7-73a7-453d-b614-da62e4048e54 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.481664 Aug 23 10:42:57.527844 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 798/1626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:57 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:57.532994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e0b97b54-cf0c-48c9-a66a-1174a75d4c99 req-93af6d81-1854-4320-a8aa-538f234eb24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c55817a-7f2f-4d09-9f3e-d3428bbed107", "name": "network-vif-deleted", "tag": "088689b9-d59f-42c1-9193-62fdab23084d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:57.543737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0b97b54-cf0c-48c9-a66a-1174a75d4c99 req-93af6d81-1854-4320-a8aa-538f234eb24a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.545541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0b97b54-cf0c-48c9-a66a-1174a75d4c99 req-93af6d81-1854-4320-a8aa-538f234eb24a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.546337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0b97b54-cf0c-48c9-a66a-1174a75d4c99 req-93af6d81-1854-4320-a8aa-538f234eb24a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.559740 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e0b97b54-cf0c-48c9-a66a-1174a75d4c99 req-93af6d81-1854-4320-a8aa-538f234eb24a service nova] Creating event network-vif-deleted:088689b9-d59f-42c1-9193-62fdab23084d for instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 on n-h2-847009-13 Aug 23 10:42:57.565905 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e0b97b54-cf0c-48c9-a66a-1174a75d4c99 req-93af6d81-1854-4320-a8aa-538f234eb24a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036349 Aug 23 10:42:57.569519 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 799/1627] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:57.576679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:57.577723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:57.584913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.586429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.587064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.587854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.589124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.590309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.614882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:57.639632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fdffc15c-3743-4748-8a25-d0f56abc52e2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1324 microversion: 2.1 time: 1.230200 Aug 23 10:42:57.658657 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 829/1628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:56 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1324 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:57.658657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:57.658657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:57.668167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.669305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.670157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.671099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.671862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.672506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.672905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:57.682170 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cbfcabb6-5300-4aa4-ba2c-e70cc45b7702 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1272 microversion: 2.1 time: 0.110972 Aug 23 10:42:57.683625 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 800/1629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:57 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:57.730306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:57.730933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:57.740807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.744918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.746288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.748835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.749834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.750921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.842447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:57.855540 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f6a7e5c-b580-46dc-9a26-402272d63250 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1290 microversion: 2.1 time: 0.129496 Aug 23 10:42:57.867257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 801/1630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:57 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1290 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:57.922505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:57.923142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:57.930962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.931457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.932479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:57.934586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:57.935076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:57.935512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:58.021972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:58.032599 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92e0f91f-ced5-46a7-af4c-c9eafc21a4f9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1259 microversion: 2.1 time: 0.113876 Aug 23 10:42:58.046504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 802/1631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:57 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1259 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:42:58.066127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:58.098331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:58.099835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:58.101141 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aae7a31f-0151-4d38-9578-a7958be501a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1811 microversion: 2.25 time: 0.451524 Aug 23 10:42:58.111180 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 830/1632] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:57 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1811 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:58.555088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:58.556851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:58.568510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:58.570946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:58.572372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:58.573495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:58.575182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:58.576210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:58.671212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:58.672909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:58.695998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:58.696641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:58.698435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:58.699037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:58.699519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:58.699987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:58.915805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:58.929205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76cda2c3-4753-4c51-ae73-c88ad9b30ef9 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.382283 Aug 23 10:42:58.941786 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 803/1633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:58 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:58.950384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:58.966243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:58.988159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:58.989476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:58.991445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:58.994251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:58.995458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:58.997914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.252571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.264799 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2db7949f-54d6-418e-a764-4940226a340a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.321238 Aug 23 10:42:59.265446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 804/1634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:58 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:59.270506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:59.271132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:59.277862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.278359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.278801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.280492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.281001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.281458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.357515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.362274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.367843 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f2c5868-5bac-4e1f-982d-89dea63b4f28 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 200 len: 1520 microversion: 2.1 time: 0.701724 Aug 23 10:42:59.369821 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 831/1635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:58 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 1520 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:59.373657 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5559e742-90d6-4795-b049-4fef92ab027b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1290 microversion: 2.1 time: 0.106811 Aug 23 10:42:59.375131 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 805/1636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:59 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:59.376225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:59.377046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:59.379747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:59.380586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:59.384341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.385653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.387494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.388531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.389427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.389883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.390605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.390838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.391484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.391883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.392606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.393081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.546457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.556421 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19214b08-79e3-4657-8eb5-de3acd625ee3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1265 microversion: 2.1 time: 0.184954 Aug 23 10:42:59.556606 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 832/1637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:42:59 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:42:59.563279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "name": "network-vif-unplugged", "status": "completed", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:59.574598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.575744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.576192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.591378 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] Creating event network-vif-unplugged:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h2-847009-13 Aug 23 10:42:59.593500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.608235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:42:59.610171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.612356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:42:59.616785 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-584f0dd2-ee0f-4a45-a4da-36c417ca898c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1801 microversion: 2.25 time: 0.240455 Aug 23 10:42:59.617677 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 806/1638] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:59 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1801 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:59.624271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'action', calling method: .version_select at 0x7fdc9f83f550>, body: {"addFloatingIp": {"address": "172.25.9.59"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:42:59.627390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:59.634562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.636388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.637437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.638355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.638905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.639612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.640422 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-966a458c-1de2-4fbc-a18c-585960c8850a req-f4f2993d-0faf-4ce3-8667-9f904c816ab3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081567 Aug 23 10:42:59.643934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 833/1639] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:42:59.649272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4d9962f-38f0-4b33-8429-a7c07bbc04ca tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '.version_select at 0x7fdca1d2bd30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:59.662195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4d9962f-38f0-4b33-8429-a7c07bbc04ca tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.666894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4d9962f-38f0-4b33-8429-a7c07bbc04ca tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.667546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4d9962f-38f0-4b33-8429-a7c07bbc04ca tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.702599 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4d9962f-38f0-4b33-8429-a7c07bbc04ca tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 4511 microversion: 2.25 time: 0.057248 Aug 23 10:42:59.709695 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 834/1640] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Aug 23 10:42:59 2022] GET /compute/v2.1/os-migrations => generated 4511 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:42:59.726728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:42:59.727518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:42:59.736839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.737329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.737912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.742611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:42:59.743157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:42:59.743615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:42:59.769930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:42:59.770774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquired lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:00.467198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:00.496814 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8db8bd9-0d7e-4846-a3cb-d0f4120a2b9a tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 2421 microversion: 2.25 time: 0.775073 Aug 23 10:43:00.498367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 835/1641] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:42:59 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 2421 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:00.503412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:00.504196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:00.524270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:00.525557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:00.526424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:00.527969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:00.528802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:00.529936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:01.297786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:01.569936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:01.581498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bdf7ca85-f764-483b-9f6a-20aa2f7144d3 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 1.081644 Aug 23 10:43:01.596812 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 836/1642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:00 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:01.602115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:01.602979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:01.610588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:01.611319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:01.611951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:01.613099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:01.613723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:01.614304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.240440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:02.244782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:02.250112 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7059d08d-9f37-4a4a-8441-b0bec9923619 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.651914 Aug 23 10:43:02.269306 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 837/1643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:01 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:02.269556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Updating instance_info_cache with network_info: [{"id": "e5977e8e-da2e-41d1-95f4-4751418fce48", "address": "fa:16:3e:d8:93:84", "network": {"id": "7380efd3-97d2-489c-88db-bb3014da90df", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-949240103-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47a750024d634a43b5f854401d5afa43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape5977e8e-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:02.277848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:02.279872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:02.282092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Releasing lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:02.283580 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e2e3e4d-b1b8-4758-a88f-def67c7f310f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action" status: 202 len: 0 microversion: 2.1 time: 2.664431 Aug 23 10:43:02.284926 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 807/1644] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:42:59 2022] POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action => generated 0 bytes in 2666 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:43:02.293850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:02.295974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:02.299902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:02.303121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:02.305701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.307785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:02.308319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:02.309140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:02.309874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:02.310570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.311788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:02.312478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.312974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:02.314351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.615612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:02.643332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e695e02-d0c5-4e61-9a3b-e65baf41c0ee tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 2421 microversion: 2.25 time: 0.356126 Aug 23 10:43:02.644588 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 808/1645] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:43:02 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 2421 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:02.651862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:02.653240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:02.659763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:02.660547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:02.661358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.662288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:02.663371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:02.664000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:02.723852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:03.007259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:03.016879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a86c130-08af-415d-99e5-b419a6a20ca0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.370752 Aug 23 10:43:03.020112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 809/1646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:02 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:03.028256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9c5935cd-10be-42be-98da-665953f1bc29 req-2286bef3-4979-40e8-ba8f-62c6d0f1eb04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:03.050160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9c5935cd-10be-42be-98da-665953f1bc29 req-2286bef3-4979-40e8-ba8f-62c6d0f1eb04 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.050787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9c5935cd-10be-42be-98da-665953f1bc29 req-2286bef3-4979-40e8-ba8f-62c6d0f1eb04 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.055946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:03.063377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9c5935cd-10be-42be-98da-665953f1bc29 req-2286bef3-4979-40e8-ba8f-62c6d0f1eb04 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.069932 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82d6b358-07fd-4aad-9be1-a6da4cc7e97f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.806788 Aug 23 10:43:03.070619 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 838/1647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:02 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:03.089336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:03.094627 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9c5935cd-10be-42be-98da-665953f1bc29 req-2286bef3-4979-40e8-ba8f-62c6d0f1eb04 service nova] Creating event network-changed:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:43:03.109185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.109971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.111004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.112464 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9c5935cd-10be-42be-98da-665953f1bc29 req-2286bef3-4979-40e8-ba8f-62c6d0f1eb04 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089549 Aug 23 10:43:03.114370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 810/1648] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:03.124716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] Creating event network-changed:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h2-847009-13 Aug 23 10:43:03.133721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 10:43:03.135978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.59"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:03.146072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:03.148104 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1eaede2f-1adc-4835-904e-74b36817db07 req-43aa9156-d4e8-4369-99dc-8a81d0137fd6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066716 Aug 23 10:43:03.149804 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 839/1649] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:03.157826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:03.159350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:03.172899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.175035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.175403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.175969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.176595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.177039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.177868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.178742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.179344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.180651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.182245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.185334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.292387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "refresh_cache-916eb643-8e14-4230-8587-56faf3c8c6bc" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:03.294433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquired lock "refresh_cache-916eb643-8e14-4230-8587-56faf3c8c6bc" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:03.912627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:03.933884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a16f502-b9a5-4833-98aa-e62bd508c2aa tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.780709 Aug 23 10:43:03.936257 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 840/1650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:03 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:03.945304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:03.946673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:03.965249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.966850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.967516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:03.968909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:03.969571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:03.970680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:04.143699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lazy-loading 'services' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:04.312139 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a6168c9-4b89-4253-a600-d124fb644474 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments/5116d7ef-e6c8-4e08-a97a-fb468a188092" status: 202 len: 0 microversion: 2.25 time: 0.374021 Aug 23 10:43:04.318902 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 841/1651] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Aug 23 10:43:03 2022] DELETE /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments/5116d7ef-e6c8-4e08-a97a-fb468a188092 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:04.330861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:04.334306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:04.348499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:04.350081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:04.351734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:04.354519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:04.355028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:04.355479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:04.906985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:04.919727 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d2bc9e02-8a45-40ef-bff7-93806c75b258 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.597899 Aug 23 10:43:04.920621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 842/1652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:04 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:04.925453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:04.926277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:04.933173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:04.933934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:04.934541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:04.935482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:04.936110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:04.936712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:04.941394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:05.018594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=18 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:05.274407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:05.287047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d691d6ac-031b-4f08-9ab7-1071ff988ada tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.364473 Aug 23 10:43:05.288846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 843/1653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:04 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:05.294123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:05.295149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:05.307463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:05.308254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:05.309235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:05.310550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:05.311663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:05.312283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:05.436247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:05.684172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:05.706602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-57eebdff-cac0-47d5-a43b-5e64201a8c4f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.412987 Aug 23 10:43:05.707249 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 844/1654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:05 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:05.713474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:05.717075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:05.743993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:05.748805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:05.750077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:05.751044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:05.751786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:05.752426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:05.831068 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a89de2d-3637-4a5d-a6b5-20554714920e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122701 Aug 23 10:43:05.831689 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 845/1655] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:05 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:05.839887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:05.840871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:05.848168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:05.849120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:05.850126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:05.851262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:05.851964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:05.852617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.032679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:06.045176 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e796e14-a18a-4ad8-a293-f51043c04d81 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1469 microversion: 2.1 time: 0.212396 Aug 23 10:43:06.046122 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 846/1656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:05 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:06.051080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60029070-fe8f-4b07-add2-6f3e6b458368", "tag": "b9390a42-2c3b-4af1-b791-d1ff8239626e"}, {"name": "network-changed", "server_uuid": "685ee89e-f7b8-46ed-811d-9deea9b1af35", "tag": "c10d467d-46f9-41b5-a841-e0deb1d1d830"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:06.062696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.063440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.064078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.083560 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] Creating event network-changed:b9390a42-2c3b-4af1-b791-d1ff8239626e for instance 60029070-fe8f-4b07-add2-6f3e6b458368 on n-h1-847009-13 Aug 23 10:43:06.084185 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] Creating event network-changed:c10d467d-46f9-41b5-a841-e0deb1d1d830 for instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 on n-h1-847009-13 Aug 23 10:43:06.091786 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-19df18d7-2c26-45f0-a578-ceb3c99c00d1 req-a65df357-f25e-4dbb-9537-6d35647b448e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044211 Aug 23 10:43:06.092913 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 847/1657] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:06.099755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:06.100931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:06.109296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.110219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.110870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.111842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.113125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.114005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.406629 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.neutron [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] re-assign floating IP 172.25.9.59 from instance f8a78c98-3708-49a1-9376-298b7cf19576 Aug 23 10:43:06.435413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:06.446321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-496d696d-aebc-4684-9850-835e96aa6ef3 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.351958 Aug 23 10:43:06.446913 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 848/1658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:06 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:06.454541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1b75aa6f-f163-40af-9d64-a6714a2fe7ce req-06e01fd0-cd86-4659-816d-2c7652e0c418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:06.474852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1b75aa6f-f163-40af-9d64-a6714a2fe7ce req-06e01fd0-cd86-4659-816d-2c7652e0c418 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.475647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1b75aa6f-f163-40af-9d64-a6714a2fe7ce req-06e01fd0-cd86-4659-816d-2c7652e0c418 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.476656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1b75aa6f-f163-40af-9d64-a6714a2fe7ce req-06e01fd0-cd86-4659-816d-2c7652e0c418 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.490445 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1b75aa6f-f163-40af-9d64-a6714a2fe7ce req-06e01fd0-cd86-4659-816d-2c7652e0c418 service nova] Creating event network-changed:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:43:06.497010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1b75aa6f-f163-40af-9d64-a6714a2fe7ce req-06e01fd0-cd86-4659-816d-2c7652e0c418 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047722 Aug 23 10:43:06.498300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 849/1659] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:06.504139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:06.504878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:06.511587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.512135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.512587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.513342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.513989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.514398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.577416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:06.952465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:06.966357 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da77fe35-513c-46e3-ae5e-07ea01d89ca9 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.466778 Aug 23 10:43:06.967595 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 850/1660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:06 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:06.973363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:06.974202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:06.982157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.982851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.983491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:06.984420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:06.985076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:06.985677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.160392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:07.169729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-908f3060-3626-4ca1-b53a-11092b124cf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.200826 Aug 23 10:43:07.179403 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 851/1661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:06 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:07.179403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:07.179403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:07.186239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.186808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.187298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.188145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.188616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.189138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.225142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-074416d2-9079-4a7a-9dd4-0c26496715ee tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053088 Aug 23 10:43:07.231193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 852/1662] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:07 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:07.231193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:07.231736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:07.237729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.238347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.238721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.239445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.240459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.240459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.433176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:07.446978 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f5196b22-0085-495f-b0bc-87b2afdc2e37 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1462 microversion: 2.1 time: 0.219227 Aug 23 10:43:07.449756 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 853/1663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:07 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1462 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:07.478271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:07.480044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:07.489475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.490930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.491726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.493179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.494296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.495131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.709424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:07.719528 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f48d23ce-0894-4021-b959-75ee7485c7d1 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.253512 Aug 23 10:43:07.724798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 854/1664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:07 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:07.761594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Updating instance_info_cache with network_info: [{"id": "e5977e8e-da2e-41d1-95f4-4751418fce48", "address": "fa:16:3e:d8:93:84", "network": {"id": "7380efd3-97d2-489c-88db-bb3014da90df", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-949240103-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47a750024d634a43b5f854401d5afa43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape5977e8e-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:07.776877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:07.900069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:07.902213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:07.926535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.928282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.928979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.930821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:07.932137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:07.932799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:07.997708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:08.184673 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef30b91b-0519-43f0-aa7d-9db49d647bdf tempest-MigrationsAdminTest-862103239 tempest-MigrationsAdminTest-862103239-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1615 microversion: 2.1 time: 0.462953 Aug 23 10:43:08.200336 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 855/1665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:07 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1615 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:08.200336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:08.200336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:08.200336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.200336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.201733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.201733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.201733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.202068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.408160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:08.416534 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f264254a-0f64-4e0e-a628-1c325d37074b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.229740 Aug 23 10:43:08.418503 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 856/1666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:08 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:08.424417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-eeebb320-4d60-4f3a-a3a0-f18150f15981 req-256e173f-1e85-46c3-a37f-3ca8a75f6f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7bef7e7-48bc-426b-aef7-d87facd717f4", "tag": "19d7cb31-9140-46a0-a97a-6d04ac533929"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:08.436904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeebb320-4d60-4f3a-a3a0-f18150f15981 req-256e173f-1e85-46c3-a37f-3ca8a75f6f48 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.437422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeebb320-4d60-4f3a-a3a0-f18150f15981 req-256e173f-1e85-46c3-a37f-3ca8a75f6f48 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.437866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeebb320-4d60-4f3a-a3a0-f18150f15981 req-256e173f-1e85-46c3-a37f-3ca8a75f6f48 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.453929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-eeebb320-4d60-4f3a-a3a0-f18150f15981 req-256e173f-1e85-46c3-a37f-3ca8a75f6f48 service nova] Creating event network-changed:19d7cb31-9140-46a0-a97a-6d04ac533929 for instance a7bef7e7-48bc-426b-aef7-d87facd717f4 on n-h1-847009-13 Aug 23 10:43:08.460688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-eeebb320-4d60-4f3a-a3a0-f18150f15981 req-256e173f-1e85-46c3-a37f-3ca8a75f6f48 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040940 Aug 23 10:43:08.461377 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 857/1667] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:08.473038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:08.473759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:08.487906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.488603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.489198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.491523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.492672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.493540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.671974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:08.684614 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f686e5d1-1875-4a52-af37-26939a589cef tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.220154 Aug 23 10:43:08.685990 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 858/1668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:08 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:08.692281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:08.694412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:08.720050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.720050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.720492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.731117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:08.731896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:08.732658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:08.818045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:09.099003 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-764e1ce5-ef05-426c-abef-d01bf62ee882 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 204 len: 0 microversion: 2.1 time: 0.411071 Aug 23 10:43:09.104125 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 859/1669] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:08 2022] DELETE /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:09.110449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:09.121446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:09.140565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.141137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.141627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.142510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.142984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.143440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.174401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Updating instance_info_cache with network_info: [{"id": "2cf3a722-9639-4d09-9c55-4aea7029cde3", "address": "fa:16:3e:54:54:5b", "network": {"id": "7380efd3-97d2-489c-88db-bb3014da90df", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-949240103-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47a750024d634a43b5f854401d5afa43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2cf3a722-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:09.199514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Releasing lock "refresh_cache-916eb643-8e14-4230-8587-56faf3c8c6bc" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:09.200424 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d796bff0-da7d-481b-ac34-95366fb4e2f3 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc/action" status: 202 len: 0 microversion: 2.1 time: 6.084329 Aug 23 10:43:09.201529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 811/1670] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:03 2022] POST /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc/action => generated 0 bytes in 6086 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:43:09.208928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8ccde059-a136-49f7-896a-5d7dfd74fe78 req-74a1464e-451c-4f3d-8303-dc589d01536a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916eb643-8e14-4230-8587-56faf3c8c6bc", "tag": "2cf3a722-9639-4d09-9c55-4aea7029cde3"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:09.219617 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3debae2a-93e5-4e49-abc8-1e8fefbd1364 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113817 Aug 23 10:43:09.222564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 860/1671] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:09 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:09.232764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:09.233468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:09.243370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.244424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8ccde059-a136-49f7-896a-5d7dfd74fe78 req-74a1464e-451c-4f3d-8303-dc589d01536a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.245286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8ccde059-a136-49f7-896a-5d7dfd74fe78 req-74a1464e-451c-4f3d-8303-dc589d01536a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.246019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8ccde059-a136-49f7-896a-5d7dfd74fe78 req-74a1464e-451c-4f3d-8303-dc589d01536a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.247732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.248534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.250366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.252353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.253062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.279753 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8ccde059-a136-49f7-896a-5d7dfd74fe78 req-74a1464e-451c-4f3d-8303-dc589d01536a service nova] Creating event network-changed:2cf3a722-9639-4d09-9c55-4aea7029cde3 for instance 916eb643-8e14-4230-8587-56faf3c8c6bc on n-h2-847009-13 Aug 23 10:43:09.287330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8ccde059-a136-49f7-896a-5d7dfd74fe78 req-74a1464e-451c-4f3d-8303-dc589d01536a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084475 Aug 23 10:43:09.287950 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 812/1672] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:09.315602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:09.318553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:09.334241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.335120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.335809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.336994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.337897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.339810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.626796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:09.644501 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb12bf0d-1c41-4393-98c4-d3ecf13171bd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1468 microversion: 2.1 time: 0.351027 Aug 23 10:43:09.646876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 813/1673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:09 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:09.664097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'action', calling method: .version_select at 0x7fdc9f83faf0>, body: {"removeFloatingIp": {"address": "172.25.9.59"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:09.882240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:09.891473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.892195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.896018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.897001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.897788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.898421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.942087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:09.952686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3078b3a4-27b6-4a92-80d7-3f213fa03f11 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.724851 Aug 23 10:43:09.971361 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 861/1674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:09 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:09.985549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:09.986473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:09.996504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.997047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.997754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:09.998481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:09.998947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:09.999381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.371079 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] HTTP exception thrown: Floating IP 172.25.9.59 is not associated with instance f8a78c98-3708-49a1-9376-298b7cf19576. Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Request method failure captured: Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action HTTP/1.1 Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 48 Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK76qV8d93NQDsB_I-Am8kbXr6IwLIp3dgduJFNnT7xEcrL6vAfYXnimkR6jMcvWura199EuP7K3Yai057ckPUzw3BYJtOcBSFwY7viowwjJtvNOjHIAvwSSnw9XmjHBqdtxfTgzDMPxhTnGXSXmFsVD2c5cXRb3en6K2M9PTlF3bcw Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:43:10.378273 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/47a750024d634a43b5f854401d5afa43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_47a750024d634a43b5f854401d5afa43", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}] Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 45ac7be54bb940b9b2e0cb4559c64019 Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: {"removeFloatingIp": {"address": "172.25.9.59"}} Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:43:10.380489 n-d-847009-13 devstack@n-api.service[128860]: exception: Floating IP 172.25.9.59 is not associated with instance f8a78c98-3708-49a1-9376-298b7cf19576. Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f8a78c98-3708-49a1-9376-298b7cf19576', 'body': {'removeFloatingIp': {'address': '172.25.9.59'}}} Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.59 is not associated with instance f8a78c98-3708-49a1-9376-298b7cf19576. Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:10.381735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:10.385805 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:10.385805 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:10.385805 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:10.385805 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:10.385805 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.59 is not associated with instance f8a78c98-3708-49a1-9376-298b7cf19576. Aug 23 10:43:10.385805 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:10.388828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Returning 409 to user: Floating IP 172.25.9.59 is not associated with instance f8a78c98-3708-49a1-9376-298b7cf19576. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:10.389949 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d71ad703-9add-49e1-bb7f-dd1bef7d4e7a tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action" status: 409 len: 145 microversion: 2.1 time: 0.741468 Aug 23 10:43:10.395398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 814/1675] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:09 2022] POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action => generated 145 bytes in 747 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:43:10.410413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:10.411472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:10.432515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.433458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.434229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.436773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.438413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.440234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.674658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:10.686527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91d73cd3-8b71-4954-b1c1-3c78f818b846 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.713779 Aug 23 10:43:10.688708 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 862/1676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:09 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:10.694034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-664f848f-9e71-4ecf-b849-1f8ca8a2f0e2 req-c4e86efc-93a6-41bd-a3f2-955eea8eb809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "name": "network-vif-plugged", "status": "completed", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:10.706736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-664f848f-9e71-4ecf-b849-1f8ca8a2f0e2 req-c4e86efc-93a6-41bd-a3f2-955eea8eb809 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.707259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-664f848f-9e71-4ecf-b849-1f8ca8a2f0e2 req-c4e86efc-93a6-41bd-a3f2-955eea8eb809 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.707916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-664f848f-9e71-4ecf-b849-1f8ca8a2f0e2 req-c4e86efc-93a6-41bd-a3f2-955eea8eb809 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.721245 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-664f848f-9e71-4ecf-b849-1f8ca8a2f0e2 req-c4e86efc-93a6-41bd-a3f2-955eea8eb809 service nova] Creating event network-vif-plugged:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h2-847009-13 Aug 23 10:43:10.728013 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-664f848f-9e71-4ecf-b849-1f8ca8a2f0e2 req-c4e86efc-93a6-41bd-a3f2-955eea8eb809 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037836 Aug 23 10:43:10.731164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 863/1677] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:10.737749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:10.740247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:10.749343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.752137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.752638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.753416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.753892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.754331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.839628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:10.847818 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05dee669-39cf-4310-9ea8-524af04cf393 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.450816 Aug 23 10:43:10.848004 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-746d7d48-8ecc-4676-ade3-47496505f7f4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115329 Aug 23 10:43:10.849685 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 815/1678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:10 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:10.855492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.59"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:10.863901 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 864/1679] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:10 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:10.873061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:10.878189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:10.887749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.888449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.889102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:10.890519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:10.891146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:10.891735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:11.064588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:11.073697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:11.074958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:11.076035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:11.077049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:11.078094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:11.078810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:11.081704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:11.092659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de50a97c-39f3-4265-a621-d45a4775f491 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1468 microversion: 2.1 time: 0.227374 Aug 23 10:43:11.104767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 865/1680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:10 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1468 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:11.104767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:11.104767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:11.107414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:11.107919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:11.110624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:11.110624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:11.110624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:11.110624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:11.265352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:11.276820 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4595ce90-2925-4f84-8938-d62ee3eb403b tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.181688 Aug 23 10:43:11.277999 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 866/1681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:11 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:11.362912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "refresh_cache-916eb643-8e14-4230-8587-56faf3c8c6bc" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:11.363435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquired lock "refresh_cache-916eb643-8e14-4230-8587-56faf3c8c6bc" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:11.710345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:11.711830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:11.723642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:11.724406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:11.733159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:11.734266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:11.734945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:11.735417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:12.308251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:12.321838 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae4f437c-bd24-43f8-93f9-3f0842512aec tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.615660 Aug 23 10:43:12.355499 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 867/1682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:11 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:12.374391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:12.378171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:12.399367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:12.399367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:12.399367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:12.402177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:12.403256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:12.404100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:12.475681 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-203fc801-7959-4232-bd7e-6ba1fc12347f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118626 Aug 23 10:43:12.476634 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 868/1683] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:12 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:12.482637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:12.483852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:12.492456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:12.493613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:12.495693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:12.496800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:12.497712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:12.498426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:12.806122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:13.073092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:13.086439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c88215e-5713-42a4-8873-ed6d898b83d1 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.604330 Aug 23 10:43:13.087081 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 869/1684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:12 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:13.097507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:13.100911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:13.114703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.115499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.117168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.118128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.120583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.122840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.234579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:13.245513 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c1ee00e-2bbb-4c1e-8a71-90487fdef179 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 200 len: 1298 microversion: 2.1 time: 0.156331 Aug 23 10:43:13.257383 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 870/1685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:13 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 1298 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:13.264781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:13.266458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:13.272492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:13.274073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.275123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.275922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.276917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.277706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.278310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.542435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:13.548313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:13.569171 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13f529e4-a40d-4bfd-98d7-63b896e9e850 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.310225 Aug 23 10:43:13.586280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 871/1686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:13 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:13.596967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f8f80e05-a2e3-4e52-929f-42a86e48f3d1 req-03c103ba-c0db-4469-a4ca-44382f9bf2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916eb643-8e14-4230-8587-56faf3c8c6bc", "tag": "2cf3a722-9639-4d09-9c55-4aea7029cde3"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:13.619974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8f80e05-a2e3-4e52-929f-42a86e48f3d1 req-03c103ba-c0db-4469-a4ca-44382f9bf2a5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.622731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8f80e05-a2e3-4e52-929f-42a86e48f3d1 req-03c103ba-c0db-4469-a4ca-44382f9bf2a5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.626948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8f80e05-a2e3-4e52-929f-42a86e48f3d1 req-03c103ba-c0db-4469-a4ca-44382f9bf2a5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.668288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f8f80e05-a2e3-4e52-929f-42a86e48f3d1 req-03c103ba-c0db-4469-a4ca-44382f9bf2a5 service nova] Creating event network-changed:2cf3a722-9639-4d09-9c55-4aea7029cde3 for instance 916eb643-8e14-4230-8587-56faf3c8c6bc on n-h2-847009-13 Aug 23 10:43:13.679513 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f8f80e05-a2e3-4e52-929f-42a86e48f3d1 req-03c103ba-c0db-4469-a4ca-44382f9bf2a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092085 Aug 23 10:43:13.681846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 872/1687] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:13.689526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b545132c-b45c-442a-963e-90575c9c8020 req-19ea5976-8f27-4563-a99c-99d9b79c8d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5cec42-0396-4f03-a3aa-7ca02c3dab76", "name": "network-vif-deleted", "tag": "3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:13.703380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b545132c-b45c-442a-963e-90575c9c8020 req-19ea5976-8f27-4563-a99c-99d9b79c8d6a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.704198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b545132c-b45c-442a-963e-90575c9c8020 req-19ea5976-8f27-4563-a99c-99d9b79c8d6a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.704971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b545132c-b45c-442a-963e-90575c9c8020 req-19ea5976-8f27-4563-a99c-99d9b79c8d6a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.719742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b545132c-b45c-442a-963e-90575c9c8020 req-19ea5976-8f27-4563-a99c-99d9b79c8d6a service nova] Creating event network-vif-deleted:3a4cda2b-dd05-4bde-b2f5-cf25f4eb922a for instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 on n-h2-847009-13 Aug 23 10:43:13.726123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b545132c-b45c-442a-963e-90575c9c8020 req-19ea5976-8f27-4563-a99c-99d9b79c8d6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042612 Aug 23 10:43:13.732028 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 873/1688] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:13.738274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:13.739570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:13.749277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.750444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.751176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:13.752196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:13.753257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:13.753936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.004069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Updating instance_info_cache with network_info: [{"id": "2cf3a722-9639-4d09-9c55-4aea7029cde3", "address": "fa:16:3e:54:54:5b", "network": {"id": "7380efd3-97d2-489c-88db-bb3014da90df", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-949240103-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47a750024d634a43b5f854401d5afa43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2cf3a722-96", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:14.012295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Releasing lock "refresh_cache-916eb643-8e14-4230-8587-56faf3c8c6bc" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:14.013186 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c407936-92e7-4b9c-b04c-455fee0e08e0 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc/action" status: 202 len: 0 microversion: 2.1 time: 3.162147 Aug 23 10:43:14.016936 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 816/1689] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:10 2022] POST /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc/action => generated 0 bytes in 3166 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:43:14.031955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:14.034522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:14.054845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.055726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.068467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.070286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.071421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.072095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.129525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d1bffd8-f9fa-4c63-8784-01905ffe6ff8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.109870 Aug 23 10:43:14.133725 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 817/1690] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:14 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:14.152555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:14.153517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:14.162227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.163538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.164164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.165081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.166219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.166920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.186992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:14.200601 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8b3285c-8a21-44fb-9b9c-c20a42555049 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.466923 Aug 23 10:43:14.214960 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 874/1691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:13 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:14.227343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:14.231015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:14.238722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:14.247049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.249106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.249695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.254623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.255138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.257691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.445606 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-773da4cb-8f6f-474b-ac74-bd038eed7586 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "DELETE /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 204 len: 0 microversion: 2.1 time: 0.309485 Aug 23 10:43:14.446467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 818/1692] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:14 2022] DELETE /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:14.467662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:14.468955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: ed5cec42-0396-4f03-a3aa-7ca02c3dab76] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:14.483286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.483944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.485149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.486003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.489476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.490146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.526508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] HTTP exception thrown: Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 could not be found. Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Request method failure captured: Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 HTTP/1.1 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3csbLApRW04VF1qwkBCCDO1Cj4r0uF-9mKVSOfXaYxNO4myNslc9zZas3_A0IzqN3h4iK1SZR4TqIZ0_Q0DeMdLMRDBkQ3BQo58pgNEGJcY-xUvuBA6odnT1GAl17gVuepBu1K-4znpr4nI2TwlrEoQj4VZUf7Q1MSI25b3PYCKK8 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:43:14.528547 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81dd6dd624b14701860deb0d33332e83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}] Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9574ff57c9474f7fb5ec4567bc06d531 Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 could not be found. Aug 23 10:43:14.530221 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ed5cec42-0396-4f03-a3aa-7ca02c3dab76'} Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 could not be found. Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:14.531160 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 could not be found. Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 could not be found. Aug 23 10:43:14.534492 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:14.536974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Returning 404 to user: Instance ed5cec42-0396-4f03-a3aa-7ca02c3dab76 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:14.536974 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3003af07-1b84-41cb-bca1-1f7698546f19 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76" status: 404 len: 111 microversion: 2.1 time: 0.081564 Aug 23 10:43:14.536974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 819/1693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:14 2022] GET /compute/v2.1/servers/ed5cec42-0396-4f03-a3aa-7ca02c3dab76 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:14.543638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.59"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:14.546719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:14.554950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.555861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.556728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.559140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:14.559926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:14.560817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:14.640387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:14.645028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquired lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:15.303253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:15.317085 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78ac8535-f8c6-4d5a-b52d-ae7c0d2f4b4b tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 1.100584 Aug 23 10:43:15.331230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 875/1694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:14 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:15.353022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:15.353665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:15.362613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.363105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.363550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.364263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.364726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.365172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.429651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:15.595297 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11510d29-619d-4ba2-b7e9-8ad2d82d8d08 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 204 len: 0 microversion: 2.1 time: 0.259999 Aug 23 10:43:15.602021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 876/1695] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:15 2022] DELETE /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:15.610785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:15.611658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:15.620030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.620030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.620424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.621172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.621713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.622156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.778977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:15.786895 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3e8aa8d-43d7-46d3-829a-85e469f3f4b0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.186680 Aug 23 10:43:15.787477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 877/1696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:15 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:15.792890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-dd6f563a-cd3e-4201-9ef4-0679ddd851a3 req-be1434b6-be63-4325-920e-aff03e5c59e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60029070-fe8f-4b07-add2-6f3e6b458368", "name": "network-vif-plugged", "status": "completed", "tag": "b9390a42-2c3b-4af1-b791-d1ff8239626e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:15.802798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dd6f563a-cd3e-4201-9ef4-0679ddd851a3 req-be1434b6-be63-4325-920e-aff03e5c59e4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.803284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dd6f563a-cd3e-4201-9ef4-0679ddd851a3 req-be1434b6-be63-4325-920e-aff03e5c59e4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.803907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dd6f563a-cd3e-4201-9ef4-0679ddd851a3 req-be1434b6-be63-4325-920e-aff03e5c59e4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.816162 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-dd6f563a-cd3e-4201-9ef4-0679ddd851a3 req-be1434b6-be63-4325-920e-aff03e5c59e4 service nova] Creating event network-vif-plugged:b9390a42-2c3b-4af1-b791-d1ff8239626e for instance 60029070-fe8f-4b07-add2-6f3e6b458368 on n-h1-847009-13 Aug 23 10:43:15.821067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-dd6f563a-cd3e-4201-9ef4-0679ddd851a3 req-be1434b6-be63-4325-920e-aff03e5c59e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Aug 23 10:43:15.821663 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 878/1697] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:15.827298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:15.829659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:15.835884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.836371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.836839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.838121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.838942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.839266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.870040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e24bc505-435c-47fc-8d38-35a1b3bb1a62 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046826 Aug 23 10:43:15.870798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 879/1698] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:15 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:15.875407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:15.876046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:15.881868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.882291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.882743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:15.883441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:15.883901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:15.884365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:16.063504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:16.071302 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67b7decc-676f-4265-811b-0bf2771c215a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.199647 Aug 23 10:43:16.085161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 880/1699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:15 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:16.090898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:16.091756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:16.099563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:16.100133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:16.101325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:16.102040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:16.102509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:16.102941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:16.327052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:16.335992 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de4fd86b-6620-45a4-8f02-9559acc2f494 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1534 microversion: 2.1 time: 0.249360 Aug 23 10:43:16.336770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 881/1700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:16 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1534 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:16.341181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:16.341793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:16.347809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:16.348307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:16.348895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:16.349483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:16.349933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:16.350362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:16.655083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:16.666435 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aee59716-4e63-4283-8a9d-c08da775a7df tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.328105 Aug 23 10:43:16.667570 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 882/1701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:16 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:16.810548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:16.810856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:16.833208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:16.834297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:16.834486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:16.836855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:16.839391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:16.841337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.033504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:17.042793 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c675eaba-baa7-444b-a334-1703ebce5766 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.238320 Aug 23 10:43:17.043794 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 883/1702] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:16 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:17.048537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:17.050835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:17.058539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.059230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.059620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.060317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.060802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.061236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.093349 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef1b5d4a-8ec2-4caf-b555-cc8c8ae89d47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.048457 Aug 23 10:43:17.093932 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 884/1703] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:17 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:17.098345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:17.098939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:17.105448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.105938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.106380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.107080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.107539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.107967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.288047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:17.296634 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-217b2692-3ed3-4c1e-ae70-be6c99388cbe tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.201670 Aug 23 10:43:17.297586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 885/1704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:17 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:17.358464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:17.359159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:17.370559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.373173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.373740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.374553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.375024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.375453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.697406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:17.708692 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb95b67f-09b3-4b5e-9625-11708da84168 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1534 microversion: 2.1 time: 0.354120 Aug 23 10:43:17.736918 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 886/1705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:17 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1534 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:17.750717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:17.752088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:17.758497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.759221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.762359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:17.763357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:17.763820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:17.764259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.065617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:18.075073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0cde06c1-4651-42e1-a1b0-e8e7e0e08175 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.336287 Aug 23 10:43:18.076022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 887/1706] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:17 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:18.083089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-44f588b1-09e1-43a8-87fa-73dadf254394 req-451c5446-84f2-4e39-9990-93465f19b5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916eb643-8e14-4230-8587-56faf3c8c6bc", "name": "network-vif-deleted", "tag": "2cf3a722-9639-4d09-9c55-4aea7029cde3"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:18.095583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-44f588b1-09e1-43a8-87fa-73dadf254394 req-451c5446-84f2-4e39-9990-93465f19b5ab service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.096389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-44f588b1-09e1-43a8-87fa-73dadf254394 req-451c5446-84f2-4e39-9990-93465f19b5ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.097493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-44f588b1-09e1-43a8-87fa-73dadf254394 req-451c5446-84f2-4e39-9990-93465f19b5ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.116370 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-44f588b1-09e1-43a8-87fa-73dadf254394 req-451c5446-84f2-4e39-9990-93465f19b5ab service nova] Creating event network-vif-deleted:2cf3a722-9639-4d09-9c55-4aea7029cde3 for instance 916eb643-8e14-4230-8587-56faf3c8c6bc on n-h2-847009-13 Aug 23 10:43:18.124952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-44f588b1-09e1-43a8-87fa-73dadf254394 req-451c5446-84f2-4e39-9990-93465f19b5ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045613 Aug 23 10:43:18.125986 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 888/1707] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:18.134096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:18.135801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:18.146164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.146750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.147370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.149256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.149674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.152905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.178921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:18.182818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:18.363170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:18.384054 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3df3f61-7ce6-493b-91a2-fd4133c43909 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.256598 Aug 23 10:43:18.384919 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 889/1708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:18 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:18.390212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:18.393584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:18.402958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.403688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.404881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.405692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.407133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.407593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.446527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ca5df8e-a440-452b-aedc-eb930a571ad4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.060264 Aug 23 10:43:18.453193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 890/1709] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 10:43:18 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:18.453193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:18.453570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:18.459898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.460396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.461361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.461574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.462042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.463079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.645482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:18.662315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47ea9ad4-7cfa-43e8-8ae9-e34e512be066 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.212964 Aug 23 10:43:18.671065 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 891/1710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:18 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:18.737089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:18.737841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:18.748224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.749352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.750774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.752630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:18.753600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:18.754357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:18.883889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Updating instance_info_cache with network_info: [{"id": "e5977e8e-da2e-41d1-95f4-4751418fce48", "address": "fa:16:3e:d8:93:84", "network": {"id": "7380efd3-97d2-489c-88db-bb3014da90df", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-949240103-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47a750024d634a43b5f854401d5afa43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape5977e8e-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:18.936525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Releasing lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:18.938071 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1deb2123-95fb-42f5-a3a7-14d23013584b tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action" status: 202 len: 0 microversion: 2.1 time: 4.403291 Aug 23 10:43:18.939611 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 820/1711] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:14 2022] POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action => generated 0 bytes in 4405 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:43:18.948611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d1332fe-53d2-45fd-ab6c-d665deb41155 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '.version_select at 0x7fdc9cb09820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:18.976625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:18.991691 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c92cdc7-a282-49a1-a9e1-7b1090e4a0cd tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1534 microversion: 2.1 time: 0.259824 Aug 23 10:43:18.993110 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 892/1712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:18 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1534 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:19.041562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-900014455", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "16058aaf-a351-4bde-a15a-8b9493e9e115"}], "block_device_mapping_v2": [{"uuid": "42a3cf86-c012-402f-bcc1-4039968ac9e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:19.138457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] validate_networks() for [('16058aaf-a351-4bde-a15a-8b9493e9e115', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:43:19.256832 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d1332fe-53d2-45fd-ab6c-d665deb41155 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/9844bdd0-dbb2-46d4-a155-134f1371feb0" status: 200 len: 183 microversion: 2.1 time: 0.312975 Aug 23 10:43:19.265153 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 821/1713] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 10:43:18 2022] GET /compute/v2.1/os-floating-ips/9844bdd0-dbb2-46d4-a155-134f1371feb0 => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:43:19.265153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:19.265153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:19.270881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:19.271381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:19.271848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:19.272554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:19.273069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:19.273498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:19.456234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:19.465966 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d9ed39a-c914-4344-a5bf-dfa79a141163 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.207111 Aug 23 10:43:19.467122 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 822/1714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:19 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:19.472668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.59"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:19.642713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:19.651510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:19.651991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:19.652446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:19.653274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:19.653833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:19.654351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:19.750995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:43:19.751589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:43:19.752083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:43:19.752509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:43:19.752990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:43:19.778817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:19.779303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:19.779949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:19.781211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:19.783158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:19.783793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:19.810053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:43:19.817862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Getting quotas for user b2ac0227a26f41c8a9b5c89cddea52f5 and project 1482830f506e4e79b82c0bf9fb3b11ee. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:43:19.939909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:43:19.942332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42a3cf86-c012-402f-bcc1-4039968ac9e3',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:43:19.968327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:19.968854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquired lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:20.121040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01742310-f68c-4717-ac95-20318511911a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084021 Aug 23 10:43:20.122516 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 893/1715] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:43:20.127530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:20.128811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:20.139180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.139985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.140586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.141742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.143476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.144521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.320802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:20.332124 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-892f5dcb-3159-4656-bb69-3c021e7af70a tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.208272 Aug 23 10:43:20.332715 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 894/1716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:20 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:20.338099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:20.338945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:20.345987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.346469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.346966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.347968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.348605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.349141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.541468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:20.551942 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fbfa77e5-f837-4888-9a47-44e0ca2eee53 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.218134 Aug 23 10:43:20.567539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 895/1717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:20 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:20.577141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-35003285-b05a-47ad-8641-27bdc22c530d req-a41a517b-31a4-4ca0-b731-66e264c8dd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685ee89e-f7b8-46ed-811d-9deea9b1af35", "name": "network-vif-plugged", "status": "completed", "tag": "c10d467d-46f9-41b5-a841-e0deb1d1d830"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:20.593692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35003285-b05a-47ad-8641-27bdc22c530d req-a41a517b-31a4-4ca0-b731-66e264c8dd5d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.594538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35003285-b05a-47ad-8641-27bdc22c530d req-a41a517b-31a4-4ca0-b731-66e264c8dd5d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.595587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35003285-b05a-47ad-8641-27bdc22c530d req-a41a517b-31a4-4ca0-b731-66e264c8dd5d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.610761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-35003285-b05a-47ad-8641-27bdc22c530d req-a41a517b-31a4-4ca0-b731-66e264c8dd5d service nova] Creating event network-vif-plugged:c10d467d-46f9-41b5-a841-e0deb1d1d830 for instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 on n-h1-847009-13 Aug 23 10:43:20.616592 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-35003285-b05a-47ad-8641-27bdc22c530d req-a41a517b-31a4-4ca0-b731-66e264c8dd5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046918 Aug 23 10:43:20.617955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 896/1718] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:20.627947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:20.628714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:20.636223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.636646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.637158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.638311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.638959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.639652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.832054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:20.843588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1c42f6e-55cf-4ee2-bc00-8a7a8e8bd9c7 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1534 microversion: 2.1 time: 0.224462 Aug 23 10:43:20.847073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 897/1719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:20 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1534 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:20.851396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:20.852226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:20.860523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.861284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.861861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.862750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:20.863755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:20.864465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:20.881564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:20.902002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:20.961499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:20.973740 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d83eb1a-09c5-481b-a702-d1890eb95ae3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1094 microversion: 2.1 time: 0.127114 Aug 23 10:43:20.979549 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 898/1720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:20 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1094 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:20.990239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-543e9769-c437-4d8c-8922-db5a09fee0e3 req-85672633-51c4-409f-b3b2-78d92dbc76f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:21.015767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-543e9769-c437-4d8c-8922-db5a09fee0e3 req-85672633-51c4-409f-b3b2-78d92dbc76f7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.016244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-543e9769-c437-4d8c-8922-db5a09fee0e3 req-85672633-51c4-409f-b3b2-78d92dbc76f7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.016717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-543e9769-c437-4d8c-8922-db5a09fee0e3 req-85672633-51c4-409f-b3b2-78d92dbc76f7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.053930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-543e9769-c437-4d8c-8922-db5a09fee0e3 req-85672633-51c4-409f-b3b2-78d92dbc76f7 service nova] Creating event network-changed:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:43:21.068206 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-543e9769-c437-4d8c-8922-db5a09fee0e3 req-85672633-51c4-409f-b3b2-78d92dbc76f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083827 Aug 23 10:43:21.070818 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 899/1721] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:21.093848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.097756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:21.111642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.112270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.112970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.113696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.114355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.115550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.320726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:21.333895 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-718ed49c-dc53-4ef4-9204-6d8e2d9e7033 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.259355 Aug 23 10:43:21.334515 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 900/1722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:21 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:21.363494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.364143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:21.376502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.377321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.377953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.378952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.379392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.380180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.582960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Updating instance_info_cache with network_info: [{"id": "e5977e8e-da2e-41d1-95f4-4751418fce48", "address": "fa:16:3e:d8:93:84", "network": {"id": "7380efd3-97d2-489c-88db-bb3014da90df", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-949240103-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "47a750024d634a43b5f854401d5afa43", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape5977e8e-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:21.600519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Releasing lock "refresh_cache-f8a78c98-3708-49a1-9376-298b7cf19576" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:21.601441 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dd47bee-428f-43bd-b425-07f8041552d1 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action" status: 202 len: 0 microversion: 2.1 time: 2.133208 Aug 23 10:43:21.602059 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 823/1723] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:19 2022] POST /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576/action => generated 0 bytes in 2134 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:43:21.611462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.612367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:21.613540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:21.619798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:21.622721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.623441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.624176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.624430 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60526d7f-b17d-4d9d-ad41-1f03ef221297 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.267578 Aug 23 10:43:21.625816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.626616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.627306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.639727 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 901/1724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:21 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:21.646730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.647352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:21.654741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.655386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.655898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.656715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.657276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.657779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.673907 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] HTTP exception thrown: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Request method failure captured: Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc HTTP/1.1 Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK76qV8d93NQDsB_I-Am8kbXr6IwLIp3dgduJFNnT7xEcrL6vAfYXnimkR6jMcvWura199EuP7K3Yai057ckPUzw3BYJtOcBSFwY7viowwjJtvNOjHIAvwSSnw9XmjHBqdtxfTgzDMPxhTnGXSXmFsVD2c5cXRb3en6K2M9PTlF3bcw Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:21.676815 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/47a750024d634a43b5f854401d5afa43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_47a750024d634a43b5f854401d5afa43", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}] Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 45ac7be54bb940b9b2e0cb4559c64019 Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.678361 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '916eb643-8e14-4230-8587-56faf3c8c6bc'} Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:21.679256 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.683289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.686148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Returning 404 to user: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:21.686148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8e67561-91fa-40cb-9803-faa6bd81204c tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "DELETE /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 404 len: 111 microversion: 2.1 time: 0.036653 Aug 23 10:43:21.686148 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 902/1725] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:21 2022] DELETE /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:21.687732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.687732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: 916eb643-8e14-4230-8587-56faf3c8c6bc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:21.694270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.694772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.695234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.695960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.696464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.696971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.711785 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] HTTP exception thrown: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Request method failure captured: Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc HTTP/1.1 Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK76qV8d93NQDsB_I-Am8kbXr6IwLIp3dgduJFNnT7xEcrL6vAfYXnimkR6jMcvWura199EuP7K3Yai057ckPUzw3BYJtOcBSFwY7viowwjJtvNOjHIAvwSSnw9XmjHBqdtxfTgzDMPxhTnGXSXmFsVD2c5cXRb3en6K2M9PTlF3bcw Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:21.713463 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/47a750024d634a43b5f854401d5afa43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_47a750024d634a43b5f854401d5afa43", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}] Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 45ac7be54bb940b9b2e0cb4559c64019 Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.715090 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '916eb643-8e14-4230-8587-56faf3c8c6bc'} Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:21.715918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. Aug 23 10:43:21.717283 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:21.718619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Returning 404 to user: Instance 916eb643-8e14-4230-8587-56faf3c8c6bc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:21.718619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a1fd3bc-6999-44a5-b154-ec096769c73e tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc" status: 404 len: 111 microversion: 2.1 time: 0.031607 Aug 23 10:43:21.719750 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 903/1726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:21 2022] GET /compute/v2.1/servers/916eb643-8e14-4230-8587-56faf3c8c6bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:21.723575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d7432a4-1ea8-411a-bc6d-8d6d5e98e6d4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '.version_select at 0x7fdc9ce7cee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.852548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:21.867279 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23049ceb-d38a-4cb0-98c8-412a177aadc0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.262920 Aug 23 10:43:21.872597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 824/1727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:21 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:21.899598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:21.901040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:21.910731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.911391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.912126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:21.913255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:21.913973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:21.914651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:22.418056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:22.436408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-340027af-ede1-4ea1-8dc2-738c2fef6cd1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1534 microversion: 2.1 time: 0.548031 Aug 23 10:43:22.436641 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 825/1728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:21 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1534 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:22.442179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:22.443270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:22.463012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:22.465633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:22.466704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:22.469062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:22.480088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:22.480862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:22.791786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:22.811666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6d2f082-eaa3-4fe4-9936-056e62e08636 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1168 microversion: 2.1 time: 0.370718 Aug 23 10:43:22.832580 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 826/1729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:22 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1168 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:22.846618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:22.851296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:22.866083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:22.866632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:22.867122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:22.867932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:22.868441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:22.869565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:23.780524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:23.795384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae10ee27-2632-43dd-8ce3-6d10134fabf2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.965734 Aug 23 10:43:23.797007 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 827/1730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:22 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:23.810534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:23.813904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:23.824493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:23.825728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:23.826484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:23.827473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:23.828230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:23.829012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.363032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:24.365399 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d7432a4-1ea8-411a-bc6d-8d6d5e98e6d4 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/9844bdd0-dbb2-46d4-a155-134f1371feb0" status: 202 len: 0 microversion: 2.1 time: 2.645508 Aug 23 10:43:24.366567 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 904/1731] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:43:21 2022] DELETE /compute/v2.1/os-floating-ips/9844bdd0-dbb2-46d4-a155-134f1371feb0 => generated 0 bytes in 2647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:43:24.375204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:24.378355 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e389b70-3054-42e3-8017-d0f7d220e181 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1314 microversion: 2.1 time: 0.579939 Aug 23 10:43:24.378678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:24.379284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 828/1732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:23 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:24.386445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:24.387080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:24.394203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.394860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.395510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.396388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.397074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.397944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.403274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.407663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.408594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.411533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.412712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.413871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.592065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:24.625460 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbd1b760-749f-4301-90c7-18369bdf942b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1492 microversion: 2.1 time: 0.241611 Aug 23 10:43:24.627329 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 829/1733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:24 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1492 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:24.637771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-40ba4c2e-5574-4e3e-a8f2-c6c4dba1be2e req-dfdf0673-af11-44a3-805c-59336f77d03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:24.676210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-40ba4c2e-5574-4e3e-a8f2-c6c4dba1be2e req-dfdf0673-af11-44a3-805c-59336f77d03a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.677003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-40ba4c2e-5574-4e3e-a8f2-c6c4dba1be2e req-dfdf0673-af11-44a3-805c-59336f77d03a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.683003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-40ba4c2e-5574-4e3e-a8f2-c6c4dba1be2e req-dfdf0673-af11-44a3-805c-59336f77d03a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.720818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:24.729511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3d91268-fa08-49fe-867b-90e0723eaf0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.361704 Aug 23 10:43:24.733503 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 905/1734] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:24 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:24.736812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-40ba4c2e-5574-4e3e-a8f2-c6c4dba1be2e req-dfdf0673-af11-44a3-805c-59336f77d03a service nova] Creating event network-changed:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:43:24.744816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:24.746367 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-40ba4c2e-5574-4e3e-a8f2-c6c4dba1be2e req-dfdf0673-af11-44a3-805c-59336f77d03a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116177 Aug 23 10:43:24.746991 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 830/1735] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:24.750577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:24.776539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e85971e8-cf2a-4cc4-a7d2-9139ee547028 req-8415bc66-d2ad-4577-932d-6532a116a14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a6c210e-7a36-4100-958c-7b74d7eefabd", "name": "network-vif-deleted", "tag": "d43cd356-2099-494b-adea-005634742690"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:24.781261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.781829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.782284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.788648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.789422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.789872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.812543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e85971e8-cf2a-4cc4-a7d2-9139ee547028 req-8415bc66-d2ad-4577-932d-6532a116a14f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.813823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e85971e8-cf2a-4cc4-a7d2-9139ee547028 req-8415bc66-d2ad-4577-932d-6532a116a14f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.814949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e85971e8-cf2a-4cc4-a7d2-9139ee547028 req-8415bc66-d2ad-4577-932d-6532a116a14f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.863676 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e85971e8-cf2a-4cc4-a7d2-9139ee547028 req-8415bc66-d2ad-4577-932d-6532a116a14f service nova] Creating event network-vif-deleted:d43cd356-2099-494b-adea-005634742690 for instance 7a6c210e-7a36-4100-958c-7b74d7eefabd on n-h1-847009-13 Aug 23 10:43:24.886370 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e85971e8-cf2a-4cc4-a7d2-9139ee547028 req-8415bc66-d2ad-4577-932d-6532a116a14f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129666 Aug 23 10:43:24.886940 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 831/1736] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:24.892442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:24.897276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:24.910477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.910993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.911443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:24.912175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:24.920416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:24.923007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.054992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:25.105016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:25.119740 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc5548b0-46c5-4438-ab44-429f507452c0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1210 microversion: 2.1 time: 0.380808 Aug 23 10:43:25.124913 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 906/1737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:24 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1210 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:25.144513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:25.146237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:25.158096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.158955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.159561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.160981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.161607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.162345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.237383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49bd143d-f62a-43ef-afa3-0943ce39987f tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 204 len: 0 microversion: 2.1 time: 0.348597 Aug 23 10:43:25.238564 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 832/1738] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:24 2022] DELETE /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:25.254646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:25.258113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:25.281529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.282443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.285191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.285963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.286457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.286885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.414282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:25.442708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20224d1f-85cf-4bf3-94f2-22b5f3b068b2 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1332 microversion: 2.1 time: 0.313064 Aug 23 10:43:25.443335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 907/1739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:25 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1332 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:25.450752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:25.457758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:25.473753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.474544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.475455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.477215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.480876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.481344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.762284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:25.770242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:25.771687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b109d20a-1711-4685-ab7a-5e32f280063e tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1464 microversion: 2.1 time: 0.327263 Aug 23 10:43:25.772589 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 908/1740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:25 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:25.777886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:25.778728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:25.784282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8526c67-e8d7-4d0d-b5f4-ac2599be08eb tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1524 microversion: 2.1 time: 0.539769 Aug 23 10:43:25.788819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 833/1741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:25 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1524 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:25.788976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.788976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.788976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.788976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.789318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.789582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.799465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:25.800100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:25.813168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.813841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.814105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.814829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.818775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.819719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.855368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:25.855780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:25.859568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:25.860076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lazy-loading 'fault' on Instance uuid 7a6c210e-7a36-4100-958c-7b74d7eefabd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:25.925983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:25.935980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89f87854-8997-482b-8932-3e9d3485b3d4 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1369 microversion: 2.1 time: 0.161901 Aug 23 10:43:25.936787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 909/1742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:25 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1369 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:26.020021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Calling method '.version_select at 0x7fdc9cc8c790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.038968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.039761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.041064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.074075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.077358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:26.077697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.078348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.090167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-853e9fe0-6c6e-47e8-807e-4039352238ab tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.302358 Aug 23 10:43:26.093858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 834/1743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:25 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:26.099009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:26.111042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-639ae268-9130-452c-9eb6-071ecf938d29 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/6e6d1fb6028648d08c102f897e00bc7a?start=2022-08-22T10%3A43%3A25.785641&end=2022-08-24T10%3A43%3A25.785641" status: 200 len: 694 microversion: 2.1 time: 0.172900 Aug 23 10:43:26.111937 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 910/1744] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Aug 23 10:43:25 2022] GET /compute/v2.1/os-simple-tenant-usage/6e6d1fb6028648d08c102f897e00bc7a?start=2022-08-22T10%3A43%3A25.785641&end=2022-08-24T10%3A43%3A25.785641 => generated 694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:26.130418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '.version_select at 0x7fdc9cdbe0d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.144186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.145172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:26.145529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.146848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.148178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.149498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:26.156359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.158150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.158775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.160387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.161196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.162396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.202811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.203598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.204347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.245130 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad294fe4-6c6a-4d7e-943c-7680247d106d tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/6e6d1fb6028648d08c102f897e00bc7a?start=2022-08-22T10%3A43%3A25.785641&end=2022-08-24T10%3A43%3A25.785641" status: 200 len: 695 microversion: 2.1 time: 0.119051 Aug 23 10:43:26.253308 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 835/1745] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Aug 23 10:43:26 2022] GET /compute/v2.1/os-simple-tenant-usage/6e6d1fb6028648d08c102f897e00bc7a?start=2022-08-22T10%3A43%3A25.785641&end=2022-08-24T10%3A43%3A25.785641 => generated 695 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:26.269229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Calling method '.version_select at 0x7fdc9d157ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.280584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.281295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.281881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.299406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.300154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.300813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.354544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:26.363760 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-925115b9-1aa9-426d-a36a-4591a9a297b1 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1210 microversion: 2.1 time: 0.226182 Aug 23 10:43:26.376933 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 911/1746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:26 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1210 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:26.381420 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c921823-5fde-4527-b37a-fc9bc1314c59 tempest-TenantUsagesTestJSON-1687172553 tempest-TenantUsagesTestJSON-1687172553-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T10%3A43%3A25.785641&end=2022-08-24T10%3A43%3A25.785641&detailed=1" status: 200 len: 15217 microversion: 2.1 time: 0.115809 Aug 23 10:43:26.382357 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 836/1747] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Aug 23 10:43:26 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T10%3A43%3A25.785641&end=2022-08-24T10%3A43%3A25.785641&detailed=1 => generated 15217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:43:26.409308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.410072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:26.416790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.418009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.418872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.419765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.420391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.421006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.453202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:26.467681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.468807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:26.487763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.489701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.490977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.496607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.500031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.502192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.589118 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2bd3de58-c4b1-4c6c-b151-2cb526fb33cf tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "DELETE /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 204 len: 0 microversion: 2.1 time: 0.182833 Aug 23 10:43:26.593527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 912/1748] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:26 2022] DELETE /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:26.599602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.600398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:26.608430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.609738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.610132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.611394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.611863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.612390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.804951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:26.807303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:26.816300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e8f9fa3-e630-4464-9951-dca5eac33a56 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1470 microversion: 2.1 time: 0.221359 Aug 23 10:43:26.818161 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-669cfd97-b066-4703-8e54-7e0db28060d5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1536 microversion: 2.1 time: 0.357151 Aug 23 10:43:26.819252 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 913/1749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:26 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:26.824080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 837/1750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:26 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1536 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:26.841131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9617deda-d13c-4c35-8cb2-10b7661d2c24 req-f10a43c7-b44e-42a2-a971-cc6c7e181b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a18dd1f-4b4e-4011-b17b-7ce410218e5c", "tag": "9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:26.851042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:26.857535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9617deda-d13c-4c35-8cb2-10b7661d2c24 req-f10a43c7-b44e-42a2-a971-cc6c7e181b52 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.857890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:26.859192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9617deda-d13c-4c35-8cb2-10b7661d2c24 req-f10a43c7-b44e-42a2-a971-cc6c7e181b52 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.860313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9617deda-d13c-4c35-8cb2-10b7661d2c24 req-f10a43c7-b44e-42a2-a971-cc6c7e181b52 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.864766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.865557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.866320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.877643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:26.878528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:26.879676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:26.887289 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9617deda-d13c-4c35-8cb2-10b7661d2c24 req-f10a43c7-b44e-42a2-a971-cc6c7e181b52 service nova] Creating event network-changed:9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1 for instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c on n-h2-847009-13 Aug 23 10:43:26.897698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9617deda-d13c-4c35-8cb2-10b7661d2c24 req-f10a43c7-b44e-42a2-a971-cc6c7e181b52 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062854 Aug 23 10:43:26.899070 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 838/1751] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:43:26.917159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e0ded9a-0a41-4e54-be4c-d5befb3e2477 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'create', calling method: .version_select at 0x7fdc9cf9cf70>, body: {"pool": "a57c3463-0e0e-4f09-8699-1fe402d2368f"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:27.102001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:27.113318 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b160af0-f723-44f7-a997-b79056350691 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1524 microversion: 2.1 time: 0.278543 Aug 23 10:43:27.114456 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 914/1752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:26 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1524 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:27.119593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:27.120423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:27.127366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.128179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.128826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:27.129726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.130380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.130818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:27.164471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.165266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.167068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:27.167790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lazy-loading 'fault' on Instance uuid 7a6c210e-7a36-4100-958c-7b74d7eefabd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:27.212733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:27.223008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d21d2c77-0812-421b-862d-6773bc197dc6 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1369 microversion: 2.1 time: 0.107026 Aug 23 10:43:27.225116 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 915/1753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:27 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:27.241925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:27.242965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:27.252715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.253253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.253768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:27.254500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.254969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.255502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:27.512271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:27.520821 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-425c818b-2275-469f-a797-8d818c7c9ad6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.294564 Aug 23 10:43:27.527415 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 916/1754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:27 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:27.532878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:27.533618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:27.542140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.545174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.545763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:27.546610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:27.547420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:27.547987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.115388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:28.130557 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-16960f22-5f58-4c12-a28f-041caa0bc0a9 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1210 microversion: 2.1 time: 0.601220 Aug 23 10:43:28.131921 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 917/1755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:27 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1210 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:28.137262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:28.138109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:28.145254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.146249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.146935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.148175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.148890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.149576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.368793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:28.397334 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0083aeb6-c2dd-4ccf-9ade-c7e9c73d6fbc tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1470 microversion: 2.1 time: 0.260866 Aug 23 10:43:28.407737 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 918/1756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:28 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:28.412446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5090d7c5-268c-4d8e-9aca-856a7881c670 req-dcb04b5c-07cc-4a74-b89a-aafe85f910a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bef7e7-48bc-426b-aef7-d87facd717f4", "name": "network-vif-plugged", "status": "completed", "tag": "19d7cb31-9140-46a0-a97a-6d04ac533929"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:28.428445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5090d7c5-268c-4d8e-9aca-856a7881c670 req-dcb04b5c-07cc-4a74-b89a-aafe85f910a8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.429139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5090d7c5-268c-4d8e-9aca-856a7881c670 req-dcb04b5c-07cc-4a74-b89a-aafe85f910a8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.429422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5090d7c5-268c-4d8e-9aca-856a7881c670 req-dcb04b5c-07cc-4a74-b89a-aafe85f910a8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.449082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5090d7c5-268c-4d8e-9aca-856a7881c670 req-dcb04b5c-07cc-4a74-b89a-aafe85f910a8 service nova] Creating event network-vif-plugged:19d7cb31-9140-46a0-a97a-6d04ac533929 for instance a7bef7e7-48bc-426b-aef7-d87facd717f4 on n-h1-847009-13 Aug 23 10:43:28.449755 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5090d7c5-268c-4d8e-9aca-856a7881c670 req-dcb04b5c-07cc-4a74-b89a-aafe85f910a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046201 Aug 23 10:43:28.455510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 919/1757] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:28.461526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:28.462824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:28.469465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.470202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.470775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.471520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.471927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.472369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.631263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:28.642353 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec146327-ef8e-4bfc-876b-1fbe8a0d30b9 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1524 microversion: 2.1 time: 0.185333 Aug 23 10:43:28.655205 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 920/1758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:28 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1524 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:28.665412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:28.666356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:28.674567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.675590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.676158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.677030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.677709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.678233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.715776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.716274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.717455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.717455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lazy-loading 'fault' on Instance uuid 7a6c210e-7a36-4100-958c-7b74d7eefabd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:28.780023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:28.790881 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cfa0c5a9-a523-4ddd-87d4-f03fa7c0d537 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1369 microversion: 2.1 time: 0.130540 Aug 23 10:43:28.792211 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 921/1759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:28 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1369 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:28.797634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:28.798522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:28.805664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.806826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.807387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:28.808015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:28.808467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:28.808957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.017708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:29.027198 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b1384f6-c94b-46b6-85ff-a9121528ea3a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.234019 Aug 23 10:43:29.038143 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 922/1760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:28 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:29.152704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:29.153504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:29.161264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.161762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.162479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.163465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.164088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.164524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.410229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:29.420045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79715e18-d805-41de-a9e5-0478cfd7771e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1210 microversion: 2.1 time: 0.272398 Aug 23 10:43:29.432352 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 923/1761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:29 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1210 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:29.432352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:29.432352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:29.434487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.437420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.438144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.439118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.442035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.443250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.495660 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e0ded9a-0a41-4e54-be4c-d5befb3e2477 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.594042 Aug 23 10:43:29.496337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 839/1762] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:43:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:29.510899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.159"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:29.513652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:29.521293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.522383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.522840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.523590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.524055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.524557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.563016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:29.563428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquired lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:29.625039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:29.638514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b185b792-8519-4565-9a89-b41494732cc0 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1470 microversion: 2.1 time: 0.216285 Aug 23 10:43:29.639459 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 924/1763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:29 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:29.673949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:29.675021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:29.684490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.685036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.685485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.686238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:29.687155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:29.687665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:29.834773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:29.987028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:29.990772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:29.999327 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6bdc7c10-cb20-4603-9808-f977b3bc5f13 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1524 microversion: 2.1 time: 0.336973 Aug 23 10:43:29.999931 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 925/1764] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:29 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1524 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:30.005590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:30.006466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:30.015478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.016715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.016715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.017184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.017729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.018325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.054856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.055407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.055894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.057609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lazy-loading 'fault' on Instance uuid 7a6c210e-7a36-4100-958c-7b74d7eefabd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:30.101822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:30.111527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-994a18f0-8b54-4715-99ad-1e1436d3772d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 200 len: 1369 microversion: 2.1 time: 0.110014 Aug 23 10:43:30.112430 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 926/1765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:29 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 1369 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:30.119718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:30.120856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:30.127995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.128493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.128997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.129746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.130490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.130958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.520481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:30.538051 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7050a8ff-899c-4b28-a91a-8dd6c0ec5270 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.423140 Aug 23 10:43:30.550602 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 927/1766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:30 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:30.559612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:30.560161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:30.582480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.582769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.583048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.583771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.584228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.584648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.857289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:30.866661 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4680560-5448-4520-b4bb-093974340344 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.314767 Aug 23 10:43:30.882038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 928/1767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:30 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:30.887725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:30.888355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:30.894517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.895017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.895462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:30.896176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:30.897099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:30.897099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.193390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:31.203223 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-beb584bd-a53c-49e8-b3df-57047b30b4e4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1470 microversion: 2.1 time: 0.319974 Aug 23 10:43:31.203821 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 929/1768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:30 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:31.208773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:31.209544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:31.217551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.218049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.218483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.219207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.219824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.220264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.295153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:31.304064 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c21f40a5-acc9-45e9-98c4-fa5fdedfe1f8 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1482 microversion: 2.1 time: 0.099178 Aug 23 10:43:31.305486 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 930/1769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:31 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1482 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:31.312029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:31.313048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 7a6c210e-7a36-4100-958c-7b74d7eefabd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:31.319688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.321042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.322382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.323218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.323770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.324515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.339698 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] HTTP exception thrown: Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd could not be found. Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Request method failure captured: Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd HTTP/1.1 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3csbLApRW04VF1qwkBCCDO1Cj4r0uF-9mKVSOfXaYxNO4myNslc9zZas3_A0IzqN3h4iK1SZR4TqIZ0_Q0DeMdLMRDBkQ3BQo58pgNEGJcY-xUvuBA6odnT1GAl17gVuepBu1K-4znpr4nI2TwlrEoQj4VZUf7Q1MSI25b3PYCKK8 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:31.341333 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81dd6dd624b14701860deb0d33332e83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}] Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9574ff57c9474f7fb5ec4567bc06d531 Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd could not be found. Aug 23 10:43:31.343087 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '7a6c210e-7a36-4100-958c-7b74d7eefabd'} Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd could not be found. Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:31.344038 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd could not be found. Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd could not be found. Aug 23 10:43:31.345847 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:31.348761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Returning 404 to user: Instance 7a6c210e-7a36-4100-958c-7b74d7eefabd could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:31.348761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-75801c04-736f-4348-bb7a-6ae9342a0ae0 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd" status: 404 len: 111 microversion: 2.1 time: 0.036366 Aug 23 10:43:31.348761 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 931/1770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:31 2022] GET /compute/v2.1/servers/7a6c210e-7a36-4100-958c-7b74d7eefabd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:31.348761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-09bdfa0e-9a90-4d10-84d9-19d87e87cb9a req-4d66e013-c4ec-4d22-879e-e69e873a7937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a78c98-3708-49a1-9376-298b7cf19576", "name": "network-vif-deleted", "tag": "e5977e8e-da2e-41d1-95f4-4751418fce48"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:31.360064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-09bdfa0e-9a90-4d10-84d9-19d87e87cb9a req-4d66e013-c4ec-4d22-879e-e69e873a7937 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.360558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-09bdfa0e-9a90-4d10-84d9-19d87e87cb9a req-4d66e013-c4ec-4d22-879e-e69e873a7937 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.361016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-09bdfa0e-9a90-4d10-84d9-19d87e87cb9a req-4d66e013-c4ec-4d22-879e-e69e873a7937 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.374067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-09bdfa0e-9a90-4d10-84d9-19d87e87cb9a req-4d66e013-c4ec-4d22-879e-e69e873a7937 service nova] Creating event network-vif-deleted:e5977e8e-da2e-41d1-95f4-4751418fce48 for instance f8a78c98-3708-49a1-9376-298b7cf19576 on n-h1-847009-13 Aug 23 10:43:31.379164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-09bdfa0e-9a90-4d10-84d9-19d87e87cb9a req-4d66e013-c4ec-4d22-879e-e69e873a7937 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034083 Aug 23 10:43:31.381677 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 932/1771] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:31.388155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-10cab9d3-a41e-4405-8f70-701dc8daca34 req-10b83648-9480-4174-b932-0bbff0791dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60029070-fe8f-4b07-add2-6f3e6b458368", "name": "network-vif-deleted", "tag": "b9390a42-2c3b-4af1-b791-d1ff8239626e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:31.398063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-10cab9d3-a41e-4405-8f70-701dc8daca34 req-10b83648-9480-4174-b932-0bbff0791dbe service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.398545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-10cab9d3-a41e-4405-8f70-701dc8daca34 req-10b83648-9480-4174-b932-0bbff0791dbe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.398989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-10cab9d3-a41e-4405-8f70-701dc8daca34 req-10b83648-9480-4174-b932-0bbff0791dbe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.413556 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-10cab9d3-a41e-4405-8f70-701dc8daca34 req-10b83648-9480-4174-b932-0bbff0791dbe service nova] Creating event network-vif-deleted:b9390a42-2c3b-4af1-b791-d1ff8239626e for instance 60029070-fe8f-4b07-add2-6f3e6b458368 on n-h1-847009-13 Aug 23 10:43:31.419382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-10cab9d3-a41e-4405-8f70-701dc8daca34 req-10b83648-9480-4174-b932-0bbff0791dbe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036072 Aug 23 10:43:31.420307 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 933/1772] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:31.425606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e03c4924-d22f-401c-b329-02f698fdda6d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '.version_select at 0x7fdc9d13e700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:31.449108 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e03c4924-d22f-401c-b329-02f698fdda6d tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773868599" status: 202 len: 0 microversion: 2.1 time: 0.025640 Aug 23 10:43:31.451412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 934/1773] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:43:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1773868599 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:43:31.560222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:31.561418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:31.567703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.568200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.568645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.569388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:31.569853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:31.570288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:31.723507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:31.996456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:32.006298 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1b7ccc4-cf77-4a27-bc41-abfb98d55ece tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1307 microversion: 2.1 time: 0.450576 Aug 23 10:43:32.006884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 935/1774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:31 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:32.012435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:32.016582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:32.044858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.045643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.046262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.047172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.047687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.048977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.391700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:32.401307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7f5fa33-d0db-44e1-a7bf-debc270c42b0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.393075 Aug 23 10:43:32.406895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 936/1775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:32 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:32.419686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:32.420659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:32.433559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.436049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.438447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.440179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.441205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.444065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.558854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.559375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.559826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.563055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lazy-loading 'fault' on Instance uuid 60029070-fe8f-4b07-add2-6f3e6b458368 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:32.648168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e6a58c430c4b9089e6d60633ca1ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6d1fb6028648d08c102f897e00bc7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:32.652159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Updating instance_info_cache with network_info: [{"id": "c10d467d-46f9-41b5-a841-e0deb1d1d830", "address": "fa:16:3e:38:a4:20", "network": {"id": "74cc3c7c-cbc5-4030-9fbd-cd64a9917347", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1336562599-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7758f6b11c1401ba1157f9c55afe615", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc10d467d-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:32.674863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Releasing lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:32.676230 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb7bace8-b8bf-46fe-89eb-86ab6d4ca0bc tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action" status: 202 len: 0 microversion: 2.1 time: 3.170757 Aug 23 10:43:32.681422 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-407510ed-f1b1-4ccf-b3e2-cd0e5c05012f tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 200 len: 1304 microversion: 2.1 time: 0.271565 Aug 23 10:43:32.681422 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 937/1776] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:32 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 1304 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:32.681888 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 840/1777] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:29 2022] POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action => generated 0 bytes in 3177 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 23 10:43:32.693883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd5cf6b8-22af-4777-8695-0ea434a9e43d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'create', calling method: .version_select at 0x7fdc9d952f70>, body: {"pool": "a57c3463-0e0e-4f09-8699-1fe402d2368f"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:32.703879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:32.704506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:32.718021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.718521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.719013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.719742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.720146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.720822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.796523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.798801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.799727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.801433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lazy-loading 'fault' on Instance uuid f8a78c98-3708-49a1-9376-298b7cf19576 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:32.943074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ac7be54bb940b9b2e0cb4559c64019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a750024d634a43b5f854401d5afa43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:32.960158 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1fb956bd-cbcd-4383-9140-8c3002e66db2 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 200 len: 1313 microversion: 2.1 time: 0.266355 Aug 23 10:43:32.961668 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 938/1778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:32 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:32.981592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:32.982275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:32.991594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.992100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.992542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:32.993943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:32.994447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:32.996926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.029681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:33.136427 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87da289a-d82b-4fad-9985-b45b17739b50 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 204 len: 0 microversion: 2.1 time: 0.159718 Aug 23 10:43:33.139625 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 939/1779] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:32 2022] DELETE /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:33.145809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:33.146446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:33.153502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.153988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.154478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.155601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.156058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.156480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.348009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:33.357337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b82eb6db-8a0e-40b2-a75b-de9ff44045d2 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1486 microversion: 2.1 time: 0.219079 Aug 23 10:43:33.358285 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 940/1780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:33 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1486 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:33.363551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:33.364598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:33.372680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.373425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.374287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.375176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.375821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.376701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.589583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:33.599623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c24c8b7-2706-4371-b3e2-cb81597fac72 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1469 microversion: 2.1 time: 0.239900 Aug 23 10:43:33.600791 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 941/1781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:33 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:33.617277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:33.617826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:33.626684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.627188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.627646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.628399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.628979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.629448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.684827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lazy-loading 'flavor' on Instance uuid a7bef7e7-48bc-426b-aef7-d87facd717f4 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:33.736906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:33.842509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a962002-b51f-4c7f-8623-f162f17be086 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4/action" status: 202 len: 0 microversion: 2.1 time: 0.240917 Aug 23 10:43:33.845074 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 942/1782] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:33 2022] POST /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:43:33.852158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3ecbfe5e-2209-4880-929c-28a3f29abb05 req-1885df51-b186-4b59-976b-7bc1f9f68646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685ee89e-f7b8-46ed-811d-9deea9b1af35", "tag": "c10d467d-46f9-41b5-a841-e0deb1d1d830"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:33.865905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ecbfe5e-2209-4880-929c-28a3f29abb05 req-1885df51-b186-4b59-976b-7bc1f9f68646 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.866397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ecbfe5e-2209-4880-929c-28a3f29abb05 req-1885df51-b186-4b59-976b-7bc1f9f68646 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.868041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ecbfe5e-2209-4880-929c-28a3f29abb05 req-1885df51-b186-4b59-976b-7bc1f9f68646 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.882760 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3ecbfe5e-2209-4880-929c-28a3f29abb05 req-1885df51-b186-4b59-976b-7bc1f9f68646 service nova] Creating event network-changed:c10d467d-46f9-41b5-a841-e0deb1d1d830 for instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 on n-h1-847009-13 Aug 23 10:43:33.895823 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3ecbfe5e-2209-4880-929c-28a3f29abb05 req-1885df51-b186-4b59-976b-7bc1f9f68646 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047757 Aug 23 10:43:33.901743 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 943/1783] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:33.914886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:33.916907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:33.927903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.928326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.928804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:33.929532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:33.930033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:33.933564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.127415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:34.136934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-460abe3e-b6ba-436e-b59d-57f3e61c169f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.232799 Aug 23 10:43:34.137934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 944/1784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:33 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:34.143329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:34.146385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] [instance: 60029070-fe8f-4b07-add2-6f3e6b458368] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:34.153737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.154487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.155146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.156421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.157111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.157818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.179186 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] HTTP exception thrown: Instance 60029070-fe8f-4b07-add2-6f3e6b458368 could not be found. Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Request method failure captured: Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 HTTP/1.1 Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK8l4gDZYoXEcJm0uRBIFdaWhcAvFWvzpm1IrY5lCBe3JNbtVYjjwlzLznWjx6gv2uCWyfkI1fBPmXlKzaGwmpN6Rv2irnpJagQw5oQeqouUFQS3XcVdCgRJyLVTTbeeY4qaPtbqPcCwPk7xPJ1YAjq6M2Z91KCo66QSZ8bELLCvlPw Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6e6d1fb6028648d08c102f897e00bc7a Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TenantUsagesTestJSON-105420540 Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:34.180936 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6e6d1fb6028648d08c102f897e00bc7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6e6d1fb6028648d08c102f897e00bc7a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e6d1fb6028648d08c102f897e00bc7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6e6d1fb6028648d08c102f897e00bc7a"}]}] Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TenantUsagesTestJSON-105420540 Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6e6d1fb6028648d08c102f897e00bc7a Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TenantUsagesTestJSON-105420540 Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TenantUsagesTestJSON-105420540-project Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 76e6a58c430c4b9089e6d60633ca1ca8 Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TenantUsagesTestJSON-105420540-project Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 60029070-fe8f-4b07-add2-6f3e6b458368 could not be found. Aug 23 10:43:34.183392 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '60029070-fe8f-4b07-add2-6f3e6b458368'} Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60029070-fe8f-4b07-add2-6f3e6b458368 could not be found. Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:34.185121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60029070-fe8f-4b07-add2-6f3e6b458368 could not be found. Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60029070-fe8f-4b07-add2-6f3e6b458368 could not be found. Aug 23 10:43:34.187925 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.190515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] Returning 404 to user: Instance 60029070-fe8f-4b07-add2-6f3e6b458368 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:34.190515 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c586390-ee40-4504-848a-a3a05fab7bd4 tempest-TenantUsagesTestJSON-105420540 tempest-TenantUsagesTestJSON-105420540-project] 10.222.0.78 "GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368" status: 404 len: 111 microversion: 2.1 time: 0.043746 Aug 23 10:43:34.190515 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 945/1785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:34 2022] GET /compute/v2.1/servers/60029070-fe8f-4b07-add2-6f3e6b458368 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:34.196061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:34.197300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:34.215605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.216099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.216535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.217288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.217731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.218153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.329285 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd5cf6b8-22af-4777-8695-0ea434a9e43d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.643211 Aug 23 10:43:34.330155 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 841/1786] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:43:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:43:34.336887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:34.338517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] [instance: f8a78c98-3708-49a1-9376-298b7cf19576] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:34.351058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.351568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.353080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.355260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.356674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.357307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.387565 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] HTTP exception thrown: Instance f8a78c98-3708-49a1-9376-298b7cf19576 could not be found. Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Request method failure captured: Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 HTTP/1.1 Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK76qV8d93NQDsB_I-Am8kbXr6IwLIp3dgduJFNnT7xEcrL6vAfYXnimkR6jMcvWura199EuP7K3Yai057ckPUzw3BYJtOcBSFwY7viowwjJtvNOjHIAvwSSnw9XmjHBqdtxfTgzDMPxhTnGXSXmFsVD2c5cXRb3en6K2M9PTlF3bcw Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:43:34.392539 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/47a750024d634a43b5f854401d5afa43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_47a750024d634a43b5f854401d5afa43", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47a750024d634a43b5f854401d5afa43"}]}] Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 47a750024d634a43b5f854401d5afa43 Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-947146159 Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 45ac7be54bb940b9b2e0cb4559c64019 Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-947146159-project Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance f8a78c98-3708-49a1-9376-298b7cf19576 could not be found. Aug 23 10:43:34.394339 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f8a78c98-3708-49a1-9376-298b7cf19576'} Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a78c98-3708-49a1-9376-298b7cf19576 could not be found. Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:34.395238 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a78c98-3708-49a1-9376-298b7cf19576 could not be found. Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a78c98-3708-49a1-9376-298b7cf19576 could not be found. Aug 23 10:43:34.396953 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:34.401794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] Returning 404 to user: Instance f8a78c98-3708-49a1-9376-298b7cf19576 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:34.404363 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-871d4586-3aad-45ba-99ae-16108218d966 tempest-FloatingIPsAssociationTestJSON-947146159 tempest-FloatingIPsAssociationTestJSON-947146159-project] 10.222.0.78 "GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576" status: 404 len: 111 microversion: 2.1 time: 0.072617 Aug 23 10:43:34.407890 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 842/1787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:34 2022] GET /compute/v2.1/servers/f8a78c98-3708-49a1-9376-298b7cf19576 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:34.422179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.33"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:34.426012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:34.438678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.441417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.445444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.449295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.452055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.453746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.469279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:34.512579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:34.513103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquired lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:34.536438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:34.547659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32b3cd81-23e5-41a7-9ade-fd24de4b1f51 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1494 microversion: 2.1 time: 0.363203 Aug 23 10:43:34.561473 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 946/1788] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:34 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1494 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:34.625912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:34.626540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:34.633226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.633720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.634161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.635528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:34.635731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:34.636167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:34.901787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:34.910928 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0d212e94-7170-436a-878c-a439bb74d19f tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1469 microversion: 2.1 time: 0.289468 Aug 23 10:43:34.936220 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 947/1789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:34 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:35.159095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:35.161118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:35.174170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:35.174744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:35.175213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:35.175975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:35.176954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:35.176954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:35.442845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:35.454753 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adb039f4-c466-4459-97e3-79de38df7c71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.299623 Aug 23 10:43:35.456107 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 948/1790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:35 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:35.573186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:35.573965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:35.576146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:35.586922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:35.588717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:35.589685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:35.590228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:35.590794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:35.591336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:35.714737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f.", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:43:35.716668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Releasing lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:35.717484 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.717484 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Request method failure captured: Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action HTTP/1.1 Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 45 Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK8rAcW55Zd2Go-WcqiMZMnDsnrbxO05FzyGUoG2Ze4rBE5zZrRIBxOlS9kkro0FRS_sTT-xGUSvH53S0uPlGiMPEy872LjOafngXIT2fXtUYwLVrq-UO73o_7bqI0JsF-AOUjMgmelEkW5tyujP7wKMwVm9zD5FGt7ianDSoi6JfZk Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:43:35.721446 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7758f6b11c1401ba1157f9c55afe615", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}] Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d6eec3ace5364b24bd7a466eef0ad082 Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: {"addFloatingIp": {"address": "172.25.9.33"}} Aug 23 10:43:35.723061 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '685ee89e-f7b8-46ed-811d-9deea9b1af35', 'body': {'addFloatingIp': {'address': '172.25.9.33'}}} Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:43:35.724002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:43:35.725237 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.726443 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.731017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] Aug 23 10:43:35.732627 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:35.734904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Returning 400 to user: Cannot associate floating IP 172.25.9.33 (bd789b4e-1134-49a7-8313-d84c5a0cdb48) with port c10d467d-46f9-41b5-a841-e0deb1d1d830 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a57c3463-0e0e-4f09-8699-1fe402d2368f. Aug 23 10:43:35.734904 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-47cee478-93dd-4654-b023-ecfdd29ede78'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:35.736101 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cad8597a-a8db-40eb-b897-724ed9c6eadb tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action" status: 400 len: 380 microversion: 2.1 time: 1.326089 Aug 23 10:43:35.742801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 843/1791] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:34 2022] POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action => generated 380 bytes in 1333 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:43:35.754413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd058daf-2334-4e8c-8765-ae69bdb85ab5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '.version_select at 0x7fdc9cf9cf70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:35.785179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:35.795349 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85ca5d58-0151-418d-8b05-d948998c862c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 200 len: 1477 microversion: 2.1 time: 0.228172 Aug 23 10:43:35.796638 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 949/1792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:35 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:35.818604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-206631608"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:35.822094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:35.829502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:35.829997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:35.830455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:35.831173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:35.831643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:35.832377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:36.105435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:36.152878 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-71d44292-c24f-420a-aa92-230e15511af4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4/action" status: 202 len: 0 microversion: 2.1 time: 0.338257 Aug 23 10:43:36.159271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 950/1793] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:35 2022] POST /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:43:36.166996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:36.167991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:36.176206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:36.177002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:36.177642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:36.179055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:36.179682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:36.181313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:36.298832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:36.381403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:36.392435 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b0b5f94-514f-4c8b-8c2c-ee262fa901e1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1469 microversion: 2.1 time: 0.236060 Aug 23 10:43:36.393603 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 951/1794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:36 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:36.423553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4059e1b-3c00-42f4-8e2b-237e06da27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cdb94c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:36.500759 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4059e1b-3c00-42f4-8e2b-237e06da27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.105841 Aug 23 10:43:36.502733 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 952/1795] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:36 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:36.509620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:36.510996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:36.518753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:36.519732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:36.520720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:36.522101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:36.523193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:36.524084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:36.710831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:36.721135 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9c3347e-e620-4c5c-a647-7f15360b1545 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.216508 Aug 23 10:43:36.722511 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 953/1796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:36 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:37.331765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-68a419a4-e02a-4c0e-8567-cdf7f8ac777e req-ca9edf88-91b8-4311-9193-6e606833d270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c18564-2b98-46ce-bcf4-cb02af84cb42", "name": "network-vif-deleted", "tag": "580ca05b-9b64-4591-b4d5-6b8926b0a301"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:37.361293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-68a419a4-e02a-4c0e-8567-cdf7f8ac777e req-ca9edf88-91b8-4311-9193-6e606833d270 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:37.363119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-68a419a4-e02a-4c0e-8567-cdf7f8ac777e req-ca9edf88-91b8-4311-9193-6e606833d270 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:37.366216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-68a419a4-e02a-4c0e-8567-cdf7f8ac777e req-ca9edf88-91b8-4311-9193-6e606833d270 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:37.398702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-68a419a4-e02a-4c0e-8567-cdf7f8ac777e req-ca9edf88-91b8-4311-9193-6e606833d270 service nova] Creating event network-vif-deleted:580ca05b-9b64-4591-b4d5-6b8926b0a301 for instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 on n-h2-847009-13 Aug 23 10:43:37.409340 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-68a419a4-e02a-4c0e-8567-cdf7f8ac777e req-ca9edf88-91b8-4311-9193-6e606833d270 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082911 Aug 23 10:43:37.413911 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 954/1797] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:43:37.427725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:37.432812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:37.440602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:37.441358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:37.441793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:37.442691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:37.443212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:37.443606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:37.484636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:37.485718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:37.486353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:37.486822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lazy-loading 'fault' on Instance uuid 15c18564-2b98-46ce-bcf4-cb02af84cb42 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:37.548790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:37.561932 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7866c7da-ac81-48ec-a8e8-25f25b476f1c tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 200 len: 1303 microversion: 2.1 time: 0.145726 Aug 23 10:43:37.567659 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 955/1798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:37 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:37.581714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29412069-6f0b-481e-bacd-c0bbead53755 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc9b670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:37.642956 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29412069-6f0b-481e-bacd-c0bbead53755 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.072715 Aug 23 10:43:37.651337 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 956/1799] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:37 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:37.744975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:37.745873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:37.762953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:37.763807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:37.764257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:37.767163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:37.767833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:37.768977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:37.928597 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd058daf-2334-4e8c-8765-ae69bdb85ab5 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/bd789b4e-1134-49a7-8313-d84c5a0cdb48" status: 202 len: 0 microversion: 2.1 time: 2.183765 Aug 23 10:43:37.933388 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 844/1800] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:43:35 2022] DELETE /compute/v2.1/os-floating-ips/bd789b4e-1134-49a7-8313-d84c5a0cdb48 => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:43:37.959104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.159"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:38.107460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:38.116226 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e827609-b7ba-413c-b053-a21c9d19f27e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.377093 Aug 23 10:43:38.116844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 957/1801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:37 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:38.298922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:38.309805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:38.310736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:38.312872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:38.315085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:38.315959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:38.317281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:38.585110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:38.586572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 15c18564-2b98-46ce-bcf4-cb02af84cb42] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:38.594562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:38.595320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:38.595941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:38.596994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:38.597604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:38.598197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:38.614384 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] HTTP exception thrown: Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 could not be found. Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Request method failure captured: Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 HTTP/1.1 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3csbLApRW04VF1qwkBCCDO1Cj4r0uF-9mKVSOfXaYxNO4myNslc9zZas3_A0IzqN3h4iK1SZR4TqIZ0_Q0DeMdLMRDBkQ3BQo58pgNEGJcY-xUvuBA6odnT1GAl17gVuepBu1K-4znpr4nI2TwlrEoQj4VZUf7Q1MSI25b3PYCKK8 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:38.616329 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81dd6dd624b14701860deb0d33332e83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}] Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9574ff57c9474f7fb5ec4567bc06d531 Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 could not be found. Aug 23 10:43:38.618174 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '15c18564-2b98-46ce-bcf4-cb02af84cb42'} Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 could not be found. Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:38.619062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 could not be found. Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 could not be found. Aug 23 10:43:38.620580 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:38.623388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Returning 404 to user: Instance 15c18564-2b98-46ce-bcf4-cb02af84cb42 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:38.624474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fbaea8d7-e272-4663-8539-66ea314caa3b tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42" status: 404 len: 111 microversion: 2.1 time: 0.043582 Aug 23 10:43:38.628549 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 958/1802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:38 2022] GET /compute/v2.1/servers/15c18564-2b98-46ce-bcf4-cb02af84cb42 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:43:38.634125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:38.635032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:38.642763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:38.643517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:38.644133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:38.645095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:38.645775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:38.646363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:38.848793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:38.849243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquired lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:38.961415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:38.986859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:38.990760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:38.992646 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30a784b9-0bc2-4421-8183-7ab8e54946ed tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2949 microversion: 2.32 time: 0.362852 Aug 23 10:43:38.995153 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 959/1803] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:43:38 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2949 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:39.003021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:39.003928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:39.011965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.012676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.013300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.014172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.014991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.015888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.043528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:39.046833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:39.150336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2aeb1340-ae1b-405f-9759-4de24d15c3b1 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 204 len: 0 microversion: 2.1 time: 0.151831 Aug 23 10:43:39.152148 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 960/1804] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:38 2022] DELETE /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:39.160266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21034a73-3a94-4f12-8ec8-87d0bd71de19 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9d10e310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:39.231530 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21034a73-3a94-4f12-8ec8-87d0bd71de19 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.077848 Aug 23 10:43:39.232133 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 961/1805] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:39 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:39.245082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:39.245898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:39.253672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.254332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.254893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.257007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.257007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.257603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.401128 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06b6dbf0-e572-4e83-a556-1feff1e77427 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.167089 Aug 23 10:43:39.401991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 962/1806] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 10:43:39 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06/os-interface => generated 1831 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:39.407425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:39.408313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:39.417146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.417900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.418539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.419457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.420097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.420702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.568635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:39.579100 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a26dbe03-9d74-4a57-bf49-72d034b18d67 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.175898 Aug 23 10:43:39.593418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 963/1807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:39 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:39.594363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:39.595000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:39.603442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.604285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.605050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.605922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:39.606568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:39.607107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:39.760781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:39.770102 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-935bec07-3524-40a6-93e8-0ee0ee6c8528 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1468 microversion: 2.1 time: 0.179747 Aug 23 10:43:39.770775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 964/1808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:39 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1468 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:40.247432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8e70073-3926-4685-a134-9eeee8330ff8 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9d2f93a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:40.299729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8e70073-3926-4685-a134-9eeee8330ff8 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.056836 Aug 23 10:43:40.309468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 965/1809] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:40 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:40.604886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:40.606187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:40.613205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:40.614297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:40.615022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:40.616050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:40.616674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:40.617388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:41.202206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:43:41.292220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:41.300967 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5dfce913-d30b-48e1-8ea2-81f65616026d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 0.702176 Aug 23 10:43:41.305323 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 966/1810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:40 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:41.313259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:41.314420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:41.328802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:41.329649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:41.330344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:41.331326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:41.332012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:41.332901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:41.750335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9574ff57c9474f7fb5ec4567bc06d531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81dd6dd624b14701860deb0d33332e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:41.766873 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e348bb7b-7533-492b-a8dc-78836ff3b473 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 200 len: 1468 microversion: 2.1 time: 0.457459 Aug 23 10:43:41.768201 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 967/1811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:41 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 1468 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:41.778843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5c3d28c9-0cee-4e0e-97f9-886ec6fe7aa9 req-ce06d52c-ccc9-4a28-82b9-c52463644279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a18dd1f-4b4e-4011-b17b-7ce410218e5c", "name": "network-vif-plugged", "status": "completed", "tag": "9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:41.812110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5c3d28c9-0cee-4e0e-97f9-886ec6fe7aa9 req-ce06d52c-ccc9-4a28-82b9-c52463644279 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:41.813903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5c3d28c9-0cee-4e0e-97f9-886ec6fe7aa9 req-ce06d52c-ccc9-4a28-82b9-c52463644279 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:41.816932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5c3d28c9-0cee-4e0e-97f9-886ec6fe7aa9 req-ce06d52c-ccc9-4a28-82b9-c52463644279 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:41.847228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5c3d28c9-0cee-4e0e-97f9-886ec6fe7aa9 req-ce06d52c-ccc9-4a28-82b9-c52463644279 service nova] Creating event network-vif-plugged:9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1 for instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c on n-h2-847009-13 Aug 23 10:43:41.860425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5c3d28c9-0cee-4e0e-97f9-886ec6fe7aa9 req-ce06d52c-ccc9-4a28-82b9-c52463644279 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090563 Aug 23 10:43:41.863273 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 968/1812] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:41.879230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-37421a6a-983b-4599-95db-477e104d18a6 req-2768ccb8-e424-4b76-a5f1-28ef695c2b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685ee89e-f7b8-46ed-811d-9deea9b1af35", "tag": "c10d467d-46f9-41b5-a841-e0deb1d1d830"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:41.902211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-37421a6a-983b-4599-95db-477e104d18a6 req-2768ccb8-e424-4b76-a5f1-28ef695c2b86 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:41.907553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-37421a6a-983b-4599-95db-477e104d18a6 req-2768ccb8-e424-4b76-a5f1-28ef695c2b86 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:41.908658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-37421a6a-983b-4599-95db-477e104d18a6 req-2768ccb8-e424-4b76-a5f1-28ef695c2b86 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:41.940455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-37421a6a-983b-4599-95db-477e104d18a6 req-2768ccb8-e424-4b76-a5f1-28ef695c2b86 service nova] Creating event network-changed:c10d467d-46f9-41b5-a841-e0deb1d1d830 for instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 on n-h1-847009-13 Aug 23 10:43:41.984389 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-37421a6a-983b-4599-95db-477e104d18a6 req-2768ccb8-e424-4b76-a5f1-28ef695c2b86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105746 Aug 23 10:43:41.986496 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 969/1813] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:42.006200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-934236e4-ba7d-4d25-8521-c28414a25f0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ce51310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:42.101880 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-934236e4-ba7d-4d25-8521-c28414a25f0e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.113132 Aug 23 10:43:42.112553 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 970/1814] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:41 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:42.331685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:42.332846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:42.346543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:42.351762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:42.355573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:42.359372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:42.361168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:42.362107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:43.376982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:43.398476 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a79b1c65-8c2f-4d14-915a-ee8f9f97e602 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 1.070200 Aug 23 10:43:43.402453 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 971/1815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:42 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:43:43.418002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:43.425019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] [instance: 21e76eb0-da10-435b-ac03-0a014dbd11e5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:43.443274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:43.444668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:43.458802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:43.465650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:43.467672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:43.471030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:43.551882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] HTTP exception thrown: Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 could not be found. Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Request method failure captured: Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 HTTP/1.1 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3csbLApRW04VF1qwkBCCDO1Cj4r0uF-9mKVSOfXaYxNO4myNslc9zZas3_A0IzqN3h4iK1SZR4TqIZ0_Q0DeMdLMRDBkQ3BQo58pgNEGJcY-xUvuBA6odnT1GAl17gVuepBu1K-4znpr4nI2TwlrEoQj4VZUf7Q1MSI25b3PYCKK8 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:43.554814 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_81dd6dd624b14701860deb0d33332e83", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/81dd6dd624b14701860deb0d33332e83"}]}] Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 81dd6dd624b14701860deb0d33332e83 Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-MigrationsAdminTest-27790912 Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9574ff57c9474f7fb5ec4567bc06d531 Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-MigrationsAdminTest-27790912-project Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 could not be found. Aug 23 10:43:43.557748 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '21e76eb0-da10-435b-ac03-0a014dbd11e5'} Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 could not be found. Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:43.559203 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 could not be found. Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 could not be found. Aug 23 10:43:43.560889 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:43.566543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] Returning 404 to user: Instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:43.575654 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ce67d39-3150-4972-badb-6ae7ffc65557 tempest-MigrationsAdminTest-27790912 tempest-MigrationsAdminTest-27790912-project] 10.222.0.78 "GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5" status: 404 len: 111 microversion: 2.1 time: 0.162555 Aug 23 10:43:43.576794 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 972/1816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:43 2022] GET /compute/v2.1/servers/21e76eb0-da10-435b-ac03-0a014dbd11e5 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:43.603122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-933e5739-f33e-47f3-ac5f-87c6ebac2be1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1e09d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:43.735324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-933e5739-f33e-47f3-ac5f-87c6ebac2be1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.156079 Aug 23 10:43:43.747571 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 973/1817] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:43 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:44.041246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-69ae1323-8533-45c2-ab35-5e28e5448591 req-43f45da4-07bd-425a-8321-ab1e001ff171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e76eb0-da10-435b-ac03-0a014dbd11e5", "name": "network-vif-deleted", "tag": "4c1fb94e-059f-43fd-b258-97c51fb0e459"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:44.059498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Updating instance_info_cache with network_info: [{"id": "c10d467d-46f9-41b5-a841-e0deb1d1d830", "address": "fa:16:3e:38:a4:20", "network": {"id": "74cc3c7c-cbc5-4030-9fbd-cd64a9917347", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1336562599-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d7758f6b11c1401ba1157f9c55afe615", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc10d467d-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:43:44.073923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-69ae1323-8533-45c2-ab35-5e28e5448591 req-43f45da4-07bd-425a-8321-ab1e001ff171 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:44.074920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-69ae1323-8533-45c2-ab35-5e28e5448591 req-43f45da4-07bd-425a-8321-ab1e001ff171 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:44.077075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-69ae1323-8533-45c2-ab35-5e28e5448591 req-43f45da4-07bd-425a-8321-ab1e001ff171 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:44.087548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Releasing lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:44.101000 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccb8ac97-1a8a-4a11-a17f-c28c91bd29e3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action" status: 202 len: 0 microversion: 2.1 time: 6.162348 Aug 23 10:43:44.108104 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 845/1818] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:37 2022] POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action => generated 0 bytes in 6173 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:43:44.108470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-69ae1323-8533-45c2-ab35-5e28e5448591 req-43f45da4-07bd-425a-8321-ab1e001ff171 service nova] Creating event network-vif-deleted:4c1fb94e-059f-43fd-b258-97c51fb0e459 for instance 21e76eb0-da10-435b-ac03-0a014dbd11e5 on n-h2-847009-13 Aug 23 10:43:44.122861 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-69ae1323-8533-45c2-ab35-5e28e5448591 req-43f45da4-07bd-425a-8321-ab1e001ff171 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086303 Aug 23 10:43:44.123649 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 974/1819] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:43:44.140260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-946cec59-5e1e-4670-a64e-67251ca4051f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '.version_select at 0x7fdc9cebadc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:44.426058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:44.428356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:44.442093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:44.444191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:44.448655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:44.449792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:44.450387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:44.451015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:45.636772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:45.648209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03616f4a-0d8b-4548-b029-76782f082c4f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1198 microversion: 2.1 time: 1.230243 Aug 23 10:43:45.663137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 975/1820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:44 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1198 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:45.681957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07fe02d3-6a9b-42ab-bd6f-1681e59f364c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ccc3c10>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:45.793420 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07fe02d3-6a9b-42ab-bd6f-1681e59f364c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.124094 Aug 23 10:43:45.794484 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 976/1821] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:45 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:46.674549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:46.676546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:46.695018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:46.695504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:46.706365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:46.709358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:46.709862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:46.710987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:47.342851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:47.362592 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1205f8d-cd2b-4078-8b81-7269e1aca65f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1380 microversion: 2.1 time: 0.691586 Aug 23 10:43:47.366186 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 977/1822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:46 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1380 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:47.373633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-621b58be-9aad-4a63-95f4-7411bc88c773 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cd424c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:47.441321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-621b58be-9aad-4a63-95f4-7411bc88c773 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.073767 Aug 23 10:43:47.442273 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 978/1823] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:47 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:47.460592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-99223a01-b729-43f3-ad48-27cecc12ed40 req-b9e096da-7c28-4f57-9049-02fa67629b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bef7e7-48bc-426b-aef7-d87facd717f4", "name": "network-vif-plugged", "status": "completed", "tag": "19d7cb31-9140-46a0-a97a-6d04ac533929"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:47.476586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99223a01-b729-43f3-ad48-27cecc12ed40 req-b9e096da-7c28-4f57-9049-02fa67629b95 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:47.479865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99223a01-b729-43f3-ad48-27cecc12ed40 req-b9e096da-7c28-4f57-9049-02fa67629b95 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:47.480562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99223a01-b729-43f3-ad48-27cecc12ed40 req-b9e096da-7c28-4f57-9049-02fa67629b95 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:47.528772 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-99223a01-b729-43f3-ad48-27cecc12ed40 req-b9e096da-7c28-4f57-9049-02fa67629b95 service nova] Creating event network-vif-plugged:19d7cb31-9140-46a0-a97a-6d04ac533929 for instance a7bef7e7-48bc-426b-aef7-d87facd717f4 on n-h1-847009-13 Aug 23 10:43:47.544672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-99223a01-b729-43f3-ad48-27cecc12ed40 req-b9e096da-7c28-4f57-9049-02fa67629b95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100826 Aug 23 10:43:47.545317 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 979/1824] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:48.084997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:48.085706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:48.095694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:48.096178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:48.103632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:48.105548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:48.108505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:48.110794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:48.309824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:48.549393 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-946cec59-5e1e-4670-a64e-67251ca4051f tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/e0236454-d48a-4b5c-9aa6-646ba67642bc" status: 202 len: 0 microversion: 2.1 time: 4.437526 Aug 23 10:43:48.550783 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 846/1825] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:43:44 2022] DELETE /compute/v2.1/os-floating-ips/e0236454-d48a-4b5c-9aa6-646ba67642bc => generated 0 bytes in 4439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:43:48.558059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1149818646", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7b449e6f-509a-4a8d-a8cd-87fd09ee4594"}], "block_device_mapping_v2": [{"uuid": "3e6cada0-d345-4a61-8199-52ccea88c3ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:48.707477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] validate_networks() for [('7b449e6f-509a-4a8d-a8cd-87fd09ee4594', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:43:49.315688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a5536956-53a6-4509-a686-351277f32a9e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1533 microversion: 2.1 time: 1.768919 Aug 23 10:43:49.325111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 980/1826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:47 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1533 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:49.350402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ac3ae46-b851-4a8e-af3e-21fc7014dd13 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1e09d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:49.471987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ac3ae46-b851-4a8e-af3e-21fc7014dd13 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.137739 Aug 23 10:43:49.474532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 981/1827] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:49 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:49.488172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1f54d33-b5c6-495b-b128-6bd61a95c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'action', calling method: .version_select at 0x7fdc9f83f550>, body: {"addFloatingIp": {"address": ""}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1f54d33-b5c6-495b-b128-6bd61a95c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Request method failure captured: Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action HTTP/1.1 Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 34 Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK8rAcW55Zd2Go-WcqiMZMnDsnrbxO05FzyGUoG2Ze4rBE5zZrRIBxOlS9kkro0FRS_sTT-xGUSvH53S0uPlGiMPEy872LjOafngXIT2fXtUYwLVrq-UO73o_7bqI0JsF-AOUjMgmelEkW5tyujP7wKMwVm9zD5FGt7ianDSoi6JfZk Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:49.497696 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7758f6b11c1401ba1157f9c55afe615", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}] Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d6eec3ace5364b24bd7a466eef0ad082 Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: {"addFloatingIp": {"address": ""}} Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:43:49.499571 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '685ee89e-f7b8-46ed-811d-9deea9b1af35', 'body': {'addFloatingIp': {'address': ''}}} Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '' Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:49.500667 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:43:49.502883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:43:49.504508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 23 10:43:49.504508 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:49.511393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1f54d33-b5c6-495b-b128-6bd61a95c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:49.512703 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1f54d33-b5c6-495b-b128-6bd61a95c9ab tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action" status: 400 len: 142 microversion: 2.1 time: 0.036428 Aug 23 10:43:49.514121 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 982/1828] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:49 2022] POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action => generated 142 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:43:49.530090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:49.532041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:49.540671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:49.541482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:49.542315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:49.543222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:49.543912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:49.544528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:49.673926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:43:49.675040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:43:49.675765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:43:49.676409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:43:49.677237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:43:49.704566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:49.705882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:49.706706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:49.707826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:49.708479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:49.709140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:49.859516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:43:49.883503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Getting quotas for user 04d5d44e84d5459ab1a59c13bcf69012 and project 64ea87e1ef314e1886f92fcf108c414f. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:43:49.996227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:43:49.999621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e6cada0-d345-4a61-8199-52ccea88c3ec',volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:43:50.235404 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ede8aa3c-819b-4510-bd6f-a09b2cc46374 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.683374 Aug 23 10:43:50.236516 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 847/1829] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:43:50.242149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:50.246436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:50.254417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:50.255325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:50.255982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:50.257090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:50.257728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:50.258333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:50.298320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:43:50.299386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquired lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:43:50.457794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Releasing lock "refresh_cache-685ee89e-f7b8-46ed-811d-9deea9b1af35" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:43:50.458747 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] HTTP exception thrown: floating IP not found Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Request method failure captured: Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action HTTP/1.1 Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 41 Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK8rAcW55Zd2Go-WcqiMZMnDsnrbxO05FzyGUoG2Ze4rBE5zZrRIBxOlS9kkro0FRS_sTT-xGUSvH53S0uPlGiMPEy872LjOafngXIT2fXtUYwLVrq-UO73o_7bqI0JsF-AOUjMgmelEkW5tyujP7wKMwVm9zD5FGt7ianDSoi6JfZk Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:43:50.460231 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7758f6b11c1401ba1157f9c55afe615", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}] Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d6eec3ace5364b24bd7a466eef0ad082 Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:43:50.462881 n-d-847009-13 devstack@n-api.service[128860]: exception: floating IP not found Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '685ee89e-f7b8-46ed-811d-9deea9b1af35', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:50.463898 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 23 10:43:50.465324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.468337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Returning 404 to user: floating IP not found {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:50.468337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05f4ead8-ae1e-4a48-8f5f-278aa3aac674 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action" status: 404 len: 67 microversion: 2.1 time: 0.225080 Aug 23 10:43:50.468337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 848/1830] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:50 2022] POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action => generated 67 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:43:50.475408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b586085-3ee7-499c-8f18-3870f42a1348 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:50.476054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b586085-3ee7-499c-8f18-3870f42a1348 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:50.624863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b586085-3ee7-499c-8f18-3870f42a1348 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:50.644785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b586085-3ee7-499c-8f18-3870f42a1348 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:50.651018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b586085-3ee7-499c-8f18-3870f42a1348 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:50.651980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b5eb857-a449-4055-9e6a-845ff913928e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1533 microversion: 2.1 time: 1.136603 Aug 23 10:43:50.652926 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 983/1831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:49 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1533 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:50.653307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b586085-3ee7-499c-8f18-3870f42a1348 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1104 microversion: 2.25 time: 0.187705 Aug 23 10:43:50.654032 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 849/1832] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:43:50 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1104 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:50.658897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ec9b9b0-0e3b-4957-9281-72ca667d534c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cdce040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:50.659530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec62fee3-06ed-45a6-ba8d-790802d7bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Action: 'action', calling method: .version_select at 0x7fdc9f83faf0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:50.740152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ec9b9b0-0e3b-4957-9281-72ca667d534c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.084292 Aug 23 10:43:50.742968 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 850/1833] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:50 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:50.756537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:50.777087 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:43:50.777087 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:43:50.782847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:50.783664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:50.784118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:50.792060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:50.805275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:50.806537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:50.881827 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ab5b82e-801f-47b8-a12c-ecab2f2155dd tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.136158 Aug 23 10:43:50.883027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 851/1834] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:43:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:50.896473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-13", "block_migration": false, "disk_over_commit": false}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:50.899319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:50.917186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:50.917586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:50.920485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:50.921353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:50.924184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:50.925234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:50.969929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ec62fee3-06ed-45a6-ba8d-790802d7bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec62fee3-06ed-45a6-ba8d-790802d7bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Request method failure captured: Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action HTTP/1.1 Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 44 Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK8rAcW55Zd2Go-WcqiMZMnDsnrbxO05FzyGUoG2Ze4rBE5zZrRIBxOlS9kkro0FRS_sTT-xGUSvH53S0uPlGiMPEy872LjOafngXIT2fXtUYwLVrq-UO73o_7bqI0JsF-AOUjMgmelEkW5tyujP7wKMwVm9zD5FGt7ianDSoi6JfZk Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:43:50.971886 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7758f6b11c1401ba1157f9c55afe615", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}] Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d6eec3ace5364b24bd7a466eef0ad082 Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:43:50.973504 n-d-847009-13 devstack@n-api.service[128859]: exception: Floating IP not found for address 0.0.0.0. Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '685ee89e-f7b8-46ed-811d-9deea9b1af35', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:50.976278 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 23 10:43:50.981641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:43:50.987090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec62fee3-06ed-45a6-ba8d-790802d7bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:50.989716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec62fee3-06ed-45a6-ba8d-790802d7bfd0 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action" status: 404 len: 88 microversion: 2.1 time: 0.335357 Aug 23 10:43:51.003129 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 984/1835] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:50 2022] POST /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35/action => generated 88 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:43:51.031167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:51.037405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:51.053464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lazy-loading 'flavor' on Instance uuid 1a18dd1f-4b4e-4011-b17b-7ce410218e5c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:43:51.078194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Going to try to live migrate instance to n-h1-847009-13 {{(pid=128860) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:43:51.095143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:51.101483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:51.103439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:51.104893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:51.108828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:51.109555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:51.171769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:43:51.373762 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1a696959-93bb-407f-a5ab-186d1141f7f3 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "DELETE /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 204 len: 0 microversion: 2.1 time: 0.361877 Aug 23 10:43:51.379633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 985/1836] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:43:51 2022] DELETE /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:43:51.410875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:51.412593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:51.434127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:51.434992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:51.435800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:51.437317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:51.439057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:51.440826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:52.081659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:52.092542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:52.108020 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efd5b72f-7841-4318-97a3-0100e6a6d4bd tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1542 microversion: 2.1 time: 0.722932 Aug 23 10:43:52.123306 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 986/1837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:51 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1542 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:52.128863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:52.132867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:52.155137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:52.155651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:52.156103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:52.165430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:52.166240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:52.166906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:52.435136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:52.444573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:52.447142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:52.448495 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b0b2d3c2-8567-4f80-91c5-a2273a7d3c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1233 microversion: 2.25 time: 0.323799 Aug 23 10:43:52.449591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 987/1838] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:43:52 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1233 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:52.471767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2686bff1-cf02-43cd-b905-565654d0d1ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cd424c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:52.574982 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2686bff1-cf02-43cd-b905-565654d0d1ff tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.123627 Aug 23 10:43:52.576144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 988/1839] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:52 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:53.235044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-235622558", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:53.350670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:43:54.314691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:43:54.315284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:43:54.315750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:43:54.316173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:43:54.316639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:43:54.351551 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b32f9d10-a8c8-4bc7-82e7-a7f109f002e9 tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c/action" status: 202 len: 0 microversion: 2.1 time: 3.459224 Aug 23 10:43:54.353078 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 852/1840] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:43:50 2022] POST /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c/action => generated 0 bytes in 3461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:43:54.359565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:54.360421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:54.368538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:54.373922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:54.375346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:54.381440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:54.383270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:54.385422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:54.387348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:54.390654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:54.392009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:54.395883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:54.396823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:54.398094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:54.431775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Getting quotas for project 876d31e066de4418a6ae43fafc095a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:43:54.449604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Getting quotas for user 65a60d0f17c14f40adbcc6460e09d725 and project 876d31e066de4418a6ae43fafc095a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:43:54.467056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:43:54.469813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:43:54.606833 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9e090ab-b826-4e26-8654-c0fee76d5505 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.028817 Aug 23 10:43:54.607766 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 989/1841] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:43:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:43:54.803525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-840465932", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:54.963574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:43:55.019957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6eec3ace5364b24bd7a466eef0ad082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7758f6b11c1401ba1157f9c55afe615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:55.035553 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33789b6b-cd12-4a53-94e3-d2514008c77e tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 200 len: 1542 microversion: 2.1 time: 0.681001 Aug 23 10:43:55.037099 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 853/1842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:54 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 1542 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:55.174565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2036091757", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "1411ca65-af91-418b-a815-f90e84ddaa92"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:55.326065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] validate_networks() for [('1411ca65-af91-418b-a815-f90e84ddaa92', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:43:55.766221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:43:55.766821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:43:55.767243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:43:55.767750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:43:55.768475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:43:55.805095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:55.808771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:55.809295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:55.817016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:55.817534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:55.820408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:55.859403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Getting quotas for project 148d497ec6904a25a36eb8ce8b64306e. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:43:55.885057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Getting quotas for user 9b61ef0a5cf444ff83952926721631da and project 148d497ec6904a25a36eb8ce8b64306e. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:43:55.928118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:43:55.933423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:43:56.033289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:43:56.109226 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5974d118-367b-4451-9049-ca754f1561cb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491564 Aug 23 10:43:56.110513 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 990/1843] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:43:56.133257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:56.134336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:56.163449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:56.163968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:56.164484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:56.171131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:56.171735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:56.172190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:56.716386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:56.732133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:56.734265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:56.743202 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b52410eb-af84-4ce8-b357-cab8d495ecf9 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.627573 Aug 23 10:43:56.745574 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 991/1844] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:43:56 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:56.765552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31e0c9ef-db26-40c3-b028-1dbcfa0ab0df tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cd42430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:56.949940 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31e0c9ef-db26-40c3-b028-1dbcfa0ab0df tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.199597 Aug 23 10:43:56.950849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 992/1845] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:56 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:56.985101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:56.985964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:57.016237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.016761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.017223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.022124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.028060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.028802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.439364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:43:57.439887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:43:57.440263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:43:57.440682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:43:57.441378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:43:57.496401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.499457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.500171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.501415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.503759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.504415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.514892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:57.528260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-befc166b-c7c2-40b7-9fc7-1344d212087d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.576547 Aug 23 10:43:57.529709 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 993/1846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:56 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:57.547351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-898472493", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:57.600587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Getting quotas for project b9daf7e1d3fd4cf7a95d8f8b05d81b32. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:43:57.611050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Getting quotas for user d9d123775e9d460bbf7f258d5436692d and project b9daf7e1d3fd4cf7a95d8f8b05d81b32. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:43:57.629592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:43:57.632532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:43:57.677858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:43:57.740047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6e2c8a1-3790-49d1-9183-32037adcefbe tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.701649 Aug 23 10:43:57.741461 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 854/1847] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:43:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:43:57.747653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e01daaa5-84ca-4c99-a887-e8dacc9da207 req-464858fa-24b4-49c0-866b-b7ce808276a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685ee89e-f7b8-46ed-811d-9deea9b1af35", "name": "network-vif-deleted", "tag": "c10d467d-46f9-41b5-a841-e0deb1d1d830"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:57.761462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e01daaa5-84ca-4c99-a887-e8dacc9da207 req-464858fa-24b4-49c0-866b-b7ce808276a6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.762211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e01daaa5-84ca-4c99-a887-e8dacc9da207 req-464858fa-24b4-49c0-866b-b7ce808276a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.762824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e01daaa5-84ca-4c99-a887-e8dacc9da207 req-464858fa-24b4-49c0-866b-b7ce808276a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.778000 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e01daaa5-84ca-4c99-a887-e8dacc9da207 req-464858fa-24b4-49c0-866b-b7ce808276a6 service nova] Creating event network-vif-deleted:c10d467d-46f9-41b5-a841-e0deb1d1d830 for instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 on n-h1-847009-13 Aug 23 10:43:57.785406 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e01daaa5-84ca-4c99-a887-e8dacc9da207 req-464858fa-24b4-49c0-866b-b7ce808276a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042339 Aug 23 10:43:57.786643 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 855/1848] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:57.796265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:57.797745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] [instance: 685ee89e-f7b8-46ed-811d-9deea9b1af35] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:57.823946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.825321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.827142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.830044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.831722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.832357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.878250 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] HTTP exception thrown: Instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 could not be found. Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Request method failure captured: Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 HTTP/1.1 Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK8rAcW55Zd2Go-WcqiMZMnDsnrbxO05FzyGUoG2Ze4rBE5zZrRIBxOlS9kkro0FRS_sTT-xGUSvH53S0uPlGiMPEy872LjOafngXIT2fXtUYwLVrq-UO73o_7bqI0JsF-AOUjMgmelEkW5tyujP7wKMwVm9zD5FGt7ianDSoi6JfZk Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:43:57.883148 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7758f6b11c1401ba1157f9c55afe615", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7758f6b11c1401ba1157f9c55afe615"}]}] Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d7758f6b11c1401ba1157f9c55afe615 Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d6eec3ace5364b24bd7a466eef0ad082 Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:43:57.886810 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 could not be found. Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '685ee89e-f7b8-46ed-811d-9deea9b1af35'} Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 could not be found. Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:43:57.889385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 could not be found. Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 could not be found. Aug 23 10:43:57.891984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:43:57.895241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] Returning 404 to user: Instance 685ee89e-f7b8-46ed-811d-9deea9b1af35 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:43:57.896606 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23c56aea-c46a-4dad-97fb-159289f1622d tempest-FloatingIPsAssociationNegativeTestJSON-1196210766 tempest-FloatingIPsAssociationNegativeTestJSON-1196210766-project] 10.222.0.78 "GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35" status: 404 len: 111 microversion: 2.1 time: 0.108288 Aug 23 10:43:57.898159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 856/1849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:57 2022] GET /compute/v2.1/servers/685ee89e-f7b8-46ed-811d-9deea9b1af35 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:43:57.904076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:57.904964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:57.915312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.916389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.917263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:57.918376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:57.919138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:57.920425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:58.225083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:58.235432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0b984d1-382b-40a3-ad74-a80380c6313c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1212 microversion: 2.1 time: 0.336014 Aug 23 10:43:58.251601 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 857/1850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:57 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1212 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:58.276150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bfd19bdb-e95c-4173-a2a7-ca5618baccd8 req-c54c975d-e60a-45d9-9b2f-6df01b026d33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a99b54b-9efa-4cb1-bb53-13aff5876ae3", "tag": "f7bdb065-4ecc-458e-a69b-2c937dec02eb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:43:58.346023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bfd19bdb-e95c-4173-a2a7-ca5618baccd8 req-c54c975d-e60a-45d9-9b2f-6df01b026d33 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:58.353917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bfd19bdb-e95c-4173-a2a7-ca5618baccd8 req-c54c975d-e60a-45d9-9b2f-6df01b026d33 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:58.357659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bfd19bdb-e95c-4173-a2a7-ca5618baccd8 req-c54c975d-e60a-45d9-9b2f-6df01b026d33 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:58.426851 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bfd19bdb-e95c-4173-a2a7-ca5618baccd8 req-c54c975d-e60a-45d9-9b2f-6df01b026d33 service nova] Creating event network-changed:f7bdb065-4ecc-458e-a69b-2c937dec02eb for instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 on n-h2-847009-13 Aug 23 10:43:58.447517 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bfd19bdb-e95c-4173-a2a7-ca5618baccd8 req-c54c975d-e60a-45d9-9b2f-6df01b026d33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192219 Aug 23 10:43:58.457407 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 858/1851] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:43:58.480113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5b043f8-66ce-45f0-a41c-35fd6fda8af0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:58.480879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b5b043f8-66ce-45f0-a41c-35fd6fda8af0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:58.740674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5b043f8-66ce-45f0-a41c-35fd6fda8af0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:58.773439 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5b043f8-66ce-45f0-a41c-35fd6fda8af0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1216 microversion: 2.1 time: 0.313305 Aug 23 10:43:58.777321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 859/1852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:58 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1216 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:58.794566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:58.795232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:58.840161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:58.842966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:58.846087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:58.847615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:58.854165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:58.856254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:59.197953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:43:59.198467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:43:59.199072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:59.199964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:43:59.200406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:43:59.201019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:43:59.216148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:59.219359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:43:59.227077 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-185d5001-4572-43bc-b461-6ceef339c9a0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.448028 Aug 23 10:43:59.230200 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 860/1853] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:43:58 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:43:59.231392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:59.239865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-183a48a9-d8de-47d9-bc1b-852623aeb536 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ccb2ca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:59.240861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:59.241557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:59.242662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:59.243652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:59.244324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:59.311412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Getting quotas for project 876d31e066de4418a6ae43fafc095a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:43:59.329848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Getting quotas for user 65a60d0f17c14f40adbcc6460e09d725 and project 876d31e066de4418a6ae43fafc095a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:43:59.370271 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-183a48a9-d8de-47d9-bc1b-852623aeb536 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.137628 Aug 23 10:43:59.379881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 861/1854] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:43:59 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:43:59.382203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:43:59.391113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:59.391638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:43:59.401581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:59.443138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:59.444640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:59.447341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:59.450483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:59.453667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:59.457743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:59.595152 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d44e0bec-77cf-42a7-ae1b-dfef08a90f43 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063396 Aug 23 10:43:59.606911 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 994/1855] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:43:59.632287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:43:59.636339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:43:59.667474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:59.667989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:59.683649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:43:59.687700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:43:59.693152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:43:59.694701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:00.034662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:00.051996 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73d1891e-49bd-4273-b7bd-b461bb18a99e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.668609 Aug 23 10:44:00.054501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 862/1856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:59 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:00.066485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36ce111f-28d3-4925-a246-dbdea3389879 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:00.069543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36ce111f-28d3-4925-a246-dbdea3389879 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:00.082150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:00.096402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1899bdbf-24a5-4a5a-be69-fff6ea678507 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1276 microversion: 2.1 time: 0.489323 Aug 23 10:44:00.097697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 995/1857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:43:59 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1276 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:00.112461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:00.113405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:00.125295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:00.128043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:00.128956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:00.132352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:00.133036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:00.138054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:00.312801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36ce111f-28d3-4925-a246-dbdea3389879 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:00.328536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36ce111f-28d3-4925-a246-dbdea3389879 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1213 microversion: 2.1 time: 0.270375 Aug 23 10:44:00.331339 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 863/1858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:00 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1213 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:00.342295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:00.342929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:00.358348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:00.360587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:00.362266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:00.364872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:00.365721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:00.368466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:00.762057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:00.771462 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d85402fb-a05e-4174-a06a-13e6b47f8739 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1268 microversion: 2.1 time: 0.672242 Aug 23 10:44:00.784475 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 996/1859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:00 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1268 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:00.793119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b61af7e9-c88d-481c-9455-280a2fb1c6a7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c611d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:00.851477 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b61af7e9-c88d-481c-9455-280a2fb1c6a7 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.062753 Aug 23 10:44:00.852682 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 997/1860] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:00 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:01.077111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:01.077709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:01.092304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:01.092889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:01.093451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:01.094216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:01.094686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:01.095127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:01.185460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:01.219272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:01.221663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:01.224298 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18870ec8-a32c-4905-a360-5eb624f05e61 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.890990 Aug 23 10:44:01.226091 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 864/1861] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:00 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:01.233617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:01.234561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:01.241307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:01.242286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:01.243455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:01.254311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:01.255561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:01.259555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.067790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.083787 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11814061-2440-4aa8-8683-8f348043369e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 1.011593 Aug 23 10:44:02.084545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 998/1862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:01 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:02.090311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.098557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:02.100561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:02.107469 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13894911-b95b-4b3a-96ee-cf27bbd4cf60 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1274 microversion: 2.1 time: 0.879768 Aug 23 10:44:02.111459 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 865/1863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:01 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1274 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:02.119458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:02.122837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:02.124066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.125428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:02.127726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:02.128540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.138814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:02.139494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:02.195409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:02.197005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:02.197483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.198368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:02.199018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:02.199471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.364083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.367447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.379934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3416f287-29ac-464a-9c8e-c38ee898e37a tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1274 microversion: 2.1 time: 0.266539 Aug 23 10:44:02.382352 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 866/1864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:02 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:02.389898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f760fba4-28a4-4a4e-9ffb-2e2cfdaf2017 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cd840d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:02.417779 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5786a050-6ac4-4b06-8f53-16cd4723740e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1265 microversion: 2.1 time: 0.331619 Aug 23 10:44:02.420335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 999/1865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:02 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:02.427230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:02.428350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:02.439931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:02.445164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:02.446439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.450022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:02.450674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:02.451134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:02.485608 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f760fba4-28a4-4a4e-9ffb-2e2cfdaf2017 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.101676 Aug 23 10:44:02.487432 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 867/1866] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:02 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:02.871528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.887329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.902687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:02.904207 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e6ba2ea-d0d3-4f5a-8e7d-9b14a3321024 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.482018 Aug 23 10:44:02.905003 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1000/1867] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:02 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:03.112259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:03.114097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:03.132951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:03.134211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:03.142315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.144287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.147041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.152979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.156301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.156995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.157535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.158056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.158513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.159244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.165829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.170502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.483464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:03.496524 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7e8f9778-279b-4a35-b218-377717278839 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1274 microversion: 2.1 time: 0.363717 Aug 23 10:44:03.519343 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1001/1868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:03 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1274 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:03.532287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:03.532749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:03.553822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.555052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.555758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.557176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.557991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.558590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.714183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:03.722438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e14f3785-b283-4585-954d-ef789263a426 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1274 microversion: 2.1 time: 0.201737 Aug 23 10:44:03.733535 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1002/1869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:03 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:03.749046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:03.749978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:03.766342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.779383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.783061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.784162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:03.784840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:03.803847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:03.938176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:03.948412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adb9f763-24c1-420e-83ad-3f58b7bf3b71 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.843014 Aug 23 10:44:03.957584 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 868/1870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:03 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:03.964675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-608eda4d-030d-4cef-a978-53f28189fd8f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9d14e3a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:04.064506 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-608eda4d-030d-4cef-a978-53f28189fd8f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.105349 Aug 23 10:44:04.066369 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 869/1871] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:03 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:04.089169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:04.089833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:04.108127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.108652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.111503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.112338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.112850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.114451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.199729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:04.215977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a5d6cf04-978d-4062-bd03-b77a1453c96c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1271 microversion: 2.1 time: 0.478493 Aug 23 10:44:04.237905 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1003/1872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:03 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1271 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:04.521808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:04.527783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:04.544197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.545640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.547518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.550958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.552126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.552990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.712906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:04.715642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:04.732099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:04.734136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:04.735518 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf04d778-d733-4977-aae3-5deb37bf1783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.668285 Aug 23 10:44:04.749219 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 870/1873] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:04 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:04.756693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:04.757552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:04.768595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.780077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.781261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.782269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.782906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.783524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.944071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:04.959244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-443fcc2a-aea0-465b-9a14-1150b584d491 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.437674 Aug 23 10:44:04.960278 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1004/1874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:04 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:04.981549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:04.982606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:04.991375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:04.996613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:04.998335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:04.999420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:05.000107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:05.000698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:05.067106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:05.083808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-863ef5dd-a0cc-48ad-b1fc-a08dd09b325c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.330735 Aug 23 10:44:05.084709 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 871/1875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:04 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:05.091573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e064cd7c-060c-439e-ae7c-728b17df0139 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc440d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:05.218543 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e064cd7c-060c-439e-ae7c-728b17df0139 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.132515 Aug 23 10:44:05.228729 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 872/1876] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:05 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:05.253615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:05.254478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:05.277954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:05.278461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:05.278909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:05.279625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:05.280091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:05.280522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:05.490548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:05.511187 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5889bd7f-4017-4667-a7d2-24669270f71d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.523656 Aug 23 10:44:05.525875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1005/1877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:04 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:05.761303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:05.762621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:05.777280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:05.779323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:05.782307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:05.783395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:05.784429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:05.786756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:06.021233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:06.033473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-004ac84d-03ab-4f19-b31a-4b9d952fc31b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.790202 Aug 23 10:44:06.047972 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 873/1878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:05 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:06.056658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:06.057876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:06.068554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:06.069955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:06.071677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:06.074188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:06.076820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:06.077682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:06.529252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:06.538686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc13b95a-e519-46dd-9f20-8da60a96ec7c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.488635 Aug 23 10:44:06.548647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 874/1879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:06 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:06.569400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:06.577570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:06.592992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:06.594002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:06.594685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:06.595649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:06.597181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:06.602644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:06.980804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:06.990324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:06.999402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:07.006115 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-afcf717c-5965-4bfd-a441-450536d81ebb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 1.250280 Aug 23 10:44:07.012280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1006/1880] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:05 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:07.023573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4615f74-229c-4053-8e56-ca46ec7476b3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9ce59790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:07.151209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4615f74-229c-4053-8e56-ca46ec7476b3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.135045 Aug 23 10:44:07.154126 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1007/1881] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:07 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:07.165594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:07.169388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:07.189120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:07.190070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:07.190716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:07.191782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:07.192421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:07.194022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:07.244158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:07.254415 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37b4578b-b6b9-451f-b30b-d34cfeafdf40 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.704502 Aug 23 10:44:07.264361 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 875/1882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:06 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:07.273468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-57d7d9b0-ba5e-4bd7-82bb-2bd3f96660bb req-35a0f1aa-99ed-4129-826a-be41b14cb853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5031dce-cd99-469f-9f88-1090e3afbcc9", "tag": "b2403bc7-9508-4cf8-a999-ca14108ae60a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:07.293770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-57d7d9b0-ba5e-4bd7-82bb-2bd3f96660bb req-35a0f1aa-99ed-4129-826a-be41b14cb853 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:07.296429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-57d7d9b0-ba5e-4bd7-82bb-2bd3f96660bb req-35a0f1aa-99ed-4129-826a-be41b14cb853 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:07.298802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-57d7d9b0-ba5e-4bd7-82bb-2bd3f96660bb req-35a0f1aa-99ed-4129-826a-be41b14cb853 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:07.351014 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-57d7d9b0-ba5e-4bd7-82bb-2bd3f96660bb req-35a0f1aa-99ed-4129-826a-be41b14cb853 service nova] Creating event network-changed:b2403bc7-9508-4cf8-a999-ca14108ae60a for instance d5031dce-cd99-469f-9f88-1090e3afbcc9 on n-h1-847009-13 Aug 23 10:44:07.357183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-57d7d9b0-ba5e-4bd7-82bb-2bd3f96660bb req-35a0f1aa-99ed-4129-826a-be41b14cb853 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091438 Aug 23 10:44:07.357802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 876/1883] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:07.378214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:07.379214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:07.399050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:07.400097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:07.400771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:07.401677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:07.402651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:07.403510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:07.552997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:08.037951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:08.046941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e059fdb8-2884-4c35-9041-0ff15b6a6626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.687871 Aug 23 10:44:08.066067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 877/1884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:07 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:08.078073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:08.079061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:08.093499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:08.096767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:08.098660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:08.099699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:08.102987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:08.103722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:08.702366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:08.716228 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d17bee16-dbd6-47ce-8e05-741b24254036 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.643595 Aug 23 10:44:08.719633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 878/1885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:08 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:08.732597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:08.733696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:08.753663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:08.754553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:08.755264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:08.756252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:08.756983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:08.757674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.171473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:09.172669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:09.185114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:09.186892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:09.188394 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-441bae6d-8301-4355-b955-988ee8202596 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.466021 Aug 23 10:44:09.188835 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b4fc5c7-f65a-46df-9339-78c0a9515df5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 2.031164 Aug 23 10:44:09.206175 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1008/1886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:07 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 2051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:09.207759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 879/1887] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:08 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:09.215177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:09.216180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:09.216563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1cc86e66-4ae4-4ff4-a3a0-cf2ea92ebd0a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1d1ea60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:09.228028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:09.228955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:09.229645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.230637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:09.231359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:09.232029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.269187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:09.312521 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1cc86e66-4ae4-4ff4-a3a0-cf2ea92ebd0a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.104712 Aug 23 10:44:09.320215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1009/1888] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:09 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:09.327149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3c8c79e2-7e82-425d-8681-16a76618d19f req-3ca1744b-f6a2-4560-8c6a-654015ffd978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:09.353423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c8c79e2-7e82-425d-8681-16a76618d19f req-3ca1744b-f6a2-4560-8c6a-654015ffd978 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:09.361344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c8c79e2-7e82-425d-8681-16a76618d19f req-3ca1744b-f6a2-4560-8c6a-654015ffd978 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:09.364842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c8c79e2-7e82-425d-8681-16a76618d19f req-3ca1744b-f6a2-4560-8c6a-654015ffd978 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.368718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=18 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:09.403654 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3c8c79e2-7e82-425d-8681-16a76618d19f req-3ca1744b-f6a2-4560-8c6a-654015ffd978 service nova] Creating event network-changed:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:44:09.409503 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3c8c79e2-7e82-425d-8681-16a76618d19f req-3ca1744b-f6a2-4560-8c6a-654015ffd978 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086858 Aug 23 10:44:09.413730 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1010/1889] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:09.431698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:09.435370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:09.451811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:09.455787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:09.456559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.457993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:09.460437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:09.462797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.473615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:09.919110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:09.927220 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6b25a0a-70e7-46ba-ade2-d84d50e74d27 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.717949 Aug 23 10:44:09.931538 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 880/1890] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:09 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:09.934786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:09.953382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-03691850-a060-45be-8903-fc8e9a84b4de req-b4d89092-bb0d-464f-a27a-d410952a2ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317a9f9b-a033-4e93-b427-b945cda21208", "tag": "3b78f27d-6125-4ed6-b657-01c4f3e0328c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:09.967164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20be5afd-2d24-4668-a13b-f5eb636d5d98 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.545737 Aug 23 10:44:09.979471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-03691850-a060-45be-8903-fc8e9a84b4de req-b4d89092-bb0d-464f-a27a-d410952a2ca2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:09.979471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-03691850-a060-45be-8903-fc8e9a84b4de req-b4d89092-bb0d-464f-a27a-d410952a2ca2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:09.979471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-03691850-a060-45be-8903-fc8e9a84b4de req-b4d89092-bb0d-464f-a27a-d410952a2ca2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:09.979898 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1011/1891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:09 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:09.987171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:09.987871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:10.002234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-03691850-a060-45be-8903-fc8e9a84b4de req-b4d89092-bb0d-464f-a27a-d410952a2ca2 service nova] Creating event network-changed:3b78f27d-6125-4ed6-b657-01c4f3e0328c for instance 317a9f9b-a033-4e93-b427-b945cda21208 on n-h2-847009-13 Aug 23 10:44:10.013704 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-03691850-a060-45be-8903-fc8e9a84b4de req-b4d89092-bb0d-464f-a27a-d410952a2ca2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080387 Aug 23 10:44:10.014974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 881/1892] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:10.025367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:10.026369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:10.027020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:10.027773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:10.028255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:10.028665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:10.232162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:10.234196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:10.253093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:10.265038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:10.269727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:10.270811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:10.277870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:10.278864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:10.280717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:10.356333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=18 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:10.631029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:10.646645 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c07e2c24-0604-4954-a427-dba94ab03ebc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.672839 Aug 23 10:44:10.661014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1012/1893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:09 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:10.663830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:10.665085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:10.683249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:10.686835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:10.687665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:10.692419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:10.693380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:10.694104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:10.897240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:10.933139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:10.943451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:10.949446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ac0e682-fd26-4c75-9064-b93e81c04c2b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1293 microversion: 2.25 time: 0.732429 Aug 23 10:44:10.953259 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 882/1894] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:10 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1293 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:10.969899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33aaf120-2ed8-4779-bb39-fa31ea51211e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cf6de50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:11.165023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33aaf120-2ed8-4779-bb39-fa31ea51211e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1439 microversion: 2.1 time: 0.208889 Aug 23 10:44:11.165691 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 883/1895] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:10 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1439 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:11.176158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:11.180616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:11.190645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:11.195348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:11.197203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:11.198229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:11.214211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:11.216872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:11.599072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:11.612593 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f9ae33b-bab0-4f73-92c5-1a7d6b50927b tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.442999 Aug 23 10:44:11.614281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 884/1896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:11 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:11.628648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:11.630930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:11.661606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:11.662127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:11.662659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:11.663763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:11.666434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:11.666954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:11.895267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:11.924791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a554f4f-8a25-41db-8eb1-209ddc9ae463 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 1.268176 Aug 23 10:44:11.928641 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1013/1897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:10 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:11.936997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:11.956207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:12.005666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.012942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.014436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:12.015622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.016431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.017321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:12.358002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:12.370507 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26cef902-fe30-4c81-a970-fdc237e5a175 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.435906 Aug 23 10:44:12.373109 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1014/1898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:11 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:12.382615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-050f26bf-55f9-4eb1-b4fe-965fcb6b6d71 req-2a004ccb-f718-4c0a-bc1b-60e4e3ee7205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:12.409032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-050f26bf-55f9-4eb1-b4fe-965fcb6b6d71 req-2a004ccb-f718-4c0a-bc1b-60e4e3ee7205 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.410826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-050f26bf-55f9-4eb1-b4fe-965fcb6b6d71 req-2a004ccb-f718-4c0a-bc1b-60e4e3ee7205 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.412603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-050f26bf-55f9-4eb1-b4fe-965fcb6b6d71 req-2a004ccb-f718-4c0a-bc1b-60e4e3ee7205 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:12.442121 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-050f26bf-55f9-4eb1-b4fe-965fcb6b6d71 req-2a004ccb-f718-4c0a-bc1b-60e4e3ee7205 service nova] Creating event network-changed:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:44:12.453531 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-050f26bf-55f9-4eb1-b4fe-965fcb6b6d71 req-2a004ccb-f718-4c0a-bc1b-60e4e3ee7205 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077854 Aug 23 10:44:12.460142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1015/1899] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:12.466895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:12.467992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:12.476420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.477905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.478620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:12.479987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.480993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.482042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:12.789788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:12.801701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:12.803651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:12.806778 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98b89cf7-aa9e-4142-847a-a28731d47203 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.344083 Aug 23 10:44:12.808337 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1016/1900] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:12 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:12.813642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-255afc0a-062c-4e7f-98b7-9db771f8ac69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdca1e09310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:12.926763 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-255afc0a-062c-4e7f-98b7-9db771f8ac69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1448 microversion: 2.1 time: 0.116365 Aug 23 10:44:12.929377 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1017/1901] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:12 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1448 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:12.937455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:12.938078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:12.954801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.955521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.956158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:12.957158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:12.957897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:12.958787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.032025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:13.045943 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5f72078-e2f8-425f-b86d-b0be6a8f31a1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 1.426101 Aug 23 10:44:13.046838 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 885/1902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:11 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:13.059528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94ab4fb7-bc59-48d2-b6cb-edb88c6b7e3b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cf6d5e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:13.147132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94ab4fb7-bc59-48d2-b6cb-edb88c6b7e3b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 200 len: 1448 microversion: 2.1 time: 0.097840 Aug 23 10:44:13.148260 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 886/1903] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:13 2022] GET /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 1448 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:13.154889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:13.155766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:13.173354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:13.187194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:13.188477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.200844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:13.201511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:13.202074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.212943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:13.225366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6bfe3076-6396-4b8d-9bf1-9dc7af389cf9 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.294281 Aug 23 10:44:13.226174 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1018/1904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:12 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:13.231464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49f0d6f5-b69f-43bc-8e19-35a5aac888fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9cc178b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:13.670613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:13.690987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3876dbd-efa2-4906-b224-68c65ae9a627 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.540568 Aug 23 10:44:13.692170 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 887/1905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:13 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:13.697705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:13.698585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:13.705333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:13.706179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:13.707102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.707988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:13.708612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:13.709557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.941285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:13.956102 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96196dcb-eed1-4069-ba1d-8da9d072dd67 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.262861 Aug 23 10:44:13.957000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 888/1906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:13 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:13.962957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:13.963807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:13.971857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:13.972583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:13.973077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.974003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:13.974468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:13.974901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:13.987745 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49f0d6f5-b69f-43bc-8e19-35a5aac888fb tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 204 len: 0 microversion: 2.1 time: 0.759978 Aug 23 10:44:13.992420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1019/1907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:13 2022] DELETE /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:44:13.998869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:13.999566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:14.009118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.009929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.010523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.011405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.012024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.012615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.040275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:44:14.142582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:14.152263 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a23d8ed-31b0-40a8-b070-222945be60d1 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 204 len: 0 microversion: 2.1 time: 0.156316 Aug 23 10:44:14.153041 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1020/1908] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:13 2022] DELETE /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:44:14.154099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:14.156250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:14.157594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa79cf93-dd39-4236-89cb-e5dcb4e9b18d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.199219 Aug 23 10:44:14.158339 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 889/1909] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:13 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:14.162397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:14.162397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:14.167795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.168289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.168725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.169672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.170161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.170587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.250119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:14.250767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:14.260911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.263291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.264348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.265584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.266054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.266563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.381308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:14.391488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb06ab5c-3ae3-4c08-b556-b89532106910 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.236862 Aug 23 10:44:14.406900 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1021/1910] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:14 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:14.412024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-40665608", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "f3c62108-8f19-4a8d-8de7-8cbb5b2b0858"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:14.463573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:14.473231 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b48cfcb-7337-4a6e-a998-ce57e43e403e tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.227828 Aug 23 10:44:14.474515 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 890/1911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:14 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:14.493565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] validate_networks() for [('f3c62108-8f19-4a8d-8de7-8cbb5b2b0858', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:44:14.712696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:14.713843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:14.720770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.721373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.721975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.722951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:14.723493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:14.724339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:14.986918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:14.989819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:14.998045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f53fa705-3202-441b-ba00-84edfe00e31b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.289671 Aug 23 10:44:15.000003 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 891/1912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:14 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:15.004996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:15.005903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:15.012090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.012860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.013512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.014230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.014699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.015133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.041871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:44:15.043093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:44:15.043891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:44:15.044911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:44:15.045555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:44:15.062728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.063233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.063679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.064422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.065117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.065723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.088941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:44:15.095262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Getting quotas for user a2f47ead9ba342b2b1456305289c6188 and project d4bb1b02eebe47e2b961da19bdcc6e5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:44:15.110421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:44:15.113206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:44:15.179425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8375fdf4-4ccc-41b9-9845-e790429b9728 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771227 Aug 23 10:44:15.180489 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1022/1913] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:44:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:44:15.192654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c46862d7-2cc5-4c59-bbe5-d35d132ca1cc req-9d68ee8c-10e9-4a44-860c-0d14c544998d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5031dce-cd99-469f-9f88-1090e3afbcc9", "name": "network-vif-plugged", "status": "completed", "tag": "b2403bc7-9508-4cf8-a999-ca14108ae60a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:15.220811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c46862d7-2cc5-4c59-bbe5-d35d132ca1cc req-9d68ee8c-10e9-4a44-860c-0d14c544998d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.222966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c46862d7-2cc5-4c59-bbe5-d35d132ca1cc req-9d68ee8c-10e9-4a44-860c-0d14c544998d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.225220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c46862d7-2cc5-4c59-bbe5-d35d132ca1cc req-9d68ee8c-10e9-4a44-860c-0d14c544998d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.249187 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c46862d7-2cc5-4c59-bbe5-d35d132ca1cc req-9d68ee8c-10e9-4a44-860c-0d14c544998d service nova] Creating event network-vif-plugged:b2403bc7-9508-4cf8-a999-ca14108ae60a for instance d5031dce-cd99-469f-9f88-1090e3afbcc9 on n-h1-847009-13 Aug 23 10:44:15.252463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.259127 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c46862d7-2cc5-4c59-bbe5-d35d132ca1cc req-9d68ee8c-10e9-4a44-860c-0d14c544998d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074562 Aug 23 10:44:15.260146 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1023/1914] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:15.262934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ece124d3-24c1-4509-8635-bc7012fcd86e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.260393 Aug 23 10:44:15.263979 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 892/1915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:15 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:15.270780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a42999f-bf4c-45a0-be58-14471977d4d4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:15.271488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a42999f-bf4c-45a0-be58-14471977d4d4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:15.280227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:15.280880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:15.290821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.291320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.291823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.297086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.297846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.298485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.352755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a42999f-bf4c-45a0-be58-14471977d4d4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.361021 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a42999f-bf4c-45a0-be58-14471977d4d4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1206 microversion: 2.1 time: 0.096745 Aug 23 10:44:15.361610 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1024/1916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:15 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1206 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:15.413920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:15.416451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:15.424450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.425358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.426002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.427245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.427811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.428434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.470698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.491835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.494805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.496099 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a409ff14-793a-4371-8e75-9ddc98b1f27d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.230897 Aug 23 10:44:15.497197 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 893/1917] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:15 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:15.517593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:15.518271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:15.525776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.526325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.527614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.529101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:15.529906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:15.530347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:15.637251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.649958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f9d84215-43a0-4adc-9da7-5b5effa4cc8f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.240234 Aug 23 10:44:15.659210 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1025/1918] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:15 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:15.709077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:15.718033 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49386c3e-3996-4781-92a3-be508bebaeaa tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.207570 Aug 23 10:44:15.718858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 894/1919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:15 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:16.020139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:16.020805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:16.028187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.028777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.029214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.029915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.030364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.030784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.190144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:16.199726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3385232a-c3ba-4718-a72c-ba96fa0a0d43 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.183781 Aug 23 10:44:16.200322 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1026/1920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:16 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:16.285344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:16.286669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:16.295663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.296295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.296831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.297762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.298395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.298993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.384542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:16.385199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:16.409259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.410112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.410709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.412360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.413192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.415174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.526209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:16.542366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:16.543719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b57a3ce-0263-42cc-9868-f990de267668 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.263654 Aug 23 10:44:16.554001 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 895/1921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:16 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:16.554215 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77dc82e8-4dd3-4f86-a319-e3d141c6ff40 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1258 microversion: 2.1 time: 0.172217 Aug 23 10:44:16.554215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1027/1922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:16 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:16.557463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:16.557759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:16.564236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.565340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.565340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.565979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.566494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.566926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.674581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:16.675887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:16.678350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:16.687371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.688151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.688956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.689908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.690631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.691344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.756936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:16.767097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:16.768992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:16.770510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa7b38b6-61e8-4f03-9bf7-128486d91584 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.217775 Aug 23 10:44:16.787504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 896/1923] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:16 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:16.794206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:16.795094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:16.803083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.803740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.804486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:16.806724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:16.807305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:16.808077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.042251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:17.058635 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c63a0029-0b4b-4cea-9525-0e482f6d6d67 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.386112 Aug 23 10:44:17.059808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1028/1924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:16 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:17.250170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:17.253228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:17.272889 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 10:44:17.273156 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 10:44:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 (ip 10.222.0.78) !!! Aug 23 10:44:17.288828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.290795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.291638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.292668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:17.294110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.295078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.296294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.306728 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f58bcedb-9e48-4de6-b643-f0ea098d941c tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.517731 Aug 23 10:44:17.310266 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 897/1925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:16 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:17.327131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2102d847-9a42-4d29-b081-125aa2a5bd25 req-8f138854-9cc1-4776-925e-5b9d0137a742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317a9f9b-a033-4e93-b427-b945cda21208", "name": "network-vif-plugged", "status": "completed", "tag": "3b78f27d-6125-4ed6-b657-01c4f3e0328c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:17.366741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2102d847-9a42-4d29-b081-125aa2a5bd25 req-8f138854-9cc1-4776-925e-5b9d0137a742 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.368034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2102d847-9a42-4d29-b081-125aa2a5bd25 req-8f138854-9cc1-4776-925e-5b9d0137a742 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.371189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2102d847-9a42-4d29-b081-125aa2a5bd25 req-8f138854-9cc1-4776-925e-5b9d0137a742 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.403059 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2102d847-9a42-4d29-b081-125aa2a5bd25 req-8f138854-9cc1-4776-925e-5b9d0137a742 service nova] Creating event network-vif-plugged:3b78f27d-6125-4ed6-b657-01c4f3e0328c for instance 317a9f9b-a033-4e93-b427-b945cda21208 on n-h2-847009-13 Aug 23 10:44:17.409562 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2102d847-9a42-4d29-b081-125aa2a5bd25 req-8f138854-9cc1-4776-925e-5b9d0137a742 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096576 Aug 23 10:44:17.410904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 898/1926] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:17.584798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:17.585585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:17.598767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.599346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.599803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.600597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.601094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.603045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.782906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:17.813191 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ce56c75-134c-48c9-a07b-2f90fe4d7fb8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.586555 Aug 23 10:44:17.816881 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1029/1927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:17 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:17.861333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:17.863007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:17.876213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.877649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.878048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.878797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.879323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.879553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:17.879964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.890255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13e5b736-51a1-40d3-8d0a-6265a7031ff7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.323819 Aug 23 10:44:17.891030 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 899/1928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:17 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:17.901082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:17.905815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:17.921622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.922564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.923608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:17.924546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:17.925540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:17.926194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.033510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:18.047522 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09fa5828-d4b2-4877-9e22-aa8b8e66b718 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1264 microversion: 2.1 time: 0.226156 Aug 23 10:44:18.053016 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1030/1929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:17 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:18.082978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:18.083865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:18.098843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.099559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.100003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.103400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.104004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.105675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.136060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:18.256675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:18.268274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:18.270185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:18.271401 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-beed5701-39e1-4042-82a7-11d7f57758b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.378664 Aug 23 10:44:18.288418 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 900/1930] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:17 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:18.336131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:18.337959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:18.345196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.346142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.347016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.347779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.348271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.348707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.472201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:18.483736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-229153c7-d730-4254-8fc4-d659559075c2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.405835 Aug 23 10:44:18.484572 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1031/1931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:18 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:18.583791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:18.594291 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d68ddee-4896-4f3f-9f22-22dabe4c146f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.262370 Aug 23 10:44:18.607885 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 901/1932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:18 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:18.835699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:18.837564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:18.847987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.848609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.849378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.850348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.853876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.854574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.911787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:18.913035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:18.927452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.931207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.931974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:18.933458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:18.934374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:18.935038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.161085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:19.173199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-05d17f76-f465-4a79-a31c-28a219de923e tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.341266 Aug 23 10:44:19.174420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1032/1933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:18 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:19.197694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:19.198517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:19.207389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.208427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.209246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.209998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.211741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.212412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.237444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:19.251599 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-617e9b13-d9be-482a-9318-f78d82a94484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.342519 Aug 23 10:44:19.259528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 902/1934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:18 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:19.297691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:19.298376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:19.307243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.307761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.308649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.309404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.309870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.310708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.530803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:19.539924 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-689e6860-5f5f-4f9b-8ca1-c94ced314e6e tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.363182 Aug 23 10:44:19.539924 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1033/1935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:19 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:19.548837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:19.549653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:19.563283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.565442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.566563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.567631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.568236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.568806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.672125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:19.685200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:19.687707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:19.689372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef5e7c34-430b-410a-86ed-095536bcea51 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.395899 Aug 23 10:44:19.706012 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 903/1936] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:19 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:19.711135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:19.712650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:19.719584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.720492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.721216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:19.722356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:19.723052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:19.723714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.032538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.044998 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a55bca0-1fc1-4315-b03f-cecabe33acd3 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.337594 Aug 23 10:44:20.045839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 904/1937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:19 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:20.051270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6db4ed73-8724-42d2-a6ff-aa46f5f18fcc req-2650a5ac-c686-4f79-9f7a-a90250b32254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5678d158-2a5a-40fb-81ba-18ef4e6399f7", "tag": "490c80d4-5e8b-47c8-b9a1-3e06373c59cf"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:20.064493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6db4ed73-8724-42d2-a6ff-aa46f5f18fcc req-2650a5ac-c686-4f79-9f7a-a90250b32254 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.065319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6db4ed73-8724-42d2-a6ff-aa46f5f18fcc req-2650a5ac-c686-4f79-9f7a-a90250b32254 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.066197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6db4ed73-8724-42d2-a6ff-aa46f5f18fcc req-2650a5ac-c686-4f79-9f7a-a90250b32254 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.080556 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6db4ed73-8724-42d2-a6ff-aa46f5f18fcc req-2650a5ac-c686-4f79-9f7a-a90250b32254 service nova] Creating event network-changed:490c80d4-5e8b-47c8-b9a1-3e06373c59cf for instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 on n-h2-847009-13 Aug 23 10:44:20.088087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6db4ed73-8724-42d2-a6ff-aa46f5f18fcc req-2650a5ac-c686-4f79-9f7a-a90250b32254 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040852 Aug 23 10:44:20.091129 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 905/1938] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:20.199187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:20.199978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:20.212544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.213142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.213881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.214814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.215335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.216939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.260341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.276175 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3067eb8d-01ef-4a6c-ba63-cf2666cad156 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1313 microversion: 2.1 time: 0.730774 Aug 23 10:44:20.277171 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1034/1939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:19 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:20.293353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:20.294576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:20.302448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.305973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.306991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.308590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.309308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.309952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.396213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.408102 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13432ab1-677e-4832-9e4d-5654ef6630d2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.214523 Aug 23 10:44:20.410893 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 906/1940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:20 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:20.544466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-216150fd-1db2-4eb3-b383-e326c879cc78 req-41d42d6e-3939-45a0-81d7-1e3ebae0b7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "name": "network-vif-plugged", "status": "completed", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:20.565863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-216150fd-1db2-4eb3-b383-e326c879cc78 req-41d42d6e-3939-45a0-81d7-1e3ebae0b7fa service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.566423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-216150fd-1db2-4eb3-b383-e326c879cc78 req-41d42d6e-3939-45a0-81d7-1e3ebae0b7fa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.566931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-216150fd-1db2-4eb3-b383-e326c879cc78 req-41d42d6e-3939-45a0-81d7-1e3ebae0b7fa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.568246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.581725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8170ad6a-945b-4e17-a0de-3f0f76a28ddc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.301947 Aug 23 10:44:20.597360 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1035/1941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:20 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:20.599412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-216150fd-1db2-4eb3-b383-e326c879cc78 req-41d42d6e-3939-45a0-81d7-1e3ebae0b7fa service nova] Creating event network-vif-plugged:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:44:20.606057 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-216150fd-1db2-4eb3-b383-e326c879cc78 req-41d42d6e-3939-45a0-81d7-1e3ebae0b7fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065681 Aug 23 10:44:20.606921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 907/1942] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:20.609249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:20.609894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:20.619922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.621015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.622623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.623712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.625032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.625755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.719591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:20.720969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:20.727473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.728228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.728872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.729767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:20.730403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:20.730995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:20.980369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.990940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.993902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:20.996308 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fee6039-e14d-4c71-aab9-ce6780d0f72a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.280937 Aug 23 10:44:20.997810 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 908/1943] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:20 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:21.042947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:21.053405 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66ad9580-1be0-43fa-9d8a-62d6f9864191 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.454684 Aug 23 10:44:21.054013 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1036/1944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:20 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:21.074837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:21.075292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:21.081924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.082424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.082877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.083654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.084168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.084606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.243314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:21.268338 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-977b6505-cacc-48fc-941e-b5136d35a4f8 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.197718 Aug 23 10:44:21.278214 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 909/1945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:21 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:21.297873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:21.298967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:21.306788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.307574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.308267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.310378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.311378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.311983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.430800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:21.431454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:21.449400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.449723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.450484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.451387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.452034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.452650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.496193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:21.620862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:21.630899 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08979cea-268e-4b1c-9529-b055c8850c81 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.204608 Aug 23 10:44:21.631490 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 910/1946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:21 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:21.651299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:21.652579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:21.659735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.660232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.660904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.661629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.662122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.662815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.702195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:21.713639 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20ada05a-a421-4a65-be95-6128c10e0476 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1463 microversion: 2.1 time: 0.419788 Aug 23 10:44:21.714846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1037/1947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:21 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1463 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:21.734714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:21.735700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:21.743474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.744179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.744916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.745918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:21.746403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:21.747276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:21.837376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:21.846226 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7711d48-b07f-4798-8a32-247979bf4c7d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.213399 Aug 23 10:44:21.847056 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 911/1948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:21 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:22.021788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:22.022582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:22.040570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.041119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.041569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.042294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.042764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.043197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.237834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:22.249549 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e4ddce3-5aeb-47a6-bb5f-6ea7f8c3e10a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.518672 Aug 23 10:44:22.253894 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1038/1949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:21 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:22.254743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:22.267031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:22.268549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:22.269733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9cd2161-32b3-40bf-a0d1-6c3bfa7dc4a7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.251995 Aug 23 10:44:22.270597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 912/1950] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:22 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:22.276209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:22.276899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:22.277487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c447f7f0-256e-416f-98e3-4cbda315298c req-79b37cdf-083c-4ca7-8f4d-ef64250edc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bef7e7-48bc-426b-aef7-d87facd717f4", "name": "network-vif-deleted", "tag": "19d7cb31-9140-46a0-a97a-6d04ac533929"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:22.286868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.286868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.286868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.287422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.287875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.288308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.296398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c447f7f0-256e-416f-98e3-4cbda315298c req-79b37cdf-083c-4ca7-8f4d-ef64250edc49 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.297244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c447f7f0-256e-416f-98e3-4cbda315298c req-79b37cdf-083c-4ca7-8f4d-ef64250edc49 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.298728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c447f7f0-256e-416f-98e3-4cbda315298c req-79b37cdf-083c-4ca7-8f4d-ef64250edc49 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.313439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c447f7f0-256e-416f-98e3-4cbda315298c req-79b37cdf-083c-4ca7-8f4d-ef64250edc49 service nova] Creating event network-vif-deleted:19d7cb31-9140-46a0-a97a-6d04ac533929 for instance a7bef7e7-48bc-426b-aef7-d87facd717f4 on n-h1-847009-13 Aug 23 10:44:22.319745 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c447f7f0-256e-416f-98e3-4cbda315298c req-79b37cdf-083c-4ca7-8f4d-ef64250edc49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062712 Aug 23 10:44:22.321106 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1039/1951] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:22.328107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:22.329105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:22.337069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.339033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.339712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.341634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.342691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.343248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.454703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:22.465874 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68d89398-b29c-4f85-8c77-f881529ca7f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.194036 Aug 23 10:44:22.480826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 913/1952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:22 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:22.668168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:22.668528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:22.688842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.689362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.689812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.690548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.691016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.691451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.782117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:22.795812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d5e1973d-db04-4065-9e83-d119d4c50b35 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1316 microversion: 2.1 time: 0.472900 Aug 23 10:44:22.796759 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1040/1953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:22 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:22.801274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-da5fec99-7327-4044-b085-6ed0774745a0 req-af44e887-6d6d-49f6-9434-d0a85fa4df05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7bef7e7-48bc-426b-aef7-d87facd717f4", "name": "network-vif-unplugged", "status": "completed", "tag": "19d7cb31-9140-46a0-a97a-6d04ac533929"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:22.831160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-da5fec99-7327-4044-b085-6ed0774745a0 req-af44e887-6d6d-49f6-9434-d0a85fa4df05 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.832609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-da5fec99-7327-4044-b085-6ed0774745a0 req-af44e887-6d6d-49f6-9434-d0a85fa4df05 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.837622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-da5fec99-7327-4044-b085-6ed0774745a0 req-af44e887-6d6d-49f6-9434-d0a85fa4df05 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.866042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-da5fec99-7327-4044-b085-6ed0774745a0 req-af44e887-6d6d-49f6-9434-d0a85fa4df05 service nova] Creating event network-vif-unplugged:19d7cb31-9140-46a0-a97a-6d04ac533929 for instance a7bef7e7-48bc-426b-aef7-d87facd717f4 on n-h1-847009-13 Aug 23 10:44:22.878130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-da5fec99-7327-4044-b085-6ed0774745a0 req-af44e887-6d6d-49f6-9434-d0a85fa4df05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080086 Aug 23 10:44:22.882117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1041/1954] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:22.895398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:22.897048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:22.936863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.938161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.938668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:22.939600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:22.940069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:22.940502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.080941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:23.091416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3166294f-4489-42f8-8389-9e0d17af11d5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.436713 Aug 23 10:44:23.094907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 914/1955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:22 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:23.279210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:23.279437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:23.287117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.287630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.288082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.289806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.290081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.290392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.353313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:23.370901 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1f735b8-7c85-4f49-b6f5-9bcb7e354fe7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1316 microversion: 2.1 time: 0.486057 Aug 23 10:44:23.371500 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1042/1956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:22 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:23.384640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:23.384640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:23.389720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.390327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.390639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.391357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.391819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.396404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.570195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:23.585123 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad0b28e9-774b-4877-9c44-bfc3c6d2e6e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.311466 Aug 23 10:44:23.587858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 915/1957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:23 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:23.605677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:23.608438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:23.621821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.623626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.624259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.625411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.626062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.627912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.868009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:23.883734 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cadbc9c-523a-48f2-978a-69145d94e46a tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.292150 Aug 23 10:44:23.884952 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 916/1958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:23 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:23.895690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:23.899199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:23.917826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.919014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.924152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:23.925318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:23.926974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:23.930357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.106803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:24.119568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:24.122254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:24.123977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d4385d5-c0ed-4d89-bd0c-063bd27915d2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.751303 Aug 23 10:44:24.124971 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1043/1959] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:23 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:24.170143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:24.182353 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad312cd4-ada9-494e-a1a9-eef3803bd099 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1503 microversion: 2.1 time: 0.294538 Aug 23 10:44:24.183675 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 917/1960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:23 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:24.189585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:24.190427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:24.197682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.198209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.198664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.199391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.199854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.200421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.340596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-290b20d8-eda9-4fdb-939d-fb8b192d657a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'create', calling method: .version_select at 0x7fdc9c5b5ee0>, body: {"keypair": {"name": "tempest-keypair-1965829258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTlomKRiVaxG59LEnhyHONJEY/0tjn3Tgm4H+/mtPOX+knxj9Kt6T9BreYxRfEoAAJnVoG8gfybQmgv5fkiSMVd4F7r+kpdW+EXcSIwG/qO7hh26PIz3Wnp8iuKxTAPhA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:24.373365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-290b20d8-eda9-4fdb-939d-fb8b192d657a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for project 8c7fefe975214d6a8482557904472914. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:44:24.383729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-290b20d8-eda9-4fdb-939d-fb8b192d657a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for user ca80ea2c8904468d9e6944fc274afdb8 and project 8c7fefe975214d6a8482557904472914. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:44:24.402718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:24.412009 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-288c258a-57a5-45ba-b614-455f5cc9fc7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.226841 Aug 23 10:44:24.426156 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 918/1961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:24 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:24.426156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:24.426156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:24.426156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.426156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.426735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.427334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.427334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.427870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.437450 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-290b20d8-eda9-4fdb-939d-fb8b192d657a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.303945 Aug 23 10:44:24.438878 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1044/1962] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:44:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:24.446598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:24.447494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:24.456055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.457680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.458394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.459618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.460554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.462070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.475701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:44:24.714882 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-492810f4-2249-4248-89c2-074fffcea1c7 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 204 len: 0 microversion: 2.1 time: 0.295119 Aug 23 10:44:24.716472 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 919/1963] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:24 2022] DELETE /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:44:24.741810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a1bc4be6-6d94-4a3f-8640-c597c94e580d req-1ae3bc88-9cc6-417c-98f8-d276cfb6b043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a18dd1f-4b4e-4011-b17b-7ce410218e5c", "name": "network-vif-unplugged", "status": "completed", "tag": "9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:24.769323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:24.769590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a1bc4be6-6d94-4a3f-8640-c597c94e580d req-1ae3bc88-9cc6-417c-98f8-d276cfb6b043 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.770563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a1bc4be6-6d94-4a3f-8640-c597c94e580d req-1ae3bc88-9cc6-417c-98f8-d276cfb6b043 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.771013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a1bc4be6-6d94-4a3f-8640-c597c94e580d req-1ae3bc88-9cc6-417c-98f8-d276cfb6b043 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.790997 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4cd6400-e0d6-410b-bebc-be924d328944 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1465 microversion: 2.1 time: 0.350041 Aug 23 10:44:24.804948 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a1bc4be6-6d94-4a3f-8640-c597c94e580d req-1ae3bc88-9cc6-417c-98f8-d276cfb6b043 service nova] Creating event network-vif-unplugged:9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1 for instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c on n-h2-847009-13 Aug 23 10:44:24.804948 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a1bc4be6-6d94-4a3f-8640-c597c94e580d req-1ae3bc88-9cc6-417c-98f8-d276cfb6b043 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077037 Aug 23 10:44:24.804948 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 920/1964] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:24.807123 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1045/1965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:24 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1465 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:24.810046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:24.810893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:24.818803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.819448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.820836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.822630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.823368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.823933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.824970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:24.825598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:24.839580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.840359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.841117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:24.842008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:24.842636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:24.843268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.020795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.030838 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9130dbe0-6089-4999-9fff-163d5ef3d27d tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1509 microversion: 2.1 time: 0.222540 Aug 23 10:44:25.044798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1046/1966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:24 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:25.044798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1695787024", "metadata": {"image_type": "test"}}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:25.044798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:25.046858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.047330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.047772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.048481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.048965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.049391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.077136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:25.096417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Getting quotas for project 148d497ec6904a25a36eb8ce8b64306e. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:44:25.102296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Getting quotas for user 9b61ef0a5cf444ff83952926721631da and project 148d497ec6904a25a36eb8ce8b64306e. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:44:25.119740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.135844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07f5155b-e704-4434-a2f7-5af2037d91f1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.333761 Aug 23 10:44:25.165876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 921/1967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:24 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:25.189055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:25.192881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:25.206532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.207214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.217149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.218112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.218659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.219170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.436242 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c503d49-eebd-4ad2-927e-711771a001fb tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "POST /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b/action" status: 202 len: 0 microversion: 2.1 time: 0.402204 Aug 23 10:44:25.440085 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1047/1968] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:44:25 2022] POST /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:44:25.446226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.453622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1053bc6d-9d2e-4fa4-aa82-cce65f092875 req-b77f6455-f45e-4c94-b0ee-9c14e0f7b339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a99b54b-9efa-4cb1-bb53-13aff5876ae3", "name": "network-vif-plugged", "status": "completed", "tag": "f7bdb065-4ecc-458e-a69b-2c937dec02eb"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:25.459159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9875c33-df6e-4a34-b92d-8eaf27b267cf tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.290298 Aug 23 10:44:25.460106 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 922/1969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:25 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:25.466568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:25.467636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:25.477387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.478350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.479258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.479530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1053bc6d-9d2e-4fa4-aa82-cce65f092875 req-b77f6455-f45e-4c94-b0ee-9c14e0f7b339 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.480053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1053bc6d-9d2e-4fa4-aa82-cce65f092875 req-b77f6455-f45e-4c94-b0ee-9c14e0f7b339 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.480295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.480900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.481506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.482110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1053bc6d-9d2e-4fa4-aa82-cce65f092875 req-b77f6455-f45e-4c94-b0ee-9c14e0f7b339 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.489610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:25.507606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1053bc6d-9d2e-4fa4-aa82-cce65f092875 req-b77f6455-f45e-4c94-b0ee-9c14e0f7b339 service nova] Creating event network-vif-plugged:f7bdb065-4ecc-458e-a69b-2c937dec02eb for instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 on n-h2-847009-13 Aug 23 10:44:25.513525 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1053bc6d-9d2e-4fa4-aa82-cce65f092875 req-b77f6455-f45e-4c94-b0ee-9c14e0f7b339 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071676 Aug 23 10:44:25.514386 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1048/1970] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:25.519766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:25.521605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:25.530281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.534611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.535333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.536286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:25.536947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:25.537533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:25.759987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.772438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.776816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.778283 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3b1e0bc-e62c-4edf-9a6c-e328832c7e0d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.316745 Aug 23 10:44:25.779400 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 923/1971] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:25 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:25.784874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1663e1b8-ddc3-49bc-b7e5-c369c8a1f6c3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4630d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:25.800255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:25.812773 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-355be428-3e83-418e-a806-e271c97dc9b3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.296439 Aug 23 10:44:25.813869 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1049/1972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:25 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:25.866644 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1663e1b8-ddc3-49bc-b7e5-c369c8a1f6c3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.085882 Aug 23 10:44:25.877014 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 924/1973] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:25 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:26.057717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:26.058747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:26.075189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.075705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.077306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.078072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.078539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.083308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.164595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:26.165651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:26.184441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.187650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.189796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.191399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.194922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.197291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.475632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:26.488333 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61cb38ec-71a9-46a6-abef-b8741bfa17f8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.328553 Aug 23 10:44:26.489928 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 925/1974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:26 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:26.502607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:26.504862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:26.513118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.514612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.514796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.515749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.516551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.516808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.682169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:26.690115 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-520e3d11-30db-4443-8aa3-64bb29eaa59f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.198892 Aug 23 10:44:26.691352 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 926/1975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:26 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:26.782840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:26.797076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41444476-852d-400d-b601-f9fb2394d669 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1509 microversion: 2.1 time: 0.745455 Aug 23 10:44:26.797924 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1050/1976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:26 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1509 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:26.807001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:26.807902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:26.814433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.815137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.815737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.817373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.817995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.818794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.824416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:26.834534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3c7f08f4-487c-453c-9f39-b8c71203722a req-18a81986-57fe-4a3b-b3d7-206e5310d77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a18dd1f-4b4e-4011-b17b-7ce410218e5c", "tag": "9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:26.866137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c7f08f4-487c-453c-9f39-b8c71203722a req-18a81986-57fe-4a3b-b3d7-206e5310d77c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.867606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c7f08f4-487c-453c-9f39-b8c71203722a req-18a81986-57fe-4a3b-b3d7-206e5310d77c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.868247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c7f08f4-487c-453c-9f39-b8c71203722a req-18a81986-57fe-4a3b-b3d7-206e5310d77c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.889036 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3c7f08f4-487c-453c-9f39-b8c71203722a req-18a81986-57fe-4a3b-b3d7-206e5310d77c service nova] Creating event network-changed:9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1 for instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c on n-h2-847009-13 Aug 23 10:44:26.896244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3c7f08f4-487c-453c-9f39-b8c71203722a req-18a81986-57fe-4a3b-b3d7-206e5310d77c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069398 Aug 23 10:44:26.897385 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1051/1977] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:26.905421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:26.907009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:26.917706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.918677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.919307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.920211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:26.920874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:26.921477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:26.989472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:26.999905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:27.001461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:27.002569 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97e081ed-03f8-49a7-892a-3c47c2cadfbd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.200223 Aug 23 10:44:27.003133 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 927/1978] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:26 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:27.007752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5709c001-5668-47f1-9e68-9754097bfcbd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4c79d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:27.083946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5709c001-5668-47f1-9e68-9754097bfcbd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.078455 Aug 23 10:44:27.095062 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 928/1979] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:27 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:27.300413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:27.309474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f1e1b93-9d40-403d-b58e-cc6d25aa4a9a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.410510 Aug 23 10:44:27.310188 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1052/1980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:26 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:27.521668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:27.524615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:27.548376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ff6c002b-1e6a-4d65-ad9d-6d2b385f8236 req-062c3dcc-aa16-4104-be3e-fd6c717db0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "name": "network-vif-plugged", "status": "completed", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:27.562232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:27.563183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:27.563700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:27.565653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:27.568494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ff6c002b-1e6a-4d65-ad9d-6d2b385f8236 req-062c3dcc-aa16-4104-be3e-fd6c717db0f5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:27.569020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ff6c002b-1e6a-4d65-ad9d-6d2b385f8236 req-062c3dcc-aa16-4104-be3e-fd6c717db0f5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:27.569448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ff6c002b-1e6a-4d65-ad9d-6d2b385f8236 req-062c3dcc-aa16-4104-be3e-fd6c717db0f5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:27.571829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:27.572284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:27.628148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ff6c002b-1e6a-4d65-ad9d-6d2b385f8236 req-062c3dcc-aa16-4104-be3e-fd6c717db0f5 service nova] Creating event network-vif-plugged:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:44:27.638471 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ff6c002b-1e6a-4d65-ad9d-6d2b385f8236 req-062c3dcc-aa16-4104-be3e-fd6c717db0f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092389 Aug 23 10:44:27.646532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1053/1981] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:27.655128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1851451484", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c5fdc6a-1777-4c61-b011-ad5f4ef33812"}], "security_groups": [{"name": "tempest-securitygroup--1826582055"}], "key_name": "tempest-keypair-1965829258", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:27.874639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] validate_networks() for [('1c5fdc6a-1777-4c61-b011-ad5f4ef33812', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:44:27.889986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:27.906241 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de96621f-34ad-4840-826a-26d3ad7636f9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.390504 Aug 23 10:44:27.910327 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 929/1982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:27 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:27.924273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:27.925334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:27.940003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:27.944500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:27.945444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:27.947203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:27.947603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:27.949212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.172110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.180656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae214f5c-63dc-4411-b940-06cd5c58bcf3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.268451 Aug 23 10:44:28.181378 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 930/1983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:27 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:28.187765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:28.188518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:28.201908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.202495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.203091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.205149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.205755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.206497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.252404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.252944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.253592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.254228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lazy-loading 'fault' on Instance uuid d5031dce-cd99-469f-9f88-1090e3afbcc9 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:28.302105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.313045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b49fe825-a4b7-4a40-a601-e910da7cb28f tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1306 microversion: 2.1 time: 0.130227 Aug 23 10:44:28.313641 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 931/1984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:28 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:28.326954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:28.326954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:28.331874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:28.333658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.334698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.335372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.336698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.337974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.338514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.470381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:44:28.471088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:44:28.471887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:44:28.472485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:44:28.473207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:44:28.485198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.489176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.489640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.490449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.490919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.491358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.511976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.528885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:44:28.533768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.539876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.541615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for user ca80ea2c8904468d9e6944fc274afdb8 and project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:44:28.549664 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15fcfe78-233b-4183-84ea-3e16eb9d48d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1281 microversion: 2.25 time: 0.234925 Aug 23 10:44:28.556377 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 932/1985] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:28 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:28.564618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:44:28.568002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:44:28.571737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-552c2f90-dd03-4af1-bc4b-a22990a3c3bc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4635e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:28.630710 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-552c2f90-dd03-4af1-bc4b-a22990a3c3bc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.072789 Aug 23 10:44:28.631208 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9a4d056e-ac3c-456f-90f1-11ebb49fe5bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.982805 Aug 23 10:44:28.631711 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 933/1986] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:28 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:28.636717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:28.638187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:28.644389 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1054/1987] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:44:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:44:28.662475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee991710-15d6-4831-be67-a05e98372021 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:28.665548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee991710-15d6-4831-be67-a05e98372021 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:28.676087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.677030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.680897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.681423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.681962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.687844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.752499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ee991710-15d6-4831-be67-a05e98372021 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.762304 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee991710-15d6-4831-be67-a05e98372021 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1239 microversion: 2.1 time: 0.114703 Aug 23 10:44:28.762956 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1055/1988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:28 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1239 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:28.912951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f9fab48c-52f3-4edd-834d-5462c8200113 req-855f15a6-f7ad-4e2f-a375-1d42c6b21b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5031dce-cd99-469f-9f88-1090e3afbcc9", "name": "network-vif-deleted", "tag": "b2403bc7-9508-4cf8-a999-ca14108ae60a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:28.917851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:28.937562 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8deb17ec-ad8b-4a9c-a4a9-47ddec1d5767 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.304242 Aug 23 10:44:28.943565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f9fab48c-52f3-4edd-834d-5462c8200113 req-855f15a6-f7ad-4e2f-a375-1d42c6b21b9b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.943839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 934/1989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:28 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:28.949313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:28.949932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:28.953148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f9fab48c-52f3-4edd-834d-5462c8200113 req-855f15a6-f7ad-4e2f-a375-1d42c6b21b9b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.953595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f9fab48c-52f3-4edd-834d-5462c8200113 req-855f15a6-f7ad-4e2f-a375-1d42c6b21b9b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.965746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.966250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.966697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.967419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:28.967882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:28.968310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:28.974899 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f9fab48c-52f3-4edd-834d-5462c8200113 req-855f15a6-f7ad-4e2f-a375-1d42c6b21b9b service nova] Creating event network-vif-deleted:b2403bc7-9508-4cf8-a999-ca14108ae60a for instance d5031dce-cd99-469f-9f88-1090e3afbcc9 on n-h1-847009-13 Aug 23 10:44:28.981249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f9fab48c-52f3-4edd-834d-5462c8200113 req-855f15a6-f7ad-4e2f-a375-1d42c6b21b9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071892 Aug 23 10:44:28.982213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1056/1990] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:29.159866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.169152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8af685e-dec2-4088-a3a0-4bd73e1d4c0a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.223965 Aug 23 10:44:29.169942 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 935/1991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:28 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:29.202198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.202922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:29.209118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.209606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.210073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.211267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.211741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.212169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.343146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.344051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:29.348240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.352120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.352700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.353241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.354101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.354629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.355254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.358326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84930edf-7f6d-45ce-97b0-220d674fbaee tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.160276 Aug 23 10:44:29.359055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1057/1992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:29.389271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.389685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.390154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.390629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lazy-loading 'fault' on Instance uuid d5031dce-cd99-469f-9f88-1090e3afbcc9 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:29.435399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.443908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99f8da11-31bb-410d-9d5d-2cc4a65dcee4 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1306 microversion: 2.1 time: 0.105632 Aug 23 10:44:29.444678 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 936/1993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:29.579444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.580061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:29.587005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.587488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.587922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.588613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.589099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.589527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.645766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-389bfc56-3969-41a9-a846-6905531aa3aa tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4c7a60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.699732 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-389bfc56-3969-41a9-a846-6905531aa3aa tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.057803 Aug 23 10:44:29.707388 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 937/1994] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:29.707388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ecd15116-483d-4048-ad0b-d5d76bd8d83c req-3876cdb3-3c98-4003-9192-33af6f53e6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5678d158-2a5a-40fb-81ba-18ef4e6399f7", "name": "network-vif-plugged", "status": "completed", "tag": "490c80d4-5e8b-47c8-b9a1-3e06373c59cf"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:29.715998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ecd15116-483d-4048-ad0b-d5d76bd8d83c req-3876cdb3-3c98-4003-9192-33af6f53e6ef service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.716787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ecd15116-483d-4048-ad0b-d5d76bd8d83c req-3876cdb3-3c98-4003-9192-33af6f53e6ef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.717444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ecd15116-483d-4048-ad0b-d5d76bd8d83c req-3876cdb3-3c98-4003-9192-33af6f53e6ef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.729962 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ecd15116-483d-4048-ad0b-d5d76bd8d83c req-3876cdb3-3c98-4003-9192-33af6f53e6ef service nova] Creating event network-vif-plugged:490c80d4-5e8b-47c8-b9a1-3e06373c59cf for instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 on n-h2-847009-13 Aug 23 10:44:29.731838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.735152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ecd15116-483d-4048-ad0b-d5d76bd8d83c req-3876cdb3-3c98-4003-9192-33af6f53e6ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033548 Aug 23 10:44:29.736038 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 938/1995] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:29.741236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.744068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.745273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3209de37-80e8-4a79-92d6-4a8c0b5d5980 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1478 microversion: 2.25 time: 0.169816 Aug 23 10:44:29.745858 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1058/1996] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:29.784727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.785531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:29.793215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.793908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.794571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.795367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.795831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.796262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.877244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:29.887342 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2393b350-4ffe-4240-8c49-42d693fe51b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1243 microversion: 2.1 time: 0.107966 Aug 23 10:44:29.888507 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1059/1997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1243 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:29.893124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.894487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:29.905018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.905580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.906307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.907369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.908231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.910915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.959525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:29.960235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:29.962477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:29.969627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.970137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.970588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:29.971310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:29.972060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:29.972503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.133831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:30.136479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:30.145057 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87d1c8cf-f4d8-46fc-89dd-2a671b0f28eb tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.189415 Aug 23 10:44:30.145764 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1060/1998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:30.147817 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ddb0ce0-3cb7-4253-90b7-2076e79b8069 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1973 microversion: 2.25 time: 0.384042 Aug 23 10:44:30.148444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 939/1999] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:29 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1973 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:30.172110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.172110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:30.178198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.178691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.179132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.180606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.180817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.181245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.192321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.193006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:30.199783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.200272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.200715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.201443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.201905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.202335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.312112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:30.325784 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef73546e-fba7-464d-a65c-7932fb4e3c54 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1973 microversion: 2.25 time: 0.159074 Aug 23 10:44:30.326503 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1061/2000] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1973 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:30.336434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:30.344462 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3afa7c4-f999-4562-bcd6-fa5478904675 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1313 microversion: 2.1 time: 0.156030 Aug 23 10:44:30.345071 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 940/2001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:30.352356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.355043 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:44:30.355043 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:44:30.356191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.356673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.357156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.357878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.358330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.358750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.379558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.380177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:30.384084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-55020710-7139-4830-acaa-bcb8f364e934 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.035949 Aug 23 10:44:30.384686 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1062/2002] 10.222.0.78 () {60 vars in 1217 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:44:30.386870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.387362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.387875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.388607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.389107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.389544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.396934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-847009-13", "block_migration": "auto"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:30.400013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:30.406133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.407287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.407287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.407960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.408414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.408862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.435625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'flavor' on Instance uuid 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:30.450599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Going to try to live migrate instance to n-h1-847009-13 {{(pid=128859) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 10:44:30.533061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:30.541907 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-583917d2-f964-48e8-8a09-1eacc9aaa6a3 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.166156 Aug 23 10:44:30.552955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 941/2003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:30.552955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.552955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:30.554079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.555391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.556417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.559808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.559808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.559808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.595093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.595735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.596275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.596860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lazy-loading 'fault' on Instance uuid d5031dce-cd99-469f-9f88-1090e3afbcc9 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:30.664184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d123775e9d460bbf7f258d5436692d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9daf7e1d3fd4cf7a95d8f8b05d81b32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:30.676449 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-709a8f54-aef1-4221-8b83-f5b9cc532826 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 200 len: 1306 microversion: 2.1 time: 0.132775 Aug 23 10:44:30.677055 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 942/2004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:30.715349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fc135b8-24bf-44f0-87af-d33e1f6e1e7b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9ccb2040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.769990 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fc135b8-24bf-44f0-87af-d33e1f6e1e7b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.058935 Aug 23 10:44:30.770667 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 943/2005] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:30.908685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:30.909598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:30.916926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.917415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.917867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.918581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:30.919035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:30.919485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:30.985367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:30.994096 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64587780-e596-43e3-a711-52abb8e488f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1235 microversion: 2.1 time: 0.089394 Aug 23 10:44:30.994921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 944/2006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:30 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:31.169425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:31.170045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:31.176212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:31.176706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:31.177177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:31.177886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:31.178348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:31.178783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:31.349864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:31.358977 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6901fed-04ad-4e0e-8642-7d5c668becf2 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.193267 Aug 23 10:44:31.359910 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 945/2007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:31 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:31.364396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:31.365011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:31.372222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:31.372715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:31.373174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:31.373898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:31.374357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:31.374819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:31.518843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:31.528703 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-977f8da5-f0c3-41f1-b9bd-77857145fdb7 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1462 microversion: 2.1 time: 0.167674 Aug 23 10:44:31.529649 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 946/2008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:31 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1462 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:31.568029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:31.568795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:31.576548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:31.577041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:31.577546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:31.578334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:31.578797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:31.579232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:31.582101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:31.729919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:31.737964 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-890fed34-f262-4f7e-8ec8-9a3f228e7c30 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1306 microversion: 2.1 time: 0.174607 Aug 23 10:44:31.738569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 947/2009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:31 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1306 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:31.744413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1930054083", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1e86e83a-eb70-4e79-a2fa-92d93ad91433"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:31.800088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:44:32.032394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:44:32.032855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:44:32.033362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:44:32.033830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:44:32.034252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:44:32.044342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.044881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.045464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.046205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.046824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.047283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.066382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Getting quotas for project 876d31e066de4418a6ae43fafc095a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:44:32.072589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Getting quotas for user 65a60d0f17c14f40adbcc6460e09d725 and project 876d31e066de4418a6ae43fafc095a9c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:44:32.085556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:44:32.088154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:44:32.144624 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e30a2eac-e18f-4db5-a859-b443aa61cc45 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.404644 Aug 23 10:44:32.145797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 948/2010] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:44:32.163286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:32.166243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:32.189421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.190450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.191645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.193115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.193765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.194363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.215402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 HTTP/1.1 Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:32.220779 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.222763 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'd5031dce-cd99-469f-9f88-1090e3afbcc9'} Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:32.223847 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.227017 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.230509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:32.232128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54d724c2-d466-46d4-b10f-d3d22d586197 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 404 len: 111 microversion: 2.1 time: 0.084965 Aug 23 10:44:32.237454 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 949/2011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:32 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:32.247703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b9c5f6a-258e-4a4e-9bf8-3affd1b70d46 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9cb09670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:32.309371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b9c5f6a-258e-4a4e-9bf8-3affd1b70d46 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.062896 Aug 23 10:44:32.310017 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 950/2012] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:32 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:32.324616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6f4d66ae-df10-4833-8533-e333b932d3b0 req-7e3eef9e-e934-4921-bf2f-66f0f2a4a981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "name": "network-vif-plugged", "status": "completed", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:32.346205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6f4d66ae-df10-4833-8533-e333b932d3b0 req-7e3eef9e-e934-4921-bf2f-66f0f2a4a981 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.346701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6f4d66ae-df10-4833-8533-e333b932d3b0 req-7e3eef9e-e934-4921-bf2f-66f0f2a4a981 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.358408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6f4d66ae-df10-4833-8533-e333b932d3b0 req-7e3eef9e-e934-4921-bf2f-66f0f2a4a981 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.380888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6f4d66ae-df10-4833-8533-e333b932d3b0 req-7e3eef9e-e934-4921-bf2f-66f0f2a4a981 service nova] Creating event network-vif-plugged:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:44:32.411169 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6f4d66ae-df10-4833-8533-e333b932d3b0 req-7e3eef9e-e934-4921-bf2f-66f0f2a4a981 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092972 Aug 23 10:44:32.412548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 951/2013] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:32.420957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:32.422738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:32.434048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.434656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.435202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.436119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.437120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.437654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.559950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:32.570913 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2ebc6b1-dc1f-4629-a728-82cf65d4534e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1309 microversion: 2.1 time: 0.155724 Aug 23 10:44:32.572583 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 952/2014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:32 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1309 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:32.577930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06022b86-16d7-40a8-9d26-d6ceba8d7664 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:32.578984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06022b86-16d7-40a8-9d26-d6ceba8d7664 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:32.650731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06022b86-16d7-40a8-9d26-d6ceba8d7664 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:32.661640 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06022b86-16d7-40a8-9d26-d6ceba8d7664 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1214 microversion: 2.1 time: 0.087361 Aug 23 10:44:32.662659 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 953/2015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:32 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:32.668563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-657092404", "metadata": {"image_type": "test"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:32.671265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:32.682651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.683467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.684124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.685328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.685967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.686571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.703779 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9/action HTTP/1.1 Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 111 Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:32.707009 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-657092404", "metadata": {"image_type": "test"}}} Aug 23 10:44:32.709001 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'd5031dce-cd99-469f-9f88-1090e3afbcc9', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-657092404', 'metadata': {'image_type': 'test'}}}} Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:32.710242 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.711879 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:32.713617 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:32.713617 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:32.713617 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:32.713617 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:32.713617 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.716129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:32.717281 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1eeadad-554d-43f2-89c5-5066660add43 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "POST /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9/action" status: 404 len: 111 microversion: 2.1 time: 0.053808 Aug 23 10:44:32.718362 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 954/2016] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Aug 23 10:44:32 2022] POST /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:32.723957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:32.725019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:32.732725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.735292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.736380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.737974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.738639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.739245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.918035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:32.944258 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae1313b6-b4f9-4e7c-8626-ebaa52e67fc0 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.224629 Aug 23 10:44:32.945440 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 955/2017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:32 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:32.963763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-586bcb34-1c8c-45f0-a008-f1a6f2ca3de0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1210212979", "metadata": {"image_type": "test"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:32.968778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-586bcb34-1c8c-45f0-a008-f1a6f2ca3de0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Failed to fetch instance by id tempest-invalid-1709718532 {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:44:32.969607 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-586bcb34-1c8c-45f0-a008-f1a6f2ca3de0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance tempest-invalid-1709718532 could not be found. Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-586bcb34-1c8c-45f0-a008-f1a6f2ca3de0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/tempest-invalid-1709718532/action HTTP/1.1 Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 112 Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:32.971497 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1210212979", "metadata": {"image_type": "test"}}} Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:32.973237 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance tempest-invalid-1709718532 could not be found. Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'tempest-invalid-1709718532', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1210212979', 'metadata': {'image_type': 'test'}}}} Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1709718532 could not be found. Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:32.974470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1709718532 could not be found. Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1709718532 could not be found. Aug 23 10:44:32.976489 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:32.983603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-586bcb34-1c8c-45f0-a008-f1a6f2ca3de0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance tempest-invalid-1709718532 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:32.983603 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-586bcb34-1c8c-45f0-a008-f1a6f2ca3de0 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "POST /compute/v2.1/servers/tempest-invalid-1709718532/action" status: 404 len: 101 microversion: 2.1 time: 0.029456 Aug 23 10:44:32.983603 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 956/2018] 10.222.0.78 () {60 vars in 1249 bytes} [Tue Aug 23 10:44:32 2022] POST /compute/v2.1/servers/tempest-invalid-1709718532/action => generated 101 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:32.983603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:32.983603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:32.991764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.992501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.992991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:32.993872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:32.994341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:32.994776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.170311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:33.183538 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0dbf60d-d24e-4784-81ac-cdfbaa9100dc tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1486 microversion: 2.1 time: 0.204978 Aug 23 10:44:33.184445 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 957/2019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:32 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1486 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:33.192092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dddc1d57-f9e1-4e71-a5c2-abd235dd3040 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-11526035"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:33.197548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dddc1d57-f9e1-4e71-a5c2-abd235dd3040 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:44:33.198363 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-dddc1d57-f9e1-4e71-a5c2-abd235dd3040 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dddc1d57-f9e1-4e71-a5c2-abd235dd3040 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 55 Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:33.203557 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "tempest-test-snap-11526035"}} Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:33.205645 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-11526035'}}} Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:33.207045 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.208666 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.210327 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e42b7758-b8b5-485b-ae7e-320a2c54f1dc tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3/action" status: 202 len: 0 microversion: 2.25 time: 2.810397 Aug 23 10:44:33.210327 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1063/2020] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:44:30 2022] POST /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3/action => generated 0 bytes in 2817 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:44:33.212767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dddc1d57-f9e1-4e71-a5c2-abd235dd3040 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:33.213876 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dddc1d57-f9e1-4e71-a5c2-abd235dd3040 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.027328 Aug 23 10:44:33.214900 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 958/2021] 10.222.0.78 () {60 vars in 1275 bytes} [Tue Aug 23 10:44:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:33.216467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-510904555"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:33.219345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:33.223924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:33.224881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:33.227188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.227705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.228134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.228896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.229361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.229792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.235403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.236219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.237010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.237899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.238525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.239328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.486151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:33.498111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:33.501123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:33.504602 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c665b3be-8660-4bd3-8a70-632ba209370e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.287566 Aug 23 10:44:33.505405 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 959/2022] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:33 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:33.520869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7b2980a-ab64-4de7-89ec-d7eb46ab6b70 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-547659205"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:33.523788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7b2980a-ab64-4de7-89ec-d7eb46ab6b70 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:44:33.524396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a7b2980a-ab64-4de7-89ec-d7eb46ab6b70 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7b2980a-ab64-4de7-89ec-d7eb46ab6b70 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 56 Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:33.530950 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "tempest-test-snap-547659205"}} Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:33.532791 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-547659205'}}} Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:33.533853 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 10:44:33.535612 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.537354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7b2980a-ab64-4de7-89ec-d7eb46ab6b70 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:33.537354 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7b2980a-ab64-4de7-89ec-d7eb46ab6b70 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.027517 Aug 23 10:44:33.538998 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 960/2023] 10.222.0.78 () {60 vars in 1281 bytes} [Tue Aug 23 10:44:33 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:33.551969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbddfcda-0cee-48f2-b653-2fded1210efc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c47b790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:33.653119 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbddfcda-0cee-48f2-b653-2fded1210efc tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.106206 Aug 23 10:44:33.654610 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ef112bb-b8d6-4545-9563-dbf8563c02f4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "POST /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7/action" status: 202 len: 0 microversion: 2.1 time: 0.440773 Aug 23 10:44:33.655707 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 961/2024] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:33 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:33.657002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1064/2025] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:44:33 2022] POST /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:44:33.675008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:33.675872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:33.679774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:33.683097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:33.705505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.706037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.706496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.707237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.707705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.708196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.714754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.716548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.717849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.722389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.723433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.725067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.760940 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 HTTP/1.1 Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:33.762749 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:33.764539 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'd5031dce-cd99-469f-9f88-1090e3afbcc9'} Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:33.765678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:33.767568 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:33.769336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:33.769336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46b4cb2d-86ea-4a75-9dce-b402dd080812 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 404 len: 111 microversion: 2.1 time: 0.107552 Aug 23 10:44:33.769336 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 962/2026] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:33 2022] DELETE /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:33.776732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6607da88-bff0-4647-904c-e6823386e4a0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c4638b0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:33.860829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6607da88-bff0-4647-904c-e6823386e4a0 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13" status: 200 len: 1413 microversion: 2.1 time: 0.094650 Aug 23 10:44:33.872663 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 963/2027] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:33 2022] GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:33.881689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:33.883414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:33.892420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.893364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.894111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:33.896005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:33.896835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:33.897636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.000968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.013383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90211658-f9cb-4614-a930-f3557621d83d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1266 microversion: 2.1 time: 0.135661 Aug 23 10:44:34.014889 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 964/2028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:33 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:34.030469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.031681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] [instance: d5031dce-cd99-469f-9f88-1090e3afbcc9] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:34.041175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.042353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.043325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.044592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.045430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.046360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.068869 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] HTTP exception thrown: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Request method failure captured: Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 HTTP/1.1 Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9oPgt2y0CFNCtFaLUlpWZ6hFZsxkJ2c2FjXWXfVqmIrjedF0KjoIDS-qXqDPL-JLiGBBaziAgKnDm1qFjhohxB4W3LObU-XLCr88YbFkNQ8WsFFGyVvjdCNX54gCf-6m82_0nptXyxy8DDVJn1Zl458n4-h56ArKCWdQYFdgg8Gso Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:34.072130 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b9daf7e1d3fd4cf7a95d8f8b05d81b32", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b9daf7e1d3fd4cf7a95d8f8b05d81b32"}]}] Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b9daf7e1d3fd4cf7a95d8f8b05d81b32 Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-97212497 Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d9d123775e9d460bbf7f258d5436692d Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesNegativeTestJSON-97212497-project Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:34.075040 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'd5031dce-cd99-469f-9f88-1090e3afbcc9'} Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:34.076003 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. Aug 23 10:44:34.078072 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.080932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] Returning 404 to user: Instance d5031dce-cd99-469f-9f88-1090e3afbcc9 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:34.081969 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3120adf8-9ab9-4d9a-b8dc-b9b453244378 tempest-ImagesNegativeTestJSON-97212497 tempest-ImagesNegativeTestJSON-97212497-project] 10.222.0.78 "GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9" status: 404 len: 111 microversion: 2.1 time: 0.061914 Aug 23 10:44:34.083363 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 965/2029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/servers/d5031dce-cd99-469f-9f88-1090e3afbcc9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:34.089339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.092084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c508a46-88b7-4681-b16a-a7c3eaca3fb5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c479b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.099204 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68dc8173-83d4-4c01-a86b-f01cd1079579 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.440686 Aug 23 10:44:34.100908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1065/2030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:33 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:34.115119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.116411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:34.125477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.126447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.127109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.128329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.129049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.129623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.136063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:34.182823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c508a46-88b7-4681-b16a-a7c3eaca3fb5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13" status: 200 len: 1413 microversion: 2.1 time: 0.094120 Aug 23 10:44:34.185813 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 966/2031] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:34.200950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c0b9eee-0b98-4749-9f6e-75671d58bda4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c4630d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.397031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c0b9eee-0b98-4749-9f6e-75671d58bda4 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13" status: 204 len: 0 microversion: 2.1 time: 0.203712 Aug 23 10:44:34.398168 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 967/2032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:34 2022] DELETE /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:44:34.406838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1685161-a832-4b87-8a6d-0c09401c0937 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c47bc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.432628 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e1685161-a832-4b87-8a6d-0c09401c0937 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Image not found. Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1685161-a832-4b87-8a6d-0c09401c0937 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 HTTP/1.1 Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:34.434544 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'bf3189cd-e55b-4108-af66-c95bbeec1b13'} Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:34.436170 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bf3189cd-e55b-4108-af66-c95bbeec1b13 Aug 23 10:44:34.437338 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:44:34.438692 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf3189cd-e55b-4108-af66-c95bbeec1b13 could not be found. Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:44:34.441470 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1685161-a832-4b87-8a6d-0c09401c0937 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:34.443959 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1685161-a832-4b87-8a6d-0c09401c0937 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13" status: 404 len: 62 microversion: 2.1 time: 0.033448 Aug 23 10:44:34.446810 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 968/2033] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:44:34.446810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.447130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:34.454200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.454628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.455074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.456297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.456852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.457535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.474749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.484510 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9a30c70-fab2-4135-8577-f187e91efe7d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.382130 Aug 23 10:44:34.485952 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1066/2034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:34.528225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.529099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:34.535177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.535925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.536635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.537745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:34.538407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:34.539684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:34.791920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.801572 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5240a3ed-3b06-429b-abc7-b7eb81adb34d tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1498 microversion: 2.1 time: 0.359809 Aug 23 10:44:34.802464 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 969/2035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1498 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:34.823062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2a8ebb6-0952-40ec-b966-952b113bd946 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c47bdc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:34.879601 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2a8ebb6-0952-40ec-b966-952b113bd946 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.061287 Aug 23 10:44:34.880859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 970/2036] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:34.927607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.937906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.939734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:34.941134 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc2203a1-9a49-4afc-8b9b-3f2eb1483c6f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.417307 Aug 23 10:44:34.943526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1067/2037] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:34 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:35.038266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:35.039274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:35.045777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.046540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.047225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.048057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.048530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.048988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.127241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:35.128459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:35.136498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.137356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.139110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.140502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.141311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.143178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.158602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:35.169714 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4562996b-95a4-4225-b1f3-2ed4a783a626 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1272 microversion: 2.1 time: 0.135212 Aug 23 10:44:35.170908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 971/2038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:35 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:35.399177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a99b8080-3914-4e6c-872e-a213abfddf02 req-259f5871-1241-4b5c-a014-44217dd96180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:35.410495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a99b8080-3914-4e6c-872e-a213abfddf02 req-259f5871-1241-4b5c-a014-44217dd96180 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.411526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a99b8080-3914-4e6c-872e-a213abfddf02 req-259f5871-1241-4b5c-a014-44217dd96180 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.412817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a99b8080-3914-4e6c-872e-a213abfddf02 req-259f5871-1241-4b5c-a014-44217dd96180 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.442199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:35.444440 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a99b8080-3914-4e6c-872e-a213abfddf02 req-259f5871-1241-4b5c-a014-44217dd96180 service nova] Creating event network-changed:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:44:35.451217 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a99b8080-3914-4e6c-872e-a213abfddf02 req-259f5871-1241-4b5c-a014-44217dd96180 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057462 Aug 23 10:44:35.452428 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 972/2039] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:35.466278 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ffb097dd-f9ba-49e8-9950-c356ebcb7521 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.344779 Aug 23 10:44:35.491602 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1068/2040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:35 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:35.512860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:35.514176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:35.524028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.525355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.526181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.527796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.529076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.530451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.829608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:35.834776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:35.838446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:35.847820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.848375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.849137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.850060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:35.850747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:35.851357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:35.861581 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13c24804-dbbf-41f9-9d83-577a4b9c2cf4 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.357195 Aug 23 10:44:35.862811 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 973/2041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:35 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:35.897806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d4213e3-16aa-4554-838e-4ca2d2f3f682 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c483b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:35.989668 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d4213e3-16aa-4554-838e-4ca2d2f3f682 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.097042 Aug 23 10:44:35.990955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 974/2042] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:35 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:35.996206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:35.997394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:36.014918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.015702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.016348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.017851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.018519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.019461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.341780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:36.354110 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48375e55-a94e-4043-83ef-0ca6031f6712 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1504 microversion: 2.1 time: 0.531908 Aug 23 10:44:36.355269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1069/2043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:35 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:36.372798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:36.373688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:36.380231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.383526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.384165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.385334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.385807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.386280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.422254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:36.431794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:36.441675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:36.442910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d73aaa7-bf85-4489-afc6-4e0531aaf483 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.450711 Aug 23 10:44:36.458835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 975/2044] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:35 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:36.493836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:36.494748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:36.503199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.504363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.513477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.514547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.515341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.515838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.860333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:36.870994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c184506-048c-4773-a63a-580ec1409bbe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.381113 Aug 23 10:44:36.885576 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 976/2045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:36 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:36.891430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:36.892074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:36.899166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.899837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.900288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:36.901034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:36.901503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:36.901941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.069781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:37.092459 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2b3c0c8-f730-4bbc-8d9e-4d4ba57082c8 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.735824 Aug 23 10:44:37.100236 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1070/2046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:36 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:37.105919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e14545f7-5761-4147-b3a3-a03f8c0b637a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c520550>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:37.159216 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e14545f7-5761-4147-b3a3-a03f8c0b637a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.057115 Aug 23 10:44:37.160552 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1071/2047] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:37 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:37.380218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:37.381164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:37.388777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.389688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.390366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.391532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.392241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.392938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.397323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:37.407845 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40358131-40f4-4954-ab81-25961c73cda8 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.520970 Aug 23 10:44:37.408529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 977/2048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:36 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:37.467343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:37.467986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:37.474775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.475357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.475866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.478146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.479542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.480064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.622968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:37.640333 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bbf9aead-ce1d-434c-9d66-32130f11a4b5 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1504 microversion: 2.1 time: 0.267620 Aug 23 10:44:37.641438 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1072/2049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:37 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:37.646207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6e615fb0-6235-4102-819d-c73420b0522e req-7f7a9023-cb5f-4b66-8876-2c6e8d01386d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c0fbd9-3286-48f5-8fe9-66809b979399", "tag": "9166d849-2ba5-4696-9154-35d2b387a757"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:37.659319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6e615fb0-6235-4102-819d-c73420b0522e req-7f7a9023-cb5f-4b66-8876-2c6e8d01386d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.660250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6e615fb0-6235-4102-819d-c73420b0522e req-7f7a9023-cb5f-4b66-8876-2c6e8d01386d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.660967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6e615fb0-6235-4102-819d-c73420b0522e req-7f7a9023-cb5f-4b66-8876-2c6e8d01386d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.673395 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6e615fb0-6235-4102-819d-c73420b0522e req-7f7a9023-cb5f-4b66-8876-2c6e8d01386d service nova] Creating event network-changed:9166d849-2ba5-4696-9154-35d2b387a757 for instance 81c0fbd9-3286-48f5-8fe9-66809b979399 on n-h1-847009-13 Aug 23 10:44:37.678463 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6e615fb0-6235-4102-819d-c73420b0522e req-7f7a9023-cb5f-4b66-8876-2c6e8d01386d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035568 Aug 23 10:44:37.680811 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1073/2050] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:37.792620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:37.809746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:37.813492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:37.817294 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9482a6b2-a738-4897-a9f0-c7c9467b73e2 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.354280 Aug 23 10:44:37.818709 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 978/2051] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:37 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:37.904979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:37.905953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:37.925982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.927000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.927614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:37.928623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:37.929607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:37.930552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.104780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:38.120103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:38.120762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:38.125703 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e82c4282-ec85-4cd8-b15c-0d45985cf4cf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.230863 Aug 23 10:44:38.126587 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1074/2052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:37 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:38.127455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.127959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.128405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.129155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.129621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.130055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.175309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e6c0d61-4557-4f10-8265-981af5f72ff4 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5ade50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:38.226620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e6c0d61-4557-4f10-8265-981af5f72ff4 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.054996 Aug 23 10:44:38.227208 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1075/2053] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:38 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:38.432780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:38.433449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:38.433599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:38.441907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.442983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.443713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.445758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.446596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.447253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.448662 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0bf598c9-7efd-4e09-9353-b8f88ead7c17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.332939 Aug 23 10:44:38.450577 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 979/2054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:38 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:38.517128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-16738c9e-3a26-482f-a0e9-fd0c560719f5 req-3ae7791d-879a-4803-9bbd-97bd392d0be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5678d158-2a5a-40fb-81ba-18ef4e6399f7", "name": "network-vif-plugged", "status": "completed", "tag": "490c80d4-5e8b-47c8-b9a1-3e06373c59cf"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:38.534521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-16738c9e-3a26-482f-a0e9-fd0c560719f5 req-3ae7791d-879a-4803-9bbd-97bd392d0be2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.539653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-16738c9e-3a26-482f-a0e9-fd0c560719f5 req-3ae7791d-879a-4803-9bbd-97bd392d0be2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.540700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-16738c9e-3a26-482f-a0e9-fd0c560719f5 req-3ae7791d-879a-4803-9bbd-97bd392d0be2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.568292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-16738c9e-3a26-482f-a0e9-fd0c560719f5 req-3ae7791d-879a-4803-9bbd-97bd392d0be2 service nova] Creating event network-vif-plugged:490c80d4-5e8b-47c8-b9a1-3e06373c59cf for instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 on n-h2-847009-13 Aug 23 10:44:38.581115 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-16738c9e-3a26-482f-a0e9-fd0c560719f5 req-3ae7791d-879a-4803-9bbd-97bd392d0be2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063597 Aug 23 10:44:38.581115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 980/2055] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:38.622289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:38.631049 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93ef8551-3d3f-4b63-91a1-ec8d3de79578 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.203929 Aug 23 10:44:38.631567 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1076/2056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:38 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:38.662641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:38.664154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:38.670832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.671411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.671907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.672831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.673534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.674040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.692048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:38.841565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:38.842284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:38.844320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=20 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:38.849976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.850540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.851120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.852142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.852609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.853185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.892125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:38.901161 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cfe7c2e-7940-4b6c-b823-ee40ad4b4372 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1486 microversion: 2.1 time: 0.242692 Aug 23 10:44:38.902065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 981/2057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:38 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1486 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:38.922885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:38.923388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:38.929631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.930351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.930786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.931491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:38.931942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:38.932535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:38.982347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:44:39.011789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:39.031570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:39.033696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:39.035787 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-593eabab-c5e5-403c-b3b5-827ec53b5b4a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.198180 Aug 23 10:44:39.036942 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1077/2058] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:38 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:39.089013 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56e51f6a-db49-4864-8c12-1a1012cdba80 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 204 len: 0 microversion: 2.1 time: 0.169704 Aug 23 10:44:39.089900 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 982/2059] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:38 2022] DELETE /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:44:39.105790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4118803b-86a9-4831-a053-44b7897b27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c57c790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:39.150719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:39.151635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:39.158082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-4118803b-86a9-4831-a053-44b7897b27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Image not found. Aug 23 10:44:39.166482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:39.168480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4118803b-86a9-4831-a053-44b7897b27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 HTTP/1.1 Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:44:39.169471 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'bf3189cd-e55b-4108-af66-c95bbeec1b13'} Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:39.171397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf3189cd-e55b-4108-af66-c95bbeec1b13 to delete Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.173216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf3189cd-e55b-4108-af66-c95bbeec1b13 could not be found. Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:39.174915 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:44:39.179625 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:39.182370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.182370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.182370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.182651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4118803b-86a9-4831-a053-44b7897b27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:39.182651 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4118803b-86a9-4831-a053-44b7897b27ef tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13" status: 404 len: 62 microversion: 2.1 time: 0.075040 Aug 23 10:44:39.182651 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1078/2060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:39 2022] DELETE /compute/v2.1/images/bf3189cd-e55b-4108-af66-c95bbeec1b13 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:44:39.182933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.182933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.192585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:39.193318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:39.217204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.217726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.218376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.219281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.219904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.220712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.294649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:44:39.428298 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.compute.api [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Instance is already in deleting state, ignoring this request Aug 23 10:44:39.429948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc0cef57-b1f5-4be4-925d-becfd435150c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 204 len: 0 microversion: 2.1 time: 0.251404 Aug 23 10:44:39.442556 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1079/2061] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:39 2022] DELETE /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:44:39.448377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01f5bf86-85cb-40b9-8ee2-e957c2990900 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5ada60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:39.509774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01f5bf86-85cb-40b9-8ee2-e957c2990900 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.065722 Aug 23 10:44:39.511255 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1080/2062] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:39 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:39.517752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:39.518543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:39.530829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.531660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.532265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.533924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.534546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.535145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.620527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:39.639432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f6739f43-348b-4e3d-84eb-b3854d1441aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.496168 Aug 23 10:44:39.640044 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 983/2063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:39 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:39.671981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:39.674146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:39.692468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.693006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.693458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.694189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:39.695179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:39.695797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:39.958413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:39.986615 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f267dc8-c96d-4e54-ac59-c4bf65f8d02f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.327946 Aug 23 10:44:40.000241 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 984/2064] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:39 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:40.009814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:40.011300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:40.024544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:40.025377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:40.026029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:40.026945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:40.027828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:40.028545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:40.061473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:40.069287 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d78d787d-05b4-464b-9893-218a9f51fb02 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1492 microversion: 2.1 time: 0.556727 Aug 23 10:44:40.074375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1081/2065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:39 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1492 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:40.079309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:40.079928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:40.105097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:40.105878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:40.106937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:40.107862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:40.108478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:40.109097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:40.299000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:40.317529 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e88e52c-5a16-4d66-993d-63a7b6f19da5 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1390 microversion: 2.1 time: 0.311769 Aug 23 10:44:40.321202 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 985/2066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:40 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1390 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:40.363819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:40.530909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5395d9f7-9e9f-44b9-8aa2-38f2b3be48b9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c420940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:40.552244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:40.570470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:40.575709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:40.577892 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-12dc5c96-eecc-440b-ad47-8d417beb1b5b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.501565 Aug 23 10:44:40.593305 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1082/2067] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:40 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:40.637402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5395d9f7-9e9f-44b9-8aa2-38f2b3be48b9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.116326 Aug 23 10:44:40.638000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 986/2068] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:40 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:40.666200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:40.667169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:40.675266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:40.676091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:40.676920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:40.677868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:40.678501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:40.679130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.012729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.013932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:41.029972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.030801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.031559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.033454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.034183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.034782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.126628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.143855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2419959e-24ed-43c3-b816-13bde58b0247 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.482603 Aug 23 10:44:41.144646 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1083/2069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:40 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:41.150640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.162290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:41.169699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.170213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.170667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.171590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.172064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.172595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.225472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.238211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6dbb36f-5f36-43b3-9613-a931eba88d8d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.228705 Aug 23 10:44:41.239230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 987/2070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:41.349415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.352559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:41.368819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.373763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.377146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.378093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.378727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.379343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.572695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.595514 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56ab2077-ef96-4762-93d4-bb04dc7acf05 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1380 microversion: 2.1 time: 0.252791 Aug 23 10:44:41.599183 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 988/2071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1380 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:41.608787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.609795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:41.616834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.618138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.618952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.620915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.621943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.622676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.627749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.642994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3547502c-9e8e-4189-9f4a-db66d468059b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1492 microversion: 2.1 time: 0.496612 Aug 23 10:44:41.661173 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1084/2072] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1492 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:41.668911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be0e7cee-81ae-4d6d-ae41-55200d48664e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '.version_select at 0x7fdc9c5ad040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.675270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be0e7cee-81ae-4d6d-ae41-55200d48664e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.676030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be0e7cee-81ae-4d6d-ae41-55200d48664e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.676895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be0e7cee-81ae-4d6d-ae41-55200d48664e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.691885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be0e7cee-81ae-4d6d-ae41-55200d48664e tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3118 microversion: 2.1 time: 0.028868 Aug 23 10:44:41.693637 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1085/2073] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/os-migrations => generated 3118 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:41.699966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d553472-8035-4ee0-9d8f-6da564b14339 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5209d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.769360 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d553472-8035-4ee0-9d8f-6da564b14339 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.074375 Aug 23 10:44:41.770294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1086/2074] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:41.777647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:41.778487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:41.786203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.787114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.787916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.789505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:41.790359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:41.791599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:41.910930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.922210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.926376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:41.934304 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ea0573b-cc56-4eb1-9653-689b5ec1b10b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.333534 Aug 23 10:44:41.935206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 989/2075] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:42.100584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:42.107278 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f07e5fe1-32b8-4a00-9204-50c9db44cc7c tempest-LiveMigrationTest-2059328874 tempest-LiveMigrationTest-2059328874-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1533 microversion: 2.1 time: 0.335770 Aug 23 10:44:42.108266 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1087/2076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:41 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1533 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:42.143565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:42.144419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:42.147365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:42.153606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.154456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.155147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.156079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.156778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.157430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.166547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:42.167465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:42.182820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.185314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.185955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.187069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.193510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.194232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.212072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:44:42.370625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0bdc356-1655-4a7a-acdb-a654e1c0dd70 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 204 len: 0 microversion: 2.1 time: 0.229626 Aug 23 10:44:42.375827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 990/2077] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:42 2022] DELETE /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:44:42.393169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:42.396491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:42.405024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:42.410559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.411410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.412551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.414177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.414964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.415633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.419339 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98c1c503-97aa-4054-ab6d-ba31b1da743f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.256552 Aug 23 10:44:42.420229 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1088/2078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:42 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:42.437917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:42.438672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:42.458023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.464209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.466011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.467035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.468674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.469155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.656916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:42.760978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:42.770443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08033a46-4be1-42ce-bebd-bc63a6dbf2ed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.393016 Aug 23 10:44:42.773820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 991/2079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:42 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:42.782802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:42.783432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:42.801687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.802185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.802953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.803365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.803830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.805143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.874605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:42.886054 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddde2590-5ac9-4122-9499-39c966900307 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1386 microversion: 2.1 time: 0.464245 Aug 23 10:44:42.886672 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1089/2080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:42 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1386 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:42.901397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cdde821d-4242-4bc6-984a-daff5ec2d828 req-d1ff8a76-3ebe-4099-ace2-f92a5d4d145a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5678d158-2a5a-40fb-81ba-18ef4e6399f7", "name": "network-vif-unplugged", "status": "completed", "tag": "490c80d4-5e8b-47c8-b9a1-3e06373c59cf"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:42.917670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdde821d-4242-4bc6-984a-daff5ec2d828 req-d1ff8a76-3ebe-4099-ace2-f92a5d4d145a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:42.918363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdde821d-4242-4bc6-984a-daff5ec2d828 req-d1ff8a76-3ebe-4099-ace2-f92a5d4d145a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:42.927563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdde821d-4242-4bc6-984a-daff5ec2d828 req-d1ff8a76-3ebe-4099-ace2-f92a5d4d145a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:42.958729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cdde821d-4242-4bc6-984a-daff5ec2d828 req-d1ff8a76-3ebe-4099-ace2-f92a5d4d145a service nova] Creating event network-vif-unplugged:490c80d4-5e8b-47c8-b9a1-3e06373c59cf for instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 on n-h2-847009-13 Aug 23 10:44:42.982321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cdde821d-4242-4bc6-984a-daff5ec2d828 req-d1ff8a76-3ebe-4099-ace2-f92a5d4d145a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092189 Aug 23 10:44:42.983136 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1090/2081] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:42.996607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ae40c64-783f-4502-9f4d-ca536c2da92e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c520c10>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:43.112206 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ae40c64-783f-4502-9f4d-ca536c2da92e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.126154 Aug 23 10:44:43.116777 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1091/2082] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:42 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:43.127167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:43.128196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:43.161933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.162424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.162970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.164475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.170906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.172772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.181248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:43.193341 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d716b92-adc3-4918-b471-2c6f8e942ae6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1492 microversion: 2.1 time: 0.418398 Aug 23 10:44:43.198763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 992/2083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:42 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1492 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:43.251295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-de5a91d4-b736-4bf2-ac44-84e76ba55374 req-bc89fc20-89b4-4a80-8a21-c4fbad370531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5678d158-2a5a-40fb-81ba-18ef4e6399f7", "name": "network-vif-deleted", "tag": "490c80d4-5e8b-47c8-b9a1-3e06373c59cf"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:43.262331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de5a91d4-b736-4bf2-ac44-84e76ba55374 req-bc89fc20-89b4-4a80-8a21-c4fbad370531 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.262826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de5a91d4-b736-4bf2-ac44-84e76ba55374 req-bc89fc20-89b4-4a80-8a21-c4fbad370531 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.263271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de5a91d4-b736-4bf2-ac44-84e76ba55374 req-bc89fc20-89b4-4a80-8a21-c4fbad370531 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.290429 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-de5a91d4-b736-4bf2-ac44-84e76ba55374 req-bc89fc20-89b4-4a80-8a21-c4fbad370531 service nova] Creating event network-vif-deleted:490c80d4-5e8b-47c8-b9a1-3e06373c59cf for instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 on n-h2-847009-13 Aug 23 10:44:43.305094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-de5a91d4-b736-4bf2-ac44-84e76ba55374 req-bc89fc20-89b4-4a80-8a21-c4fbad370531 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056868 Aug 23 10:44:43.305351 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 993/2084] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:43.440323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:43.440921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:43.450659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.454534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.455268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.459792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.461203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.462367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.519336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:43.530567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:43.532222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:43.533578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35b9b009-5e31-4b4c-a26a-e93157e8868b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.415205 Aug 23 10:44:43.535286 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1092/2085] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:43 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:43.762467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:43.771573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab9d7369-620d-4fcd-ab07-24a51f561075 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.334950 Aug 23 10:44:43.772374 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 994/2086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:43 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:43.793929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:43.794800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:43.807282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.807794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.808250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.809315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.812763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.813421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.912522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:43.914915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:43.930967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.931836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.933914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.934894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:43.938607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:43.940592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:43.980698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:43.989258 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9003ddf2-e339-42a5-945e-961cb4397c92 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.199379 Aug 23 10:44:44.002841 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1093/2087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:43 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:44.130002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3afd4490-b9d4-4c63-9d4e-cc5dff069efe tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5ad700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:44.200504 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3afd4490-b9d4-4c63-9d4e-cc5dff069efe tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.074257 Aug 23 10:44:44.201270 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1094/2088] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:44 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:44.205027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:44.220930 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b95b31f-8531-4647-a5e3-eabf08626e9d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1386 microversion: 2.1 time: 0.316314 Aug 23 10:44:44.222982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:44.223777 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 995/2089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:43 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:44.224651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:44.231802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.232570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.233243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.234101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.234639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.235161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.274639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.275220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.275732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.276422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lazy-loading 'fault' on Instance uuid 5678d158-2a5a-40fb-81ba-18ef4e6399f7 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:44:44.331452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f47ead9ba342b2b1456305289c6188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bb1b02eebe47e2b961da19bdcc6e5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:44.342810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6d5be5c-d81c-48e1-973c-1158b9bb2883 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 200 len: 1296 microversion: 2.1 time: 0.128500 Aug 23 10:44:44.344796 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1095/2090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:44 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 1296 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:44.474085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Calling method '.version_select at 0x7fdc9c42c040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:44.499173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.500542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.501727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.503968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.505499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.506710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.524835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:44.542684 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd018027-df8a-43a7-b656-7ef659de1357 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.221186 Aug 23 10:44:44.543391 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 996/2091] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Aug 23 10:44:44 2022] GET /compute/v2.1/limits => generated 511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:44.557854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:44.558575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:44.566155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.567078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.570327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.571577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.572890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.573548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.622573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-968988503", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:44.722101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:44:44.813989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:44.828337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:44.830260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:44.831726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e130c11-d435-472e-9295-bc21cd6fdf7b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.278239 Aug 23 10:44:44.837118 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1096/2092] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:44 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:44.844441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:44.846539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:44.857583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.858476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.859307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:44.860493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:44.861054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:44.861491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.032159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Getting quotas for project 2f1184adee484b77b7688da5bf8a7850. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:44:45.043444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:45.043676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Getting quotas for user 1250574c92764dd8aeade3cae335f7a6 and project 2f1184adee484b77b7688da5bf8a7850. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:44:45.054081 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ab8e64ac-57b5-44ab-8bd9-80d10226fa45 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.215499 Aug 23 10:44:45.056877 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1097/2093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:45.062072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ae195faa-5095-4348-b8c5-a39f26d99b8b req-0f2c621e-7d4c-448e-ab70-380db2bdf35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-plugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:45.069760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Request method failure captured: Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 1751 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-cnIQw7S3w4IizC7wIJ7ZEa0ynyU2OVlY1rdhK6P4gN7txyMgb_RVjTki4OouVl3aQXyA4i9OreWuZxrfS6rET2in71fFoMaWcQLqQmN9bYp2rhPqKnMVPGQ4zMxUqn_dKjwPiYAd-tUOwSmaCeOughYx42g1d2mKB57JHuokX-5g Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 2f1184adee484b77b7688da5bf8a7850 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1302937843 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2f1184adee484b77b7688da5bf8a7850"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2f1184adee484b77b7688da5bf8a7850", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f1184adee484b77b7688da5bf8a7850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2f1184adee484b77b7688da5bf8a7850"}]}] Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1302937843 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 2f1184adee484b77b7688da5bf8a7850 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1302937843 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1250574c92764dd8aeade3cae335f7a6 Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-968988503", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:45.073474 n-d-847009-13 devstack@n-api.service[128860]: exception: Maximum number of metadata items exceeds 128 Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-968988503', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:45.076490 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 23 10:44:45.080840 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.084025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.085129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb682a57-533a-4bf5-8a26-bfac1c993608 tempest-AbsoluteLimitsNegativeTestJSON-1302937843 tempest-AbsoluteLimitsNegativeTestJSON-1302937843-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.467942 Aug 23 10:44:45.086750 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 997/2094] 10.222.0.78 () {60 vars in 1148 bytes} [Tue Aug 23 10:44:44 2022] POST /compute/v2.1/servers => generated 87 bytes in 470 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:44:45.090623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ae195faa-5095-4348-b8c5-a39f26d99b8b req-0f2c621e-7d4c-448e-ab70-380db2bdf35d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.094577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.094816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ae195faa-5095-4348-b8c5-a39f26d99b8b req-0f2c621e-7d4c-448e-ab70-380db2bdf35d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.095443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ae195faa-5095-4348-b8c5-a39f26d99b8b req-0f2c621e-7d4c-448e-ab70-380db2bdf35d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.095926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.104215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.105107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.105756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.106702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.107401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.108026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.122487 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ae195faa-5095-4348-b8c5-a39f26d99b8b req-0f2c621e-7d4c-448e-ab70-380db2bdf35d service nova] Creating event network-vif-plugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:44:45.134980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ae195faa-5095-4348-b8c5-a39f26d99b8b req-0f2c621e-7d4c-448e-ab70-380db2bdf35d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076583 Aug 23 10:44:45.138068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1098/2095] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:45.220968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ceb9a17e-3825-48ab-86fb-8d1f2c959120 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5c61f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.304673 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ceb9a17e-3825-48ab-86fb-8d1f2c959120 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.086810 Aug 23 10:44:45.305485 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1099/2096] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:45.320822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.321588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.343568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.344291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.346967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.347986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.348367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.352609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:45.353075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.364979 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c190b70-7fe9-4a83-871e-b396303523ee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.276785 Aug 23 10:44:45.366646 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 998/2097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:45.372001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.372566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 5678d158-2a5a-40fb-81ba-18ef4e6399f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.397114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.402441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.404617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.408476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.414411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.420290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.456381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 could not be found. Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 HTTP/1.1 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 could not be found. Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5678d158-2a5a-40fb-81ba-18ef4e6399f7'} Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 could not be found. Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 could not be found. Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.458265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 could not be found. Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance 5678d158-2a5a-40fb-81ba-18ef4e6399f7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7ee776a-6684-4f79-bba9-6685e4c2769b tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7" status: 404 len: 111 microversion: 2.1 time: 0.094548 Aug 23 10:44:45.465549 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 999/2098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/5678d158-2a5a-40fb-81ba-18ef4e6399f7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:45.473805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c22c717f-e51d-4756-b69b-d8fe1ed72871 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c3eb550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.500457 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c22c717f-e51d-4756-b69b-d8fe1ed72871 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Image not found. Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c22c717f-e51d-4756-b69b-d8fe1ed72871 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 HTTP/1.1 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5336b64a-0252-4d9c-93cf-abeffe77d213'} Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5336b64a-0252-4d9c-93cf-abeffe77d213 to delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5336b64a-0252-4d9c-93cf-abeffe77d213 could not be found. Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.502652 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c22c717f-e51d-4756-b69b-d8fe1ed72871 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c22c717f-e51d-4756-b69b-d8fe1ed72871 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213" status: 404 len: 62 microversion: 2.1 time: 0.035274 Aug 23 10:44:45.507305 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1000/2099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] DELETE /compute/v2.1/images/5336b64a-0252-4d9c-93cf-abeffe77d213 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:44:45.518625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.519363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.528082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.528711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.529329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.530240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.531048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.531806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.565651 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 HTTP/1.1 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'a7bef7e7-48bc-426b-aef7-d87facd717f4'} Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:45.567663 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.576425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.578540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.578701 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75480960-d062-4fe4-8dea-3814d1ee66f6 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 404 len: 111 microversion: 2.1 time: 0.064778 Aug 23 10:44:45.580881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1001/2100] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:45 2022] DELETE /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:45.591612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.593469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: a7bef7e7-48bc-426b-aef7-d87facd717f4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.606342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.606931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.607597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.608196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.608772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.609317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.626148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.626627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 HTTP/1.1 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'a7bef7e7-48bc-426b-aef7-d87facd717f4'} Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.627782 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance a7bef7e7-48bc-426b-aef7-d87facd717f4 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.633604 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e02728de-f53a-431c-935d-ee52b3d8ae71 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4" status: 404 len: 111 microversion: 2.1 time: 0.045870 Aug 23 10:44:45.634323 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1002/2101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/a7bef7e7-48bc-426b-aef7-d87facd717f4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:45.640912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58be7d93-bcd8-4b29-a0af-13390a87807f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c4833a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.643886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29e3b63e-7398-45db-a490-384e52593788 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1386 microversion: 2.1 time: 0.337318 Aug 23 10:44:45.649044 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1100/2102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1386 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:45.667040 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-58be7d93-bcd8-4b29-a0af-13390a87807f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Image not found. Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58be7d93-bcd8-4b29-a0af-13390a87807f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 HTTP/1.1 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'e819c14a-6c2e-46b9-b08c-2bb6e76f2494'} Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e819c14a-6c2e-46b9-b08c-2bb6e76f2494 to delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e819c14a-6c2e-46b9-b08c-2bb6e76f2494 could not be found. Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.669425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:44:45.676249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.679945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58be7d93-bcd8-4b29-a0af-13390a87807f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.681511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58be7d93-bcd8-4b29-a0af-13390a87807f tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494" status: 404 len: 62 microversion: 2.1 time: 0.045788 Aug 23 10:44:45.682459 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1003/2103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] DELETE /compute/v2.1/images/e819c14a-6c2e-46b9-b08c-2bb6e76f2494 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:44:45.691534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.692112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.699591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.700187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.700706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.701504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.702292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.702951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.735961 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 HTTP/1.1 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '8c55817a-7f2f-4d09-9f3e-d3428bbed107'} Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:45.745152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.750610 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.752522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.753765 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85e7cd36-74bb-4d50-a6e7-dc0d7482de4c tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 404 len: 111 microversion: 2.1 time: 0.066537 Aug 23 10:44:45.758347 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1101/2104] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:45 2022] DELETE /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:45.764670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.765382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 8c55817a-7f2f-4d09-9f3e-d3428bbed107] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.774905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.775598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.776312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.777553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.777745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.778378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.796256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 HTTP/1.1 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8c55817a-7f2f-4d09-9f3e-d3428bbed107'} Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.798641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.805463 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.805463 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.805463 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.805463 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.805463 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. Aug 23 10:44:45.805463 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.807105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance 8c55817a-7f2f-4d09-9f3e-d3428bbed107 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.807105 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04544425-6290-456c-9f0a-25aaef3438da tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107" status: 404 len: 111 microversion: 2.1 time: 0.047350 Aug 23 10:44:45.809683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1004/2105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/8c55817a-7f2f-4d09-9f3e-d3428bbed107 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:45.817435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-198c1b9c-7358-4cb7-a23d-d95e75842c69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '.version_select at 0x7fdc9c548820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.852729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-198c1b9c-7358-4cb7-a23d-d95e75842c69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Image not found. Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-198c1b9c-7358-4cb7-a23d-d95e75842c69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f HTTP/1.1 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd1b4cf95-af12-444e-8333-6ad2e525ff8f'} Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d1b4cf95-af12-444e-8333-6ad2e525ff8f to delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d1b4cf95-af12-444e-8333-6ad2e525ff8f could not be found. Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.856631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-198c1b9c-7358-4cb7-a23d-d95e75842c69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.861537 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-198c1b9c-7358-4cb7-a23d-d95e75842c69 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f" status: 404 len: 62 microversion: 2.1 time: 0.047099 Aug 23 10:44:45.867744 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1102/2106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] DELETE /compute/v2.1/images/d1b4cf95-af12-444e-8333-6ad2e525ff8f => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:44:45.881383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.884185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.888712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.900845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:45.904553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.906131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.908303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.911468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.917266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.920064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.926684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.927765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.929488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.931622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:45.934880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:45.935762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:45.954752 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 HTTP/1.1 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '73ee006f-9d99-49b9-9c30-15237f120050'} Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:45.957228 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:45.965360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:45.966894 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b78167a-e8c1-40b1-aedb-bd55cb694947 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "DELETE /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 404 len: 111 microversion: 2.1 time: 0.090366 Aug 23 10:44:45.973637 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1103/2107] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:44:45 2022] DELETE /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:45.987715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:45.991670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] [instance: 73ee006f-9d99-49b9-9c30-15237f120050] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:46.014731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.017051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.018047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.019207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.020092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.021037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.042157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] HTTP exception thrown: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Request method failure captured: Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 HTTP/1.1 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK6eMkUNVVdSKstKMbCM3fw8TpODX93IqgfzInxw7SkKh4KgF8lc--OHeNcxa6jrgyPrLo4taEo-9iEfYZyBmBI6KhwmgLtRCQ8F4B-2dx14DLv1UdghPcWxQ1twqkV4fEgaK2VvrAy8pWMvSzUGM0l2pXEoOeg37G5U0mnasw1Jbdc Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d4bb1b02eebe47e2b961da19bdcc6e5d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d4bb1b02eebe47e2b961da19bdcc6e5d"}]}] Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d4bb1b02eebe47e2b961da19bdcc6e5d Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesTestJSON-2104318480 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a2f47ead9ba342b2b1456305289c6188 Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesTestJSON-2104318480-project Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '73ee006f-9d99-49b9-9c30-15237f120050'} Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:46.044714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:46.050751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:46.050751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:46.050751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:46.050751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:46.050751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. Aug 23 10:44:46.050751 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:44:46.052386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] Returning 404 to user: Instance 73ee006f-9d99-49b9-9c30-15237f120050 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:46.053401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4625ada-c95c-4d4c-b0a5-4378ea305588 tempest-ImagesTestJSON-2104318480 tempest-ImagesTestJSON-2104318480-project] 10.222.0.78 "GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050" status: 404 len: 111 microversion: 2.1 time: 0.077026 Aug 23 10:44:46.054768 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1104/2108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/73ee006f-9d99-49b9-9c30-15237f120050 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:46.083480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:46.085969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:46.099525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.099943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.102174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.102917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.107965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.108980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.247299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:46.262716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:46.264806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:46.268996 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-388439b1-418c-410d-a46e-fb927cd014d7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.408109 Aug 23 10:44:46.269874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1005/2109] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:45 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:46.320811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8db8c9c9-195c-4e49-b21a-df1af239f484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c3eb790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:46.429563 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8db8c9c9-195c-4e49-b21a-df1af239f484 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.113410 Aug 23 10:44:46.459941 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1006/2110] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:46 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:46.487181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:46.492229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:46.501421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:46.512121 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-96af5292-3c7e-4f50-917e-ca1d059a5ea7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 0.437047 Aug 23 10:44:46.512295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.512910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.518184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.518910 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1105/2111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:46 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:46.529197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.529197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.529197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.674352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:46.676058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:46.688899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.702892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.704775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.705784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:46.706617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:46.707558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:46.828029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:46.846282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b88ca0c3-cc2f-49d5-8438-86fda6a12418 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.374624 Aug 23 10:44:46.847618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1007/2112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:46 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:47.108236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:47.117535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06781329-f97e-4712-9ab4-8d979965c661 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1386 microversion: 2.1 time: 0.448151 Aug 23 10:44:47.122640 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1106/2113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:46 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1386 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:47.300640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:47.302188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:47.336284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.353453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.356689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:47.362004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.369511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.370254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:47.415305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2d150394-eee2-4c8a-ba17-193e5c55c72e req-e083edb9-8c2d-4b50-a1ac-ee2c3cc2d302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a18dd1f-4b4e-4011-b17b-7ce410218e5c", "name": "network-vif-deleted", "tag": "9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:47.441757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2d150394-eee2-4c8a-ba17-193e5c55c72e req-e083edb9-8c2d-4b50-a1ac-ee2c3cc2d302 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.442553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2d150394-eee2-4c8a-ba17-193e5c55c72e req-e083edb9-8c2d-4b50-a1ac-ee2c3cc2d302 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.443174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2d150394-eee2-4c8a-ba17-193e5c55c72e req-e083edb9-8c2d-4b50-a1ac-ee2c3cc2d302 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:47.471310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2d150394-eee2-4c8a-ba17-193e5c55c72e req-e083edb9-8c2d-4b50-a1ac-ee2c3cc2d302 service nova] Creating event network-vif-deleted:9f6e3caa-eb64-4dd2-a25a-fa37f8a160e1 for instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c on n-h1-847009-13 Aug 23 10:44:47.478431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2d150394-eee2-4c8a-ba17-193e5c55c72e req-e083edb9-8c2d-4b50-a1ac-ee2c3cc2d302 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067565 Aug 23 10:44:47.479418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1107/2114] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:44:47.493147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-162806f2-4226-4215-a51f-65d56f98fb5c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c548e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:47.551642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-162806f2-4226-4215-a51f-65d56f98fb5c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.070989 Aug 23 10:44:47.553220 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1108/2115] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:47 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:47.561865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:47.562874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:47.578647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.580710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.583611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:47.585035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.587530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.588211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:47.918015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:47.938799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:47.940932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:47.950939 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c0c4145-40f2-40e0-8759-79e26ad9c9fb tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.655195 Aug 23 10:44:47.951829 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1008/2116] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:47 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:47.966045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:47.967447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:47.983844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.984728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.985628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:47.986691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:47.988937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:47.990397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:48.338314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:48.349472 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6637c80-6e27-4d42-92f9-3d1432d44a35 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.396261 Aug 23 10:44:48.351501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1009/2117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:47 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:48.367055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:48.369255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:48.396838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:48.403960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:48.404849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:48.405890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:48.406672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:48.407688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:48.592310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:48.603596 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ed9ca63-a8e9-4d70-bec5-1bc5a3130a2c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.250712 Aug 23 10:44:48.618775 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1010/2118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:48 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:48.624492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8ad1d1c-a4cc-4f6a-ac21-bde70df164d9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c3eb3a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:48.677196 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8ad1d1c-a4cc-4f6a-ac21-bde70df164d9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.056798 Aug 23 10:44:48.678192 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1011/2119] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:48 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:48.986328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:48.988371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:48.998139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:48.999395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:49.000367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:49.002282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:49.003395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:49.004132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:49.017250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:49.033540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1301f8e8-8f3a-4c6e-8cdd-223332942145 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1365 microversion: 2.1 time: 1.478669 Aug 23 10:44:49.037566 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1109/2120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:47 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1365 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:49.323663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:49.341423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:49.342985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:49.344207 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5088805-c99a-43b3-9914-ac0367d97634 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.361984 Aug 23 10:44:49.356381 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1012/2121] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:48 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:49.372808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:49.373666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:49.388427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:49.388971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:49.389417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:49.390398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:49.391034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:49.396986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:49.626749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:49.627525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:49.637917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:49.638444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:49.638890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:49.639656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:49.653570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:49.654264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:49.855813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:49.864305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89be37a7-8b3c-427f-b6c2-c42e93b1c0fe tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.241416 Aug 23 10:44:49.873190 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1013/2122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:49 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:49.880600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-387d7da8-f4c5-4b77-b5d6-b5ff938d686c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c42ce50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:50.020755 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-387d7da8-f4c5-4b77-b5d6-b5ff938d686c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.146039 Aug 23 10:44:50.033492 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1014/2123] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:49 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:50.058980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:50.060016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:50.072953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:50.084254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:50.085151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:50.087548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:50.089461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:50.090396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:50.199330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:50.216684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e67f1e74-087b-4d80-9605-ffeeaebc187d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.844693 Aug 23 10:44:50.218118 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1110/2124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:49 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:50.385425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:50.386336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:50.411194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:50.421608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:50.422365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:50.423315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:50.423962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:50.424598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:50.747649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:50.769651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:50.776676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:50.786012 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c630f658-5342-4f49-a3c9-fdc2a73a60ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.404392 Aug 23 10:44:50.792905 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1111/2125] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:50 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:50.897739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:50.898735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:50.920676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:50.923846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:50.925376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:50.931714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:50.934559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:50.936493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.155310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:51.169111 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-624fc3b5-1a2a-4dae-8125-c9eb05af50e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1552 microversion: 2.1 time: 1.113400 Aug 23 10:44:51.193152 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1015/2126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:50 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1552 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:51.206119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e7d387d-9988-45aa-8e0f-84d3bc4422c8 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c39d820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:51.229891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:51.239590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dec2b645-92fc-4e90-a03b-ab9f27e3a16a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.348457 Aug 23 10:44:51.247567 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1112/2127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:50 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:51.256544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:51.265557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:51.286204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.289850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.290605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.292302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.294616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.297782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e7d387d-9988-45aa-8e0f-84d3bc4422c8 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.102919 Aug 23 10:44:51.297982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.299878 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1016/2128] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:51 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:51.315132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:51.323017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:51.330798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:51.374139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.380503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.382771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.388477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.389171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.390378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.639390 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5150b572-e30a-4746-bb51-e94e8f364905 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.390365 Aug 23 10:44:51.640497 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1113/2129] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:44:51 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/os-interface => generated 285 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:51.795558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:51.808790 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82d90e05-5647-4a69-a4fa-f05c3a9018e6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.494100 Aug 23 10:44:51.809519 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1017/2130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:51 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:51.818967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:51.819983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:51.833304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.834134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.836288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.837249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.839391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.839960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:51.939964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d0f55f72-eda8-42c3-9175-e22a8f3f165d req-eca12fab-d2c1-4586-b698-8795987f1cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c0fbd9-3286-48f5-8fe9-66809b979399", "name": "network-vif-plugged", "status": "completed", "tag": "9166d849-2ba5-4696-9154-35d2b387a757"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:51.965377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d0f55f72-eda8-42c3-9175-e22a8f3f165d req-eca12fab-d2c1-4586-b698-8795987f1cd8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:51.971116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d0f55f72-eda8-42c3-9175-e22a8f3f165d req-eca12fab-d2c1-4586-b698-8795987f1cd8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:51.980096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d0f55f72-eda8-42c3-9175-e22a8f3f165d req-eca12fab-d2c1-4586-b698-8795987f1cd8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:52.047671 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d0f55f72-eda8-42c3-9175-e22a8f3f165d req-eca12fab-d2c1-4586-b698-8795987f1cd8 service nova] Creating event network-vif-plugged:9166d849-2ba5-4696-9154-35d2b387a757 for instance 81c0fbd9-3286-48f5-8fe9-66809b979399 on n-h1-847009-13 Aug 23 10:44:52.067039 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d0f55f72-eda8-42c3-9175-e22a8f3f165d req-eca12fab-d2c1-4586-b698-8795987f1cd8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131542 Aug 23 10:44:52.080886 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1018/2131] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:52.286580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:52.289371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:52.300911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:52.304718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:52.309645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:52.310708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:52.311475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:52.311875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:52.634096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:52.650829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f684da2-e6f4-47a3-8579-9e36a03a6fe3 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.371815 Aug 23 10:44:52.667824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1019/2132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:52 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:52.683917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abab04b2-7a99-4e5c-a461-8b57ae3decc8 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c418ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:52.782720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abab04b2-7a99-4e5c-a461-8b57ae3decc8 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.113575 Aug 23 10:44:52.785415 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1020/2133] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:52 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:52.829167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:52.831586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:52.833434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:52.847671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:52.848286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:52.850340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:52.852659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca1ec3c0-8abe-430c-a1d0-b64e4561665d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 1.039966 Aug 23 10:44:52.853473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:52.853749 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1114/2134] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:51 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:52.855080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:52.859475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:52.862280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:52.866967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:53.287762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:53.310382 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de6a3a2a-0e23-4b8d-acf1-b3445f183825 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 0.484389 Aug 23 10:44:53.324644 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1021/2135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:52 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:53.683110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:53.683741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:53.700399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:53.700960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:53.701405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:53.702191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:53.702727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:53.703509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:53.798538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12ee010a-c343-43be-90b5-f379db017e41 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c41bee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:53.909335 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12ee010a-c343-43be-90b5-f379db017e41 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.114504 Aug 23 10:44:53.910546 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1022/2136] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:53 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:44:53.923475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:53.924139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:53.941174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:53.941658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:53.942155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:53.942871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:53.949867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:53.950625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:53.976839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:53.986184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e464df95-55c7-4a5b-a2b7-f5020c35b27c tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.308635 Aug 23 10:44:53.986833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1115/2137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:53 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:54.254740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:54.273078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:54.297519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:54.299050 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8672e889-cf5b-465b-902d-5f9a245db68f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.387157 Aug 23 10:44:54.310244 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1023/2138] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:53 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:54.332270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:54.333013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:54.344561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:54.345429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:54.346088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:54.347034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:54.347700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:54.348352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:54.929116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee77c982-548e-4b26-8072-2cbbf91f4f73 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4188b0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:54.955989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:55.064665 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee77c982-548e-4b26-8072-2cbbf91f4f73 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.143488 Aug 23 10:44:55.066616 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1024/2139] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:54 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:55.094358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:55.098675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:55.130399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:55.137107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:55.139056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:55.139924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:55.141052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:55.141771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:55.150873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:55.356727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:55.371838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f8168a9-6183-47c0-ab40-076d153eff3d tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.303163 Aug 23 10:44:55.374942 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1025/2140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:55 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:55.386816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:55.387706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:55.405832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:55.406679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:55.407322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:55.410190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:55.410854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:55.411484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:55.873006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:55.875317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:55.886422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:55.887989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:55.889240 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03d7d645-5495-48a8-a426-d522110c1cf0 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.513123 Aug 23 10:44:55.901438 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1026/2141] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:55 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:44:55.935568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:55.965502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90dce728-9ac7-419b-b12a-bae6bd8b3651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1314 microversion: 2.1 time: 1.635583 Aug 23 10:44:55.968978 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1116/2142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:54 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1314 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:56.079335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5233922e-a46a-47a4-b895-180adc9ebadd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c41bdc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:56.184870 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5233922e-a46a-47a4-b895-180adc9ebadd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.108566 Aug 23 10:44:56.186736 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1027/2143] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:56 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:56.408755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:56.410158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:56.431499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:56.432660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:56.433373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:56.434473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:56.435671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:56.436345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:56.918707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:56.920475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:56.953456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:56.953998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:56.963489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:56.964689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:56.965435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:56.968404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:57.166796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:57.191213 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c17c2cf-97ee-4b89-bbbf-d6de5528ab95 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 200 len: 1183 microversion: 2.1 time: 0.795509 Aug 23 10:44:57.205432 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1117/2144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:56 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 1183 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:57.213545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:57.216593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:57.237969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:44:57.252663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:57.253548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:57.259531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:57.263991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:57.264815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:57.267094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:57.544451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:57.568907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:57.571806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:57.579527 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5158f3bf-a0f9-4115-a046-2621ad91c3a1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.664766 Aug 23 10:44:57.583210 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1028/2145] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:56 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:57.599416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80c41483-627d-454a-a661-c2e375f8f5a1 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4830d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:57.717631 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80c41483-627d-454a-a661-c2e375f8f5a1 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.133129 Aug 23 10:44:57.718321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1029/2146] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:57 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:58.112280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3942b5ac-9ccf-4f1c-a6b5-cad31b107e4e req-c4b29e2a-a648-4181-9b3f-08f244b0a67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:58.127435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3942b5ac-9ccf-4f1c-a6b5-cad31b107e4e req-c4b29e2a-a648-4181-9b3f-08f244b0a67d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:58.128191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3942b5ac-9ccf-4f1c-a6b5-cad31b107e4e req-c4b29e2a-a648-4181-9b3f-08f244b0a67d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:58.128984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3942b5ac-9ccf-4f1c-a6b5-cad31b107e4e req-c4b29e2a-a648-4181-9b3f-08f244b0a67d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:58.144444 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3942b5ac-9ccf-4f1c-a6b5-cad31b107e4e req-c4b29e2a-a648-4181-9b3f-08f244b0a67d service nova] Creating event network-changed:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:44:58.160775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3942b5ac-9ccf-4f1c-a6b5-cad31b107e4e req-c4b29e2a-a648-4181-9b3f-08f244b0a67d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055549 Aug 23 10:44:58.161995 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1030/2147] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:58.219773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:58.222387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 1a18dd1f-4b4e-4011-b17b-7ce410218e5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:58.237484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:58.238473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:58.239314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:58.240259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:58.240933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:58.242252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:58.261339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] HTTP exception thrown: Instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c could not be found. Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Request method failure captured: Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c HTTP/1.1 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3uYvEcGwHulOdBXN2iUutwVoXa27Zon45otswRHHR9kVZFNebDMpJkITNpXivUsmUFQM0QvFrnPNkcaaa0ObV-_0xPV8tHThA1HgH2mbUKud1pFKZDIFF4AKqordLArUekzRG6Bt4ZzN452p21EXp92HgXWM6-2_U93Y8Dvi2h4zs Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1482830f506e4e79b82c0bf9fb3b11ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}] Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-LiveMigrationTest-2112330571 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-LiveMigrationTest-2112330571-project Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: b2ac0227a26f41c8a9b5c89cddea52f5 Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-LiveMigrationTest-2112330571-project Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c could not be found. Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1a18dd1f-4b4e-4011-b17b-7ce410218e5c'} Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c could not be found. Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c could not be found. Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:44:58.263499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c could not be found. Aug 23 10:44:58.270309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:44:58.273519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Returning 404 to user: Instance 1a18dd1f-4b4e-4011-b17b-7ce410218e5c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:44:58.274625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5904e91a-96db-4d5d-9713-e4b17434803a tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c" status: 404 len: 111 microversion: 2.1 time: 0.060762 Aug 23 10:44:58.275686 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1031/2148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:58 2022] GET /compute/v2.1/servers/1a18dd1f-4b4e-4011-b17b-7ce410218e5c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:44:58.612029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:58.612699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:44:58.631082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:58.633503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:58.634158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:58.635731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:58.639640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:58.641304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:58.663344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:58.682550 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ceb545e-f8fa-4ba3-acb3-ec05d8d7da9a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1464 microversion: 2.1 time: 1.471002 Aug 23 10:44:58.688939 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1118/2149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:44:57 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1464 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:59.162391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:59.176463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:59.183193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:44:59.186701 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b6ea02d-1c0c-4862-9f7e-7a50f95cef73 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.579618 Aug 23 10:44:59.189711 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1032/2150] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:44:58 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:44:59.199862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c5e7f6c-ad2b-4bbd-bd1b-4868736157a1 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4189d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:59.336260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c5e7f6c-ad2b-4bbd-bd1b-4868736157a1 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.144947 Aug 23 10:44:59.337093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1033/2151] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:44:59 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:44:59.447741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:59.461903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'deleted': False, 'project_id': '3e65cb0d3abe48e2b123d6ad25503685'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:44:59.493703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f1aac94-0051-4ef5-8d58-af8115a757fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c41b820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1465320229", "description": "tempest-description-1670084115"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:59.509118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:59.509609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:59.510049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:59.510785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:59.511257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:59.511668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:59.843926 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-62ba3a96-7db4-42bb-841b-9de71f045ab6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.129113 Aug 23 10:44:59.848069 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1119/2152] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:44:58 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:44:59.876731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:44:59.889435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'deleted': False} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:44:59.896132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f1aac94-0051-4ef5-8d58-af8115a757fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.555465 Aug 23 10:44:59.896672 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1034/2153] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:44:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:44:59.910605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0067430e-9171-45b4-a517-960b760ae66b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c41bca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1598744020", "description": "tempest-description-1429223528"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:44:59.922898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:59.923552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:59.930451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:44:59.947808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:44:59.947808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:44:59.951035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:00.416656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:45:00.457196 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0067430e-9171-45b4-a517-960b760ae66b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.551348 Aug 23 10:45:00.458093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1035/2154] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:44:59 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:00.489539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:00.493699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:00.510980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:00.512184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:00.541307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:00.545910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:00.546427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:00.565482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:00.813523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:00.813958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:00.814476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:00.989842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:01.032793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:01.035583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:01.036364 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da25b2c1-ddb4-402e-a941-ce12961e0c2e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.576857 Aug 23 10:45:01.056024 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1036/2155] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:00 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:01.065079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0834f1a2-ae28-4097-9ab9-bb52f2a18cca tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c418ca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:01.129976 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0834f1a2-ae28-4097-9ab9-bb52f2a18cca tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1424 microversion: 2.1 time: 0.072254 Aug 23 10:45:01.131702 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1037/2156] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:01 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:01.139033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-568807258", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "78f9eefa-5b07-487e-9e97-dc9574fe6db6"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:01.235123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] validate_networks() for [('78f9eefa-5b07-487e-9e97-dc9574fe6db6', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:45:02.159527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db30e594-682d-42c5-89ed-f325ffa68e0f tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22851 microversion: 2.1 time: 2.289171 Aug 23 10:45:02.178163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1120/2157] 10.222.0.78 () {58 vars in 1171 bytes} [Tue Aug 23 10:44:59 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22851 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:45:02.200404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:02.201225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:02.215856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.216979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.223446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.224858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.226014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.227299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.550914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:02.551332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:02.551836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:02.552303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:02.552722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:02.563715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.564722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.565447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.566552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.567257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.568041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.586444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:02.598498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:02.601875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:02.604421 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce1caed5-6e21-4571-acd9-73c660f2e3c8 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.422618 Aug 23 10:45:02.605936 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1121/2158] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:02 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:02.614336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af065050-d329-44fa-b62a-d29f3ad18771 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5463a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:02.621801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:02.628325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Getting quotas for project 8ac28f7e36bb480db15c2898c855eeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:02.635196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Getting quotas for user 750e7f2db9b24dcf93ad785b12a4998f and project 8ac28f7e36bb480db15c2898c855eeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:02.651770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:45:02.654914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:45:02.705158 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af065050-d329-44fa-b62a-d29f3ad18771 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1433 microversion: 2.1 time: 0.097230 Aug 23 10:45:02.717719 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1122/2159] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:02 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1433 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:02.724561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:02.737743 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07116c18-a1a5-4f12-aa85-97228e5060d9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603482 Aug 23 10:45:02.739944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1038/2160] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:45:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:45:02.748505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'deleted': False, 'project_id': '3e65cb0d3abe48e2b123d6ad25503685'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:45:02.750329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb59551e-75b9-42dd-99bd-c4f18af49f4e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c3cdc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:02.776154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.777136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.778178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.780146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.780972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.781891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.844150 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb59551e-75b9-42dd-99bd-c4f18af49f4e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 200 len: 1433 microversion: 2.1 time: 0.101605 Aug 23 10:45:02.846778 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1039/2161] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:02 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 1433 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:02.878679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e28b5b20-5a47-436a-9d8e-17b1c48002f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:02.879473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e28b5b20-5a47-436a-9d8e-17b1c48002f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:02.885539 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d2c89283-fbc2-42ee-9156-f9a61be513e6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?tenant_id=876d31e066de4418a6ae43fafc095a9c" status: 200 len: 15 microversion: 2.1 time: 0.164748 Aug 23 10:45:02.896151 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1123/2162] 10.222.0.78 () {58 vars in 1231 bytes} [Tue Aug 23 10:45:02 2022] GET /compute/v2.1/servers/detail?tenant_id=876d31e066de4418a6ae43fafc095a9c => generated 15 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:45:02.915982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:02.917005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:02.934752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.935255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.936806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:02.942297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:02.944981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:02.948205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.040148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e28b5b20-5a47-436a-9d8e-17b1c48002f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:03.048297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e28b5b20-5a47-436a-9d8e-17b1c48002f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1215 microversion: 2.1 time: 0.200426 Aug 23 10:45:03.049657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1040/2163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:02 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:03.055134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:03.075590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'tenant_id': '876d31e066de4418a6ae43fafc095a9c', 'deleted': False} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:45:03.112504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.113004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.113448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.114189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.121389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.122037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.344825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:45:03.345360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:03.362382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0662d1c-2bfe-4720-bba0-7bec2589ff89 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1478 microversion: 2.1 time: 0.464712 Aug 23 10:45:03.374691 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1124/2164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:02 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1478 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:03.546422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.548457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.549045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.657412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Calling method '.version_select at 0x7fdc9c546af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:03.682129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.683307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.684227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.685218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.685782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.686910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.714335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-911138b7-f67a-4519-886d-b5269302cb1a tempest-AbsoluteLimitsTestJSON-589089645 tempest-AbsoluteLimitsTestJSON-589089645-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.317494 Aug 23 10:45:03.715781 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1125/2165] 10.222.0.78 () {58 vars in 1122 bytes} [Tue Aug 23 10:45:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:03.720529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:03.721465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:03.734822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.735994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.736870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.740573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.741926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.744187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.771570 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce9734aa-c469-4903-bf86-d17e490726e2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=876d31e066de4418a6ae43fafc095a9c" status: 200 len: 4831 microversion: 2.1 time: 0.720826 Aug 23 10:45:03.773597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1041/2166] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 10:45:03 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=876d31e066de4418a6ae43fafc095a9c => generated 4831 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:03.800596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:03.815635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'tenant_id': '3e65cb0d3abe48e2b123d6ad25503685', 'deleted': False} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:45:03.849908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.851196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.851617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.856354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:03.856925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:03.857379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:03.971599 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83313ebe-f0bd-405e-8f51-fdcce5c87fbb tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3e65cb0d3abe48e2b123d6ad25503685" status: 200 len: 15 microversion: 2.1 time: 0.174995 Aug 23 10:45:03.974532 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1042/2167] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 10:45:03 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3e65cb0d3abe48e2b123d6ad25503685 => generated 15 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:45:04.002088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19f8d491-f0ab-466d-aaff-4d53d2a06d8e tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:04.022791 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19f8d491-f0ab-466d-aaff-4d53d2a06d8e tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014781 Aug 23 10:45:04.034653 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1043/2168] 10.222.0.78 () {58 vars in 1189 bytes} [Tue Aug 23 10:45:03 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:45:04.062279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:04.085725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:04.099008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.099836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.100000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.101434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.101943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.103225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.153940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:04.170648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:04.177582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:04.181828 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-beff93e1-a699-45f6-ba19-6b69e6f82133 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.462021 Aug 23 10:45:04.181828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1126/2169] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:03 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:04.192598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:04.193676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:04.201610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.203413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.204073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.205317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.205983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.206605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.306507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:04.319935 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19799fac-a837-4c49-86f4-aab941797599 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1267 microversion: 2.1 time: 0.135427 Aug 23 10:45:04.337446 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1127/2170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:04 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:04.367366 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d4c5e2c-e9f0-4e79-b81e-2d01cffbbb88 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 0 microversion: 2.1 time: 0.315475 Aug 23 10:45:04.372818 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1044/2171] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:04 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:04.378769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:04.396885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:04.399291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:04.400170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:04.400477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '876d31e066de4418a6ae43fafc095a9c'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:45:04.413685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.414890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.415492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.416430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.417184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.417634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.422753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.423250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.432981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.434157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:04.434662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:04.435109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:04.678209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:45:04.722402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:04.733815 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-118f9dc8-b7f6-4a72-95f5-8e1b584e8206 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1465 microversion: 2.1 time: 0.346977 Aug 23 10:45:04.737444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1045/2172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:04 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1465 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:04.788115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-794f3a8f-21b4-46df-af41-027ea973d826 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c3cd670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:04.907143 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-794f3a8f-21b4-46df-af41-027ea973d826 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4ffccc2-7c96-4941-8a42-0d5d5e6236b8" status: 200 len: 784 microversion: 2.1 time: 0.150773 Aug 23 10:45:04.918318 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1046/2173] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:04 2022] GET /compute/v2.1/images/b4ffccc2-7c96-4941-8a42-0d5d5e6236b8 => generated 784 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:04.926866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7124e854-dc9b-482a-84de-907f860c731e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:04.951204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7124e854-dc9b-482a-84de-907f860c731e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029268 Aug 23 10:45:04.961676 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1047/2174] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:45:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:04.968772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf1573b8-adca-47b3-badf-a47323b4a2fe tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c418ca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:05.189396 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d22dbdb-6c54-4576-b040-90123577698d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.814181 Aug 23 10:45:05.191037 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1128/2175] 10.222.0.78 () {58 vars in 1150 bytes} [Tue Aug 23 10:45:04 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:05.203190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:05.206164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:05.213698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:05.214633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:05.215556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:05.217646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:05.218418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:05.222703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:05.436126 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bbac7e91-99dd-452a-b96f-6aea64750ce9 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 0 microversion: 2.1 time: 0.237456 Aug 23 10:45:05.437268 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1129/2176] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:05 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:05.451497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:05.452340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:05.490945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:05.491464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:05.492112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:05.492863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:05.516305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:05.524618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:05.968100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:05.970811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:06.005183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:06.009616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:06.013078 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fa9eec30-889d-4968-9759-9c635eb82252 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.574632 Aug 23 10:45:06.014637 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1130/2177] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:05 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:06.028601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:06.030412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:06.065322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:06.066596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:06.067333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:06.068424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:06.070747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:06.072275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:06.271718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:06.285642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-18b6652c-8f48-49c6-b3fe-af44b8b216b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1273 microversion: 2.1 time: 0.266767 Aug 23 10:45:06.306161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1131/2178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:06 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:06.317876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:06.318525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:06.335935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:06.336580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:06.338253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:06.339975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:06.341470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:06.343933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:06.386705 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf1573b8-adca-47b3-badf-a47323b4a2fe tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "DELETE /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 204 len: 0 microversion: 2.1 time: 1.423804 Aug 23 10:45:06.390493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1048/2179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:04 2022] DELETE /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 0 bytes in 1425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:45:06.395675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6e4991e-d2c8-4b8f-8204-96e8a43e5f4d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c3cd9d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:06.463435 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b6e4991e-d2c8-4b8f-8204-96e8a43e5f4d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] HTTP exception thrown: Image not found. Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6e4991e-d2c8-4b8f-8204-96e8a43e5f4d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Request method failure captured: Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac HTTP/1.1 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9o3g8lPL6DapcZUaxsTOSvEKdzzp7vhYdOUGSuwtT-oPcjzv7EFLdrgEft6mucbsf9_pV7IXqm3lj1AJu5hqyAzyzzIyqX1dOwpaZS0gpmToxHylYvNccpqTlHudqjZgcbdSDbf3933KFFA5JQTuodqIrkqrd2l3p0CJOywXYi730 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 148d497ec6904a25a36eb8ce8b64306e Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/148d497ec6904a25a36eb8ce8b64306e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_148d497ec6904a25a36eb8ce8b64306e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148d497ec6904a25a36eb8ce8b64306e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148d497ec6904a25a36eb8ce8b64306e"}]}] Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 148d497ec6904a25a36eb8ce8b64306e Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerTestJSON-2031197830-project Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9b61ef0a5cf444ff83952926721631da Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerTestJSON-2031197830-project Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac'} Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:45:06.465716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac could not be found. Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6e4991e-d2c8-4b8f-8204-96e8a43e5f4d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:06.471741 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6e4991e-d2c8-4b8f-8204-96e8a43e5f4d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 404 len: 62 microversion: 2.1 time: 0.076262 Aug 23 10:45:06.479764 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1049/2180] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:06 2022] GET /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:45:06.485179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1351622221"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:06.505299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:06.547208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:06.547902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:06.548420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:06.552229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:06.552937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:06.554948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.005634 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22b5e9cd-be8f-4bb5-a4d4-3312fbcf5dc3 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "POST /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b/action" status: 202 len: 0 microversion: 2.1 time: 0.525094 Aug 23 10:45:07.007486 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1050/2181] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:06 2022] POST /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:45:07.014188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-db0d4406-faaf-43ac-9119-d81691430b28 req-c147f2fa-49af-49c8-a721-beac5a1010d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "name": "network-vif-unplugged", "status": "completed", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:07.027173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-db0d4406-faaf-43ac-9119-d81691430b28 req-c147f2fa-49af-49c8-a721-beac5a1010d1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.027915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-db0d4406-faaf-43ac-9119-d81691430b28 req-c147f2fa-49af-49c8-a721-beac5a1010d1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.028787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-db0d4406-faaf-43ac-9119-d81691430b28 req-c147f2fa-49af-49c8-a721-beac5a1010d1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.044416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-db0d4406-faaf-43ac-9119-d81691430b28 req-c147f2fa-49af-49c8-a721-beac5a1010d1 service nova] Creating event network-vif-unplugged:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:45:07.050376 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-db0d4406-faaf-43ac-9119-d81691430b28 req-c147f2fa-49af-49c8-a721-beac5a1010d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040949 Aug 23 10:45:07.055556 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1051/2182] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:07.061434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f55e1e81-32ed-49e9-8ca3-b5ba1f1134ac tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c2d7550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:07.071137 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78c6e033-7a08-4283-8785-9c666cd14815 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1615 microversion: 2.1 time: 0.763772 Aug 23 10:45:07.092038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1132/2183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:06 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1615 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:07.100893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:07.100893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:07.125188 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f55e1e81-32ed-49e9-8ca3-b5ba1f1134ac tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.068106 Aug 23 10:45:07.126615 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1052/2184] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:07 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:07.132553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:07.133663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:07.141232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.142077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.142823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.143846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.144720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.145466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.146801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.154335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.154994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.157042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.165376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.165733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.539595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cfd7ec2-1eb8-419f-b76f-8f9934d82ae3 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1615 microversion: 2.1 time: 0.411113 Aug 23 10:45:07.558396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1053/2185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:07 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1615 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:07.567286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:07.568519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:07.581301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.586539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.587258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:07.588200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:07.594654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:07.595307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:08.037301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:08.051414 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea7144c1-a298-471d-b97f-598f4db5389e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.491498 Aug 23 10:45:08.052590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1054/2186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:07 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:08.105020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:08.134454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:08.141867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:08.164296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5bb3bae5-cd8a-4e74-8c97-489c05ce881f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 1.075536 Aug 23 10:45:08.166244 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1133/2187] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:07 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:08.190770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:08.207422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'host': 'n-h1-847009-13', 'deleted': False} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:45:08.215713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:08.216830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:08.217516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:08.218735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:08.219434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:08.220215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:08.351742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1571554495", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": "none"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:08.480450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:45:08.568493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5cd46271-17b4-4ecb-a19b-e8f2b30607fc tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=n-h1-847009-13&all_tenants=1" status: 200 len: 2309 microversion: 2.1 time: 0.395025 Aug 23 10:45:08.569796 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1134/2188] 10.222.0.78 () {58 vars in 1192 bytes} [Tue Aug 23 10:45:08 2022] GET /compute/v2.1/servers?host=n-h1-847009-13&all_tenants=1 => generated 2309 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:08.581077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-deece887-9c97-41a2-a5c8-c6e60f2f4efe tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c5db1f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:08.660430 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-deece887-9c97-41a2-a5c8-c6e60f2f4efe tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.089058 Aug 23 10:45:08.661756 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1135/2189] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:08 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:08.696991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:08.745402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:45:08.762174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:08.763120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:08.765603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:08.766644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:08.767300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:08.770226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:08.815115 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7089ff8f-6ec3-4363-8444-e1b5b20fb524 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.151757 Aug 23 10:45:08.816533 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1136/2190] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Aug 23 10:45:08 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:45:08.830969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:08.835968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:08.854560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:08.858758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:08.861559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:08.862855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:08.865450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:08.868384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.042973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:09.043578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:09.044058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:09.044571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:09.045969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:09.071744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.075073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e3eafd6-9a94-4032-8ecf-5c610772f166 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 0 microversion: 2.1 time: 0.249746 Aug 23 10:45:09.076888 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1137/2191] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:08 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:09.080104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.080660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.084008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.085116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.085540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.090623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:09.091620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:09.107371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.111361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.112951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.117078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.117815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.118487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.131914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Getting quotas for project db46411b7a8f4a299efe71f355eeed18. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:09.145173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Getting quotas for user b605cde68375418d92e0902b33fc572b and project db46411b7a8f4a299efe71f355eeed18. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:09.184240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:45:09.195985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:45:09.275444 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-040d9697-3ff0-4847-b41e-9430c6e02a17 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.221469 Aug 23 10:45:09.282875 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1055/2192] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:45:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:45:09.289714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:09.293246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:09.302106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.302898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.304381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.305422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.306101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.306802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.477197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:09.486465 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4e6e498-76c6-4867-b3d7-80795144685b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.407898 Aug 23 10:45:09.492028 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1138/2193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:09 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:09.504501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:09.505157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:09.508346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:09.508827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:09.512151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:09.512653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:09.513195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:09.514258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.515056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.517142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.518534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.525858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.526737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.592783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:09.682216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:09.699282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.712016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.713556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.716473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.719296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.720016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.811122 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-678cd669-820d-4026-9455-4338010fb668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 1066 microversion: 2.1 time: 0.516801 Aug 23 10:45:09.814988 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1056/2194] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:09 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 1066 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 10:45:09.840959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-202faa49-459c-4df5-8443-329068e66836 req-77f8c122-4d43-4c5c-a535-bb1146f6517a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b29ed9-4389-495c-9325-4a61d3826826", "tag": "bca1e81a-30cb-4864-862b-0a93a9b95003"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:09.878892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-202faa49-459c-4df5-8443-329068e66836 req-77f8c122-4d43-4c5c-a535-bb1146f6517a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:09.879382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-202faa49-459c-4df5-8443-329068e66836 req-77f8c122-4d43-4c5c-a535-bb1146f6517a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:09.879823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-202faa49-459c-4df5-8443-329068e66836 req-77f8c122-4d43-4c5c-a535-bb1146f6517a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:09.922722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-202faa49-459c-4df5-8443-329068e66836 req-77f8c122-4d43-4c5c-a535-bb1146f6517a service nova] Creating event network-changed:bca1e81a-30cb-4864-862b-0a93a9b95003 for instance 97b29ed9-4389-495c-9325-4a61d3826826 on n-h2-847009-13 Aug 23 10:45:09.942454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-202faa49-459c-4df5-8443-329068e66836 req-77f8c122-4d43-4c5c-a535-bb1146f6517a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102188 Aug 23 10:45:09.944843 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1057/2195] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:09.963178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e30d53cc-b8a5-4871-9ade-0693a67945e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:09.965478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e30d53cc-b8a5-4871-9ade-0693a67945e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:10.002297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.014003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.016222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.017817 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-83ceecf0-139c-429a-8221-ff0e8088aa65 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.524668 Aug 23 10:45:10.030937 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1139/2196] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:09 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:10.045205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-846015d1-e62a-4d43-b75d-5b9205d8222e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c546940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:10.129707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e30d53cc-b8a5-4871-9ade-0693a67945e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.141943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-846015d1-e62a-4d43-b75d-5b9205d8222e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.106765 Aug 23 10:45:10.152374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e30d53cc-b8a5-4871-9ade-0693a67945e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.152591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1140/2197] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:10 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:10.156523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e30d53cc-b8a5-4871-9ade-0693a67945e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.165200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e30d53cc-b8a5-4871-9ade-0693a67945e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1278 microversion: 2.57 time: 0.213148 Aug 23 10:45:10.165876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1058/2198] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:09 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:10.169267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:10.170034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:10.193074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:10.193637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:10.194844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:10.195893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:10.196706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:10.198192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:10.399353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.417224 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6109f882-4d2a-421b-b7ec-ecf2a8265c27 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.269445 Aug 23 10:45:10.418541 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1141/2199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:10 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:10.515011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:10.515895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:10.529768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:10.530369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:10.530832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:10.539199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:10.539627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:10.540114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:10.914716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:10.966093 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f127664c-7d9c-47de-b1e3-ba9f31744754 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.446093 Aug 23 10:45:10.969159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1059/2200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:10 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:11.050095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:11.050899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:11.062028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:11.064657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:11.065257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:11.066628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:11.068624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:11.070981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:11.159451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0838f52d-3e91-4816-85ae-4fb99c43043e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c2c7670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:11.285359 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0838f52d-3e91-4816-85ae-4fb99c43043e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.129446 Aug 23 10:45:11.285784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.295470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1060/2201] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:11 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:11.300487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.302196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.305454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:11.305977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6111cd44-85b4-424d-b15b-59dc8039714b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.258828 Aug 23 10:45:11.306597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:11.314646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:11.315692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:11.316156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1142/2202] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:11 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:11.316925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:11.318322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:11.319083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:11.319842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:11.422834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.433656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.435487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.438691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78cb423f-35af-42dc-b805-c5cf6dbe182b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1330 microversion: 2.57 time: 0.140847 Aug 23 10:45:11.439884 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1061/2203] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:11 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1330 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:11.444884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:11.445714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:11.453836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:11.454437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:11.455010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:11.455912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:11.456478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:11.457111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:11.604527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:11.613276 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2c25fb3-c62a-4faf-9e76-c54f2b60d856 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.173331 Aug 23 10:45:11.613923 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1143/2204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:11 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:11.993079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:11.993914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:12.002426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.003170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.003703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.004494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.005192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.005652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.106704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:12.107518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:12.116323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.117157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.117767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.118669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.119294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.119898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.150034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:12.152360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.161977 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d25159c2-0238-48ac-8764-c1d2a68d86b6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.174148 Aug 23 10:45:12.170060 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1062/2205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:11 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:12.246646 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-755c74ab-578c-432c-8906-ad29285fe037 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 204 len: 0 microversion: 2.1 time: 0.143388 Aug 23 10:45:12.251408 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1144/2206] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:45:12 2022] DELETE /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:45:12.257271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:12.258329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:12.265212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.266104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.266771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.267934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.268607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.269448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.302617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14188c36-20bc-4ffe-8c76-bedd41c79ed8 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c52c040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:12.386196 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14188c36-20bc-4ffe-8c76-bedd41c79ed8 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.088039 Aug 23 10:45:12.389116 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1145/2207] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:12 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:12.400716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:12.401692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:12.416573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.421058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.421660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.422698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.423373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.424021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.475848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.486708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46b7e771-a5af-49f8-acc5-c86daac7798b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1666 microversion: 2.1 time: 0.234139 Aug 23 10:45:12.488008 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1063/2208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:12 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1666 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:12.502105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:12.503249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:12.513423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.514060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.514596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.515666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.516183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.516878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.645641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.659317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.664718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.667530 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cfe9f20-6f07-4bee-8204-5a992ee50efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1338 microversion: 2.57 time: 0.178190 Aug 23 10:45:12.671866 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1064/2209] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:12 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:12.681868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.693865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:12.695084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.695592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:12.700022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.703688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1808232-62b8-4681-bf46-5d7163de1061 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.312085 Aug 23 10:45:12.704676 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1146/2210] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:12 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:12.719993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.720520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.720996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.721863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:12.724921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:12.725939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:12.905375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:12.918247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3615121-040e-4de8-a5d3-08e599be21ae tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.243359 Aug 23 10:45:12.920820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1065/2211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:12 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:13.184424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:13.185299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:13.191422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.191923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.192698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.193468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.195009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.201065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.224284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:13.371961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.379918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cfc3af9d-8ba9-42d8-8037-8197df217501 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.199335 Aug 23 10:45:13.380499 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1147/2212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:13 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:13.404433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-903d3983-6886-4ffe-8d58-f9d945947c1f tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c483e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:13.456323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-903d3983-6886-4ffe-8d58-f9d945947c1f tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.055969 Aug 23 10:45:13.457084 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1066/2213] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:13 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:13.516125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:13.516794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:13.525655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.527104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.527761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.529599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.530484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.530982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.675465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:13.682822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.690890 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-709f2823-e69c-42d2-9a4a-12ceb73a4042 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1666 microversion: 2.1 time: 0.178679 Aug 23 10:45:13.691469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1148/2214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:13 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1666 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:13.696833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:13.697483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:13.704480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.705054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.705731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.706500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.706961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.707455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.729168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:13.729869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:13.736019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.736521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.737011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.737733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.738201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.738634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.781352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.792729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.794464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.795714 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e08f756-0008-4a1c-8de6-b7db4287609d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.103275 Aug 23 10:45:13.796369 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1067/2215] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:13 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:13.879692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.889175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.891132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:13.892455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-502d8c13-1110-48f6-b566-dcec590dabfd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.167851 Aug 23 10:45:13.893214 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1149/2216] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:13 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:13.941824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:13.942447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:13.949327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.949838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.950287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:13.951015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:13.951477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:13.951905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.195563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:14.210098 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af0a76f8-b9cd-4a7f-a136-6cd8340cd6cd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.271853 Aug 23 10:45:14.211052 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1068/2217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:13 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:14.401044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:14.401776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:14.409996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.410572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.411077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.412052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.412838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.413394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.473377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5829bc7-dbf5-4008-9421-2c65a8f2d95e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c42aaf0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:14.531040 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5829bc7-dbf5-4008-9421-2c65a8f2d95e tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.063177 Aug 23 10:45:14.532214 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1069/2218] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:14 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:14.646392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:14.656895 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3843bab2-ed90-45b0-a75a-4156805d1ec8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.260153 Aug 23 10:45:14.657800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1150/2219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:14 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:14.715608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:14.717115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:14.727623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.728598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.729545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.730447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.731250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.732070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.814684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:14.821983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:14.822621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:14.830554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.832277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.835365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.836450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.836978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.839802 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2bc86af-2a25-44d8-b78f-9ee218b857db tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1599 microversion: 2.1 time: 0.131825 Aug 23 10:45:14.840385 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1070/2220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:14 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1599 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:14.853211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.918735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5156f904-be3a-4670-9014-de5f48433108 req-3ea65124-2b7e-4bf0-bb49-12314474c21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "name": "network-vif-plugged", "status": "completed", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:14.931150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5156f904-be3a-4670-9014-de5f48433108 req-3ea65124-2b7e-4bf0-bb49-12314474c21a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.931823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5156f904-be3a-4670-9014-de5f48433108 req-3ea65124-2b7e-4bf0-bb49-12314474c21a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.932567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5156f904-be3a-4670-9014-de5f48433108 req-3ea65124-2b7e-4bf0-bb49-12314474c21a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.942722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:14.947395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5156f904-be3a-4670-9014-de5f48433108 req-3ea65124-2b7e-4bf0-bb49-12314474c21a service nova] Creating event network-vif-plugged:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:45:14.953708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5156f904-be3a-4670-9014-de5f48433108 req-3ea65124-2b7e-4bf0-bb49-12314474c21a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043361 Aug 23 10:45:14.954722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1071/2221] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:14.961400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:14.962488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:14.967673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:14.969098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:14.973108 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5e37ab8-151c-4431-b7ec-9efc6d4f44ea tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.153593 Aug 23 10:45:14.973403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.974132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.974825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:14.976530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1151/2222] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:14 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:14.977565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:14.978277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:14.978932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.162050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:15.177885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:15.179633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:15.181020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b925b56-deab-4010-ab30-d9bdc70eb3d1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.224868 Aug 23 10:45:15.182143 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1072/2223] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:14 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:15.233948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:15.234749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:15.242448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.243134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.243688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.244664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.245263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.245822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.524383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:15.532478 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ce82ce5-dcad-4b7f-af1e-ffe405e78835 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.303381 Aug 23 10:45:15.533081 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1152/2224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:15 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:15.547805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65bf1103-cd6b-4924-8625-eb0e50ef032c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c42a9d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:15.563553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-41b5512a-8fcd-49c7-885e-95e0e717987a req-fdb29c55-e1d5-4a7f-b7be-1a0826986eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b74d026-1d35-4393-95b4-2ac77f28b3d1", "name": "network-vif-deleted", "tag": "ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:15.574651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-41b5512a-8fcd-49c7-885e-95e0e717987a req-fdb29c55-e1d5-4a7f-b7be-1a0826986eec service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.575152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-41b5512a-8fcd-49c7-885e-95e0e717987a req-fdb29c55-e1d5-4a7f-b7be-1a0826986eec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.575594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-41b5512a-8fcd-49c7-885e-95e0e717987a req-fdb29c55-e1d5-4a7f-b7be-1a0826986eec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.588608 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-41b5512a-8fcd-49c7-885e-95e0e717987a req-fdb29c55-e1d5-4a7f-b7be-1a0826986eec service nova] Creating event network-vif-deleted:ab9a3d5b-e17e-4bc2-9daa-ca6044a9337b for instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 on n-h2-847009-13 Aug 23 10:45:15.595923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-41b5512a-8fcd-49c7-885e-95e0e717987a req-fdb29c55-e1d5-4a7f-b7be-1a0826986eec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036009 Aug 23 10:45:15.597143 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1153/2225] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:15.606804 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65bf1103-cd6b-4924-8625-eb0e50ef032c tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.063345 Aug 23 10:45:15.607394 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1073/2226] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:15 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:15.680877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:15.682011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:15.689551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.690092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.690612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.691403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.691943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.692457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.835403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:15.844980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a5559731-a291-4e0b-ba24-3d9ff50280f5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.168249 Aug 23 10:45:15.845190 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1154/2227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:15 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:15.864147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:15.864829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:15.872905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.873955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.874404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.875203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.875668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.876099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.911716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:15.912209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:15.913375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:15.913828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lazy-loading 'fault' on Instance uuid 4b74d026-1d35-4393-95b4-2ac77f28b3d1 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:15.964462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:15.974179 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac1195e2-7a89-4794-a04e-04e8899dfa64 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 200 len: 1324 microversion: 2.1 time: 0.113914 Aug 23 10:45:15.987261 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1074/2228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:15 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:16.000339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:16.000993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:16.007702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.008295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.008965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.009724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.010526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.010916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.080892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.090217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.091717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.092875 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9967cae5-2a7c-4c88-9893-076197041efe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.096667 Aug 23 10:45:16.093487 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1155/2229] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:15 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:16.205779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:16.206403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:16.213053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.213543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.213983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.214685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.215140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.215563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.359142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.369273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.370788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.372228 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a93ba1fc-042a-4f55-91e0-b09a3d8a1afd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.170528 Aug 23 10:45:16.372796 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1075/2230] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:16 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:16.555695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:16.557981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:16.566696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.567308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.567948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.570084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.570803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.571476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.623319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce930d56-570b-492a-b47b-6b06dee7f609 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c418e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:16.675643 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce930d56-570b-492a-b47b-6b06dee7f609 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.056796 Aug 23 10:45:16.676634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1076/2231] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:16 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:16.717624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:16.726178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-081b8165-007a-4708-8b94-030eb08184bd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.176066 Aug 23 10:45:16.726870 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1156/2232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:16 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:16.867899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:16.868574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:16.876764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.877295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.877748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.878483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:16.878962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:16.879401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:16.995578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:16.996462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 4b74d026-1d35-4393-95b4-2ac77f28b3d1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:17.002608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.003176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.003686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.004469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.005045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.005543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.015433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.020350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] HTTP exception thrown: Instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 could not be found. Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Request method failure captured: Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 HTTP/1.1 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3uYvEcGwHulOdBXN2iUutwVoXa27Zon45otswRHHR9kVZFNebDMpJkITNpXivUsmUFQM0QvFrnPNkcaaa0ObV-_0xPV8tHThA1HgH2mbUKud1pFKZDIFF4AKqordLArUekzRG6Bt4ZzN452p21EXp92HgXWM6-2_U93Y8Dvi2h4zs Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1482830f506e4e79b82c0bf9fb3b11ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}] Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveMigrationTest-2112330571-project Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: b2ac0227a26f41c8a9b5c89cddea52f5 Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveMigrationTest-2112330571-project Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 could not be found. Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '4b74d026-1d35-4393-95b4-2ac77f28b3d1'} Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 could not be found. Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 could not be found. Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:17.022631 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 could not be found. Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:17.027692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Returning 404 to user: Instance 4b74d026-1d35-4393-95b4-2ac77f28b3d1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:17.028521 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffa77367-48dd-4133-b7fa-f88e57f9cae5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.161084 Aug 23 10:45:17.028723 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8246772a-d268-4901-a05d-23214d53395b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1" status: 404 len: 111 microversion: 2.1 time: 0.033209 Aug 23 10:45:17.028723 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1157/2233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:16 2022] GET /compute/v2.1/servers/4b74d026-1d35-4393-95b4-2ac77f28b3d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:45:17.031833 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1077/2234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:16 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:17.036623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b6f8318-cd7a-47ed-b9bb-947dd675f23f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '.version_select at 0x7fdc9c420af0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.041167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e8481783-ac61-4ed4-8071-fb79c7919dfd req-842acedb-aeee-4fcc-af61-b3cfee6c7ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b29ed9-4389-495c-9325-4a61d3826826", "name": "network-vif-plugged", "status": "completed", "tag": "bca1e81a-30cb-4864-862b-0a93a9b95003"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:17.050862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e8481783-ac61-4ed4-8071-fb79c7919dfd req-842acedb-aeee-4fcc-af61-b3cfee6c7ca8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.051344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e8481783-ac61-4ed4-8071-fb79c7919dfd req-842acedb-aeee-4fcc-af61-b3cfee6c7ca8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.051782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e8481783-ac61-4ed4-8071-fb79c7919dfd req-842acedb-aeee-4fcc-af61-b3cfee6c7ca8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.059811 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b6f8318-cd7a-47ed-b9bb-947dd675f23f tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574761953" status: 202 len: 0 microversion: 2.1 time: 0.026735 Aug 23 10:45:17.060396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1078/2235] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574761953 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:17.065300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e8481783-ac61-4ed4-8071-fb79c7919dfd req-842acedb-aeee-4fcc-af61-b3cfee6c7ca8 service nova] Creating event network-vif-plugged:bca1e81a-30cb-4864-862b-0a93a9b95003 for instance 97b29ed9-4389-495c-9325-4a61d3826826 on n-h2-847009-13 Aug 23 10:45:17.070857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e8481783-ac61-4ed4-8071-fb79c7919dfd req-842acedb-aeee-4fcc-af61-b3cfee6c7ca8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044034 Aug 23 10:45:17.071500 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1158/2236] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:17.117307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.118032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:17.121531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:17.126248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.126825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.127343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.128145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.128617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.129078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.212481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.221474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.223870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.228370 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b76b6e9-ba34-4fee-99e9-b438497114ff tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.112612 Aug 23 10:45:17.228370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1079/2237] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:17 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:17.396421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.398099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:17.404131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.404701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.405264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.406043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.406584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.407088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.546967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.555848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.557488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.558706 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53209342-65af-4c66-8dbf-20a3529f8c47 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.166839 Aug 23 10:45:17.559484 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1159/2238] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:17 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:17.691763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df3844c5-0cfd-4f73-8437-4b72d16a42d9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c2c7820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.703448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.703953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:17.711787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.712276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.712765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.713495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.714089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.714389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.738610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df3844c5-0cfd-4f73-8437-4b72d16a42d9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.050843 Aug 23 10:45:17.739269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1080/2239] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:17 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:17.742763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:17.747291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.747939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:17.754016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.754516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.754984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.755696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.756750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.757193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.776471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:17.823581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09181a05-a645-4001-80b4-ab339a8c84e7 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 204 len: 0 microversion: 2.1 time: 0.123601 Aug 23 10:45:17.824186 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1160/2240] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:45:17 2022] DELETE /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:45:17.832875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:17.833590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:17.836152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:17.842251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.842747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.843186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.843891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:17.844374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:17.844836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:17.900225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.908258 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db47a283-7ade-40cd-b73d-8361c183082b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.165141 Aug 23 10:45:17.909021 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1081/2241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:17 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:17.989305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:17.998147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49b0af35-0468-408e-8085-ca096a90ce76 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1482 microversion: 2.1 time: 0.169562 Aug 23 10:45:17.998655 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1161/2242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:17 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1482 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:18.062068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:18.062674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:18.072211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.072715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.073193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.073910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.074372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.074804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.205053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.212648 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0296e766-974d-44d0-be5d-979d7ce4dbe9 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.171596 Aug 23 10:45:18.213236 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1082/2243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:18 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:18.250462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:18.251129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:18.258182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.258675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.259115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.259814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.260274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.260702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.325584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.333662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.335409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.336541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-330e646f-4e93-4124-aba0-d557067b3792 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.090521 Aug 23 10:45:18.337141 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1162/2244] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:18 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:18.582250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:18.582864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:18.589051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.589667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.590115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.590820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.591281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.591715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.727421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.735878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.737454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:18.738689 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd917bfc-717f-40a8-9176-6ccf06d11370 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.160508 Aug 23 10:45:18.739256 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1083/2245] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:18 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:18.753645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e8585c44-abc7-48d0-8422-8c914f4e069f tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c539dc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:18.800194 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e8585c44-abc7-48d0-8422-8c914f4e069f tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.050472 Aug 23 10:45:18.800930 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1163/2246] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:18 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:18.932833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:18.933545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:18.941349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.942225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.942896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:18.944362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:18.944950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:18.945515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.018463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=14 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:19.022843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:19.023470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:19.030172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.030665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.031109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.031823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.032288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.032725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.079412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.087357 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb39d4ec-5594-44e7-ab82-7fb8c53e5e1c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.159758 Aug 23 10:45:19.087856 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1084/2247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:18 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:19.163801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.171662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b3aec2c-daf8-426f-9230-843b0724ff03 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1482 microversion: 2.1 time: 0.154808 Aug 23 10:45:19.172232 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1164/2248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:19 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1482 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:19.232503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:19.233148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:19.234990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:19.240474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.241115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.241530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.242229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.242692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.243116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.359884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:19.360525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:19.369976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.370467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.370902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.372519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.373028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.373635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.379723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.389155 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76c428b8-19f0-40e8-b5ad-0349e7f209a7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1315 microversion: 2.1 time: 0.160420 Aug 23 10:45:19.401186 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1085/2249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:19 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:19.401310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:19.448197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.457240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.458772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.461099 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35caf1ad-fc03-4030-82da-63ed71a15793 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.105359 Aug 23 10:45:19.461684 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1165/2250] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:19 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:19.763389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:19.764017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:19.770834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.771322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.771798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.772602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.773102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.773675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.815539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4264e74-4930-4883-9f88-6c30367daca7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdca1dae160>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:19.869686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4264e74-4930-4883-9f88-6c30367daca7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.058032 Aug 23 10:45:19.870533 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1166/2251] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:19 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:19.939028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-bd8ea646-2099-4433-80c4-0aea37ae65dd req-0ff6420c-f4f5-44c6-a682-d1dd98af0386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd1d2a11-c639-47c1-8987-849de67c63ba", "name": "network-vif-deleted", "tag": "5b1d8b1c-42fc-4d01-a50a-853265d4ec13"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:19.939240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.949637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.951198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:19.953748 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-026ad82d-69dd-480e-89b9-7ba4c0d78193 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.194479 Aug 23 10:45:19.954318 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1086/2252] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:19 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:19.954556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bd8ea646-2099-4433-80c4-0aea37ae65dd req-0ff6420c-f4f5-44c6-a682-d1dd98af0386 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:19.955150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bd8ea646-2099-4433-80c4-0aea37ae65dd req-0ff6420c-f4f5-44c6-a682-d1dd98af0386 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:19.955691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bd8ea646-2099-4433-80c4-0aea37ae65dd req-0ff6420c-f4f5-44c6-a682-d1dd98af0386 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:19.984098 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-bd8ea646-2099-4433-80c4-0aea37ae65dd req-0ff6420c-f4f5-44c6-a682-d1dd98af0386 service nova] Creating event network-vif-deleted:5b1d8b1c-42fc-4d01-a50a-853265d4ec13 for instance fd1d2a11-c639-47c1-8987-849de67c63ba on n-h2-847009-13 Aug 23 10:45:19.990722 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-bd8ea646-2099-4433-80c4-0aea37ae65dd req-0ff6420c-f4f5-44c6-a682-d1dd98af0386 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055522 Aug 23 10:45:19.991536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1167/2253] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:20.107470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:20.108019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:20.114106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.114593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.115031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.115754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.116391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.116856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.138397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=18 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:20.194787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:20.195660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:20.202176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.202670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.203113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.203820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.204283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.204715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.244313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.244827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.245273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.245726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lazy-loading 'fault' on Instance uuid fd1d2a11-c639-47c1-8987-849de67c63ba {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:20.253973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:20.262909 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7bc9f55-a653-4146-93cf-f0280ed55569 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.159318 Aug 23 10:45:20.264124 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1087/2254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:20 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:20.290777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:20.298629 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73fe3477-4a05-4ce3-9597-2cfeee700579 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 200 len: 1299 microversion: 2.1 time: 0.109523 Aug 23 10:45:20.299176 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1168/2255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:20 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:20.411343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:20.411958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:20.418148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.418636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.419071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.419768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.420227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.420679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.484982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:20.485612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:20.493020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.493528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.493973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.494699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.495169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.495604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.565710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:20.566471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:20.574686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23307315-74d1-495a-86c2-2c0b26e96992 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1504 microversion: 2.1 time: 0.167190 Aug 23 10:45:20.575269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1088/2256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:20 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:20.576989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:20.578530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:20.579681 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6cb4b7a9-0701-46cb-b612-00f8c26c6027 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1336 microversion: 2.57 time: 0.098700 Aug 23 10:45:20.580472 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1169/2257] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:20 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:20.595989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1465320229"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:20.596549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:20.602721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.603223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.604034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.604943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:20.605759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:20.606380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:20.736961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.security_group_api [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Adding security group a712912d-afcb-4832-96bc-90077728d3ca to port bca1e81a-30cb-4864-862b-0a93a9b95003 Aug 23 10:45:20.896089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fa34f817-4821-482c-a7c2-7358881396f4 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c57cf70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:20.991798 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fa34f817-4821-482c-a7c2-7358881396f4 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.107269 Aug 23 10:45:20.993006 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1170/2258] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:20 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:20.998022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:20.998854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.005067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.005566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.006012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.007285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.007749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.008184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.138595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54d69c1b-1d86-414d-92ff-e66a875c5dc7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826/action" status: 202 len: 0 microversion: 2.1 time: 0.547478 Aug 23 10:45:21.139749 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1089/2259] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:20 2022] POST /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:21.147342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1598744020"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:21.148108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.157038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.157541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.157985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.158699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.159159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.159586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.235414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.248050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.250363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.251855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a5dbe46-4d88-4126-8232-9c8985c04dc6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.257743 Aug 23 10:45:21.268283 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1171/2260] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:20 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:21.278146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-dff190db-794a-46c6-8267-8eb0ae514efc req-a04fdbb0-aa21-45a4-89d3-8ed4ee3a6409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b29ed9-4389-495c-9325-4a61d3826826", "tag": "bca1e81a-30cb-4864-862b-0a93a9b95003"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:21.301929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dff190db-794a-46c6-8267-8eb0ae514efc req-a04fdbb0-aa21-45a4-89d3-8ed4ee3a6409 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.302769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dff190db-794a-46c6-8267-8eb0ae514efc req-a04fdbb0-aa21-45a4-89d3-8ed4ee3a6409 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.304074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dff190db-794a-46c6-8267-8eb0ae514efc req-a04fdbb0-aa21-45a4-89d3-8ed4ee3a6409 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.335585 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-dff190db-794a-46c6-8267-8eb0ae514efc req-a04fdbb0-aa21-45a4-89d3-8ed4ee3a6409 service nova] Creating event network-changed:bca1e81a-30cb-4864-862b-0a93a9b95003 for instance 97b29ed9-4389-495c-9325-4a61d3826826 on n-h2-847009-13 Aug 23 10:45:21.342283 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.security_group_api [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Adding security group 799a22ac-eb01-4af6-b61d-e7d3005e6630 to port bca1e81a-30cb-4864-862b-0a93a9b95003 Aug 23 10:45:21.350467 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-dff190db-794a-46c6-8267-8eb0ae514efc req-a04fdbb0-aa21-45a4-89d3-8ed4ee3a6409 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080230 Aug 23 10:45:21.354877 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1172/2261] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:21.363728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:21.367638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.394386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.397393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.398266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.399738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.401525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.403381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.730515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.739187 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df69e924-800d-48fc-977b-ff415ceed16b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.382687 Aug 23 10:45:21.741353 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1173/2262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:21 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:21.746880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:21.747763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: fd1d2a11-c639-47c1-8987-849de67c63ba] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.754139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.754892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.755564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.757162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.757839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.758285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.773474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] HTTP exception thrown: Instance fd1d2a11-c639-47c1-8987-849de67c63ba could not be found. Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Request method failure captured: Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba HTTP/1.1 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK3uYvEcGwHulOdBXN2iUutwVoXa27Zon45otswRHHR9kVZFNebDMpJkITNpXivUsmUFQM0QvFrnPNkcaaa0ObV-_0xPV8tHThA1HgH2mbUKud1pFKZDIFF4AKqordLArUekzRG6Bt4ZzN452p21EXp92HgXWM6-2_U93Y8Dvi2h4zs Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1482830f506e4e79b82c0bf9fb3b11ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}] Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveMigrationTest-2112330571-project Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: b2ac0227a26f41c8a9b5c89cddea52f5 Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveMigrationTest-2112330571-project Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fd1d2a11-c639-47c1-8987-849de67c63ba could not be found. Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fd1d2a11-c639-47c1-8987-849de67c63ba'} Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd1d2a11-c639-47c1-8987-849de67c63ba could not be found. Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd1d2a11-c639-47c1-8987-849de67c63ba could not be found. Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:21.775167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd1d2a11-c639-47c1-8987-849de67c63ba could not be found. Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:21.780360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Returning 404 to user: Instance fd1d2a11-c639-47c1-8987-849de67c63ba could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:21.782216 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-197d754a-1272-40b6-88b7-7a4a19ee5f3b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba" status: 404 len: 111 microversion: 2.1 time: 0.038248 Aug 23 10:45:21.782216 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1174/2263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:21 2022] GET /compute/v2.1/servers/fd1d2a11-c639-47c1-8987-849de67c63ba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:21.787300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:21.788306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.794882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.795544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.796312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.797268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.798079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.798736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.807287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08275d60-7ae5-44de-9ef9-23cd3d9efb7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826/action" status: 202 len: 0 microversion: 2.1 time: 0.663473 Aug 23 10:45:21.812924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1090/2264] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:21 2022] POST /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:21.823347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:21.824028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.832960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.833842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.834738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.836095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.836968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.837955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.870766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:21.968119 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-282d0587-adcd-4bfe-bf90-fec50b846471 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "DELETE /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 204 len: 0 microversion: 2.1 time: 0.153275 Aug 23 10:45:21.968387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.971982 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1091/2265] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:45:21 2022] DELETE /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:45:21.978833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:21.979820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:21.985330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.986341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.986844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.986967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:21.987293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.988029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:21.988151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-877f9123-346f-4eef-bc49-50b45cf88850 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1357 microversion: 2.57 time: 0.205313 Aug 23 10:45:21.988487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:21.988957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:21.989077 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1175/2266] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:21 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:21.993699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:21.994317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:22.000624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.001167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.001634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.002346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.002809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.003242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.163394 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-319fbec2-e424-436b-958a-0f7374996b2a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.188872 Aug 23 10:45:22.164005 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1092/2267] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Aug 23 10:45:21 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826/os-security-groups => generated 1159 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:22.169759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6bb4375-8c01-40b8-abe6-f23c0aec35dd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4a7700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.181838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.191162 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f4837e6-efec-4a34-b72d-fc35637b33ac tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1499 microversion: 2.1 time: 0.201152 Aug 23 10:45:22.191843 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1176/2268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:21 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:22.198506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:22.201495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:22.208220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.208823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.210147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.211388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.212084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.212778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.230227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6bb4375-8c01-40b8-abe6-f23c0aec35dd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.064687 Aug 23 10:45:22.230741 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1093/2269] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:22 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:22.236119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e0dd8fc8-5190-4d98-bebc-e712f34d229b req-f49da6fb-1484-47dd-9233-a5612b96c23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a99b54b-9efa-4cb1-bb53-13aff5876ae3", "name": "network-vif-unplugged", "status": "completed", "tag": "f7bdb065-4ecc-458e-a69b-2c937dec02eb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:22.249432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0dd8fc8-5190-4d98-bebc-e712f34d229b req-f49da6fb-1484-47dd-9233-a5612b96c23b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.250036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0dd8fc8-5190-4d98-bebc-e712f34d229b req-f49da6fb-1484-47dd-9233-a5612b96c23b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.250547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0dd8fc8-5190-4d98-bebc-e712f34d229b req-f49da6fb-1484-47dd-9233-a5612b96c23b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.264307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e0dd8fc8-5190-4d98-bebc-e712f34d229b req-f49da6fb-1484-47dd-9233-a5612b96c23b service nova] Creating event network-vif-unplugged:f7bdb065-4ecc-458e-a69b-2c937dec02eb for instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 on n-h2-847009-13 Aug 23 10:45:22.271524 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e0dd8fc8-5190-4d98-bebc-e712f34d229b req-f49da6fb-1484-47dd-9233-a5612b96c23b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038909 Aug 23 10:45:22.273386 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1094/2270] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:22.282109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75ead691-e80f-4530-8a32-a01697530a74 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c418af0>, body: {"security_group": {"name": " tempest-securitygroup -828240303 ", "description": "tempest-description-355609551"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:22.311688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:22.312126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:22.312615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:22.313064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:22.313509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:22.408787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:22.417734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.419024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.419490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.420656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.421551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.421965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.458623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7f3c97ad-9365-4d71-90e6-2f620f90f825 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "POST /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac/action" status: 202 len: 1138 microversion: 2.57 time: 0.265478 Aug 23 10:45:22.459495 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1177/2271] 10.222.0.78 () {62 vars in 1320 bytes} [Tue Aug 23 10:45:22 2022] POST /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac/action => generated 1138 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 23 10:45:22.464722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.465155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:22.478283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.478900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.479433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.480442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.480935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.481437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.481566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75ead691-e80f-4530-8a32-a01697530a74 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.204795 Aug 23 10:45:22.489014 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1095/2272] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:22 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:22.489014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.489014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:22.499431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.500375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.501199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.502126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.502809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.503545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.576732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.586801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.588600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.591862 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eae208d6-d8e5-4ada-92ce-863d3c3a914e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.108152 Aug 23 10:45:22.605987 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1096/2273] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:22 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:22.615145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a447cb6a-5c93-4efd-9cdd-4e7752e87b7e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c2d7e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.670160 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a447cb6a-5c93-4efd-9cdd-4e7752e87b7e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012" status: 200 len: 222 microversion: 2.1 time: 0.062679 Aug 23 10:45:22.670957 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1097/2274] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:45:22 2022] GET /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012 => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:22.684088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b9a08a9-ab2e-414f-96d5-bafa620af953 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d5e65e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.732774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.747076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.751395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:22.753430 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1477609b-acf7-44dc-b5ec-a9801824fedc tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.292406 Aug 23 10:45:22.766506 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1178/2275] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:22 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:22.781453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.782316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:22.789643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.790443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.791105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.792069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:22.792768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:22.793405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:22.884788 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b9a08a9-ab2e-414f-96d5-bafa620af953 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012" status: 202 len: 0 microversion: 2.1 time: 0.205253 Aug 23 10:45:22.885386 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1098/2276] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:22 2022] DELETE /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:45:22.893587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c420a60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:22.930834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:22.931719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:22.932265 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.932265 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012 HTTP/1.1 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '28b65280-e648-45b4-ac1d-e5b1e2d3b012'} Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:22.935407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-5abc79c3-e7c1-4a4a-873b-2493e4037477'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7dc2b00-bb49-4cd0-bcb9-517d7ad82385 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012" status: 404 len: 194 microversion: 2.1 time: 0.047590 Aug 23 10:45:22.940484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1099/2277] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:45:22 2022] GET /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:45:22.950739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1caf84fd-25fb-482b-be4e-46f4036cd155 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c3c7280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1973485768", "description": "tempest-description-434386126"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:22.999722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:23.008226 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a9b13d0-4302-4cc7-b8ac-618507922fcd tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1470 microversion: 2.1 time: 0.232660 Aug 23 10:45:23.008930 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1179/2278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:22 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:23.151715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1caf84fd-25fb-482b-be4e-46f4036cd155 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.206548 Aug 23 10:45:23.152905 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1100/2279] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:23.171693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e0bf0a5-d46f-4b8c-835e-ca5264345955 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdca1e6ec10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1849378065", "description": "tempest-description-1358865308"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:23.213884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:23.214506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:23.230116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.230882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.231492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.235752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.236446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.238882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.465715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:23.475879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cecc7966-af06-4b8d-a31d-ad139d7a3e94 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1499 microversion: 2.1 time: 0.266572 Aug 23 10:45:23.478577 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1101/2280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:23 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1499 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:23.489806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d94baac-0a2b-47ce-a3b1-1e5d882f6370 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c45ae50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:23.582947 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d94baac-0a2b-47ce-a3b1-1e5d882f6370 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.103098 Aug 23 10:45:23.596073 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1102/2281] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:23 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:23.602303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-01993006-5881-49ea-8f44-35d66a747abf req-a92cec38-87f2-4233-b837-cbaf9b426b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b29ed9-4389-495c-9325-4a61d3826826", "tag": "bca1e81a-30cb-4864-862b-0a93a9b95003"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:23.624851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-01993006-5881-49ea-8f44-35d66a747abf req-a92cec38-87f2-4233-b837-cbaf9b426b25 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.625329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-01993006-5881-49ea-8f44-35d66a747abf req-a92cec38-87f2-4233-b837-cbaf9b426b25 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.625763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-01993006-5881-49ea-8f44-35d66a747abf req-a92cec38-87f2-4233-b837-cbaf9b426b25 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.639284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-01993006-5881-49ea-8f44-35d66a747abf req-a92cec38-87f2-4233-b837-cbaf9b426b25 service nova] Creating event network-changed:bca1e81a-30cb-4864-862b-0a93a9b95003 for instance 97b29ed9-4389-495c-9325-4a61d3826826 on n-h2-847009-13 Aug 23 10:45:23.645013 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-01993006-5881-49ea-8f44-35d66a747abf req-a92cec38-87f2-4233-b837-cbaf9b426b25 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047685 Aug 23 10:45:23.645795 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1103/2282] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:23.655264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:23.656261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:23.668493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.669104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.669590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.670572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.671386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.671985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.779489 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e0bf0a5-d46f-4b8c-835e-ca5264345955 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.617345 Aug 23 10:45:23.780686 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1180/2283] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:23.786416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:23.789471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:23.796520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.797845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.798882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.799868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:23.800557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:23.801689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:23.808293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:23.819028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:23.823039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:23.827382 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dda756eb-8a9e-4964-92b6-d97acaef5163 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.179672 Aug 23 10:45:23.846521 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1104/2284] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:23 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:23.863507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afdd15ca-1413-4de3-8a55-7086ecfe45e7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c47b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-856787851", "description": "tempest-description-800214542"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:24.216182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afdd15ca-1413-4de3-8a55-7086ecfe45e7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.367522 Aug 23 10:45:24.217841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1105/2285] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:24.246239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:24.250473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:24.274810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:24.275743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:24.276422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:24.277797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:24.280647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:24.284110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:24.299856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:24.316305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:24.317962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:24.320193 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7745b07b-f411-40b0-94f2-741953099339 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.538376 Aug 23 10:45:24.320923 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1181/2286] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:23 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:24.329036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-94aa52e4-36e6-4330-8c0d-2b9f98bdd1a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c520670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:24.671723 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-94aa52e4-36e6-4330-8c0d-2b9f98bdd1a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.349062 Aug 23 10:45:24.672664 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1182/2287] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:45:24 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:24.678625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-af504eec-acc3-4b5f-b6bf-81e44cc6db83 req-035438d2-d1a6-4a39-a60c-d201b20228d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a99b54b-9efa-4cb1-bb53-13aff5876ae3", "tag": "f7bdb065-4ecc-458e-a69b-2c937dec02eb"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:24.697079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-af504eec-acc3-4b5f-b6bf-81e44cc6db83 req-035438d2-d1a6-4a39-a60c-d201b20228d4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:24.697704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-af504eec-acc3-4b5f-b6bf-81e44cc6db83 req-035438d2-d1a6-4a39-a60c-d201b20228d4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:24.698485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-af504eec-acc3-4b5f-b6bf-81e44cc6db83 req-035438d2-d1a6-4a39-a60c-d201b20228d4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:24.713977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-af504eec-acc3-4b5f-b6bf-81e44cc6db83 req-035438d2-d1a6-4a39-a60c-d201b20228d4 service nova] Creating event network-changed:f7bdb065-4ecc-458e-a69b-2c937dec02eb for instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 on n-h2-847009-13 Aug 23 10:45:24.719534 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-af504eec-acc3-4b5f-b6bf-81e44cc6db83 req-035438d2-d1a6-4a39-a60c-d201b20228d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045254 Aug 23 10:45:24.725394 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1183/2288] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:24.732214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:24.732882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:24.741250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:24.742059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:24.742750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:24.743664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:24.745001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:24.745813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:24.792467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:24.793341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:24.793797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:24.794485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lazy-loading 'fault' on Instance uuid 918f1dd3-6cf0-4039-955b-30877b478575 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:24.853139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:24.877855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f474e24b-f7f9-4f9b-b283-1092f2e8935b tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1300 microversion: 2.1 time: 0.150812 Aug 23 10:45:24.878664 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1184/2289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:24 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:24.907455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c64db140-0c3b-41ae-aa74-7409b0606cb9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9cded670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:24.968027 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c64db140-0c3b-41ae-aa74-7409b0606cb9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.072109 Aug 23 10:45:24.969457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1185/2290] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:24 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:24.975553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c30c66a-e1d3-464d-bd38-0367b98e58e1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d13e700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.031251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.045488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:25.048064 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ff35c14-ee0e-41ca-a728-0ca9f7c95964 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.828815 Aug 23 10:45:25.055010 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1106/2291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:24 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:25.078619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.079492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:25.087334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:25.088199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:25.088902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:25.089961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:25.090660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:25.091670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:25.271711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.286883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.291946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.293720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba02f8db-81f9-44d1-8df7-0d0ada9f0e9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.225600 Aug 23 10:45:25.298665 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1107/2292] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:25 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:25.344065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.346333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:25.354554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:25.355294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:25.356679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:25.357670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:25.358388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:25.359093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:25.466717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c30c66a-e1d3-464d-bd38-0367b98e58e1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595" status: 202 len: 0 microversion: 2.1 time: 0.495418 Aug 23 10:45:25.468966 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1186/2293] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:24 2022] DELETE /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:25.477853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdca1e09550>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.510441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:25.511050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:25.511830 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.511830 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595 HTTP/1.1 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '18cafb78-f4d5-486f-8c67-c3e1e069b595'} Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:25.514422 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-3bc71217-d083-4e84-8738-7308e73e690b'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6395327f-8c35-43e4-a8c2-67b758143512 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595" status: 404 len: 194 microversion: 2.1 time: 0.043746 Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1187/2294] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:45:25 2022] GET /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:45:25.559621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc128701-f11f-47ac-96bc-2b9dd5ebcb4c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d10e0d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.634007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.650825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.652781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:25.654009 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-379e6ed9-0c45-4909-9c4f-47d502d0ff25 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.314669 Aug 23 10:45:25.664783 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1108/2295] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:25 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:25.807352 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc128701-f11f-47ac-96bc-2b9dd5ebcb4c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c" status: 202 len: 0 microversion: 2.1 time: 0.283895 Aug 23 10:45:25.808269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1188/2296] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:25 2022] DELETE /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:25.823190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d023dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.886012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:25.887626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group cac52297-e343-4807-ad1c-a9103ecb629c not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:25.888881 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.888881 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c HTTP/1.1 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'cac52297-e343-4807-ad1c-a9103ecb629c'} Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:25.891220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] Aug 23 10:45:25.894024 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:25.903141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.904848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:25.904848 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-081e0398-d301-49ef-9269-ff96cef94dcd'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:25.905331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:25.907080 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22bc7850-6fb0-47b1-b772-f19fcd5926a8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c" status: 404 len: 194 microversion: 2.1 time: 0.094647 Aug 23 10:45:25.910274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1109/2297] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:45:25 2022] GET /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:25.924311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2b74736-97f9-4358-b356-b85a461917c6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c267430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:25.924977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:25.925504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:25.927251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:25.928053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:25.933122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:25.933607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.017296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.017829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.018252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.018701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lazy-loading 'fault' on Instance uuid 918f1dd3-6cf0-4039-955b-30877b478575 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:26.094417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2ac0227a26f41c8a9b5c89cddea52f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1482830f506e4e79b82c0bf9fb3b11ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.098593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:26.106267 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce04ffbb-3500-46e4-bde4-21d6e0adb487 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 200 len: 1300 microversion: 2.1 time: 0.206982 Aug 23 10:45:26.112587 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1189/2298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:25 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:26.118298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bf4e4ff3-96eb-4877-88ce-c83ea6dabaf9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c611e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:26.194831 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bf4e4ff3-96eb-4877-88ce-c83ea6dabaf9 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.079594 Aug 23 10:45:26.195657 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1190/2299] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:26 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:26.207891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:26.208994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:26.216626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.217242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.217895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.218847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.219489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.220146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.267759 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2b74736-97f9-4358-b356-b85a461917c6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c" status: 202 len: 0 microversion: 2.1 time: 0.351506 Aug 23 10:45:26.268779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1110/2300] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:25 2022] DELETE /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:26.277889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c2c7790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:26.308602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:26.309238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:26.309766 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.309766 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c HTTP/1.1 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '161d9538-3d54-4d53-8fd4-2e6c53e9e29c'} Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:26.311681 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-da4b3d61-119f-427e-9902-f12319fcba4f'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:26.314384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fefc1185-d268-407e-bcad-f0067e58a10c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c" status: 404 len: 194 microversion: 2.1 time: 0.040579 Aug 23 10:45:26.320367 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1111/2301] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:45:26 2022] GET /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:45:26.330201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:26.330994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:26.339429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.339928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.340571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.341330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.341798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.342376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.406692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.416291 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d64124fb-114c-47ea-9737-ec74ad6d19c6 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.212393 Aug 23 10:45:26.428955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.430106 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1191/2302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:26 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:26.437220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.437713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64af4007-b5d0-478f-b46a-f4b6af4614ad tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c611ca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:26.439509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.440720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4923be94-2718-4340-a22a-07206f52d067 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.120297 Aug 23 10:45:26.441623 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1112/2303] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:26 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:26.659028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64af4007-b5d0-478f-b46a-f4b6af4614ad tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1159 microversion: 2.1 time: 0.227546 Aug 23 10:45:26.660063 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1192/2304] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:45:26 2022] GET /compute/v2.1/os-security-groups => generated 1159 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:26.683680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:26.684300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:26.688008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-073da8c8-9da5-4462-9ff4-f9ce16068162 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c42ab80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-38587171", "description": "tempest-description-172563017"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:26.691035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.691534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.694387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.694387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.694387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.694387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.893593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.907077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.915779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:26.917289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4aaeae52-340b-4f20-97ed-e688d1694f3d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.237647 Aug 23 10:45:26.928773 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1193/2305] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:26 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:26.928773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f2e3fba7-524c-44f8-887a-203771e5b6b3 req-5f9d0a5d-f6e4-406f-a4c9-fedba2e63033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "918f1dd3-6cf0-4039-955b-30877b478575", "name": "network-vif-deleted", "tag": "f280a4a9-1cc8-4c58-8789-f1ed450d48bc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:26.950033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f2e3fba7-524c-44f8-887a-203771e5b6b3 req-5f9d0a5d-f6e4-406f-a4c9-fedba2e63033 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.950681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f2e3fba7-524c-44f8-887a-203771e5b6b3 req-5f9d0a5d-f6e4-406f-a4c9-fedba2e63033 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:26.951231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f2e3fba7-524c-44f8-887a-203771e5b6b3 req-5f9d0a5d-f6e4-406f-a4c9-fedba2e63033 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:26.966597 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-073da8c8-9da5-4462-9ff4-f9ce16068162 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.290046 Aug 23 10:45:26.967645 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1113/2306] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:26 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:26.972416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8f692dbb-dcf0-4b01-9c5a-9491bb9a8453 req-ec824f03-6c3e-4400-84d6-03075ea966be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "name": "network-vif-unplugged", "status": "completed", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:26.991975 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f2e3fba7-524c-44f8-887a-203771e5b6b3 req-5f9d0a5d-f6e4-406f-a4c9-fedba2e63033 service nova] Creating event network-vif-deleted:f280a4a9-1cc8-4c58-8789-f1ed450d48bc for instance 918f1dd3-6cf0-4039-955b-30877b478575 on n-h2-847009-13 Aug 23 10:45:26.995308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f692dbb-dcf0-4b01-9c5a-9491bb9a8453 req-ec824f03-6c3e-4400-84d6-03075ea966be service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:26.999739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f692dbb-dcf0-4b01-9c5a-9491bb9a8453 req-ec824f03-6c3e-4400-84d6-03075ea966be service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.000395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f692dbb-dcf0-4b01-9c5a-9491bb9a8453 req-ec824f03-6c3e-4400-84d6-03075ea966be service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:27.005549 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f2e3fba7-524c-44f8-887a-203771e5b6b3 req-5f9d0a5d-f6e4-406f-a4c9-fedba2e63033 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084390 Aug 23 10:45:27.007654 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1194/2307] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:27.020432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0afde7b2-acef-4897-8c51-4002345bbee0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9c611820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-958984293", "description": "tempest-description-435454701"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:27.029921 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8f692dbb-dcf0-4b01-9c5a-9491bb9a8453 req-ec824f03-6c3e-4400-84d6-03075ea966be service nova] Creating event network-vif-unplugged:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:45:27.035474 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8f692dbb-dcf0-4b01-9c5a-9491bb9a8453 req-ec824f03-6c3e-4400-84d6-03075ea966be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066204 Aug 23 10:45:27.036789 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1114/2308] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:27.133750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:27.134718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] [instance: 918f1dd3-6cf0-4039-955b-30877b478575] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:27.146209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:27.147709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.151294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:27.152830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:27.153499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.154117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:27.181237 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] HTTP exception thrown: Instance 918f1dd3-6cf0-4039-955b-30877b478575 could not be found. Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Request method failure captured: Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 HTTP/1.1 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK3uYvEcGwHulOdBXN2iUutwVoXa27Zon45otswRHHR9kVZFNebDMpJkITNpXivUsmUFQM0QvFrnPNkcaaa0ObV-_0xPV8tHThA1HgH2mbUKud1pFKZDIFF4AKqordLArUekzRG6Bt4ZzN452p21EXp92HgXWM6-2_U93Y8Dvi2h4zs Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1482830f506e4e79b82c0bf9fb3b11ee", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1482830f506e4e79b82c0bf9fb3b11ee"}]}] Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1482830f506e4e79b82c0bf9fb3b11ee Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-LiveMigrationTest-2112330571 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-LiveMigrationTest-2112330571-project Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: b2ac0227a26f41c8a9b5c89cddea52f5 Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-LiveMigrationTest-2112330571-project Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 918f1dd3-6cf0-4039-955b-30877b478575 could not be found. Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '918f1dd3-6cf0-4039-955b-30877b478575'} Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 918f1dd3-6cf0-4039-955b-30877b478575 could not be found. Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 918f1dd3-6cf0-4039-955b-30877b478575 could not be found. Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:27.184825 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 918f1dd3-6cf0-4039-955b-30877b478575 could not be found. Aug 23 10:45:27.187851 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:27.192692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] Returning 404 to user: Instance 918f1dd3-6cf0-4039-955b-30877b478575 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:27.194535 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06eee9a1-9f5f-4f5c-982d-a5c7a9dbba69 tempest-LiveMigrationTest-2112330571 tempest-LiveMigrationTest-2112330571-project] 10.222.0.78 "GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575" status: 404 len: 111 microversion: 2.1 time: 0.065592 Aug 23 10:45:27.195690 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1115/2309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:27 2022] GET /compute/v2.1/servers/918f1dd3-6cf0-4039-955b-30877b478575 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:27.213367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9fd24fd3-ab3e-4f4b-97e9-b1d6c6c3458d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4a7310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:27.261687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0afde7b2-acef-4897-8c51-4002345bbee0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.252956 Aug 23 10:45:27.262639 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1195/2310] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:27 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:27.272692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9fd24fd3-ab3e-4f4b-97e9-b1d6c6c3458d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.065968 Aug 23 10:45:27.281162 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1116/2311] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:27 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:27.415721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1310656075", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "78f9eefa-5b07-487e-9e97-dc9574fe6db6"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:27.442975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:27.443893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:27.473136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:27.476336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.477012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:27.478932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:27.480349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.482573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:27.511911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] validate_networks() for [('78f9eefa-5b07-487e-9e97-dc9574fe6db6', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:45:27.910965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:27.924487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b9f85bf-78c4-4689-8804-bcb61108c668 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.487693 Aug 23 10:45:27.925641 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1117/2312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:27 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:27.931556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:27.932358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:27.948495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:27.949394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.949824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:27.950703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:27.951318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:27.951881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:28.077213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:28.077903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:28.078681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:28.079555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:28.080214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:28.111264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:28.112804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:28.113355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:28.116460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:28.117169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:28.118048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.118431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:28.130112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.132320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.134453 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16d1231a-2513-4d90-bfc4-f9c4bfc63fa2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.207689 Aug 23 10:45:28.135593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1118/2313] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:27 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:28.141101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:28.141968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:28.149657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:28.150344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:28.150993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:28.152014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:28.152611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:28.153202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:28.183209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Getting quotas for project 8ac28f7e36bb480db15c2898c855eeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:28.197638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Getting quotas for user 750e7f2db9b24dcf93ad785b12a4998f and project 8ac28f7e36bb480db15c2898c855eeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:28.216969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:45:28.224295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:45:28.330450 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca2c5485-d489-4a71-8392-5aea5b229dbb tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921695 Aug 23 10:45:28.331410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1196/2314] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:45:28.342851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5387830e-02ce-48f2-b7be-e710a07ae049 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c611a60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:28.419373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5387830e-02ce-48f2-b7be-e710a07ae049 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.086810 Aug 23 10:45:28.430545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1197/2315] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:28 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:28.439990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7fdac9e-d067-4f89-baae-5f7cb4060f9c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:28.440576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7fdac9e-d067-4f89-baae-5f7cb4060f9c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:28.507768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.523022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.524593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.527349 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-140237c5-a0c8-44fd-8e6b-7866746c45cd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.390642 Aug 23 10:45:28.532526 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1119/2316] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:28 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:28.590615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7fdac9e-d067-4f89-baae-5f7cb4060f9c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:28.598771 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7fdac9e-d067-4f89-baae-5f7cb4060f9c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1216 microversion: 2.1 time: 0.175026 Aug 23 10:45:28.607151 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1198/2317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:28 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:28.949872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:28.950627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:28.960915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:28.964172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:28.964870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:28.967563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:28.968226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:28.972249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.167017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:29.168226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:29.188472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:29.189081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:29.189480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.192751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:29.193257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:29.197432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.325947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:29.330152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:29.346846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f25004d4-1e16-489b-a07f-7aa33ff6c149 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.401907 Aug 23 10:45:29.363651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:29.364437 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1120/2318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:28 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:29.366658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:29.368424 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f546c44-607b-4e25-aa38-11ef61b3b27c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.207206 Aug 23 10:45:29.371607 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1199/2319] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:29 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:29.438292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16cc54c2-fe72-4dc2-8fc6-c717532356f4 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c2d7e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:29.563141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:29.563760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:29.572352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16cc54c2-fe72-4dc2-8fc6-c717532356f4 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.134583 Aug 23 10:45:29.577114 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1121/2320] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:29 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:29.582016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:29.583933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:29.586210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.591792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:29.593038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:29.593662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.620320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:29.621286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:29.632236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:29.632754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:29.641495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.642509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:29.650098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:29.653313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:29.837153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:29.863488 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dcee7436-1418-4a59-acfc-1f2c97aabd58 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1212 microversion: 2.1 time: 0.247788 Aug 23 10:45:29.872347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1122/2321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:29 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1212 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:30.006713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.022565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.025426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.030157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15864b1d-4d25-49a2-baf7-132ce953e93a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.469171 Aug 23 10:45:30.031447 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1200/2322] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:29 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:30.371620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:30.372451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:30.380733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:30.381572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:30.382157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:30.383009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:30.383610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:30.384361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:30.395851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:30.397295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:30.408096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:30.411350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:30.415196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:30.416104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:30.416717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:30.417482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:30.510604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.522975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.525077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.526455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6fc8e98a-f581-4298-9a01-cfc6dadc66e4 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.134741 Aug 23 10:45:30.527633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1201/2323] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:30 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:30.589801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9b0644b-21da-482a-bae0-0d7dc3dbfb18 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdca1e09670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:30.661849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:30.676200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dce9da9-6566-4187-a5e9-83d4374909a2 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.309318 Aug 23 10:45:30.680655 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1123/2324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:30 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:30.692576 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9b0644b-21da-482a-bae0-0d7dc3dbfb18 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.108767 Aug 23 10:45:30.696269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1202/2325] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:30 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:30.897957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:30.898901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:30.911529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:30.914530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:30.918107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:30.919168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:30.922580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:30.923254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.059850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:31.063730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:31.075300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:31.075807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:31.076236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.076998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:31.077562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:31.080221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.086136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.094676 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-178dec19-5d98-49a0-8fd4-888cb6ba4d70 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1274 microversion: 2.1 time: 0.201567 Aug 23 10:45:31.095261 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1124/2326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:30 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:31.551595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:31.552446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:31.562287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:31.563115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:31.563793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.564798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:31.565474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:31.566110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.691435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.703844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.706635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.708241 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccb8211e-9578-451b-926a-bc9d147efaf8 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.160631 Aug 23 10:45:31.709964 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1125/2327] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:31 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:31.715477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f51b5c5d-60ab-4306-a9bf-792ac6d84913 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c420ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:31.718691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.736016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.739789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:31.741811 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02072d74-abf8-4ca4-a820-cb32f68a647a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.687764 Aug 23 10:45:31.742865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1203/2328] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:31 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:31.747979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:31.750991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:31.766726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:31.768438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:31.768915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.769714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:31.770180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:31.770612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:31.808045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f51b5c5d-60ab-4306-a9bf-792ac6d84913 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.096338 Aug 23 10:45:31.808643 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1126/2329] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:31 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:32.043730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e26afb07-2947-419e-a83a-9fb79cb37edf req-db2d6d60-134b-42ca-805f-cef85cfab53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "name": "network-vif-plugged", "status": "completed", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:32.072373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e26afb07-2947-419e-a83a-9fb79cb37edf req-db2d6d60-134b-42ca-805f-cef85cfab53d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.076584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e26afb07-2947-419e-a83a-9fb79cb37edf req-db2d6d60-134b-42ca-805f-cef85cfab53d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.079494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e26afb07-2947-419e-a83a-9fb79cb37edf req-db2d6d60-134b-42ca-805f-cef85cfab53d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.116666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e26afb07-2947-419e-a83a-9fb79cb37edf req-db2d6d60-134b-42ca-805f-cef85cfab53d service nova] Creating event network-vif-plugged:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:45:32.139513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e26afb07-2947-419e-a83a-9fb79cb37edf req-db2d6d60-134b-42ca-805f-cef85cfab53d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100586 Aug 23 10:45:32.143498 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1127/2330] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:32.162570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:32.163754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:32.186005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.186513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.187017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.190796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.191288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.191734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.338149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:32.377940 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4514c671-7afb-4c3c-b16c-2313ce8d415b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.630104 Aug 23 10:45:32.379104 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1204/2331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:31 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:32.451728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:32.460887 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-448c0493-e93a-4676-9d5e-0fcdaa278a43 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1274 microversion: 2.1 time: 0.315762 Aug 23 10:45:32.461500 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1128/2332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:32 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1274 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:32.735403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:32.736052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:32.743748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.744248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.744697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.745449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.746189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.746626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.767225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:32.767853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:32.792527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.796270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.797387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.799353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:32.801440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:32.802062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:32.987378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.003582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.005296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.007446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d40f252-69b7-442d-b996-b84e62855f8c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.244218 Aug 23 10:45:33.009414 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1129/2333] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:32 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:33.014378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa6fad3f-bcbf-4a5e-948f-dbb5db58da61 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c4a79d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:33.083535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.100194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.101992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.103210 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a942679-9c96-4293-a4e5-ba71b6376e1a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.371743 Aug 23 10:45:33.120286 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa6fad3f-bcbf-4a5e-948f-dbb5db58da61 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.109975 Aug 23 10:45:33.128113 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1205/2334] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:32 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:33.129262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1130/2335] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:33 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:33.404106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:33.404787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:33.425176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:33.429392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:33.429925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:33.430811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:33.433339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:33.437952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:33.483674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:33.486537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:33.500416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:33.504502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:33.505724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:33.507641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:33.509887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:33.511304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:33.688525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.703457 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de470e12-8ffe-4dad-9d7d-754825451f47 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.225299 Aug 23 10:45:33.714600 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1131/2336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:33 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:33.969207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:33.988365 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9bdf8f3c-1349-427c-8de1-c5db27f2f5b4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1476 microversion: 2.1 time: 0.589004 Aug 23 10:45:33.992607 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1206/2337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:33 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:34.031583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:34.032209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:34.046838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.047343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.047784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.048511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.049014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.049443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.134455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:34.135083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:34.144532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.145360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.145999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.147531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.148422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.149112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.265151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:34.281257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:34.284301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:34.287870 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-652eedc5-26ee-4f52-99ff-a38628292c31 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.159023 Aug 23 10:45:34.289707 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1207/2338] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:34 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:34.296941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8bd03e94-e674-4595-a6c7-6beb1a3bed23 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9cdb9ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:34.304056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:34.322445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:34.326572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:34.329437 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88b73a75-f381-41f7-98c2-31f69a01523e tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.301792 Aug 23 10:45:34.330939 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1132/2339] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:34 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:34.372970 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8bd03e94-e674-4595-a6c7-6beb1a3bed23 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.080892 Aug 23 10:45:34.383285 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1208/2340] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:34 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:34.727924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:34.728700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:34.741135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.745618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.747220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.751779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.752626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.753299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.802154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:34.886486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f1a998a7-da4c-4cd7-94b3-983677c1c7f4 req-7a070006-abdb-4487-9ce0-60a2028cb904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311aa760-aad6-4829-835a-c05b8d725ef2", "tag": "2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:34.911316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f1a998a7-da4c-4cd7-94b3-983677c1c7f4 req-7a070006-abdb-4487-9ce0-60a2028cb904 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:34.917398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f1a998a7-da4c-4cd7-94b3-983677c1c7f4 req-7a070006-abdb-4487-9ce0-60a2028cb904 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:34.918378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f1a998a7-da4c-4cd7-94b3-983677c1c7f4 req-7a070006-abdb-4487-9ce0-60a2028cb904 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:34.949055 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f1a998a7-da4c-4cd7-94b3-983677c1c7f4 req-7a070006-abdb-4487-9ce0-60a2028cb904 service nova] Creating event network-changed:2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 for instance 311aa760-aad6-4829-835a-c05b8d725ef2 on n-h2-847009-13 Aug 23 10:45:34.966295 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f1a998a7-da4c-4cd7-94b3-983677c1c7f4 req-7a070006-abdb-4487-9ce0-60a2028cb904 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085954 Aug 23 10:45:34.967424 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1209/2341] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:35.016772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:35.018303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:35.026832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.028515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.029128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.043236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.044471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.046654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.264587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.274084 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa4a464f-d21b-40b2-806d-a78cf24d20a5 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.551595 Aug 23 10:45:35.277529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1133/2342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:34 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:35.316212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:35.317096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:35.333418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.337572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.338393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.339861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.341759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.343513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.510039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.522419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.523974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.526248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.530254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac754b52-7007-4346-827b-6232fc2a0b2e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.219688 Aug 23 10:45:35.531154 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1134/2343] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:35 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:35.533912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5200a0e0-9bbe-4cae-aa97-e648df867e59 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1462 microversion: 2.1 time: 0.521282 Aug 23 10:45:35.538063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:35.539106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:35.555749 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1210/2344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:35 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1462 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:35.561876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-949c4367-46e9-441d-a795-9d411a145af7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9ccc3670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:35.563483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.563995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.564446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.565196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.566019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.566458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.655706 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-949c4367-46e9-441d-a795-9d411a145af7 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.098559 Aug 23 10:45:35.656286 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1211/2345] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:35 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:35.666642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:35.667588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:35.699542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.700046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.700489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.701251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:35.710014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:35.710557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:35.807119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.816688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.819379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:35.821015 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0fef1dc7-84f5-4b44-b099-2fa2b280dc28 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1488 microversion: 2.25 time: 0.288358 Aug 23 10:45:35.837512 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1135/2346] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:35 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1488 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:36.140769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:36.154206 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fdfe68b8-8645-4f57-a26f-73f6fe106582 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1462 microversion: 2.1 time: 0.496677 Aug 23 10:45:36.155483 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1212/2347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:35 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1462 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:36.175547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:36.179216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:36.187245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.188041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.188686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.189684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.190210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.190970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.277822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:36.278903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:36.279516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:36.280076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:36.280527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:36.297728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:36.298345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:36.313076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.313572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.322851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.323844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.324477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.325085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.369164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:36.376851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.377358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.377802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.378604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.379052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.379499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.410113 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a6c88a3-5081-40c0-b449-06bc555b32dc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 1066 microversion: 2.1 time: 0.238375 Aug 23 10:45:36.421562 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1136/2348] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:36 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 1066 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 10:45:36.429627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:36.430255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:36.438894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.438894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.440774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.440774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.441159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.441609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.696005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:36.706925 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ec6f922-6c3c-4450-9429-1017caf5e5e3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.281662 Aug 23 10:45:36.722110 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1137/2349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:36 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:36.723304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:36.724016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:36.732797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.733529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.734175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.735055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.735884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.736468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.848766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:36.858820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:36.860342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:36.861856 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af499d33-ad03-4705-a142-5b99beb08f9e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.149481 Aug 23 10:45:36.862528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1138/2350] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:36 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:36.867888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2174751-05cc-4b27-b767-ed120a1d0d0a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9d157c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:36.935963 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2174751-05cc-4b27-b767-ed120a1d0d0a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.071725 Aug 23 10:45:36.944703 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1139/2351] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:36 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:36.949771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:36.950391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:36.982427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:36.995034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:36.996522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:36.998125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.001763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.003055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.123280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:37.138788 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1de1a37e-1007-48dc-b708-52347d062194 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.844949 Aug 23 10:45:37.139926 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1213/2352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:36 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:37.198631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:37.209005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:37.211583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:37.213175 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2043996-3bb9-4dc8-bcf6-6949bfa7a965 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1478 microversion: 2.25 time: 0.267250 Aug 23 10:45:37.214397 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1140/2353] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:36 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1478 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:37.247354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1ca0a35-b870-4c23-9d30-9b16e01be8d9 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '.version_select at 0x7fdc9d09ddc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:37.251074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ca0a35-b870-4c23-9d30-9b16e01be8d9 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.251568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ca0a35-b870-4c23-9d30-9b16e01be8d9 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.261495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1ca0a35-b870-4c23-9d30-9b16e01be8d9 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.273431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1ca0a35-b870-4c23-9d30-9b16e01be8d9 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.25 time: 0.029236 Aug 23 10:45:37.278335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1214/2354] 10.222.0.78 () {60 vars in 1184 bytes} [Tue Aug 23 10:45:37 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:37.289589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:37.290811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:37.297437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.297939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.298813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.299129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.300543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.300543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.481204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] Lazy-loading 'services' on Instance uuid 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:37.498750 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c45993dc-8cf4-41ae-84dd-0ed88911aa08 tempest-LiveAutoBlockMigrationV225Test-376848886 tempest-LiveAutoBlockMigrationV225Test-376848886-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1973 microversion: 2.25 time: 0.213805 Aug 23 10:45:37.500054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1141/2355] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:37 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1973 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:37.543175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:37.544231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:37.551913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:37.554987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.555956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.556603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.557352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.557815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.558247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.602499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:37.676294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:37.722067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1065d8ac-a6e7-41bb-850e-9f3ee1b2e3fa tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 204 len: 0 microversion: 2.25 time: 0.186280 Aug 23 10:45:37.723110 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1215/2356] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:45:37 2022] DELETE /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:45:37.732413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:37.733071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:37.733328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:37.734317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:37.736315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:37.743748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.744456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.745147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.746128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.746647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.747084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.762031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.768031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.768553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:37.770484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:37.770976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:37.776198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:38.002586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.011637 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f890471d-2c65-4efc-87fb-393a3e0ba785 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.283959 Aug 23 10:45:38.012530 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1142/2357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:37 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:38.017137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:38.017743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:38.024261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:38.024813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:38.025257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:38.025996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:38.026453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:38.027007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:38.051192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.081656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.083529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.098724 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac0f5050-5923-4ed7-8a2d-b8952042c7be tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1484 microversion: 2.25 time: 0.370350 Aug 23 10:45:38.100183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1216/2358] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:37 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1484 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:38.105980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82256d3f-4b43-4147-9ea5-a3507ed82f8d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9cde2a60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:38.135417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:38.181225 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82256d3f-4b43-4147-9ea5-a3507ed82f8d tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1429 microversion: 2.1 time: 0.079453 Aug 23 10:45:38.184965 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1217/2359] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:38 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:38.189561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.200280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:38.200974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:38.218808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:38.219576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:38.220004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.220199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:38.220973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:38.221666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:38.222552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:38.224023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.226370 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-986e8b15-1f41-44f9-8a6c-b5a70ebc5632 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.211939 Aug 23 10:45:38.242303 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1143/2360] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:38 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:38.544981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:38.552321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28c439be-90fa-444b-9851-76e04acf8d99 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.366078 Aug 23 10:45:38.565517 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1218/2361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:38 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:39.103957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.109145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:39.128629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.137466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:39.143098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.149370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.151444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.154390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.154911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.157181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:39.161281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.166052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.166558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.167000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.177160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.181314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.181492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.503216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.517809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.520551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.523696 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d69f520-4c47-4b6c-960f-e03faf93c5b6 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1484 microversion: 2.25 time: 0.401231 Aug 23 10:45:39.525794 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1219/2362] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1484 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:39.533260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33f508bc-ab7e-4ba2-b5e8-123117863f53 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdca1e6e940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.598093 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33f508bc-ab7e-4ba2-b5e8-123117863f53 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1438 microversion: 2.1 time: 0.070810 Aug 23 10:45:39.600853 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1220/2363] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:39.606005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.606787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:39.613789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.614486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.615127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.616504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.617289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.617862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.706162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.717154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.718907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.720262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5edd074c-bf48-4faa-8a99-12346a70b844 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.118161 Aug 23 10:45:39.721593 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1221/2364] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:39.727014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.727822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:39.734410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.735056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.735633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.736507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:39.737251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:39.737940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:39.845404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:39.855829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c731a3d9-5f2d-4dd7-b79b-cfa9ae188bf1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.757390 Aug 23 10:45:39.858811 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1144/2365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:39.874607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00f8c6ed-9896-4024-a333-07281302ee81 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c47bc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.947935 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00f8c6ed-9896-4024-a333-07281302ee81 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 200 len: 1438 microversion: 2.1 time: 0.087771 Aug 23 10:45:39.948309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1145/2366] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 1438 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:39.972540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:39.982367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:39.999704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.000213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.000885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.001774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.003857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.004771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.249127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.260509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec718710-9e78-41b5-8069-2207f2c813b5 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1478 microversion: 2.1 time: 0.300998 Aug 23 10:45:40.274006 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1146/2367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:40.274006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ac8deea1-f161-456b-8520-45f6a9cd1bbc req-240d90a0-1667-4dc0-98fa-8f22b633a789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a99b54b-9efa-4cb1-bb53-13aff5876ae3", "name": "network-vif-deleted", "tag": "f7bdb065-4ecc-458e-a69b-2c937dec02eb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:40.280773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.282929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ac8deea1-f161-456b-8520-45f6a9cd1bbc req-240d90a0-1667-4dc0-98fa-8f22b633a789 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.283422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ac8deea1-f161-456b-8520-45f6a9cd1bbc req-240d90a0-1667-4dc0-98fa-8f22b633a789 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.283865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ac8deea1-f161-456b-8520-45f6a9cd1bbc req-240d90a0-1667-4dc0-98fa-8f22b633a789 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.291751 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33f71c6d-9fc0-4696-844a-2596e461e263 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.568813 Aug 23 10:45:40.294151 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1222/2368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:39 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:40.302420 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ac8deea1-f161-456b-8520-45f6a9cd1bbc req-240d90a0-1667-4dc0-98fa-8f22b633a789 service nova] Creating event network-vif-deleted:f7bdb065-4ecc-458e-a69b-2c937dec02eb for instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 on n-h1-847009-13 Aug 23 10:45:40.311428 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ac8deea1-f161-456b-8520-45f6a9cd1bbc req-240d90a0-1667-4dc0-98fa-8f22b633a789 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047680 Aug 23 10:45:40.313948 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1147/2369] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:40.551422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:40.552057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:40.566752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.567500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.568171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.569152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.569801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.570421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.659029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.670875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.672664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.674103 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51f052e7-e1ef-41ef-a9df-57386107d9ce tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1266 microversion: 2.25 time: 0.127148 Aug 23 10:45:40.675168 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1223/2370] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:40 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:40.747239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:40.748063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:40.756999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.757577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.758228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.759226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.759884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.760397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.838321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.853092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.854807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:40.856924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18eff65e-ee2c-4943-b5d0-37c654760107 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.116719 Aug 23 10:45:40.858555 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1148/2371] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:40 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:40.878088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:40.879003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:40.888052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.888888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.889337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:40.890080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:40.890720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:40.891298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.125150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:41.140712 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a3ab2ff-1554-4de4-8441-b7a73bd8518b tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.265122 Aug 23 10:45:41.153834 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1224/2372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:40 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:41.204252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-257ef382-0dbb-455b-94d7-016d074c29dc req-761f1307-6b2f-47e3-af35-5502240ca62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311aa760-aad6-4829-835a-c05b8d725ef2", "name": "network-vif-plugged", "status": "completed", "tag": "2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:41.231843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-257ef382-0dbb-455b-94d7-016d074c29dc req-761f1307-6b2f-47e3-af35-5502240ca62c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.232906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-257ef382-0dbb-455b-94d7-016d074c29dc req-761f1307-6b2f-47e3-af35-5502240ca62c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.233535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-257ef382-0dbb-455b-94d7-016d074c29dc req-761f1307-6b2f-47e3-af35-5502240ca62c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.248248 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-257ef382-0dbb-455b-94d7-016d074c29dc req-761f1307-6b2f-47e3-af35-5502240ca62c service nova] Creating event network-vif-plugged:2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 for instance 311aa760-aad6-4829-835a-c05b8d725ef2 on n-h2-847009-13 Aug 23 10:45:41.254986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-257ef382-0dbb-455b-94d7-016d074c29dc req-761f1307-6b2f-47e3-af35-5502240ca62c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054733 Aug 23 10:45:41.256009 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1149/2373] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:41.282116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:41.283281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:41.290691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.291196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.291648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.292373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.292870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.293319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.321803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:41.324201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:41.332300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.333059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.334145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.336237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.336950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.337707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.538400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:41.547742 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7dcc3f9d-0dac-4fe5-b7bc-11e83b9cde91 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.231849 Aug 23 10:45:41.548803 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1150/2374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:41 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:41.677512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:41.688946 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c26ccbb-c89c-461b-980b-24c169f9b803 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1465 microversion: 2.1 time: 0.411602 Aug 23 10:45:41.690074 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1225/2375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:41 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1465 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:41.704788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:41.705933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:41.714583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92b99a69-9f81-4b73-9f05-a41cdc4f570b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9cc9bca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:41.725534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.726300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.727683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.728963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.729630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.730264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.735199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:41.810812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:41.822202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:41.823942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:41.825410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09e3ff29-610b-4bc5-aa6f-459f2936861b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1266 microversion: 2.25 time: 0.125916 Aug 23 10:45:41.826556 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1151/2376] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:41 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:41.885155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:41.886458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:41.901873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.906436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.907362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:41.908127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:41.908611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:41.912285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.094678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.107773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.109834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.111300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9692040e-9122-49c0-9d1c-f65f6b0e3b51 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.231874 Aug 23 10:45:42.112384 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1152/2377] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:41 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:42.166490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:42.167136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:42.175605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.176154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.185253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.186021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.188629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.189017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.349149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.359946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd359352-7ccb-4916-8e6a-870f08b78651 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.200252 Aug 23 10:45:42.360536 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1153/2378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:42 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:42.406009 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92b99a69-9f81-4b73-9f05-a41cdc4f570b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "DELETE /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d" status: 204 len: 0 microversion: 2.1 time: 0.695114 Aug 23 10:45:42.406586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1226/2379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:41 2022] DELETE /compute/v2.1/images/4fffcec8-9ecc-496d-9483-d07601245f5d => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:45:42.416010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ff22e06-67ab-45ff-a1af-715111eff86b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '.version_select at 0x7fdc9c463ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:42.442582 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3ff22e06-67ab-45ff-a1af-715111eff86b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] HTTP exception thrown: Image not found. Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ff22e06-67ab-45ff-a1af-715111eff86b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Request method failure captured: Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac HTTP/1.1 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9o3g8lPL6DapcZUaxsTOSvEKdzzp7vhYdOUGSuwtT-oPcjzv7EFLdrgEft6mucbsf9_pV7IXqm3lj1AJu5hqyAzyzzIyqX1dOwpaZS0gpmToxHylYvNccpqTlHudqjZgcbdSDbf3933KFFA5JQTuodqIrkqrd2l3p0CJOywXYi730 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 148d497ec6904a25a36eb8ce8b64306e Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/148d497ec6904a25a36eb8ce8b64306e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_148d497ec6904a25a36eb8ce8b64306e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148d497ec6904a25a36eb8ce8b64306e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148d497ec6904a25a36eb8ce8b64306e"}]}] Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 148d497ec6904a25a36eb8ce8b64306e Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerTestJSON-2031197830-project Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9b61ef0a5cf444ff83952926721631da Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerTestJSON-2031197830-project Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac'} Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac to delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac could not be found. Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.445079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ff22e06-67ab-45ff-a1af-715111eff86b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ff22e06-67ab-45ff-a1af-715111eff86b tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "DELETE /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac" status: 404 len: 62 microversion: 2.1 time: 0.035635 Aug 23 10:45:42.449088 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1154/2380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:42 2022] DELETE /compute/v2.1/images/b4192fcf-0b6a-4f4e-8ac9-d4ad4fcd1bac => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:45:42.456093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:42.456599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:42.464970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.465559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.466006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.466727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.467414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.467772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.497173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:42.581363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:42.582208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:42.605781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.607986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.608919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.609210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.609684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.610158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.619338 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edb7f31d-69c0-4196-8390-b6cd8c91d7a2 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 204 len: 0 microversion: 2.1 time: 0.166893 Aug 23 10:45:42.619934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1227/2381] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:45:42 2022] DELETE /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:45:42.632507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:42.633499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:42.639995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.640695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.641336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.642220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.642691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.643132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.794644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.803482 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ff53c60-cb0c-4706-9f41-bfaae5b2d349 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1316 microversion: 2.1 time: 0.236539 Aug 23 10:45:42.812956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1155/2382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:42 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:42.832501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.841909 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f606a92d-178f-41fe-a6e1-a017ac20b080 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1471 microversion: 2.1 time: 0.213617 Aug 23 10:45:42.843205 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1228/2383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:42 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:42.848355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:42.849388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:42.856935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.857441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.857891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.858738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:42.859208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:42.859644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:42.936950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.949239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.950767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:42.951958 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f8a78f8-4f21-4dfc-a330-8b42d8eaad9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1266 microversion: 2.25 time: 0.107761 Aug 23 10:45:42.952524 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1156/2384] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:42 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:43.136949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:43.137932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:43.144231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.144844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.145283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.146042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.147005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.147602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.231440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:43.240837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:43.243287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:43.244666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69227ad8-3b3b-4a9d-80e0-f2e03a154fad tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.111693 Aug 23 10:45:43.245390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1229/2385] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:43 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:43.386061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:43.386691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:43.393702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.394660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.395116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.395836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.397036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.397484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.549508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:43.558342 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33314056-0eee-4137-a6b3-745fd6d3559f tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.177433 Aug 23 10:45:43.559395 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1157/2386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:43 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:43.831218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:43.832960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:43.843150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.843936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.844549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.845947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.846731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.847355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.863377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:43.864015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:43.881140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.881833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.882573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:43.883451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:43.884067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:43.884650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.062320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.073183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7256cf2e-456c-415e-a4c3-a35dcde154e0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1504 microversion: 2.1 time: 0.251348 Aug 23 10:45:44.073785 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1230/2387] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:43 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:44.088667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.094332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-de01a9c8-e541-46ab-8eac-7f5925ab355a req-25195c15-a1e9-447c-9a02-4937875523e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "name": "network-vif-unplugged", "status": "completed", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:44.103567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22045fbc-48fe-4dfc-99a9-950a2e69b7ae tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1471 microversion: 2.1 time: 0.244081 Aug 23 10:45:44.104554 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1158/2388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:43 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:44.107266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-de01a9c8-e541-46ab-8eac-7f5925ab355a req-25195c15-a1e9-447c-9a02-4937875523e8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.107892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-de01a9c8-e541-46ab-8eac-7f5925ab355a req-25195c15-a1e9-447c-9a02-4937875523e8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.108455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-de01a9c8-e541-46ab-8eac-7f5925ab355a req-25195c15-a1e9-447c-9a02-4937875523e8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.122258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:44.123153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:44.127387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-de01a9c8-e541-46ab-8eac-7f5925ab355a req-25195c15-a1e9-447c-9a02-4937875523e8 service nova] Creating event network-vif-unplugged:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:45:44.130334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.134986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-de01a9c8-e541-46ab-8eac-7f5925ab355a req-25195c15-a1e9-447c-9a02-4937875523e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044946 Aug 23 10:45:44.136906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.137383 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1231/2389] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:44.138060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.139860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.140547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.141290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.145663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-38587171"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:44.146902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:44.159590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.160259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.160793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.163228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.163658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.164436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.249763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.258436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.259976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.261272 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30b1dc33-4666-48c1-9913-84b559c738dd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1266 microversion: 2.25 time: 0.143170 Aug 23 10:45:44.261987 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1159/2390] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:44 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:44.275973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:44.276943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:44.283979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.284479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.285008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.286034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.286659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.287647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.358184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.network.security_group_api [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Adding security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 to port 2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 Aug 23 10:45:44.385219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.396937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.400362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.402246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28164ef8-e294-4e8f-ab62-f4794a52470c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.132233 Aug 23 10:45:44.415951 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1160/2391] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:44 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:44.579947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:44.580994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:44.588019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.588985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.589914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.590849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.592126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.592575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.760032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:44.769272 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08c6edbd-b174-4ab0-9c11-9735e1334078 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.192770 Aug 23 10:45:44.770472 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1161/2392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:44 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:44.808833 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af9ab568-b9d8-4256-86be-3bab4e49d6b1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.668906 Aug 23 10:45:44.813469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1232/2393] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:44 2022] POST /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:44.818753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-648c58a6-0f1e-4723-bd1f-eec2123dca6a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cd29310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:44.830464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-029275ab-3ae2-4a74-a858-109cc5c270ea req-4fa26637-d4fe-438b-8511-ae0eac53632c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311aa760-aad6-4829-835a-c05b8d725ef2", "tag": "2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:44.844987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-029275ab-3ae2-4a74-a858-109cc5c270ea req-4fa26637-d4fe-438b-8511-ae0eac53632c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:44.846359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-029275ab-3ae2-4a74-a858-109cc5c270ea req-4fa26637-d4fe-438b-8511-ae0eac53632c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:44.847093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-029275ab-3ae2-4a74-a858-109cc5c270ea req-4fa26637-d4fe-438b-8511-ae0eac53632c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:44.894531 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-029275ab-3ae2-4a74-a858-109cc5c270ea req-4fa26637-d4fe-438b-8511-ae0eac53632c service nova] Creating event network-changed:2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 for instance 311aa760-aad6-4829-835a-c05b8d725ef2 on n-h2-847009-13 Aug 23 10:45:44.907517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-029275ab-3ae2-4a74-a858-109cc5c270ea req-4fa26637-d4fe-438b-8511-ae0eac53632c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080687 Aug 23 10:45:44.908550 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1233/2394] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:44.975310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-648c58a6-0f1e-4723-bd1f-eec2123dca6a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use.", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:44.976363 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-648c58a6-0f1e-4723-bd1f-eec2123dca6a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.976363 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-648c58a6-0f1e-4723-bd1f-eec2123dca6a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994 HTTP/1.1 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: exception: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6d4908a6-dc88-4d7b-ab01-8d76fdb78994'} Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:44.978751 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] Aug 23 10:45:44.981877 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:44.985136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-648c58a6-0f1e-4723-bd1f-eec2123dca6a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 400 to user: Security Group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 in use. Aug 23 10:45:44.985136 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-765b41b3-7319-4b18-b543-9b133b98cd8f'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:44.986246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-648c58a6-0f1e-4723-bd1f-eec2123dca6a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994" status: 400 len: 185 microversion: 2.1 time: 0.171429 Aug 23 10:45:44.987266 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1162/2395] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:44 2022] DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994 => generated 185 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:45:44.998090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:45.000392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:45.011911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.012480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.014242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.017009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.017651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.018253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.113512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:45.147466 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd4362c7-cb64-45cf-8f73-3f427b9361f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.154311 Aug 23 10:45:45.151437 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1234/2396] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:44 2022] POST /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:45.157796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.158853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:45.176544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.181197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.181710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.182831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.183931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.184495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.384857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.390305 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:45:45.390305 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:45:45.393071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.393823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.394466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.411696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.414341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.416815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.435728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.449757 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bcb680db-17bd-4812-a6e6-fd0686f58233 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1471 microversion: 2.1 time: 0.298722 Aug 23 10:45:45.461111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1235/2397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:45.461660 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a6c7a90-4016-4e9f-96e3-e1b2f4144ef7 tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.354693 Aug 23 10:45:45.463164 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1163/2398] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/os-services => generated 949 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:45.473480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.474131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:45.475188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.475852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:45.481791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.482903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.482903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.483611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.484078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.484869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.486899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.487469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.488445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.489449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.490693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.491292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.577461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.587683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.589515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.590838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39588aa1-bf66-4bff-a567-3fa17a0694ea tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 200 len: 1266 microversion: 2.25 time: 0.126657 Aug 23 10:45:45.591408 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1164/2399] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:45.596121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.596937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:45.604091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.604875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.605522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.606531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.607147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.607742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.706779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.717904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.719996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.721692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a56a5db-9bfb-4565-bd3c-4881bf9597df tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.129186 Aug 23 10:45:45.722251 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1165/2400] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:45.739863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.743665 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:45:45.743665 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:45:45.745904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.746163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.746622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.747628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.748809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.749634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.786525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1ab97e6-f57e-4347-a395-ea82ddb2c72a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-847009-13" status: 200 len: 581 microversion: 2.1 time: 0.054330 Aug 23 10:45:45.796422 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1166/2401] 10.222.0.78 () {58 vars in 1174 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/os-services?host=n-d-847009-13 => generated 581 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:45.801685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:45.802877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:45.810487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.811048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.811494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.812207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:45.812666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:45.813118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:45.984799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:45.994409 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8eb6a22f-62f1-41c3-9f9f-0262dc1e7b73 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.196690 Aug 23 10:45:45.995206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1167/2402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:46.002180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:46.005239 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:45:46.005239 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:45:46.007126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.008140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.009022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.010014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.011149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.011597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.039846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c4d215d-8b16-4f54-8a9f-de867e63ef2a tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.041594 Aug 23 10:45:46.040604 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1168/2403] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:46.054174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:46.056846 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:45:46.056846 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:45:46.058168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.058873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.059468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.060323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.060892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.061400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.086987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48cc0433-f57c-41b3-95f3-4381f52d1cec tempest-ServicesAdminTestJSON-1118152327 tempest-ServicesAdminTestJSON-1118152327-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.037354 Aug 23 10:45:46.089588 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1169/2404] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:45:46 2022] GET /compute/v2.1/os-services => generated 949 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:46.187479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:46.200157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-566226d6-d476-46b5-8a93-5fe27869abca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1573 microversion: 2.1 time: 0.737898 Aug 23 10:45:46.201606 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1236/2405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:45 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1573 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:46.471506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:46.472049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:46.486922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.487634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.488273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.489237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.490107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.490907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.615891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:46.616532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 0a99b54b-9efa-4cb1-bb53-13aff5876ae3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:46.623875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.624399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.624880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.625609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.626308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.626969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.654475 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] HTTP exception thrown: Instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 could not be found. Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Request method failure captured: Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 HTTP/1.1 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4KM3yofeWUL9QE3W_qodzlgo3jHb-IeUeT2rJ30T49I5usZAUJd2m0Gc4fb2ROwTYOwuzoAxyUBrQNEMujdLraxlQ_0v6VNcVggylcggmzpGcISLNXbNZxoZmqBD9N6B5qhla49_nVGS3lVziI7x0T6-DOqxh65DocmwTfFv5Huig Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_64ea87e1ef314e1886f92fcf108c414f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}] Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 04d5d44e84d5459ab1a59c13bcf69012 Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 could not be found. Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '0a99b54b-9efa-4cb1-bb53-13aff5876ae3'} Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 could not be found. Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 could not be found. Aug 23 10:45:46.663706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 could not be found. Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Returning 404 to user: Instance 0a99b54b-9efa-4cb1-bb53-13aff5876ae3 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-280e2ad4-f50b-458c-9285-b166c9bc50b4 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3" status: 404 len: 111 microversion: 2.25 time: 0.053659 Aug 23 10:45:46.670776 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1237/2406] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:46 2022] GET /compute/v2.1/servers/0a99b54b-9efa-4cb1-bb53-13aff5876ae3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:45:46.733363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:46.747133 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eebfde96-6bc9-4bd0-9f1e-5918b6d83065 tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1471 microversion: 2.1 time: 0.278430 Aug 23 10:45:46.749732 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1170/2407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:46 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1471 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:46.752443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:46.760960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:46.781085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.782203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.782831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.783737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.784953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.790004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:46.933150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:46.935770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-255f54ac-82c6-4495-a2cf-1528b8c1642b req-246b0fc3-d36f-41a8-9f66-c00e0866baa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52bb8e9-e627-4ccd-92a2-781dba0d602b", "name": "network-vif-deleted", "tag": "db1498d0-cefb-4f1e-91df-4d10ebad2a63"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:46.942522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:46.946522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:46.950329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-173dc361-49a3-441c-bce1-92fe8127b22f tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.208395 Aug 23 10:45:46.953454 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1238/2408] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:46 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:46.960727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-255f54ac-82c6-4495-a2cf-1528b8c1642b req-246b0fc3-d36f-41a8-9f66-c00e0866baa4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:46.961808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-255f54ac-82c6-4495-a2cf-1528b8c1642b req-246b0fc3-d36f-41a8-9f66-c00e0866baa4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:46.962306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-255f54ac-82c6-4495-a2cf-1528b8c1642b req-246b0fc3-d36f-41a8-9f66-c00e0866baa4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.001115 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-255f54ac-82c6-4495-a2cf-1528b8c1642b req-246b0fc3-d36f-41a8-9f66-c00e0866baa4 service nova] Creating event network-vif-deleted:db1498d0-cefb-4f1e-91df-4d10ebad2a63 for instance e52bb8e9-e627-4ccd-92a2-781dba0d602b on n-h1-847009-13 Aug 23 10:45:47.012299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-255f54ac-82c6-4495-a2cf-1528b8c1642b req-246b0fc3-d36f-41a8-9f66-c00e0866baa4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087824 Aug 23 10:45:47.013691 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1171/2409] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:47.016264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:47.017145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:47.027357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.033678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.034294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.035053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.035518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.036004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.225543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:47.226283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:47.242308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.243371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.243833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.246872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.248643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.249701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.349945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:47.373971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77461ab5-536f-4fe6-bbc5-85c38f0464cb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.361195 Aug 23 10:45:47.394191 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1239/2410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:47 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:47.536129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:47.549086 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a386895-3687-4094-b168-3cebb8a113c1 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1573 microversion: 2.1 time: 0.329664 Aug 23 10:45:47.555243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1172/2411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:47 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1573 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:47.776867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:47.777512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:47.790249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.790755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.791871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.792827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.797571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.798319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.877411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:47.883710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:47.884626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:47.885620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lazy-loading 'fault' on Instance uuid e52bb8e9-e627-4ccd-92a2-781dba0d602b {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:47.960797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b61ef0a5cf444ff83952926721631da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148d497ec6904a25a36eb8ce8b64306e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:47.973665 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-96ab9e11-7c80-4c2c-888b-e555b200c3fd tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 200 len: 1306 microversion: 2.1 time: 0.202033 Aug 23 10:45:47.991292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1240/2412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:47 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:48.002061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:48.003266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:48.027205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.028036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.028793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.030204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.030884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.031664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.046146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:48.155535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:48.174134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:48.179589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:48.183358 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0961cf6f-0f1d-4fdf-b7b9-5de12d143c69 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.199020 Aug 23 10:45:48.186491 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1173/2413] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:47 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:48.404583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:48.405259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:48.419104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.420108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.420244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.421011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.421474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.421902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.574837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:48.577737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:48.602819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.603400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.603895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.604635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.605130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.605568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.689074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:48.700767 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38251b7e-8f8c-4615-b2d1-2c6106e21087 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.304568 Aug 23 10:45:48.719693 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1241/2414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:48 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:48.860516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:48.871761 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0231dfed-b347-4802-8b25-dbaaa589bcbf tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1571 microversion: 2.1 time: 0.304098 Aug 23 10:45:48.889110 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1174/2415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:48 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1571 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:48.896369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-958984293"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:48.896369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:48.908525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.909544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.910368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:48.911153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:48.911800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:48.912407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.142738 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.network.security_group_api [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Adding security group 11523be2-e16b-4aa7-8c62-ed6ec53391af to port 2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 Aug 23 10:45:49.158890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:49.159414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:49.170295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.170795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.174428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.175358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.178451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.179090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.223924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:49.385459 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fac969e1-a4d4-4902-87ce-11026d3e27cd tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 204 len: 0 microversion: 2.32 time: 0.482472 Aug 23 10:45:49.386829 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1175/2416] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:45:48 2022] DELETE /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:45:49.393713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:49.395624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] [instance: e52bb8e9-e627-4ccd-92a2-781dba0d602b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:49.417852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.418369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.418823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.419567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.420198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.420862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.459211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] HTTP exception thrown: Instance e52bb8e9-e627-4ccd-92a2-781dba0d602b could not be found. Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Request method failure captured: Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b HTTP/1.1 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9o3g8lPL6DapcZUaxsTOSvEKdzzp7vhYdOUGSuwtT-oPcjzv7EFLdrgEft6mucbsf9_pV7IXqm3lj1AJu5hqyAzyzzIyqX1dOwpaZS0gpmToxHylYvNccpqTlHudqjZgcbdSDbf3933KFFA5JQTuodqIrkqrd2l3p0CJOywXYi730 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 148d497ec6904a25a36eb8ce8b64306e Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/148d497ec6904a25a36eb8ce8b64306e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_148d497ec6904a25a36eb8ce8b64306e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148d497ec6904a25a36eb8ce8b64306e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148d497ec6904a25a36eb8ce8b64306e"}]}] Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 148d497ec6904a25a36eb8ce8b64306e Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2031197830 Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerTestJSON-2031197830-project Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9b61ef0a5cf444ff83952926721631da Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerTestJSON-2031197830-project Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance e52bb8e9-e627-4ccd-92a2-781dba0d602b could not be found. Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'e52bb8e9-e627-4ccd-92a2-781dba0d602b'} Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52bb8e9-e627-4ccd-92a2-781dba0d602b could not be found. Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52bb8e9-e627-4ccd-92a2-781dba0d602b could not be found. Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:49.464425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52bb8e9-e627-4ccd-92a2-781dba0d602b could not be found. Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] Returning 404 to user: Instance e52bb8e9-e627-4ccd-92a2-781dba0d602b could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:49.467940 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a30d09ba-77f0-45ec-b083-6fc28acce33a tempest-ImagesOneServerTestJSON-2031197830 tempest-ImagesOneServerTestJSON-2031197830-project] 10.222.0.78 "GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b" status: 404 len: 111 microversion: 2.1 time: 0.079164 Aug 23 10:45:49.486934 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1176/2417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:49 2022] GET /compute/v2.1/servers/e52bb8e9-e627-4ccd-92a2-781dba0d602b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:49.503702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:49.504343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:49.535893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.537195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.539813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.540582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.541089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.541786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.706493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:49.718038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:49.720832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:49.722445 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37a530ff-5d26-43c4-a7ce-ffabc4cce66b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.234010 Aug 23 10:45:49.743025 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1177/2418] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:49 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:49.750702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:49.751661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:49.760976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.762076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.762970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.765729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.766623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.767405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.787798 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17a737e7-41a5-46aa-ac8e-22da3352aa7b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2/action" status: 202 len: 0 microversion: 2.1 time: 0.896165 Aug 23 10:45:49.789835 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1242/2419] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:45:48 2022] POST /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:45:49.798421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:49.799976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:49.813062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.813956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.815608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:49.817355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:49.818618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:49.819845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.085911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.097466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.098136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.101457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.103747 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c17522dc-19b2-4d5b-add5-b0973a477c17 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2955 microversion: 2.32 time: 0.359485 Aug 23 10:45:50.110722 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49e75d12-51cb-4bc7-bb9e-b39de9ac1a28 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.319454 Aug 23 10:45:50.112193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1243/2420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:49 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:50.117272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60fcc354-b1dd-4ece-b152-b7d52c6e86a6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cc42040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:50.134502 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1178/2421] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:49 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2955 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:50.148719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-513a6dee-dbdd-4ced-9ae1-75eec53baaf2 req-b553776e-1c85-42bd-b6c2-a9163a37bad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311aa760-aad6-4829-835a-c05b8d725ef2", "tag": "2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:50.174317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-513a6dee-dbdd-4ced-9ae1-75eec53baaf2 req-b553776e-1c85-42bd-b6c2-a9163a37bad5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.177558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-513a6dee-dbdd-4ced-9ae1-75eec53baaf2 req-b553776e-1c85-42bd-b6c2-a9163a37bad5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.179122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-513a6dee-dbdd-4ced-9ae1-75eec53baaf2 req-b553776e-1c85-42bd-b6c2-a9163a37bad5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.206930 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-513a6dee-dbdd-4ced-9ae1-75eec53baaf2 req-b553776e-1c85-42bd-b6c2-a9163a37bad5 service nova] Creating event network-changed:2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 for instance 311aa760-aad6-4829-835a-c05b8d725ef2 on n-h2-847009-13 Aug 23 10:45:50.222899 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-513a6dee-dbdd-4ced-9ae1-75eec53baaf2 req-b553776e-1c85-42bd-b6c2-a9163a37bad5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086828 Aug 23 10:45:50.223776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1179/2422] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:50.476708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-60fcc354-b1dd-4ece-b152-b7d52c6e86a6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use.", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:50.478121 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-60fcc354-b1dd-4ece-b152-b7d52c6e86a6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.478121 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60fcc354-b1dd-4ece-b152-b7d52c6e86a6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af HTTP/1.1 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: exception: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '11523be2-e16b-4aa7-8c62-ed6ec53391af'} Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:50.481258 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] Aug 23 10:45:50.484255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:50.492944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60fcc354-b1dd-4ece-b152-b7d52c6e86a6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 400 to user: Security Group 11523be2-e16b-4aa7-8c62-ed6ec53391af in use. Aug 23 10:45:50.492944 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-5e1835f6-7863-4380-ac49-0dd9187d2185'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:50.494146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60fcc354-b1dd-4ece-b152-b7d52c6e86a6 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af" status: 400 len: 185 microversion: 2.1 time: 0.380856 Aug 23 10:45:50.499107 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1244/2423] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:50 2022] DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af => generated 185 bytes in 386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:45:50.516555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:50.519680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:50.546006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.551264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.554176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.560838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.561920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.562725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.625216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:50.634449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45c52e52-3927-4472-a407-d6c09eb96a6f tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:50.653995 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45c52e52-3927-4472-a407-d6c09eb96a6f tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.425481 Aug 23 10:45:50.654946 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1180/2424] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:45:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:50.749134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:50.751561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:50.768009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.768990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.769668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.770928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.772333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.773057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.814476 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da2ced8b-6974-48a7-b056-d8bbf16fe6ca tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 204 len: 0 microversion: 2.1 time: 0.313054 Aug 23 10:45:50.815384 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1245/2425] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:45:50 2022] DELETE /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:45:50.868282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:50.868984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:50.884524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.885195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.885661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.886449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:50.892043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:50.892572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:50.951653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.961979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.968694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:50.976692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-151538e9-f252-4c22-b16f-3ea46a543ab5 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.232919 Aug 23 10:45:50.978740 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1181/2426] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:50 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:51.132251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:51.133161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:51.151099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.151644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.152123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.152910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.153404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.153804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.332423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:51.348687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e59b7da-f515-4fed-b1f6-8b615a0bcfa0 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1645 microversion: 2.1 time: 0.525473 Aug 23 10:45:51.351251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1246/2427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:50 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1645 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:51.375204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:51.380100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:51.404068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.404880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.405722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.409339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.412334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.415085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.533868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:51.543534 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57793f83-cd1c-4208-a1d7-d8bea1423ac3 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.415904 Aug 23 10:45:51.545669 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1182/2428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:51 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:51.550782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:51.551700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:51.558241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.559017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.559649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.560548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.561370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.561986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.622420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:51.774565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:51.801885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:51.804693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:51.806439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a993b811-4836-49e7-a698-5bcdd5dd53b0 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2955 microversion: 2.32 time: 0.451106 Aug 23 10:45:51.806622 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e3624ac-f503-4df5-adcb-fdcb93f425c7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 204 len: 0 microversion: 2.25 time: 0.259296 Aug 23 10:45:51.807220 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1183/2429] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:45:51 2022] DELETE /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:45:51.812142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1247/2430] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:51 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2955 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:51.825164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:51.826529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:51.843618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.845625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.846093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:51.848252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:51.848848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:51.849381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.007527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:52.008847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:52.022426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.023764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.024950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.026506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.027349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.027939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.093695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.103706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.105281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.106647 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d41159bd-ad38-4fb9-be07-c8a3d46a7c3f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1729 microversion: 2.25 time: 0.291939 Aug 23 10:45:52.109916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1184/2431] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:51 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:52.116767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed69844a-8d52-494b-8ee5-378ba5909025 tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-377645052", "imageRef": "9054ba6c-dd33-4cdf-8f1a-801afca17b44", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:52.125928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.127959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:52.137875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.139756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.141281 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f6908d7-b804-43fb-bc5d-994339684929 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.139596 Aug 23 10:45:52.147368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1248/2432] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:52 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:52.187545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-ed69844a-8d52-494b-8ee5-378ba5909025 tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:45:52.375303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:52.376275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:52.383476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.384224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.384932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.385857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.386642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.387080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.389047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ed69844a-8d52-494b-8ee5-378ba5909025 tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed69844a-8d52-494b-8ee5-378ba5909025 tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] Request method failure captured: Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 142 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_dSTwZAUcu_Ft9iDB3nZUnWRdWgQFe05fBFh1scAbe4SbV2VSpqxGQKslvluUQK72XVozd6lBUt76f4WULJyf-n3Q44cAW4Ve3rlik2HA2D7pVEF4ZRAc6iqNMsMIDdmOVIDDItCZ-9mkMB4aGArhGVHPoAnJ_Yto4HaGo0-CC3Ww Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 63c7f3603feb43f58fcf84cee1411334 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FlavorsV2NegativeTest-1401868330 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/63c7f3603feb43f58fcf84cee1411334"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_63c7f3603feb43f58fcf84cee1411334", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63c7f3603feb43f58fcf84cee1411334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/63c7f3603feb43f58fcf84cee1411334"}]}] Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FlavorsV2NegativeTest-1401868330 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 63c7f3603feb43f58fcf84cee1411334 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1401868330 Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FlavorsV2NegativeTest-1401868330-project Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: ae2c2e21e1fe4b03953c0abb71393eae Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FlavorsV2NegativeTest-1401868330-project Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-377645052", "imageRef": "9054ba6c-dd33-4cdf-8f1a-801afca17b44", "flavorRef": "452"}} Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: exception: Flavor's memory is too small for requested image. Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-377645052', 'imageRef': '9054ba6c-dd33-4cdf-8f1a-801afca17b44', 'flavorRef': '452'}}} Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:52.390959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed69844a-8d52-494b-8ee5-378ba5909025 tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:52.394322 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed69844a-8d52-494b-8ee5-378ba5909025 tempest-FlavorsV2NegativeTest-1401868330 tempest-FlavorsV2NegativeTest-1401868330-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.281517 Aug 23 10:45:52.398288 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1185/2433] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:45:52 2022] POST /compute/v2.1/servers => generated 93 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:45:52.558810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.565491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:52.566200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:52.572628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.573299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.573818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.574589 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ff0f3ba-bc2c-4f63-8b74-7845f7d06666 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1645 microversion: 2.1 time: 0.202574 Aug 23 10:45:52.574722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.575181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.575685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.577568 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1249/2434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:52 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1645 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:52.714996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:52.722901 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a32b7a80-7066-41f7-9693-33bbf01ccf6d tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.162108 Aug 23 10:45:52.723474 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1186/2435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:52 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:52.842246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:52.843002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:52.850699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.853845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.854421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:52.855178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:52.855652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:52.856164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.117521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.124853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:53.129537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.131800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:53.132288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.133157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:53.133262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c3d2a6d0-2bb0-410e-b3db-8697d33bf7b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2955 microversion: 2.32 time: 0.295644 Aug 23 10:45:53.133913 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1250/2436] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:52 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2955 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:53.149436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.150053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.150862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.151792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.152611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.153440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.167613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:53.168249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:53.191876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.193242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.195132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.196033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.199030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.199502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.356703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.371953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.373859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.375792 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfd5f1db-f736-4ac1-919a-b76c815a9afe tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.212480 Aug 23 10:45:53.387315 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1251/2437] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:53 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:53.524102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.536951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.539185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.540410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51a2fb79-3789-4237-90d2-efa986defbff tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1729 microversion: 2.25 time: 0.413246 Aug 23 10:45:53.541384 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1187/2438] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:53 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1729 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:53.598785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:53.599866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:53.606683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.607894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.608536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.609648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.610184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.610824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.747943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:53.749029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:53.759379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.760291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.760978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.762601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:53.763385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:53.764216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:53.913048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:53.921982 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a579d5b0-5b93-466e-85a8-91f7d65bdf3c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1645 microversion: 2.1 time: 0.326986 Aug 23 10:45:53.922953 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1252/2439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:53 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1645 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:53.929232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26583cb7-2a16-420d-94b3-c9fe07357dd4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9d4f9ca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:53.996461 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26583cb7-2a16-420d-94b3-c9fe07357dd4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/f4951779-8f23-4afc-9326-ea736e0d8cb9" status: 200 len: 661 microversion: 2.1 time: 0.071474 Aug 23 10:45:53.997980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1253/2440] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:53 2022] GET /compute/v2.1/images/f4951779-8f23-4afc-9326-ea736e0d8cb9 => generated 661 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:54.014041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c97425f-c13d-4286-acd1-774c52637bf1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cc37af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:54.073345 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c97425f-c13d-4286-acd1-774c52637bf1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/f4951779-8f23-4afc-9326-ea736e0d8cb9" status: 200 len: 661 microversion: 2.1 time: 0.064259 Aug 23 10:45:54.074580 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1254/2441] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:54 2022] GET /compute/v2.1/images/f4951779-8f23-4afc-9326-ea736e0d8cb9 => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:54.165128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:54.167064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:54.184914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.186739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.187802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.190886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.194557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.195293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.371609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.387957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24e37be5-cd28-42fb-9ffa-d5e29b9a02c0 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.645836 Aug 23 10:45:54.390536 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1188/2442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:53 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:54.398161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e2bcfff8-9d31-4904-b3d6-36afe9ee898c req-ca0bce08-ef2c-43d0-b299-b373f0920c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311aa760-aad6-4829-835a-c05b8d725ef2", "name": "network-vif-deleted", "tag": "2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:54.409071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e2bcfff8-9d31-4904-b3d6-36afe9ee898c req-ca0bce08-ef2c-43d0-b299-b373f0920c5a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.409870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e2bcfff8-9d31-4904-b3d6-36afe9ee898c req-ca0bce08-ef2c-43d0-b299-b373f0920c5a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.410506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e2bcfff8-9d31-4904-b3d6-36afe9ee898c req-ca0bce08-ef2c-43d0-b299-b373f0920c5a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.427334 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e2bcfff8-9d31-4904-b3d6-36afe9ee898c req-ca0bce08-ef2c-43d0-b299-b373f0920c5a service nova] Creating event network-vif-deleted:2be7a08d-e053-4fb6-8cb2-a9f91a42f4c8 for instance 311aa760-aad6-4829-835a-c05b8d725ef2 on n-h2-847009-13 Aug 23 10:45:54.435046 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e2bcfff8-9d31-4904-b3d6-36afe9ee898c req-ca0bce08-ef2c-43d0-b299-b373f0920c5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042577 Aug 23 10:45:54.436320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1189/2443] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:54.445574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:54.446653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:54.455195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.456052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.457025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.458242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.459750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.463401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.517526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:54.646864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.650315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.659108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.660629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.662269 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f187e2f-e2ef-4d36-a268-2093b01b81a6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2955 microversion: 2.32 time: 0.504772 Aug 23 10:45:54.662848 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1255/2444] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:54 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2955 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:54.672415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.674870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.676715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f471105f-24f0-43d8-80c2-0acc94c8f9b0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.238365 Aug 23 10:45:54.695251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:54.696160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:54.698225 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1190/2445] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:54 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:54.714893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.715629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.716538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.717631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.718284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.719127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.839050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.851088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.854726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:54.856575 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51021d89-63c9-488f-8251-1a9c09d55a33 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1662 microversion: 2.25 time: 0.191510 Aug 23 10:45:54.870371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1256/2446] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:54 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:54.952244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:54.954193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:54.986075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.987025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.988166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:54.989194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:54.990370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:54.993784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-750636f6-3fe4-46fc-80f5-a4195beee982 req-366b7799-9763-477e-aa02-48a51d384cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "465d3faa-5cc1-4087-9589-d137378f09ad", "name": "network-vif-deleted", "tag": "ef0de150-72f9-464f-a35d-16625dc95f35"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:54.997404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.009689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-750636f6-3fe4-46fc-80f5-a4195beee982 req-366b7799-9763-477e-aa02-48a51d384cd2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.011280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-750636f6-3fe4-46fc-80f5-a4195beee982 req-366b7799-9763-477e-aa02-48a51d384cd2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.011926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-750636f6-3fe4-46fc-80f5-a4195beee982 req-366b7799-9763-477e-aa02-48a51d384cd2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.044912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-750636f6-3fe4-46fc-80f5-a4195beee982 req-366b7799-9763-477e-aa02-48a51d384cd2 service nova] Creating event network-vif-deleted:ef0de150-72f9-464f-a35d-16625dc95f35 for instance 465d3faa-5cc1-4087-9589-d137378f09ad on n-h1-847009-13 Aug 23 10:45:55.059755 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-750636f6-3fe4-46fc-80f5-a4195beee982 req-366b7799-9763-477e-aa02-48a51d384cd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072815 Aug 23 10:45:55.060387 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1257/2447] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:45:55.062686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.063513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.064167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.065108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lazy-loading 'fault' on Instance uuid 311aa760-aad6-4829-835a-c05b8d725ef2 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:55.206347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:55.225374 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c57ed459-a16f-40e9-a84d-a79a449c88f3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 200 len: 1306 microversion: 2.1 time: 0.283760 Aug 23 10:45:55.246400 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1191/2448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:54 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 1306 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:55.422050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:55.422903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:55.458079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.466050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.466576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.469549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.470042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.470491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.714166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:55.725642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5dcc5f7b-c2b3-4684-a1cf-e3524b39e9bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.316495 Aug 23 10:45:55.728918 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1258/2449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:55 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:55.737220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:55.740131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:55.750008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c82605c-24e1-4700-8936-c3fee8f1df1d tempest-ListImageFiltersNegativeTestJSON-1297705793 tempest-ListImageFiltersNegativeTestJSON-1297705793-project] Calling method '.version_select at 0x7fdc9c2d7430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:55.754519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.755333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.756804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.757917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.758595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.759467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.780133 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1c82605c-24e1-4700-8936-c3fee8f1df1d tempest-ListImageFiltersNegativeTestJSON-1297705793 tempest-ListImageFiltersNegativeTestJSON-1297705793-project] HTTP exception thrown: Image not found. Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c82605c-24e1-4700-8936-c3fee8f1df1d tempest-ListImageFiltersNegativeTestJSON-1297705793 tempest-ListImageFiltersNegativeTestJSON-1297705793-project] Request method failure captured: Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/images/f87f9305-98e2-4967-a078-177608d7ad3a HTTP/1.1 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_jwb8bzgT_WroEGIxcm6Pv6OLnpuJjiVo1RkYWIfU7mAgwuXuUIvdGVy-fmR5V8VNhy7trgsSRtJWURFuRZbY76bPlNOMxQCWKbtzMjHgSZ7gofz-sCfj-M70VPZO5p1OLhb2fzhv4oQ_RE0bU6jnCr1GZdhemfnqdvSQyMKvx_rY Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 282ff209c7be405e920785b62e963926 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1297705793 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/282ff209c7be405e920785b62e963926"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_282ff209c7be405e920785b62e963926", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/282ff209c7be405e920785b62e963926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/282ff209c7be405e920785b62e963926"}]}] Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1297705793 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 282ff209c7be405e920785b62e963926 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1297705793 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListImageFiltersNegativeTestJSON-1297705793-project Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: cee12b76b42847ee8fd91100855bf918 Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1297705793-project Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: exception: Image not found. Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f87f9305-98e2-4967-a078-177608d7ad3a'} Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f87f9305-98e2-4967-a078-177608d7ad3a Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:45:55.789984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f87f9305-98e2-4967-a078-177608d7ad3a could not be found. Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c82605c-24e1-4700-8936-c3fee8f1df1d tempest-ListImageFiltersNegativeTestJSON-1297705793 tempest-ListImageFiltersNegativeTestJSON-1297705793-project] Returning 404 to user: Image not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c82605c-24e1-4700-8936-c3fee8f1df1d tempest-ListImageFiltersNegativeTestJSON-1297705793 tempest-ListImageFiltersNegativeTestJSON-1297705793-project] 10.222.0.78 "GET /compute/v2.1/images/f87f9305-98e2-4967-a078-177608d7ad3a" status: 404 len: 62 microversion: 2.1 time: 0.312443 Aug 23 10:45:55.794062 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1192/2450] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:55 2022] GET /compute/v2.1/images/f87f9305-98e2-4967-a078-177608d7ad3a => generated 62 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:45:55.817067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:55.817832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:55.844087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.844380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.844823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:55.845701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:55.846264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:55.846974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.000029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.013576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.021392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.023618 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e8f924e-f7bd-43db-adcf-8780b4326742 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.230623 Aug 23 10:45:56.024652 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1193/2451] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:55 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:56.029422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.034614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:56.048872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.049608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.053156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.054650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.055325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.056582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.068044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:56.113684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.117659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.118247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.123725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lazy-loading 'fault' on Instance uuid 465d3faa-5cc1-4087-9589-d137378f09ad {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:45:56.132465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.143159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.144869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.146213 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-793ffcb6-2e75-4f63-9d2b-7a356511311c tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2934 microversion: 2.32 time: 0.416227 Aug 23 10:45:56.160768 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1259/2452] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:55 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2934 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:56.169424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5691ec4-5fdd-49be-9598-0f69847924e2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cded670>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.244518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5691ec4-5fdd-49be-9598-0f69847924e2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/abc78397-c87d-4b15-9c92-b7424c3cd444" status: 200 len: 662 microversion: 2.1 time: 0.096202 Aug 23 10:45:56.247265 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1260/2453] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:56 2022] GET /compute/v2.1/images/abc78397-c87d-4b15-9c92-b7424c3cd444 => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:56.254231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.256080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:56.257416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.264303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.265135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.265409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.265972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.266927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.267553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.268127 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-043ecb0c-5524-4ffb-8c1f-dcfbc5c0568f tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 200 len: 1373 microversion: 2.25 time: 0.242262 Aug 23 10:45:56.268577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.273555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.277296 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1194/2454] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:56 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 1373 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:56.290141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67aa2d35-63ca-4aa6-8db2-187aa1f968ca tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cdceaf0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.295509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 HTTP/1.1 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '311aa760-aad6-4829-835a-c05b8d725ef2'} Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:56.298222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:56.302248 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:56.303761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:56.305025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6ebd431-678d-4dd0-8d8d-a2e41c7a1e13 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 404 len: 111 microversion: 2.1 time: 0.056405 Aug 23 10:45:56.309127 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1261/2455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:56 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:56.315110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e001999a-84f1-4958-8d35-725a64d5c428 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d2ea1f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.352653 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67aa2d35-63ca-4aa6-8db2-187aa1f968ca tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/abc78397-c87d-4b15-9c92-b7424c3cd444" status: 200 len: 662 microversion: 2.1 time: 0.074008 Aug 23 10:45:56.353551 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1195/2456] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:56 2022] GET /compute/v2.1/images/abc78397-c87d-4b15-9c92-b7424c3cd444 => generated 662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:56.630073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e001999a-84f1-4958-8d35-725a64d5c428 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994" status: 202 len: 0 microversion: 2.1 time: 0.319410 Aug 23 10:45:56.638488 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1262/2457] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:56 2022] DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:56.643932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b9ae7b9-1865-4f67-a8ef-72adac3a4830 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cf9cb80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.747890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:56.748873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:56.751208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:45:56.764093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.764695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.765913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.766739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.767282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.767943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:56.961619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:56.967315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f28b3fc9-0183-4895-9f73-0c65f9ea5653 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.223995 Aug 23 10:45:56.980850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1263/2458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:56 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:56.980850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-af2d3672-2553-4335-8af3-ecafa3047064 req-591e65b9-bd47-4c64-a698-d9ae62979b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-deleted", "tag": "c543dece-200b-4b28-bad8-de92bd67034b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:56.985706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-af2d3672-2553-4335-8af3-ecafa3047064 req-591e65b9-bd47-4c64-a698-d9ae62979b2e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:56.986318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-af2d3672-2553-4335-8af3-ecafa3047064 req-591e65b9-bd47-4c64-a698-d9ae62979b2e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:56.987182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-af2d3672-2553-4335-8af3-ecafa3047064 req-591e65b9-bd47-4c64-a698-d9ae62979b2e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.003798 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-af2d3672-2553-4335-8af3-ecafa3047064 req-591e65b9-bd47-4c64-a698-d9ae62979b2e service nova] Creating event network-vif-deleted:c543dece-200b-4b28-bad8-de92bd67034b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:45:57.010136 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-af2d3672-2553-4335-8af3-ecafa3047064 req-591e65b9-bd47-4c64-a698-d9ae62979b2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040042 Aug 23 10:45:57.010966 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1264/2459] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:57.053236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:57.054483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:57.062346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:57.063120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:57.064570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.066618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:57.067236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:57.067864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.140897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b9ae7b9-1865-4f67-a8ef-72adac3a4830 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af" status: 202 len: 0 microversion: 2.1 time: 0.502054 Aug 23 10:45:57.141484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1196/2460] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:56 2022] DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:45:57.155318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d59b180e-13ef-45ef-9ed1-d918a703fd83 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'create', calling method: .version_select at 0x7fdc9cccf9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-486235732", "description": "tempest-description-271637145"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:57.168221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:57.178068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:57.179828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:57.181401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2202a2f4-b92d-41e2-a7b0-3517fe841d06 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.137677 Aug 23 10:45:57.182634 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1265/2461] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:57 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:45:57.187735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:57.188928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:57.195495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:57.196288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:57.196914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.197781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:57.198386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:57.198983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.403720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:57.436300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:57.453979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:57.461971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bd4af3b-493f-4276-80f0-1badf904beb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2753 microversion: 2.32 time: 0.276554 Aug 23 10:45:57.464468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1266/2462] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:57 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2753 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:57.480953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:57.481802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 465d3faa-5cc1-4087-9589-d137378f09ad] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:57.493354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:57.494526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:57.495227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.496590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:57.497472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:57.498056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:57.519149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] HTTP exception thrown: Instance 465d3faa-5cc1-4087-9589-d137378f09ad could not be found. Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Request method failure captured: Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad HTTP/1.1 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4KM3yofeWUL9QE3W_qodzlgo3jHb-IeUeT2rJ30T49I5usZAUJd2m0Gc4fb2ROwTYOwuzoAxyUBrQNEMujdLraxlQ_0v6VNcVggylcggmzpGcISLNXbNZxoZmqBD9N6B5qhla49_nVGS3lVziI7x0T6-DOqxh65DocmwTfFv5Huig Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_64ea87e1ef314e1886f92fcf108c414f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}] Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 04d5d44e84d5459ab1a59c13bcf69012 Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 465d3faa-5cc1-4087-9589-d137378f09ad could not be found. Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '465d3faa-5cc1-4087-9589-d137378f09ad'} Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 465d3faa-5cc1-4087-9589-d137378f09ad could not be found. Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 465d3faa-5cc1-4087-9589-d137378f09ad could not be found. Aug 23 10:45:57.523300 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 465d3faa-5cc1-4087-9589-d137378f09ad could not be found. Aug 23 10:45:57.527593 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:57.530513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Returning 404 to user: Instance 465d3faa-5cc1-4087-9589-d137378f09ad could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:57.531555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ba656c0-d9d6-41f7-9507-b6425b000b48 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad" status: 404 len: 111 microversion: 2.25 time: 0.065734 Aug 23 10:45:57.533481 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1267/2463] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:57 2022] GET /compute/v2.1/servers/465d3faa-5cc1-4087-9589-d137378f09ad => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:45:57.546988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f5ed255-52e3-4cb0-a2b7-b1b5ae31adc7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '.version_select at 0x7fdc9d23d280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:57.566233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d59b180e-13ef-45ef-9ed1-d918a703fd83 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.414769 Aug 23 10:45:57.567145 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1197/2464] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:45:57 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:57.581780 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f5ed255-52e3-4cb0-a2b7-b1b5ae31adc7 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85876398" status: 204 len: 0 microversion: 2.25 time: 0.042006 Aug 23 10:45:57.586469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1268/2465] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 10:45:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85876398 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:45:57.591490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2be0f13c-a48e-422d-914a-2dbc0312e714 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Action: 'update', calling method: .version_select at 0x7fdc9cf9c8b0>, body: {"security_group": {"name": "tempest-sg-hth-8992091", "description": "tempest-description-hth-727899645"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:57.994050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:57.994925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:58.008761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.010721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.012033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.013447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.015583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.017198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.155838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2be0f13c-a48e-422d-914a-2dbc0312e714 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/8a6b6c25-dd57-4a00-9278-805e8fec23b1" status: 200 len: 214 microversion: 2.1 time: 0.578998 Aug 23 10:45:58.156677 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1198/2466] 10.222.0.78 () {60 vars in 1290 bytes} [Tue Aug 23 10:45:57 2022] PUT /compute/v2.1/os-security-groups/8a6b6c25-dd57-4a00-9278-805e8fec23b1 => generated 214 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:58.287766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:58.296588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43ead970-79a6-4b39-90d1-b04b2251935a tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.308916 Aug 23 10:45:58.297302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1269/2467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:57 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:45:58.302147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8a38cf89-9f0f-469e-9668-79d7624e64b2 req-71f5157a-bc6f-4ce6-9530-be015121a887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-unplugged", "status": "completed", "tag": "d7fc2d75-be2d-4fc6-8f63-c92af11191c8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:58.312648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8a38cf89-9f0f-469e-9668-79d7624e64b2 req-71f5157a-bc6f-4ce6-9530-be015121a887 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.313999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8a38cf89-9f0f-469e-9668-79d7624e64b2 req-71f5157a-bc6f-4ce6-9530-be015121a887 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.314682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8a38cf89-9f0f-469e-9668-79d7624e64b2 req-71f5157a-bc6f-4ce6-9530-be015121a887 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.335037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8a38cf89-9f0f-469e-9668-79d7624e64b2 req-71f5157a-bc6f-4ce6-9530-be015121a887 service nova] Creating event network-vif-unplugged:d7fc2d75-be2d-4fc6-8f63-c92af11191c8 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:45:58.344028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8a38cf89-9f0f-469e-9668-79d7624e64b2 req-71f5157a-bc6f-4ce6-9530-be015121a887 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045373 Aug 23 10:45:58.345570 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1270/2468] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:58.350990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f158c09-5fc2-4389-814b-0b2595779833 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d8679d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.382664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c6ca2a8-f3b0-4b36-92db-0f45b83a0e77 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9cf6dee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBwL/tasXoyzYbN82Au4IeQLA0xSl7AzAWQ1bg48HI1+p2Bl8pg2tcMyetG62PTaOZo3la0d1+wzpskRbGH7EAoiiguAPy/UEcqg4Hz0ZjjMlBv5CCGG4D7fWvvRPSx5A=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c6ca2a8-f3b0-4b36-92db-0f45b83a0e77 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 257 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBwL/tasXoyzYbN82Au4IeQLA0xSl7AzAWQ1bg48HI1+p2Bl8pg2tcMyetG62PTaOZo3la0d1+wzpskRbGH7EAoiiguAPy/UEcqg4Hz0ZjjMlBv5CCGG4D7fWvvRPSx5A=="}} Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBwL/tasXoyzYbN82Au4IeQLA0xSl7AzAWQ1bg48HI1+p2Bl8pg2tcMyetG62PTaOZo3la0d1+wzpskRbGH7EAoiiguAPy/UEcqg4Hz0ZjjMlBv5CCGG4D7fWvvRPSx5A=='}}} Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 23 10:45:58.388579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c6ca2a8-f3b0-4b36-92db-0f45b83a0e77 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c6ca2a8-f3b0-4b36-92db-0f45b83a0e77 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.233695 Aug 23 10:45:58.392144 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1199/2469] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:45:58 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:45:58.401436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.402258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:58.409798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.411101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.412570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.414043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.415035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.415689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.426400 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f158c09-5fc2-4389-814b-0b2595779833 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/8a6b6c25-dd57-4a00-9278-805e8fec23b1" status: 200 len: 214 microversion: 2.1 time: 0.079448 Aug 23 10:45:58.427063 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1271/2470] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:45:58 2022] GET /compute/v2.1/os-security-groups/8a6b6c25-dd57-4a00-9278-805e8fec23b1 => generated 214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:58.432328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3954b7b5-3017-4506-bad8-6be234162598 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9fe32550>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.496499 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3954b7b5-3017-4506-bad8-6be234162598 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/efca15b7-3b0d-4108-a7a5-eb1db2fb6277" status: 200 len: 662 microversion: 2.1 time: 0.068181 Aug 23 10:45:58.497295 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1272/2471] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:58 2022] GET /compute/v2.1/images/efca15b7-3b0d-4108-a7a5-eb1db2fb6277 => generated 662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:58.504816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9cc8caf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-460320420", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:58.523771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:58.529746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for user 2bc36f203f2e42c5b9ce240cd1e001d8 and project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:58.548715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 2166 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-460320420", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:58.560261 n-d-847009-13 devstack@n-api.service[128859]: exception: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-460320420', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:58.562262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:58.568612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0365c4f-2fb2-47b9-a08b-f02d017307f6 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.063387 Aug 23 10:45:58.571621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1273/2472] 10.222.0.78 () {60 vars in 1160 bytes} [Tue Aug 23 10:45:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:45:58.575376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e569508d-74f8-4da3-b8ac-74a54aa05cc3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cc9bb80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.753256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:58.763772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:58.766119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:58.767726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51f5afef-64e2-4803-947c-5d9c5b63314b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.374818 Aug 23 10:45:58.770258 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1200/2473] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:58 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:58.776233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e569508d-74f8-4da3-b8ac-74a54aa05cc3 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/8a6b6c25-dd57-4a00-9278-805e8fec23b1" status: 202 len: 0 microversion: 2.1 time: 0.204825 Aug 23 10:45:58.776830 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1274/2474] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:58 2022] DELETE /compute/v2.1/os-security-groups/8a6b6c25-dd57-4a00-9278-805e8fec23b1 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:58.779771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.779771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:58.783513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a1a5f9a-b9ae-439d-9351-73867e4a71ce tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cc42280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.795356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.795885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.796406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.797181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.797645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.798121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.833402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a1a5f9a-b9ae-439d-9351-73867e4a71ce tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/efca15b7-3b0d-4108-a7a5-eb1db2fb6277" status: 200 len: 662 microversion: 2.1 time: 0.055415 Aug 23 10:45:58.834275 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1275/2475] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:45:58 2022] GET /compute/v2.1/images/efca15b7-3b0d-4108-a7a5-eb1db2fb6277 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:58.839815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d57c0d42-d981-4aab-9c9e-12c6fe53b913 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9cc8c430>, body: {"keypair": {"name": "tempest-keypair-1210276384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlgJjgyOp52tylE6kQZ8ZfgUFN8GjQf9tHZTpKWekInbsgMCAqasc2JfhCehN2EEqPCtqz/VtJuVJiqrdofqpqum9p1YwdIrrsuy8ekPY3ijEnY41YXFYb3XMO75cPy+g=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:58.858578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d57c0d42-d981-4aab-9c9e-12c6fe53b913 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:58.868208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d57c0d42-d981-4aab-9c9e-12c6fe53b913 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for user 2bc36f203f2e42c5b9ce240cd1e001d8 and project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:58.903606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d57c0d42-d981-4aab-9c9e-12c6fe53b913 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068079 Aug 23 10:45:58.904390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1276/2476] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:45:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:58.919867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:58.920500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:58.926851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.927904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.928488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.929407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:58.930019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:58.930606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:58.966222 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 HTTP/1.1 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '311aa760-aad6-4829-835a-c05b8d725ef2'} Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:58.967963 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7932a69b-5182-4f78-bdc8-c184fc98888f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 404 len: 111 microversion: 2.1 time: 0.064326 Aug 23 10:45:58.971232 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1277/2477] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:45:58 2022] DELETE /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:58.979931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9cb618b0>, body: {"keypair": {"name": "tempest-keypair-1210276384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpd+g2/Pb86q4WgpH7LMvTt6GVJ12TQeMcUHAKZeCVtrFXpYsrm+e0WA5RWT9gpRkG+Unf9aob+vkS44jyIza7d+T6dte69/8BC0kGfys5470RaIZRq3Z9286iEQ+RQw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:58.997734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:59.004318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for user 2bc36f203f2e42c5b9ce240cd1e001d8 and project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:59.031470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] HTTP exception thrown: Key pair 'tempest-keypair-1210276384' already exists. Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 273 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: {"keypair": {"name": "tempest-keypair-1210276384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpd+g2/Pb86q4WgpH7LMvTt6GVJ12TQeMcUHAKZeCVtrFXpYsrm+e0WA5RWT9gpRkG+Unf9aob+vkS44jyIza7d+T6dte69/8BC0kGfys5470RaIZRq3Z9286iEQ+RQw=="}} Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: exception: Key pair 'tempest-keypair-1210276384' already exists. Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1210276384', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpd+g2/Pb86q4WgpH7LMvTt6GVJ12TQeMcUHAKZeCVtrFXpYsrm+e0WA5RWT9gpRkG+Unf9aob+vkS44jyIza7d+T6dte69/8BC0kGfys5470RaIZRq3Z9286iEQ+RQw=='}}} Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result.read() Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '2bc36f203f2e42c5b9ce240cd1e001d8-tempest-keypair-1210276384' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 23 10:45:59.034743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi session.flush() Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result.read() Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 10:45:59.039335 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '2bc36f203f2e42c5b9ce240cd1e001d8-tempest-keypair-1210276384' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 23, 10, 45, 59, 25037), 'updated_at': None, 'name': 'tempest-keypair-1210276384', 'user_id': '2bc36f203f2e42c5b9ce240cd1e001d8', 'fingerprint': '27:9a:8e:50:4a:af:f8:17:ce:b3:0f:a5:c0:16:bf:ad', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTpd+g2/Pb86q4WgpH7LMvTt6GVJ12TQeMcUHAKZeCVtrFXpYsrm+e0WA5RWT9gpRkG+Unf9aob+vkS44jyIza7d+T6dte69/8BC0kGfys5470RaIZRq3Z9286iEQ+RQw==', 'type': 'ssh'}] Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi keypair.create() Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._create() Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1210276384' already exists. Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 23 10:45:59.043844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1210276384' already exists. Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1210276384' already exists. Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 409 to user: Key pair 'tempest-keypair-1210276384' already exists. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-27c0f655-f07a-4a15-9a7d-d651759c5ea4 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.065060 Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1278/2478] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:45:58 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.047438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 311aa760-aad6-4829-835a-c05b8d725ef2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:59.054268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.054766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.055207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.055921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.056459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.057066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.072444 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 HTTP/1.1 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '311aa760-aad6-4829-835a-c05b8d725ef2'} Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.074049 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Instance 311aa760-aad6-4829-835a-c05b8d725ef2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c08623eb-bfa4-4db6-a09e-6bca5a6d4d9b tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2" status: 404 len: 111 microversion: 2.1 time: 0.036952 Aug 23 10:45:59.078025 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1279/2479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:59 2022] GET /compute/v2.1/servers/311aa760-aad6-4829-835a-c05b8d725ef2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:59.080732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1993819708", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:59.135033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:45:59.186763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:59.199077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:59.202820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:59.204436 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-002c6631-7e3d-4bb0-846e-52ba427385e9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2659 microversion: 2.32 time: 0.433186 Aug 23 10:45:59.205247 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1201/2480] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:58 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2659 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:45:59.211077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-deleted", "tag": "8c852214-7d06-4732-b9da-d47803940a50"}, {"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-deleted", "tag": "c9fa7fb8-824f-4206-aef0-a342042e747c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:59.224800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.225588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.226090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.239457 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] Creating event network-vif-deleted:8c852214-7d06-4732-b9da-d47803940a50 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:45:59.240112 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] Creating event network-vif-deleted:c9fa7fb8-824f-4206-aef0-a342042e747c for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:45:59.246391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3cc60262-8518-4643-bd23-ed0936dd4866 req-3feb1fa3-8b8d-43d5-a4c6-865d6a27cf5c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039266 Aug 23 10:45:59.247067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1202/2481] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:45:59.252389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a1fb25c-fb65-4402-9e9e-68d1bc69e5da tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Calling method '.version_select at 0x7fdc9cd16310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.276378 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a1fb25c-fb65-4402-9e9e-68d1bc69e5da tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210276384" status: 202 len: 0 microversion: 2.1 time: 0.027852 Aug 23 10:45:59.278366 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1203/2482] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:45:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210276384 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:45:59.288993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cdbe1f0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.367699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:45:59.368349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:45:59.368857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:45:59.369275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:45:59.369689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:45:59.372767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:59.373508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 11523be2-e16b-4aa7-8c62-ed6ec53391af not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:59.374418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.374418 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af HTTP/1.1 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '11523be2-e16b-4aa7-8c62-ed6ec53391af'} Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:59.377269 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 11523be2-e16b-4aa7-8c62-ed6ec53391af does not exist Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-5cd8a260-4743-455a-9395-2d37361f76fc'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc536b2a-8743-489e-834b-22ed28d7f0fd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af" status: 404 len: 194 microversion: 2.1 time: 0.099223 Aug 23 10:45:59.381254 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1204/2483] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:59 2022] DELETE /compute/v2.1/os-security-groups/11523be2-e16b-4aa7-8c62-ed6ec53391af => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:59.388080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-beaf5302-c594-4e19-8695-d89d023cb7fa tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9c47baf0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2mf7WTMKrrTy7DacyuS1b+P4qrov8ypRWESJ+owwa5Of3u3smyxBNRYmkSXrIYbmuMpmJGrw5MTctIgosJSsJT5oY8bzVdZF2KKBUKmzgBCIzOttB4bA6PPwmynGBB3A=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-beaf5302-c594-4e19-8695-d89d023cb7fa tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 247 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2mf7WTMKrrTy7DacyuS1b+P4qrov8ypRWESJ+owwa5Of3u3smyxBNRYmkSXrIYbmuMpmJGrw5MTctIgosJSsJT5oY8bzVdZF2KKBUKmzgBCIzOttB4bA6PPwmynGBB3A=="}} Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2mf7WTMKrrTy7DacyuS1b+P4qrov8ypRWESJ+owwa5Of3u3smyxBNRYmkSXrIYbmuMpmJGrw5MTctIgosJSsJT5oY8bzVdZF2KKBUKmzgBCIzOttB4bA6PPwmynGBB3A=='}}} Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi '' Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:45:59.390444 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-beaf5302-c594-4e19-8695-d89d023cb7fa tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-beaf5302-c594-4e19-8695-d89d023cb7fa tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.011676 Aug 23 10:45:59.394051 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1205/2484] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:45:59 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:45:59.401625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.402382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:59.407566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.408350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.409104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.410061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.410204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.410837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.411177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.411551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.412211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.413186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.413803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.414666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.437045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Getting quotas for project b08e0d2ea0914fdb8bc77193f1ffe659. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:59.445119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Getting quotas for user d169ff5df3a64b94a10742bca2ace9de and project b08e0d2ea0914fdb8bc77193f1ffe659. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:59.461498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:45:59.463897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:45:59.516588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f3abf4c-589d-4e9c-877f-c69fe3199154 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439536 Aug 23 10:45:59.529063 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1280/2485] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:45:59.542086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cb61e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.567981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:59.568768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:59.569419 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.569419 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994 HTTP/1.1 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6d4908a6-dc88-4d7b-ab01-8d76fdb78994'} Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:59.571493 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 6d4908a6-dc88-4d7b-ab01-8d76fdb78994 does not exist Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-289c1343-fa18-4cd3-950f-94af3b494db7'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f934e89-9883-4d5c-95d7-0470c38f6a5c tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994" status: 404 len: 194 microversion: 2.1 time: 0.042875 Aug 23 10:45:59.574679 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1281/2486] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:59 2022] DELETE /compute/v2.1/os-security-groups/6d4908a6-dc88-4d7b-ab01-8d76fdb78994 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:59.581910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9cc9bc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-167594777", "public_key": " "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:59.600951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:45:59.606869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for user 2bc36f203f2e42c5b9ce240cd1e001d8 and project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:45:59.625688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 94 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-167594777", "public_key": " "}} Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: exception: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-167594777', 'public_key': ' '}}} Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.627784 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 23 10:45:59.631980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.635325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.636207 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48dc1cf6-8134-4bd4-b2f7-4da0a9fd8aff tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.061743 Aug 23 10:45:59.636844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1282/2487] 10.222.0.78 () {60 vars in 1158 bytes} [Tue Aug 23 10:45:59 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:45:59.641492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cbb9700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.666585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:59.667306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:59.667913 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.667913 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c HTTP/1.1 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '161d9538-3d54-4d53-8fd4-2e6c53e9e29c'} Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:59.670745 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 161d9538-3d54-4d53-8fd4-2e6c53e9e29c does not exist Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-f69abfdc-4c63-42bc-a406-0f5b5b983c7e'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b3bc425-278b-46f0-9868-5cb5ac8539f4 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c" status: 404 len: 194 microversion: 2.1 time: 0.034555 Aug 23 10:45:59.677542 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1283/2488] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:59 2022] DELETE /compute/v2.1/os-security-groups/161d9538-3d54-4d53-8fd4-2e6c53e9e29c => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:59.680343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.680532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:59.687566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.688052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.688691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.689465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.689956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.690621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.723042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:45:59.763631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:45:59.774415 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bde3c56b-4aba-4f7a-8172-8be23e8b3c10 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.380883 Aug 23 10:45:59.775278 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1206/2489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:45:59 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:45:59.781426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1630555024", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:59.831442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92227dac-90c7-4700-b306-67bb62d7b60b tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 204 len: 0 microversion: 2.25 time: 0.157081 Aug 23 10:45:59.832061 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1284/2490] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:45:59 2022] DELETE /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:45:59.840916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b3505bf-ebe4-4109-b4d4-9fa0aa241377 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9d4f90d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGCVd+RnVT61qnrhcP34y5SVlfUS8voYX6rET9zEe7vYO3+379eB/DdpuMRWZkSFjqC1EfknaMonlJTW/b3VqWJXhJVFdGZqxcaa+ZySZ0eBMiWfeFgKtU//UCfjWPfPg=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b3505bf-ebe4-4109-b4d4-9fa0aa241377 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 507 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGCVd+RnVT61qnrhcP34y5SVlfUS8voYX6rET9zEe7vYO3+379eB/DdpuMRWZkSFjqC1EfknaMonlJTW/b3VqWJXhJVFdGZqxcaa+ZySZ0eBMiWfeFgKtU//UCfjWPfPg=="}} Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGCVd+RnVT61qnrhcP34y5SVlfUS8voYX6rET9zEe7vYO3+379eB/DdpuMRWZkSFjqC1EfknaMonlJTW/b3VqWJXhJVFdGZqxcaa+ZySZ0eBMiWfeFgKtU//UCfjWPfPg=='}}} Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 23 10:45:59.845192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b3505bf-ebe4-4109-b4d4-9fa0aa241377 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b3505bf-ebe4-4109-b4d4-9fa0aa241377 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012104 Aug 23 10:45:59.847872 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1285/2491] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:45:59 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:45:59.853581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d23db80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.871835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:45:59.883507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:45:59.884118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group cac52297-e343-4807-ad1c-a9103ecb629c not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:45:59.884646 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.884646 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c HTTP/1.1 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'cac52297-e343-4807-ad1c-a9103ecb629c'} Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:45:59.886552 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group cac52297-e343-4807-ad1c-a9103ecb629c does not exist Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-b7aea3a7-1ab0-48a6-99f8-d7b6280abcd3'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-96f61ba0-dedc-4174-853b-ec0f85e7aa84 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c" status: 404 len: 194 microversion: 2.1 time: 0.039773 Aug 23 10:45:59.891230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1286/2492] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:45:59 2022] DELETE /compute/v2.1/os-security-groups/cac52297-e343-4807-ad1c-a9103ecb629c => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:45:59.896808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:45:59.896808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:45:59.904341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.904968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.905454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.906304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:45:59.906779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:45:59.907355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:45:59.993661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.002993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.005911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.007639 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9517d824-696d-461e-b430-a0e6d66f133b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.118132 Aug 23 10:46:00.008215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1287/2493] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:45:59 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:00.013347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.014189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:00.022193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.022913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.023469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.024588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.024696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.025262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.030265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:00.171126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.180175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.181703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.182937 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0973287d-04d1-48d0-8259-864ff53d222d tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1548 microversion: 2.25 time: 0.173364 Aug 23 10:46:00.184107 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1288/2494] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:00 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:00.188806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Action: 'create', calling method: .version_select at 0x7fdc9cb6e670>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1329846505", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:00.205914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:46:00.212552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Getting quotas for user 2bc36f203f2e42c5b9ce240cd1e001d8 and project bfd7080629a54ac3a039564d7f8ba716. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:46:00.215009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:00.235581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 118 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1329846505", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: exception: Keypair data is invalid: failed to generate fingerprint Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1329846505', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 23 10:46:00.237619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae914512-5908-408b-a483-4daba2e81e08 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.053941 Aug 23 10:46:00.242627 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1289/2495] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:46:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:46:00.249604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9cb21310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.275929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:46:00.276541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:46:00.277102 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.277102 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595 HTTP/1.1 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '18cafb78-f4d5-486f-8c67-c3e1e069b595'} Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:46:00.279191 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 18cafb78-f4d5-486f-8c67-c3e1e069b595 does not exist Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-b31eb767-a28d-4c38-a26a-416c284ca5de'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c90b73e6-d591-4973-927b-abf5d0d5990e tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595" status: 404 len: 194 microversion: 2.1 time: 0.039022 Aug 23 10:46:00.283094 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1290/2496] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:46:00 2022] DELETE /compute/v2.1/os-security-groups/18cafb78-f4d5-486f-8c67-c3e1e069b595 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:00.287174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.287339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:00.287955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:46:00.288448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:46:00.288714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:46:00.289230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:46:00.289727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:46:00.293777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.294319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.294963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.295672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.296134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.296563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.303718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.304236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.304692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.305505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.306090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.306414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.327506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Getting quotas for project b08e0d2ea0914fdb8bc77193f1ffe659. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:46:00.333411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Getting quotas for user d169ff5df3a64b94a10742bca2ace9de and project b08e0d2ea0914fdb8bc77193f1ffe659. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:46:00.347125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:46:00.349988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:46:00.399393 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5a6f959-956b-4523-9b21-be3cb52ebfb1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623100 Aug 23 10:46:00.400369 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1207/2497] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:45:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:46:00.405147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddc5a0de-c7f0-4b51-ac85-1f2880ab6129 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Calling method '.version_select at 0x7fdc9cd16c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.441823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ddc5a0de-c7f0-4b51-ac85-1f2880ab6129 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-386976173 not found for user 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddc5a0de-c7f0-4b51-ac85-1f2880ab6129 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Request method failure captured: Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-386976173 HTTP/1.1 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_lE3yno3pnhSTsZ_sU_wbSPIJGks4FwbCcb829bhP80ZmXxz5BfnzBp4QKtYTNIpVUixgSqfL1IfGrjzNbTj6e6jRL_T6wu56nTGptDFaB6UCQ4TjsyvyTx58dkGzZQABAvUneXyCI5e_EXd6eFegHjDsGFTeCyhtBPH5d9RJNgaQ Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfd7080629a54ac3a039564d7f8ba716", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfd7080629a54ac3a039564d7f8ba716"}]}] Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: bfd7080629a54ac3a039564d7f8ba716 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1818133324 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1818133324-project Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: exception: Keypair tempest-keypair-non-existent-386976173 not found for user 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'tempest-keypair-non-existent-386976173'} Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-386976173 not found for user 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.444231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-386976173 not found for user 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-386976173 not found for user 2bc36f203f2e42c5b9ce240cd1e001d8 Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddc5a0de-c7f0-4b51-ac85-1f2880ab6129 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] Returning 404 to user: Keypair tempest-keypair-non-existent-386976173 not found for user 2bc36f203f2e42c5b9ce240cd1e001d8 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:00.448287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddc5a0de-c7f0-4b51-ac85-1f2880ab6129 tempest-KeyPairsNegativeTestJSON-1818133324 tempest-KeyPairsNegativeTestJSON-1818133324-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-386976173" status: 404 len: 144 microversion: 2.1 time: 0.044360 Aug 23 10:46:00.455471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1208/2498] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 10:46:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-386976173 => generated 144 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:00.459518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9c3c7040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.500584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:46:00.501217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Neutron security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:46:00.501742 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.501742 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012 HTTP/1.1 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '28b65280-e648-45b4-ac1d-e5b1e2d3b012'} Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:46:00.503599 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Security group 28b65280-e648-45b4-ac1d-e5b1e2d3b012 does not exist Aug 23 10:46:00.508092 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-337c9c78-8878-4558-9d7e-6dd970a52de4'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:00.513177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.513357 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-025b82ae-909e-423e-941f-f5f49644f5b7 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012" status: 404 len: 194 microversion: 2.1 time: 0.050292 Aug 23 10:46:00.513357 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1209/2499] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:46:00 2022] DELETE /compute/v2.1/os-security-groups/28b65280-e648-45b4-ac1d-e5b1e2d3b012 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:00.513357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5a60dded-0150-48a1-99e8-a1313bdd91d4 req-e5c50aa2-1afe-4a07-a4c1-2e8727396f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-unplugged", "status": "completed", "tag": "92e6c454-69c8-4403-a85d-d026ca05400b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:00.520676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.523320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.524570 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1facdc5-96d8-4ce7-9a09-6646ae162e30 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2384 microversion: 2.32 time: 0.242442 Aug 23 10:46:00.525179 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1291/2500] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:00 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2384 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:00.540354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a60dded-0150-48a1-99e8-a1313bdd91d4 req-e5c50aa2-1afe-4a07-a4c1-2e8727396f80 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.543366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03f7acc3-e19d-41cd-81b6-9cad3161a095 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.544254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a60dded-0150-48a1-99e8-a1313bdd91d4 req-e5c50aa2-1afe-4a07-a4c1-2e8727396f80 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.544855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a60dded-0150-48a1-99e8-a1313bdd91d4 req-e5c50aa2-1afe-4a07-a4c1-2e8727396f80 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.548510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03f7acc3-e19d-41cd-81b6-9cad3161a095 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:00.575171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5a60dded-0150-48a1-99e8-a1313bdd91d4 req-e5c50aa2-1afe-4a07-a4c1-2e8727396f80 service nova] Creating event network-vif-unplugged:92e6c454-69c8-4403-a85d-d026ca05400b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:46:00.590934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5a60dded-0150-48a1-99e8-a1313bdd91d4 req-e5c50aa2-1afe-4a07-a4c1-2e8727396f80 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083186 Aug 23 10:46:00.592079 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1210/2501] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:00.604823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.605927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:00.622186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.627104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.628709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.630914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.634094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.634559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.670075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:46:00.725673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03f7acc3-e19d-41cd-81b6-9cad3161a095 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:00.738343 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03f7acc3-e19d-41cd-81b6-9cad3161a095 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1218 microversion: 2.1 time: 0.210860 Aug 23 10:46:00.739744 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1292/2502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:00 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1218 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:00.796161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.796840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:00.815363 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d086acd-5f18-420c-994d-6a9480913b3f tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 204 len: 0 microversion: 2.1 time: 0.221321 Aug 23 10:46:00.819589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.819853 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1211/2503] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:46:00 2022] DELETE /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:46:00.820790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.821519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.822579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.829803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.832761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.846811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:00.848791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:00.864263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.867976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.868430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:00.872844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:00.873662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:00.875008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.107727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.121066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c31c40d-8c91-48c8-844e-fbd6ecf69e62 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.329207 Aug 23 10:46:01.122049 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1293/2504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:00 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:01.137930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:01.145657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:01.163907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.166869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.167474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.170119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.170620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.173103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.253361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.262758 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f1f6a18-b0e5-461e-941f-2ac9c33f729a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1648 microversion: 2.1 time: 0.437926 Aug 23 10:46:01.266597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1212/2505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:00 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1648 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:01.284423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:01.285353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:01.297262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.298551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.300755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.301761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.303732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.304915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.376118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.388170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.390217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.393756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3e0e9ba-7e3e-467c-9cac-d9aae410746d tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.268606 Aug 23 10:46:01.395069 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1294/2506] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:01 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:01.415503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8c3242c2-e201-4e71-83d1-0d5862e800b9 req-cfa326b3-7468-497d-b043-f8fa66fd4797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-deleted", "tag": "d7fc2d75-be2d-4fc6-8f63-c92af11191c8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:01.430456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8c3242c2-e201-4e71-83d1-0d5862e800b9 req-cfa326b3-7468-497d-b043-f8fa66fd4797 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.431042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8c3242c2-e201-4e71-83d1-0d5862e800b9 req-cfa326b3-7468-497d-b043-f8fa66fd4797 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.432045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8c3242c2-e201-4e71-83d1-0d5862e800b9 req-cfa326b3-7468-497d-b043-f8fa66fd4797 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.454399 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8c3242c2-e201-4e71-83d1-0d5862e800b9 req-cfa326b3-7468-497d-b043-f8fa66fd4797 service nova] Creating event network-vif-deleted:d7fc2d75-be2d-4fc6-8f63-c92af11191c8 for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:46:01.459934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8c3242c2-e201-4e71-83d1-0d5862e800b9 req-cfa326b3-7468-497d-b043-f8fa66fd4797 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062819 Aug 23 10:46:01.461135 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1295/2507] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:01.553232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:01.554220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:01.561457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.562314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.562991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.563920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.564601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.564732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.565393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.573291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.574814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.576004 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a34c868-fbf0-4bb6-a474-30a06952b120 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1548 microversion: 2.25 time: 0.305447 Aug 23 10:46:01.576567 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1213/2508] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:01 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1548 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:01.695609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.707898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.709829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.711978 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8bb8fe39-c256-4312-9cbf-9a4ab4202d88 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 2029 microversion: 2.32 time: 0.163881 Aug 23 10:46:01.713093 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1296/2509] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:01 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 2029 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:01.760048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:01.760683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:01.770304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.773145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.773758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.774817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:01.775245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:01.776023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:01.916499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:01.927603 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7274aad0-2217-4e41-9954-2ad280e96e5b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1222 microversion: 2.1 time: 0.170730 Aug 23 10:46:01.928467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1214/2510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:01 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:02.146454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:02.147127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:02.155855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.156401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.157338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.158274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.160464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.161110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.288245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:02.289171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:02.309770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.310932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.311557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.312458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.313142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.313852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.385209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.418245 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ce76a0f-d4e3-46f3-88bb-37f9db290053 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.276087 Aug 23 10:46:02.419023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1297/2511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:02 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:02.450353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:02.453402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:02.466712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.468390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.470445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.472971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.473463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.474636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.588392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.604727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.610426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.618856 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-274f2871-c682-4ddc-b3f3-d76181f7a3f2 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.184185 Aug 23 10:46:02.619583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1298/2512] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:02 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:02.624654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:02.625296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:02.641259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.643275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.648860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.649924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.649924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.650298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.832129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.844186 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac1370d7-0c35-4ac2-aae5-462e72421ad8 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1648 microversion: 2.1 time: 0.560456 Aug 23 10:46:02.846207 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1215/2513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:02 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1648 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:02.852582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:02.853402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:02.867837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.878924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.881980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:02.883604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-94ac8907-1ee8-407c-a025-e40f8061ed9c tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1548 microversion: 2.25 time: 0.262738 Aug 23 10:46:02.893397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.893397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.893397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.893397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.893397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.893397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.908289 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1299/2514] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:02 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:02.950275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:02.951598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:02.958291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.959898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.960572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:02.961737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:02.962427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:02.963082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.057687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.069952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ad90678-739f-418a-a2a3-5014f02ab416 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1214 microversion: 2.1 time: 0.123763 Aug 23 10:46:03.070895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1300/2515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:02 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:03.089899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.107011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.111420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.112701 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e35c6a7c-8d62-4bff-b1d4-c33de14db9b8 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.265362 Aug 23 10:46:03.113317 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1216/2516] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:02 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:03.442175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:03.443252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:03.462225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.462886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.463410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.464172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.464661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.465111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.563029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4aa674b7-94b8-4b37-af84-7784800816d3 req-6040a400-6237-43cf-a6b7-31f677603ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f09139f-f2a8-45e4-ad00-f807d296de06", "name": "network-vif-deleted", "tag": "92e6c454-69c8-4403-a85d-d026ca05400b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:03.588458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4aa674b7-94b8-4b37-af84-7784800816d3 req-6040a400-6237-43cf-a6b7-31f677603ce7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.588989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4aa674b7-94b8-4b37-af84-7784800816d3 req-6040a400-6237-43cf-a6b7-31f677603ce7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.589435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4aa674b7-94b8-4b37-af84-7784800816d3 req-6040a400-6237-43cf-a6b7-31f677603ce7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.632498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4aa674b7-94b8-4b37-af84-7784800816d3 req-6040a400-6237-43cf-a6b7-31f677603ce7 service nova] Creating event network-vif-deleted:92e6c454-69c8-4403-a85d-d026ca05400b for instance 7f09139f-f2a8-45e4-ad00-f807d296de06 on n-h1-847009-13 Aug 23 10:46:03.642532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4aa674b7-94b8-4b37-af84-7784800816d3 req-6040a400-6237-43cf-a6b7-31f677603ce7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083204 Aug 23 10:46:03.643517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1217/2517] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:03.658068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:03.659749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:03.682520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.683319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.684821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.685757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.686431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.687088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.722895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:03.783074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.805131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.815882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:03.817323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ecd575b3-6641-4d70-9fc7-61a89ceeafa0 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.172488 Aug 23 10:46:03.818054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1218/2518] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:03 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:03.867655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:03.868361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:03.887725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.888248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.888879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:03.889671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:03.890141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:03.890572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.204348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.219696 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c35db982-0fbb-4b7d-8197-49f57a34f9c1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1471 microversion: 2.1 time: 0.780009 Aug 23 10:46:04.223050 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1301/2519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:03 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1471 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:04.241509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:04.242451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:04.257273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.271691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.273276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.277375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.278370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.278952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.363665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.370136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.371153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.373465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lazy-loading 'fault' on Instance uuid 49ae298c-7c7e-4421-b2ac-4b63e511b771 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:04.394420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.406866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38f392aa-8709-424a-80a8-bb934e4e9704 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1648 microversion: 2.1 time: 0.544316 Aug 23 10:46:04.409050 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1219/2520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:03 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1648 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:04.419153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:04.422999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:04.430453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.431294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.432060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.433891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.434603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.435273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.542502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.556130 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5af541c1-20db-424a-b508-e0f1c00d3c26 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1288 microversion: 2.1 time: 0.145652 Aug 23 10:46:04.557344 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1220/2521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:04 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1288 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:04.575561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:04.576964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:04.587677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.588601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.589261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.590530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.591185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.592748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.593287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.611728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.615034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.616502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-555077b2-f0d8-4a9d-8758-361ee413b6a3 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 200 len: 1351 microversion: 2.25 time: 0.391769 Aug 23 10:46:04.633376 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1302/2522] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:04 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 1351 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:04.768219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.778492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.790542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:04.791895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e5f7ca3-3fcf-447c-b58a-3b1c53aec964 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.233301 Aug 23 10:46:04.792563 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1221/2523] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:04 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:04.842098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:04.842724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:04.852006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.853100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.854415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:04.855308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:04.855980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:04.856700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.068277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:05.082076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:05.089272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:05.090584 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d9c0745-52fb-4090-b0a8-8d8fef7652f7 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.252429 Aug 23 10:46:05.091916 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1303/2524] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:04 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:05.210947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4f066f87-0f43-449b-b3c3-27ee8a268f50 req-220aee29-fec4-4301-a5bc-b247947ad24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b29ed9-4389-495c-9325-4a61d3826826", "name": "network-vif-deleted", "tag": "bca1e81a-30cb-4864-862b-0a93a9b95003"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:05.225343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4f066f87-0f43-449b-b3c3-27ee8a268f50 req-220aee29-fec4-4301-a5bc-b247947ad24e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.226079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4f066f87-0f43-449b-b3c3-27ee8a268f50 req-220aee29-fec4-4301-a5bc-b247947ad24e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.227337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4f066f87-0f43-449b-b3c3-27ee8a268f50 req-220aee29-fec4-4301-a5bc-b247947ad24e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.244558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4f066f87-0f43-449b-b3c3-27ee8a268f50 req-220aee29-fec4-4301-a5bc-b247947ad24e service nova] Creating event network-vif-deleted:bca1e81a-30cb-4864-862b-0a93a9b95003 for instance 97b29ed9-4389-495c-9325-4a61d3826826 on n-h2-847009-13 Aug 23 10:46:05.252466 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4f066f87-0f43-449b-b3c3-27ee8a268f50 req-220aee29-fec4-4301-a5bc-b247947ad24e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045770 Aug 23 10:46:05.253863 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1222/2525] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:05.261106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:05.262296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:05.290090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.290592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.291903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.293051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.293713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.294488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.433156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:05.433984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:05.459225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.461934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.462528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.463292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.466788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.468284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.527465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:05.539355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48b81aef-7e43-4e2b-bf8e-5d30107b67c4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.299619 Aug 23 10:46:05.556614 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1304/2526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:05 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:05.561263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.566423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.567182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.569245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lazy-loading 'fault' on Instance uuid 97b29ed9-4389-495c-9325-4a61d3826826 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:05.578217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:05.578906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:05.605543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.606114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.610939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.611744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.612238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.626027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.818274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:05.826647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee23eab1-efe2-4be5-8c6f-6be6dfcec3d5 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1276 microversion: 2.1 time: 0.252676 Aug 23 10:46:05.837826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1305/2527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:05 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:05.842862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:05.850041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 49ae298c-7c7e-4421-b2ac-4b63e511b771] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:05.870779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.875825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750e7f2db9b24dcf93ad785b12a4998f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac28f7e36bb480db15c2898c855eeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:05.883754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.885214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.886063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.887447 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e8bdf41a-f95b-4435-b6c1-d250f1def39a tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 200 len: 1305 microversion: 2.1 time: 0.460973 Aug 23 10:46:05.888959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.890800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.893508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1223/2528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:05 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 1305 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:05.910585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4d47c928-fa10-4f41-97e9-1d7e6d796734 req-85678488-e538-43bc-a348-810fd434cfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ae298c-7c7e-4421-b2ac-4b63e511b771", "name": "network-vif-deleted", "tag": "e6e6794f-24e0-432c-b195-a0b6426a39c7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:05.931849 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] HTTP exception thrown: Instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 could not be found. Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Request method failure captured: Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 HTTP/1.1 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4KM3yofeWUL9QE3W_qodzlgo3jHb-IeUeT2rJ30T49I5usZAUJd2m0Gc4fb2ROwTYOwuzoAxyUBrQNEMujdLraxlQ_0v6VNcVggylcggmzpGcISLNXbNZxoZmqBD9N6B5qhla49_nVGS3lVziI7x0T6-DOqxh65DocmwTfFv5Huig Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_64ea87e1ef314e1886f92fcf108c414f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}] Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 04d5d44e84d5459ab1a59c13bcf69012 Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 could not be found. Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '49ae298c-7c7e-4421-b2ac-4b63e511b771'} Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 could not be found. Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 could not be found. Aug 23 10:46:05.939077 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 could not be found. Aug 23 10:46:05.943753 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:05.944681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Returning 404 to user: Instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:05.945821 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-83503209-8e62-44ed-8223-98f84c26a783 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771" status: 404 len: 111 microversion: 2.25 time: 0.106665 Aug 23 10:46:05.947245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4d47c928-fa10-4f41-97e9-1d7e6d796734 req-85678488-e538-43bc-a348-810fd434cfc2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.948347 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1306/2529] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:05 2022] GET /compute/v2.1/servers/49ae298c-7c7e-4421-b2ac-4b63e511b771 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:46:05.951761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4d47c928-fa10-4f41-97e9-1d7e6d796734 req-85678488-e538-43bc-a348-810fd434cfc2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.952268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4d47c928-fa10-4f41-97e9-1d7e6d796734 req-85678488-e538-43bc-a348-810fd434cfc2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.962627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:05.963394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:05.974263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.977192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.979428 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4d47c928-fa10-4f41-97e9-1d7e6d796734 req-85678488-e538-43bc-a348-810fd434cfc2 service nova] Creating event network-vif-deleted:e6e6794f-24e0-432c-b195-a0b6426a39c7 for instance 49ae298c-7c7e-4421-b2ac-4b63e511b771 on n-h2-847009-13 Aug 23 10:46:05.980032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.980950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:05.981657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:05.982316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:05.987138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4d47c928-fa10-4f41-97e9-1d7e6d796734 req-85678488-e538-43bc-a348-810fd434cfc2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088953 Aug 23 10:46:05.988703 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1224/2530] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:06.006193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:06.006917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:06.018698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.021519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.022211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.035224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.038454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.038989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.082458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.098027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:46:06.101662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.103382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.106074 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-57e66c0a-daad-4616-85c2-19717277f472 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.155771 Aug 23 10:46:06.111773 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1307/2531] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:05 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:06.132338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:06.133592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:06.144327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.144861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.145304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.152682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.152682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.152682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.306046 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0fa87e3a-2699-4093-85c0-3e4707990fcd tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 204 len: 0 microversion: 2.25 time: 0.314668 Aug 23 10:46:06.310110 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1225/2532] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:46:05 2022] DELETE /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:46:06.316551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:06.326569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:06.337196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.337706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.346845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.347717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.348215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.349407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.446981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.451750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:06.468446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.475657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.482532 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-988b954d-5ef9-4824-b1d9-d77cffc1cabd tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.350458 Aug 23 10:46:06.499443 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1308/2533] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:06 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:46:06.564312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:06.565047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:06.573871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.574783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.575465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.576351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.581769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.582837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.888091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:06.912596 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47df85df-201a-4b93-adf0-335b5b2a23c9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.354134 Aug 23 10:46:06.916373 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1309/2534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:06 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:06.936558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:06.941578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:06.952381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.953143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.953749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:06.954631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:06.955462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:06.956920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.214572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.226051 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59dfcd38-cf19-40ce-b526-24387c4c332b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.296507 Aug 23 10:46:07.226677 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1310/2535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:06 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:07.235123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:07.235771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] [instance: 97b29ed9-4389-495c-9325-4a61d3826826] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:07.241661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.256296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.256905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.259082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.260647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.261261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.261654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.262751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.263178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.264377 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1683806c-aa88-4af0-8a3b-4429b71c29ac tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1564 microversion: 2.25 time: 0.952299 Aug 23 10:46:07.265320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1226/2536] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:06 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1564 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:07.271472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:07.276577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:07.287933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:07.303123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.303816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.304427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.305410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.306031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.310079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.313965 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] HTTP exception thrown: Instance 97b29ed9-4389-495c-9325-4a61d3826826 could not be found. Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Request method failure captured: Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 HTTP/1.1 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-q83q6uKee1-osx0MQNYMEK_P6vfaQa3JlGoUwiBlKym4Zd7WgewULCLTTqrc3xVKNQfwP4b712KMM3ELwbTZwwpCERUki2mTNVfssgIY4q3q7HbirgkS50-6HVQRUuQ0cel0fKmSNjzlVnnKod570vtkHOAjSEZC95xxjaZnYJuM Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ac28f7e36bb480db15c2898c855eeb7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ac28f7e36bb480db15c2898c855eeb7"}]}] Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ac28f7e36bb480db15c2898c855eeb7 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1157950133 Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 750e7f2db9b24dcf93ad785b12a4998f Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsTestJSON-1157950133-project Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 97b29ed9-4389-495c-9325-4a61d3826826 could not be found. Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '97b29ed9-4389-495c-9325-4a61d3826826'} Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b29ed9-4389-495c-9325-4a61d3826826 could not be found. Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b29ed9-4389-495c-9325-4a61d3826826 could not be found. Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:07.321348 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b29ed9-4389-495c-9325-4a61d3826826 could not be found. Aug 23 10:46:07.326579 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:07.329245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Returning 404 to user: Instance 97b29ed9-4389-495c-9325-4a61d3826826 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:07.335619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd8cee26-c988-454d-9065-b42dc53786bd tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826" status: 404 len: 111 microversion: 2.1 time: 0.107868 Aug 23 10:46:07.336889 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1311/2537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:07 2022] GET /compute/v2.1/servers/97b29ed9-4389-495c-9325-4a61d3826826 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:07.344838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-560b3d5d-0f67-4749-954b-ba0cd80b43cc tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdc9d23d280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:07.451018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.466628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.468420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.472461 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b1ebf68-d4bd-436f-96bd-5bcba670777a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.205248 Aug 23 10:46:07.484430 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1227/2538] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:07 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:07.510903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:07.517362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:07.531005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.531814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.535314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.537059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.537761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.538406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.770172 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-560b3d5d-0f67-4749-954b-ba0cd80b43cc tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/799a22ac-eb01-4af6-b61d-e7d3005e6630" status: 202 len: 0 microversion: 2.1 time: 0.429253 Aug 23 10:46:07.771668 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1312/2539] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:46:07 2022] DELETE /compute/v2.1/os-security-groups/799a22ac-eb01-4af6-b61d-e7d3005e6630 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:46:07.781127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b74bd274-3204-4373-bd7a-df15dbbbd144 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] Calling method '.version_select at 0x7fdca1da2700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:07.804474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.823159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.827007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:07.831851 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23af5817-dce4-46f9-8ea5-be35f6a71057 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1366 microversion: 2.57 time: 0.325691 Aug 23 10:46:07.835981 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1228/2540] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:07 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:07.938536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:07.939420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:07.951789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.954330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.955226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:07.980828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:07.981625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:07.982101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.231921 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b74bd274-3204-4373-bd7a-df15dbbbd144 tempest-SecurityGroupsTestJSON-1157950133 tempest-SecurityGroupsTestJSON-1157950133-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/a712912d-afcb-4832-96bc-90077728d3ca" status: 202 len: 0 microversion: 2.1 time: 0.455709 Aug 23 10:46:08.232845 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1313/2541] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:46:07 2022] DELETE /compute/v2.1/os-security-groups/a712912d-afcb-4832-96bc-90077728d3ca => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:46:08.247127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:08.247767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:08.261708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:08.262290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:08.263973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.264776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:08.266056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:08.266522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.608783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:08.617974 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f833c02-d5c1-4c4e-8a48-ff7e6129dfe4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.684200 Aug 23 10:46:08.624019 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1229/2542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:07 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:08.638050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:08.638834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:08.655126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:08.659897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:08.660601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.662301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:08.665729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:08.666408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.818837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:08.832311 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0f17e6f-24b0-4351-ba70-576238db2da0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.588207 Aug 23 10:46:08.833701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1314/2543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:08 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:08.846918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a922d446-040c-4ed4-8011-f06d51c81f24 req-1e0b545a-a9dd-4198-83bc-fd438908a33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:08.866951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a922d446-040c-4ed4-8011-f06d51c81f24 req-1e0b545a-a9dd-4198-83bc-fd438908a33a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:08.867363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a922d446-040c-4ed4-8011-f06d51c81f24 req-1e0b545a-a9dd-4198-83bc-fd438908a33a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:08.867799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a922d446-040c-4ed4-8011-f06d51c81f24 req-1e0b545a-a9dd-4198-83bc-fd438908a33a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.884816 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a922d446-040c-4ed4-8011-f06d51c81f24 req-1e0b545a-a9dd-4198-83bc-fd438908a33a service nova] Creating event network-changed:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:46:08.890312 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a922d446-040c-4ed4-8011-f06d51c81f24 req-1e0b545a-a9dd-4198-83bc-fd438908a33a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054705 Aug 23 10:46:08.891515 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1315/2544] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:08.897798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7fffcd4f-86d0-4653-8033-db37ecb15764 req-0e25eb84-a238-4e38-8fe8-b9dff281c143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "name": "network-vif-unplugged", "status": "completed", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:08.909985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7fffcd4f-86d0-4653-8033-db37ecb15764 req-0e25eb84-a238-4e38-8fe8-b9dff281c143 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:08.910781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7fffcd4f-86d0-4653-8033-db37ecb15764 req-0e25eb84-a238-4e38-8fe8-b9dff281c143 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:08.911899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7fffcd4f-86d0-4653-8033-db37ecb15764 req-0e25eb84-a238-4e38-8fe8-b9dff281c143 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:08.925289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7fffcd4f-86d0-4653-8033-db37ecb15764 req-0e25eb84-a238-4e38-8fe8-b9dff281c143 service nova] Creating event network-vif-unplugged:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:46:08.995807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7fffcd4f-86d0-4653-8033-db37ecb15764 req-0e25eb84-a238-4e38-8fe8-b9dff281c143 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095779 Aug 23 10:46:09.000423 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1316/2545] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:09.023040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:09.025941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:09.047455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.048317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.049195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.053913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.054920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.055719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.226120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.237360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.240132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.242371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f1c7e6b-83f9-4b84-8f64-428bd5d27502 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1564 microversion: 2.25 time: 0.608251 Aug 23 10:46:09.243737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1230/2546] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:08 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1564 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:09.250155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:09.250990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:09.260128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.260993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.263423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.264338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.265069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.265661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.294044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.309145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.310809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.311975 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2dae91c4-42b5-49f9-82e6-407636209dac tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.308825 Aug 23 10:46:09.312540 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1317/2547] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:09 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:09.385557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.396638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.398790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:09.400846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09fa095c-4f4c-48b5-8682-3788ab6b383e tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1372 microversion: 2.57 time: 0.155123 Aug 23 10:46:09.401425 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1231/2548] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:09 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:09.643814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:09.644822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:09.647850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:09.654815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.655630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.656267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.657215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.657881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.658652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.865654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:09.866703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:09.873804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.874387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.874908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:09.875704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:09.876381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:09.877004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.080099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.093382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc9be2fe-35f9-4b3b-8098-cd3715ed9a2c tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.453594 Aug 23 10:46:10.094059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1318/2549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:09 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:10.138280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.148012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bda67810-218f-401a-8b4b-572d347439f1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.286838 Aug 23 10:46:10.148979 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1232/2550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:09 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:10.276836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:10.278316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:10.289912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.290872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.291932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.293910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.294835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.295963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.340908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:10.341897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:10.344241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:10.345763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:10.358799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.359924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.360520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.361523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.362139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.362856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.574892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.585969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.588687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.590666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8af4df14-370f-4dec-b8c8-9cf10501ff82 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.254925 Aug 23 10:46:10.592533 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1233/2551] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:10 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:10.598321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:10.600342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:10.612050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.613445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.614876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.616625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.619722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.620788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:10.703673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:10.705897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.724000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.731658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.735717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c3319f1-3398-4d0a-8d4b-8f2798dc2876 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1564 microversion: 2.25 time: 0.466916 Aug 23 10:46:10.737725 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1319/2552] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:10 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1564 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:10.789459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.803604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.805413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:10.806747 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-527b9e9e-bc42-4e1f-bb04-c1637b6f3e6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1372 microversion: 2.57 time: 0.213003 Aug 23 10:46:10.807889 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1234/2553] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:10 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:10.936973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ed544981-18a9-4497-a66d-3d9dc1cb108e req-6c28b162-7fd5-429f-ba12-4bfdca7599d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9681ff3-1da2-44b0-97bf-a8150364c2f1", "tag": "e7a53fbb-1132-4ee6-99d6-efddacd5d957"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:10.951817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=28 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:10.972360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed544981-18a9-4497-a66d-3d9dc1cb108e req-6c28b162-7fd5-429f-ba12-4bfdca7599d8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:10.973457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed544981-18a9-4497-a66d-3d9dc1cb108e req-6c28b162-7fd5-429f-ba12-4bfdca7599d8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:10.977142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed544981-18a9-4497-a66d-3d9dc1cb108e req-6c28b162-7fd5-429f-ba12-4bfdca7599d8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.016569 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ed544981-18a9-4497-a66d-3d9dc1cb108e req-6c28b162-7fd5-429f-ba12-4bfdca7599d8 service nova] Creating event network-changed:e7a53fbb-1132-4ee6-99d6-efddacd5d957 for instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 on n-h2-847009-13 Aug 23 10:46:11.024445 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ed544981-18a9-4497-a66d-3d9dc1cb108e req-6c28b162-7fd5-429f-ba12-4bfdca7599d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093707 Aug 23 10:46:11.026789 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1320/2554] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:11.119128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:11.120010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:11.133170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.138419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.140551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.141556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.150367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.150846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.175179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:11.176270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:11.221047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.224104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.225179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.226157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.229456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.230173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.692560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:11.711374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-147f5244-f439-4214-9ca1-10ea0d08c24d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.543651 Aug 23 10:46:11.725339 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1321/2555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:11 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:11.732980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ca3398ad-20e6-44ee-a186-6e91164bb426 req-8b087b05-d4e7-4606-975c-bd00809622e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7fb487-32c8-4c54-96b8-1a587f153aa2", "name": "network-vif-deleted", "tag": "c17c9163-c59a-4086-b714-1fd30e316965"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:11.743000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:11.744547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ca3398ad-20e6-44ee-a186-6e91164bb426 req-8b087b05-d4e7-4606-975c-bd00809622e0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.745217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ca3398ad-20e6-44ee-a186-6e91164bb426 req-8b087b05-d4e7-4606-975c-bd00809622e0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.746168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ca3398ad-20e6-44ee-a186-6e91164bb426 req-8b087b05-d4e7-4606-975c-bd00809622e0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.764108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2fb93e12-ee18-409c-9ded-a8ee03a886a4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.651387 Aug 23 10:46:11.764801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1235/2556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:11 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:11.775984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:11.776623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:11.784269 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ca3398ad-20e6-44ee-a186-6e91164bb426 req-8b087b05-d4e7-4606-975c-bd00809622e0 service nova] Creating event network-vif-deleted:c17c9163-c59a-4086-b714-1fd30e316965 for instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 on n-h1-847009-13 Aug 23 10:46:11.799537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.800050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.800504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.803511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ca3398ad-20e6-44ee-a186-6e91164bb426 req-8b087b05-d4e7-4606-975c-bd00809622e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071479 Aug 23 10:46:11.804156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1322/2557] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:11.811074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:11.811779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:11.813452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.813955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.816706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.846769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.847283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.847722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.848475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:11.849459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:11.850384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:11.998598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.014356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.016481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.017913 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2672eed2-4c8c-4128-97e0-aa67a85e1356 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.249970 Aug 23 10:46:12.037225 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1236/2558] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:11 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:12.043776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:12.057747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:12.064445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:12.065182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:12.065782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:12.066701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:12.067524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:12.068247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:12.079080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.089387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.095893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.100155 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b46cccd9-0801-4521-840d-425e432c3fbf tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1522 microversion: 2.25 time: 0.290535 Aug 23 10:46:12.101381 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1323/2559] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:11 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:12.406686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.416073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.417641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:12.418927 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-548569a5-6bb3-416a-8194-14bb3fc289e9 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1372 microversion: 2.57 time: 0.380372 Aug 23 10:46:12.419507 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1237/2560] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:12 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:12.738749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:12.741570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:12.765781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:12.768148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:12.769127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:12.772078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:12.775405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:12.776350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:12.790548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:12.791414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:12.806030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:12.806780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:12.808598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:12.809574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:12.813432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:12.814152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:13.730651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:13.752485 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b90da2c8-46fc-420f-b1bd-149f64a44c95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 1.014861 Aug 23 10:46:13.754321 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1324/2561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:12 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:13.776379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:13.819721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:13.839584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:13.840085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:13.840763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:13.843592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:13.845929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:13.846601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:13.980468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:13.984443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.005661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.006230 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6121a6c5-f861-4c8d-8b2f-7208e45c0bed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 1.217666 Aug 23 10:46:14.007005 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1238/2562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:12 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:14.013290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.015649 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-408cf1ba-cc6f-4aff-8081-5e959e428f49 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.252373 Aug 23 10:46:14.018014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:14.018530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1325/2563] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:13 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:14.022279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:14.028094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a3641141-3959-4273-a111-a939d7fac7a2 req-0356ba01-3cbe-4731-9673-3027b33fe69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "name": "network-vif-plugged", "status": "completed", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:14.038839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.039653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.040249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.042779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.043426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.044708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.056098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a3641141-3959-4273-a111-a939d7fac7a2 req-0356ba01-3cbe-4731-9673-3027b33fe69f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.061087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a3641141-3959-4273-a111-a939d7fac7a2 req-0356ba01-3cbe-4731-9673-3027b33fe69f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.061718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a3641141-3959-4273-a111-a939d7fac7a2 req-0356ba01-3cbe-4731-9673-3027b33fe69f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.086684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a3641141-3959-4273-a111-a939d7fac7a2 req-0356ba01-3cbe-4731-9673-3027b33fe69f service nova] Creating event network-vif-plugged:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:46:14.106019 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a3641141-3959-4273-a111-a939d7fac7a2 req-0356ba01-3cbe-4731-9673-3027b33fe69f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085052 Aug 23 10:46:14.109178 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1326/2564] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:14.120954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:14.125781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:14.129462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.132401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.133084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.134499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lazy-loading 'fault' on Instance uuid 3c7fb487-32c8-4c54-96b8-1a587f153aa2 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:14.159364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.159835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.165216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.167519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.168202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.168974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.290913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.311464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.315375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04d5d44e84d5459ab1a59c13bcf69012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ea87e1ef314e1886f92fcf108c414f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.318197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.318544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-566beece-006d-4fc3-9b96-b1bd2e8c92f1 tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 200 len: 1352 microversion: 2.25 time: 0.310370 Aug 23 10:46:14.320621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1239/2565] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:14 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 1352 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:14.358309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.372647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:14.382861 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-495fc9d1-4b4a-4706-b316-cc63ea673d9c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1372 microversion: 2.57 time: 0.269409 Aug 23 10:46:14.385827 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1327/2566] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:14 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:14.789599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:14.790580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:14.809172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.810177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.811335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:14.814459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:14.816346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:14.820324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.033687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:15.034627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:15.054066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.054717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.055182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.055950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.056423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.056882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.327944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.350718 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4fe30bc-155d-4fa4-bcfa-a2907772a6d9 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.326982 Aug 23 10:46:15.351334 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1328/2567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:15 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:15.356194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:15.356842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:15.382292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.382292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.382292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.382964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.383045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.383452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.485946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.523823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.527320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.528826 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2f59de7-a893-4587-9a2e-2cad4a1cff4a tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.176410 Aug 23 10:46:15.529897 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1329/2568] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:15 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:15.534819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:15.535617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] [instance: 3c7fb487-32c8-4c54-96b8-1a587f153aa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:15.547599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.549226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.550492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.551626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.553596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.554196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.574857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] HTTP exception thrown: Instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 could not be found. Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Request method failure captured: Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 HTTP/1.1 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK4KM3yofeWUL9QE3W_qodzlgo3jHb-IeUeT2rJ30T49I5usZAUJd2m0Gc4fb2ROwTYOwuzoAxyUBrQNEMujdLraxlQ_0v6VNcVggylcggmzpGcISLNXbNZxoZmqBD9N6B5qhla49_nVGS3lVziI7x0T6-DOqxh65DocmwTfFv5Huig Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_64ea87e1ef314e1886f92fcf108c414f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/64ea87e1ef314e1886f92fcf108c414f"}]}] Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 64ea87e1ef314e1886f92fcf108c414f Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 04d5d44e84d5459ab1a59c13bcf69012 Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1677856909-project Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 could not be found. Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '3c7fb487-32c8-4c54-96b8-1a587f153aa2'} Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 could not be found. Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 could not be found. Aug 23 10:46:15.577726 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 could not be found. Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] Returning 404 to user: Instance 3c7fb487-32c8-4c54-96b8-1a587f153aa2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:15.584971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41e52a65-70d1-4175-a1f0-a2fe0b31aa6a tempest-LiveAutoBlockMigrationV225Test-1677856909 tempest-LiveAutoBlockMigrationV225Test-1677856909-project] 10.222.0.78 "GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2" status: 404 len: 111 microversion: 2.25 time: 0.053578 Aug 23 10:46:15.592939 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1330/2569] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:15 2022] GET /compute/v2.1/servers/3c7fb487-32c8-4c54-96b8-1a587f153aa2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:46:15.615245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:15.617472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:15.638428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.639024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.639493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.640239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.640711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.650550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.685669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.695758 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17edf2fc-cadd-4762-b8a3-52a598841bc0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.920813 Aug 23 10:46:15.699560 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1240/2570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:14 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:15.818869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.839155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.841084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:15.842667 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f085b37d-4331-47f0-841e-434942419946 tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1357 microversion: 2.57 time: 0.251988 Aug 23 10:46:15.844466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1331/2571] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:15 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:15.877921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:15.878862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:15.893159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.899018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.901025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.905651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:15.909363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:15.910021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:15.973327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:46:16.190644 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72b83775-d20e-4106-97f5-3ef9c1edff6a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 204 len: 0 microversion: 2.57 time: 0.317788 Aug 23 10:46:16.191632 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1241/2572] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:46:15 2022] DELETE /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:46:16.202452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:16.203096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:16.219498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.219998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.226963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:16.229346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.230064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.232627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:16.243413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:16.318437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-51d394d8-8d2c-4155-8df3-12cf9a2346e8 req-d881b595-93e8-498c-a19a-55e039887c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "name": "network-vif-plugged", "status": "completed", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:16.344220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-51d394d8-8d2c-4155-8df3-12cf9a2346e8 req-d881b595-93e8-498c-a19a-55e039887c9d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.344712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-51d394d8-8d2c-4155-8df3-12cf9a2346e8 req-d881b595-93e8-498c-a19a-55e039887c9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.345355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-51d394d8-8d2c-4155-8df3-12cf9a2346e8 req-d881b595-93e8-498c-a19a-55e039887c9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:16.370961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-51d394d8-8d2c-4155-8df3-12cf9a2346e8 req-d881b595-93e8-498c-a19a-55e039887c9d service nova] Creating event network-vif-plugged:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:46:16.384041 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-51d394d8-8d2c-4155-8df3-12cf9a2346e8 req-d881b595-93e8-498c-a19a-55e039887c9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071177 Aug 23 10:46:16.388605 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1242/2573] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:46:16.402663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:16.403634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:16.415952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.416678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.417338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:16.418220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.418844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.419446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:16.694516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:16.709629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:16.716397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:16.722297 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea80e059-bad2-4e0b-b690-0a2a7523717a tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1363 microversion: 2.57 time: 0.525100 Aug 23 10:46:16.724208 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1332/2574] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:16 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1363 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:16.731360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:16.737415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:16.756939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.757831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.758602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:16.759534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:16.760178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:16.760817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:17.203363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.219874 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-199ed1c8-a741-4038-8ff6-bc9220704fee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1477 microversion: 2.1 time: 0.829716 Aug 23 10:46:17.220923 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1243/2575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:16 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1477 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:17.230609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:17.237033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:17.250857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:17.251610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:17.252284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:17.255826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:17.256565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:17.260126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:17.381574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.393876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.399024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.400999 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef6880c7-9dca-483a-8189-015b7dbb49b1 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.675108 Aug 23 10:46:17.401579 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1333/2576] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:16 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:17.724410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.738493 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-32eeb7fa-356c-441d-9233-d7d43a8f11c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.515405 Aug 23 10:46:17.739614 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1244/2577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:17 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:17.750025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:17.750914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:17.770911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:17.771443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:17.772468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:17.774090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:17.774758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:17.775336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:17.905878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.932158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.937065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:17.939228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff50a776-1b51-4c70-a281-d6f84744319c tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1363 microversion: 2.57 time: 0.193422 Aug 23 10:46:17.940307 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1334/2578] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:17 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:18.250059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:18.250697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:18.260115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.260624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.261109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.261833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.262389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.262827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.429384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:18.432143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:18.441518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.446329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.447134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.448122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.448876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.449556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.641018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:18.660055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:18.662232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:18.667113 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-497a8a38-7af1-4987-ba06-a821198782b9 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.242401 Aug 23 10:46:18.677940 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1335/2579] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:18 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:46:18.763352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:18.764222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:18.771375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:18.775369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.779285 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62a9186d-e1ef-4860-be96-1dffb78c3799 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1462 microversion: 2.1 time: 0.534220 Aug 23 10:46:18.779870 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1245/2580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:18 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1462 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:18.792954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.792954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.792954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.792954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.792954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.817847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:18.831404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:18.837929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.849494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.850182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:18.851089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:18.851711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:18.852297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.014630 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ecb6326a-50cb-4f22-997f-46db89206ec2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 0 microversion: 2.1 time: 0.200946 Aug 23 10:46:19.015450 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1246/2581] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:46:18 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:46:19.024194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:19.025110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:19.039689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.040432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.041062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.041933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.042548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.043242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.044179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.053200 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e93235a3-0b51-4cf1-9a88-99389d367a64 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.294955 Aug 23 10:46:19.070263 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1336/2582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:18 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:19.078454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:19.079084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:19.097437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.097935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.101663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.102620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.103241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.104711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.184266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.188482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.189190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.189825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lazy-loading 'fault' on Instance uuid 1e86e83a-eb70-4e79-a2fa-92d93ad91433 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:19.394234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.409765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.412204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b605cde68375418d92e0902b33fc572b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db46411b7a8f4a299efe71f355eeed18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.417932 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f42594d-e179-4259-9f19-23587876603b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 200 len: 1363 microversion: 2.57 time: 0.398467 Aug 23 10:46:19.418953 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1247/2583] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:19 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:19.429328 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-642942bc-755b-4272-b8bb-9252c433a6c2 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1598 microversion: 2.1 time: 0.357778 Aug 23 10:46:19.431717 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1337/2584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:19 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1598 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:19.449749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:19.452090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:19.468753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.469259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.469877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.470755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.471373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.471976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.542838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:19.687508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e7ef951-adc4-4b72-8982-4bd60e19ceb6 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action" status: 202 len: 0 microversion: 2.1 time: 0.240956 Aug 23 10:46:19.697330 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1248/2585] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:46:19 2022] POST /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:46:19.701375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:19.702313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:19.712463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:19.713537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:19.715054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:19.716149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.717389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.718052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.718928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.719543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.720341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.734644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.735201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.735660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.736407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:19.750962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:19.751152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:19.862971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.877503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.881377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:19.883848 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6004ecd-b8a8-429d-99d4-5b0650438ed3 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.190055 Aug 23 10:46:19.902076 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1338/2586] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:19 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:20.079784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:20.080971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:20.094241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.096180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.096835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:20.100822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.101524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.102149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:20.329052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:20.339307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8676dc87-bb70-4c52-8a22-5915d86060a7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.265016 Aug 23 10:46:20.341113 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1339/2587] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:20 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:20.450792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:20.452327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] [instance: 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:20.461233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.462128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.462942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:20.464277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.465036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.465783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:20.484016 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] HTTP exception thrown: Instance 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac could not be found. Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Request method failure captured: Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac HTTP/1.1 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-yTBEe2SbToebi3FRdPo9H75k69c2zuifX4UfTMmchKAFgFfGUkuDXADZJmNtBQCUxNayYO7z2hT38rAR75bG_Um7N5MlM-hLJGPS17HhmlrdIqMSoOVxYsvAK4N8d9j4ECshvJUjIc0etiQm29OAbEuogiK3_kCb7XfVKo0fQEeI Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.57 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: db46411b7a8f4a299efe71f355eeed18 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerShowV257Test-1065083200 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/db46411b7a8f4a299efe71f355eeed18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_db46411b7a8f4a299efe71f355eeed18", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db46411b7a8f4a299efe71f355eeed18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/db46411b7a8f4a299efe71f355eeed18"}]}] Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerShowV257Test-1065083200 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: db46411b7a8f4a299efe71f355eeed18 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerShowV257Test-1065083200 Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerShowV257Test-1065083200-project Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: b605cde68375418d92e0902b33fc572b Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerShowV257Test-1065083200-project Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac could not be found. Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac'} Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac could not be found. Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac could not be found. Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:20.486310 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac could not be found. Aug 23 10:46:20.490804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:20.494896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] Returning 404 to user: Instance 9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:20.496662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c6b47fc-ddf2-47ef-adcf-61fa350b7c3b tempest-ServerShowV257Test-1065083200 tempest-ServerShowV257Test-1065083200-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac" status: 404 len: 111 microversion: 2.57 time: 0.052071 Aug 23 10:46:20.501264 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1340/2588] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:20 2022] GET /compute/v2.1/servers/9f1643bd-1cf4-45fe-b6e7-f5fa01f870ac => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:46:20.594136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a6d8c75c-688a-445a-b9df-536f85102e00 req-75b846f8-8a01-4098-8305-b91700773542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9681ff3-1da2-44b0-97bf-a8150364c2f1", "name": "network-vif-plugged", "status": "completed", "tag": "e7a53fbb-1132-4ee6-99d6-efddacd5d957"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:20.616387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a6d8c75c-688a-445a-b9df-536f85102e00 req-75b846f8-8a01-4098-8305-b91700773542 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.616927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a6d8c75c-688a-445a-b9df-536f85102e00 req-75b846f8-8a01-4098-8305-b91700773542 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.617371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a6d8c75c-688a-445a-b9df-536f85102e00 req-75b846f8-8a01-4098-8305-b91700773542 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:20.652133 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a6d8c75c-688a-445a-b9df-536f85102e00 req-75b846f8-8a01-4098-8305-b91700773542 service nova] Creating event network-vif-plugged:e7a53fbb-1132-4ee6-99d6-efddacd5d957 for instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 on n-h2-847009-13 Aug 23 10:46:20.665042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a6d8c75c-688a-445a-b9df-536f85102e00 req-75b846f8-8a01-4098-8305-b91700773542 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075645 Aug 23 10:46:20.668427 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1341/2589] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:46:20.916686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:20.917439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:20.931427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.931932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.932379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:20.935976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:20.938017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:20.938629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.094295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:21.136108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:21.139865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:21.145801 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7412d50e-8703-40eb-ad0a-07c1c1300fb4 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.233684 Aug 23 10:46:21.148400 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1342/2590] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:20 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:21.369838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:21.369838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:21.389210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:21.390650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:21.391115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.393728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:21.394224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:21.398015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.516970 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db8fb271-8e16-4b93-a36e-c019bf07ef05 tempest-ServersAdminTestJSON-1461927338 tempest-ServersAdminTestJSON-1461927338-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1615 microversion: 2.1 time: 1.811237 Aug 23 10:46:21.517772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1249/2591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:19 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1615 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:21.541732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:21.543976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:21.554978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:21.556286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:21.558613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.560611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:21.563017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:21.564473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.658503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:46:21.815267 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dde29b5-4ab4-4860-baba-ce972b44d8fe tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "DELETE /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 204 len: 0 microversion: 2.1 time: 0.277275 Aug 23 10:46:21.816171 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1250/2592] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:46:21 2022] DELETE /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:46:21.833707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:21.836127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:21.854248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:21.856018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:21.856622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.858596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:21.860313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:21.862578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:21.996473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:22.006176 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4dc3369-ce59-48e2-a594-a7568b98a055 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1318 microversion: 2.1 time: 0.642448 Aug 23 10:46:22.007406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1343/2593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:21 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:22.172362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:22.173060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:22.183429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:22.183925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:22.192589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:22.194925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:22.198369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:22.200853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:22.345876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:22.381382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:22.390538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:22.394401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1d6126e-ce46-47c9-bad0-e4f8d27e44c6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.226288 Aug 23 10:46:22.396397 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1344/2594] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:22 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:46:22.889492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:22.901171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d641e261-b850-4896-a92a-0c39246c0236 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1470 microversion: 2.1 time: 1.079482 Aug 23 10:46:22.916689 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1251/2595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:21 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1470 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:23.030822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:23.031456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:23.055544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:23.057213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:23.057675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:23.062471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:23.062985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:23.067350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:23.421119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:23.422110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:23.439248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:23.439762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:23.440214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:23.440983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:23.441461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:23.461300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:23.747431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:23.774625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2cb584ad-cb8c-4a57-b40d-01e0b453dbfd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1467 microversion: 2.1 time: 0.748310 Aug 23 10:46:23.777193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1345/2596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:23 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1467 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:23.794827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1679280615", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "f9224a82-4b5b-43d2-b127-b1cae869ede0"}, {"uuid": "e588994d-172a-4ac7-8ecc-bd9ccb1fb033"}, {"uuid": "f9224a82-4b5b-43d2-b127-b1cae869ede0"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:23.888210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:23.928689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:23.934327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '096919930bd0421b878f7d5e32f1ec8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4366507f35354b8aa9c0aa47c2083242', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:23.941148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06cd6cd2-fe6b-4d83-b4f2-07f204d5113d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 200 len: 1604 microversion: 2.32 time: 0.525155 Aug 23 10:46:23.959132 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1252/2597] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:23 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 1604 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:46:23.967289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:23.970447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:23.990775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:23.991553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:23.992212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:24.005415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:24.030122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:24.031029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:24.040122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] validate_networks() for [('f9224a82-4b5b-43d2-b127-b1cae869ede0', None, None, None, None, None), ('e588994d-172a-4ac7-8ecc-bd9ccb1fb033', None, None, None, None, None), ('f9224a82-4b5b-43d2-b127-b1cae869ede0', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:46:24.550662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:24.559735 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7723f819-0cc1-4be5-83f2-0c703d5d0064 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1467 microversion: 2.1 time: 0.599185 Aug 23 10:46:24.584771 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1253/2598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:23 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1467 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:24.587992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:24.588508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:24.595924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:24.596425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:24.596916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:24.605394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:24.605903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:24.606361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:25.094412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:25.105663 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6fa1c7d-9a4f-456c-ae8f-ca1ca59cfae1 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1470 microversion: 2.1 time: 0.533371 Aug 23 10:46:25.123912 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1254/2599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:24 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:25.129999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1622015631"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:25.136516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:25.148832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:25.149641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:25.150301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:25.151338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:25.151803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:25.152235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:25.590305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eedc7f2e-fab2-4c40-83a1-ac409e188694 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "POST /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f/action" status: 202 len: 0 microversion: 2.1 time: 0.463973 Aug 23 10:46:25.591559 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1255/2600] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:46:25 2022] POST /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:46:25.637410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:25.639932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:25.662889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:25.665555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:25.667031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:25.669647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:25.670464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:25.671247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:25.726914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] HTTP exception thrown: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Request method failure captured: Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 HTTP/1.1 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5nnFJigGeT8FeX7r51F2VAbToBaF46iFIRtIqs3EYFXzLkluktwOy5Ia3p9RgPP7L2zL3Gm7Z9wmf1XGIS0wBRz7LfNGj2X-DAhacLmx9Z9a63dStYD4QV6nq2YACEqQ2RsUqX7EtmbK1L67YqlLVhQELcbo4i5FgHXOC1qPtI724 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.32 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4366507f35354b8aa9c0aa47c2083242 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4366507f35354b8aa9c0aa47c2083242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4366507f35354b8aa9c0aa47c2083242", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4366507f35354b8aa9c0aa47c2083242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4366507f35354b8aa9c0aa47c2083242"}]}] Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4366507f35354b8aa9c0aa47c2083242 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TaggedBootDevicesTest-2104205019-project Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 096919930bd0421b878f7d5e32f1ec8e Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TaggedBootDevicesTest-2104205019-project Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7f09139f-f2a8-45e4-ad00-f807d296de06'} Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:25.732361 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:25.736502 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:25.742255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Returning 404 to user: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:25.746452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1fe469d-7de3-425d-a1f5-43c03e3d6a23 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 404 len: 111 microversion: 2.32 time: 0.131062 Aug 23 10:46:25.756138 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1256/2601] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:25 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:46:25.949000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4d03c11-f255-407c-9774-32fe77f1d323 tempest-ExtensionsTest-1281446112 tempest-ExtensionsTest-1281446112-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:25.950852 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4d03c11-f255-407c-9774-32fe77f1d323 tempest-ExtensionsTest-1281446112 tempest-ExtensionsTest-1281446112-project] 10.222.0.78 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.189925 Aug 23 10:46:25.951621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1257/2602] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 23 10:46:25 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:25.956575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d0bc1c0-e167-42d9-8573-4c287a44f5ff tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cdcedc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:26.039819 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d0bc1c0-e167-42d9-8573-4c287a44f5ff tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.085713 Aug 23 10:46:26.050262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1258/2603] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:25 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:26.058573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56ab28be-f0bb-443d-919e-9350e79fe1e6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '.version_select at 0x7fdc9ccf3820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:26.092216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56ab28be-f0bb-443d-919e-9350e79fe1e6 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120629805" status: 204 len: 0 microversion: 2.32 time: 0.038024 Aug 23 10:46:26.097293 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1259/2604] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:46:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120629805 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:46:26.105989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b75edeee-389c-4608-8248-38fd7f1942b9 tempest-ExtensionsTest-1281446112 tempest-ExtensionsTest-1281446112-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:26.108979 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b75edeee-389c-4608-8248-38fd7f1942b9 tempest-ExtensionsTest-1281446112 tempest-ExtensionsTest-1281446112-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008591 Aug 23 10:46:26.110464 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1260/2605] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Aug 23 10:46:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:46:26.127560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:26.128324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:26.140582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:26.141387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:26.150620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:26.151756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:26.152460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:26.153142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:26.626509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:26.640952 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac5165a1-415b-4eb1-bc5d-58685fa6bdee tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1470 microversion: 2.1 time: 0.517260 Aug 23 10:46:26.643548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1261/2606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:26 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:27.056168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73a2d758-58f6-4eed-8d4a-94893de3c5ec tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cac4b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:27.121634 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73a2d758-58f6-4eed-8d4a-94893de3c5ec tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.069795 Aug 23 10:46:27.125444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1262/2607] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:27 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:27.137844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:27.138783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:27.147457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:27.148200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:27.148830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:27.149745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:27.150363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:27.150938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:27.477662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:27.494167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a653d7e-9eda-43c4-8491-10d8aa292dc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.365707 Aug 23 10:46:27.510471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1263/2608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:27 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:27.544055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:27.546150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:27.568671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:27.570026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:27.571078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:27.572125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:27.572857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:27.573649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:28.058949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:28.076401 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e1f29b8-ebf0-4c69-9727-1d10755551b5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.542821 Aug 23 10:46:28.092521 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1264/2609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:27 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:28.092521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1743d736-c186-4cab-b124-d0c9dc82c8ef req-dc8070e9-7167-430b-9c20-c1aa072a4f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c0fbd9-3286-48f5-8fe9-66809b979399", "name": "network-vif-deleted", "tag": "9166d849-2ba5-4696-9154-35d2b387a757"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:28.116095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1743d736-c186-4cab-b124-d0c9dc82c8ef req-dc8070e9-7167-430b-9c20-c1aa072a4f14 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:28.116890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1743d736-c186-4cab-b124-d0c9dc82c8ef req-dc8070e9-7167-430b-9c20-c1aa072a4f14 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:28.119439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1743d736-c186-4cab-b124-d0c9dc82c8ef req-dc8070e9-7167-430b-9c20-c1aa072a4f14 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:28.152188 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1743d736-c186-4cab-b124-d0c9dc82c8ef req-dc8070e9-7167-430b-9c20-c1aa072a4f14 service nova] Creating event network-vif-deleted:9166d849-2ba5-4696-9154-35d2b387a757 for instance 81c0fbd9-3286-48f5-8fe9-66809b979399 on n-h1-847009-13 Aug 23 10:46:28.163376 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1743d736-c186-4cab-b124-d0c9dc82c8ef req-dc8070e9-7167-430b-9c20-c1aa072a4f14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083985 Aug 23 10:46:28.165466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1265/2610] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:28.176336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:28.180194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:28.194340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:28.196093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:28.197289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:28.197902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:28.198539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:28.198986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:28.237758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:28.238269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:28.238875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:28.239344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lazy-loading 'fault' on Instance uuid 81c0fbd9-3286-48f5-8fe9-66809b979399 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:28.248804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:28.329349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:28.339654 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4b477a8-d5e3-4abc-ad3d-0a073d0aad17 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 200 len: 1304 microversion: 2.1 time: 0.172663 Aug 23 10:46:28.340778 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1266/2611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:28 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:28.347282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:28.349216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:28.356790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:28.357627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:28.358319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:28.359754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:28.360504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:28.361196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.218842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:29.240383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f17e5cc0-eb9b-40a2-9879-f48fd81cd98b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.898251 Aug 23 10:46:29.241644 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1267/2612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:28 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:29.258222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c742ea05-a225-45e5-9c80-11f2803586e2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cbce4c0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:29.329779 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c742ea05-a225-45e5-9c80-11f2803586e2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.086854 Aug 23 10:46:29.330616 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1268/2613] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:29 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:29.337166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-205081323"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:29.344261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:29.361855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:46:29.363153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:46:29.364523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:46:29.365184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:46:29.365801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:46:29.366969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.367474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.367920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.368641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.369142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.369741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.400020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.400676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.423265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.426979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.430324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.433221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.488144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Getting quotas for project 4672980399e34e3d94dd82f7c375e2e5. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:46:29.499392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Getting quotas for user 7bea2324e2b4416e9f39c0e47b2ce15d and project 4672980399e34e3d94dd82f7c375e2e5. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:46:29.519623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:46:29.538497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:46:29.637340 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-55f6041c-06a2-4cef-b1d6-1db81d03d37f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.858151 Aug 23 10:46:29.638009 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1346/2614] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:46:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:46:29.651393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:29.652248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 81c0fbd9-3286-48f5-8fe9-66809b979399] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:29.679205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.683856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.684482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.695423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.695946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.696416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.771030 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] HTTP exception thrown: Instance 81c0fbd9-3286-48f5-8fe9-66809b979399 could not be found. Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Request method failure captured: Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 HTTP/1.1 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK9l2Sgo6A_eIpy4OBWteW3aeacARVN8qGo7ygOjfKhOh2dgKNZB01RZ_OugVN_VVwAfwv31wNrfxpssKUH8d2D0p1s6eurx5g0xkAOwc35ya-IbpaSOgCvRBsC3Su6XogpbzWMsZrxA0JarYXiGDIfuFUMBuv5vIiw0lxfEqR4EMkM Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 876d31e066de4418a6ae43fafc095a9c Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/876d31e066de4418a6ae43fafc095a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_876d31e066de4418a6ae43fafc095a9c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/876d31e066de4418a6ae43fafc095a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/876d31e066de4418a6ae43fafc095a9c"}]}] Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 876d31e066de4418a6ae43fafc095a9c Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminTestJSON-1719689223-project Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 65a60d0f17c14f40adbcc6460e09d725 Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminTestJSON-1719689223-project Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 81c0fbd9-3286-48f5-8fe9-66809b979399 could not be found. Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '81c0fbd9-3286-48f5-8fe9-66809b979399'} Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c0fbd9-3286-48f5-8fe9-66809b979399 could not be found. Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c0fbd9-3286-48f5-8fe9-66809b979399 could not be found. Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:29.790346 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c0fbd9-3286-48f5-8fe9-66809b979399 could not be found. Aug 23 10:46:29.794294 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:29.794716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Returning 404 to user: Instance 81c0fbd9-3286-48f5-8fe9-66809b979399 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:29.795492 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6be07585-6026-459f-b266-f5def8cab310 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399" status: 404 len: 111 microversion: 2.1 time: 0.156540 Aug 23 10:46:29.799895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1347/2615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:29 2022] GET /compute/v2.1/servers/81c0fbd9-3286-48f5-8fe9-66809b979399 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:29.833546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dae0c5ae-b433-4e02-9e9d-957b8a1154dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:29.834324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dae0c5ae-b433-4e02-9e9d-957b8a1154dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:29.937741 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-103131a0-a856-4c6a-b18c-fbf7faa2a219 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.605709 Aug 23 10:46:29.944582 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1269/2616] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:46:29 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 23 10:46:29.957486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:29.958863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:29.970239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.971174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.971872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:29.972902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:29.979947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:29.981872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:30.036140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:46:30.142663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dae0c5ae-b433-4e02-9e9d-957b8a1154dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:30.156664 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dae0c5ae-b433-4e02-9e9d-957b8a1154dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1213 microversion: 2.1 time: 0.355055 Aug 23 10:46:30.159550 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1348/2617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:29 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1213 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:30.281653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:30.295277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-151c0da5-8110-46cc-85ba-8b27fee1c3e4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "DELETE /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 204 len: 0 microversion: 2.1 time: 0.348840 Aug 23 10:46:30.297839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1270/2618] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:46:29 2022] DELETE /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:46:30.307518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:30.308475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:30.324890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:30.328060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:30.328974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:30.330600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:30.335717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:30.337008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:30.352633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-66c8cb6f-0128-4612-a86e-69a9538f49fd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9ca3faf0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:30.456054 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-66c8cb6f-0128-4612-a86e-69a9538f49fd tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.113448 Aug 23 10:46:30.462021 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1271/2619] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:30 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:31.183197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:31.184466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:31.197515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:31.198297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:31.199626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:31.200961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:31.201578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:31.202155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:31.407315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:31.424598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30c4984d-99ab-4d60-abcb-56ceff722790 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1209 microversion: 2.1 time: 0.243688 Aug 23 10:46:31.440703 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1272/2620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:31 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1209 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:31.482891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c866a25-7be5-4c5e-b11a-6b27889f03f3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb2f3a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:31.587490 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c866a25-7be5-4c5e-b11a-6b27889f03f3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.113236 Aug 23 10:46:31.588070 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1273/2621] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:31 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:32.004941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:32.020373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ab4b5bb-b7b8-496e-9210-88feca430aed tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1469 microversion: 2.1 time: 1.716584 Aug 23 10:46:32.022370 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1349/2622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:30 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1469 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:32.448684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:32.449519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:32.483824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:32.486266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:32.491898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:32.493825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:32.498430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:32.499178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:32.603999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26a1230e-a195-4a52-a7c4-9d600631ee0c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1d2ba60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:32.681957 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26a1230e-a195-4a52-a7c4-9d600631ee0c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.081797 Aug 23 10:46:32.682911 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1350/2623] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:32 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:33.047339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:33.049357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:33.062850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:33.067320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:33.069982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:33.071156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:33.073023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:33.074256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:33.260316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:33.272186 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5be85640-ef7b-4dff-9907-3b79bdf65352 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1273 microversion: 2.1 time: 0.828768 Aug 23 10:46:33.289916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1274/2624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:32 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1273 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:33.699464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8148a39b-d9df-4430-bd16-5028922a018a tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb09790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:33.809384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8148a39b-d9df-4430-bd16-5028922a018a tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.114886 Aug 23 10:46:33.818118 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1275/2625] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:33 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:34.313043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:34.313976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:34.325651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:34.327348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:34.328069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:34.334367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:34.335223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:34.336401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:34.443844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:34.467385 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dad27c1a-31b8-4738-9a22-8f40938fdacb tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1469 microversion: 2.1 time: 1.425004 Aug 23 10:46:34.470896 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1351/2626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:33 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1469 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:34.709820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:34.723890 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63999523-b25f-4bf4-a273-b633d5ef2cdf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1271 microversion: 2.1 time: 0.412302 Aug 23 10:46:34.726586 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1276/2627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:34 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:34.826641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6612883-be43-4b4e-b4c1-39109e310e69 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e0ee50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:34.937212 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6612883-be43-4b4e-b4c1-39109e310e69 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.116363 Aug 23 10:46:34.947325 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1352/2628] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:34 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:35.500041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:35.501604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:35.536967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:35.538291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:35.545842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:35.550148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:35.556772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:35.559082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:35.663282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b8550f03-adc7-408b-8fe0-50213fedd6f6 req-638cc66c-91e8-4e1f-8a25-c94221db0648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317a9f9b-a033-4e93-b427-b945cda21208", "name": "network-vif-deleted", "tag": "3b78f27d-6125-4ed6-b657-01c4f3e0328c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:35.717948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b8550f03-adc7-408b-8fe0-50213fedd6f6 req-638cc66c-91e8-4e1f-8a25-c94221db0648 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:35.718483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b8550f03-adc7-408b-8fe0-50213fedd6f6 req-638cc66c-91e8-4e1f-8a25-c94221db0648 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:35.722375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b8550f03-adc7-408b-8fe0-50213fedd6f6 req-638cc66c-91e8-4e1f-8a25-c94221db0648 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:35.777830 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b8550f03-adc7-408b-8fe0-50213fedd6f6 req-638cc66c-91e8-4e1f-8a25-c94221db0648 service nova] Creating event network-vif-deleted:3b78f27d-6125-4ed6-b657-01c4f3e0328c for instance 317a9f9b-a033-4e93-b427-b945cda21208 on n-h2-847009-13 Aug 23 10:46:35.795741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:35.804695 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b8550f03-adc7-408b-8fe0-50213fedd6f6 req-638cc66c-91e8-4e1f-8a25-c94221db0648 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141500 Aug 23 10:46:35.808125 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1353/2629] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:35.811764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-becca107-e3e4-4115-a2d6-2657fe15fce4 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1427 microversion: 2.1 time: 0.321881 Aug 23 10:46:35.816290 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1277/2630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:35 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1427 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:35.837879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:35.838813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:35.851433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:35.852238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:35.853440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:35.855114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:35.856137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:35.857058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:35.953893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d49e322-92ea-43eb-84b3-97afb5576313 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb7fee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:36.067084 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d49e322-92ea-43eb-84b3-97afb5576313 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.117991 Aug 23 10:46:36.068317 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1278/2631] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:35 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:36.369310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:36.376775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:36.385710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87c28928-f813-4b91-95c9-856722a03f02 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1271 microversion: 2.1 time: 0.571453 Aug 23 10:46:36.387701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1354/2632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:35 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1271 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:36.842561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:36.843824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:36.862699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:36.863977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:36.869333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:36.870631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:36.871286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:36.871876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:36.972653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:36.980290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:36.981083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:36.983079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lazy-loading 'fault' on Instance uuid 317a9f9b-a033-4e93-b427-b945cda21208 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:37.083238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30fe3f77-dca6-469c-8e37-a53b5879cf77 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cc8caf0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:37.245667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:37.259687 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba0c52ff-4389-4e54-a278-1199307c6ad5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 200 len: 1303 microversion: 2.1 time: 0.421854 Aug 23 10:46:37.268253 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1279/2633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:36 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 1303 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:37.279021 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30fe3f77-dca6-469c-8e37-a53b5879cf77 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.200179 Aug 23 10:46:37.281460 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1355/2634] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:37 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:37.295670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-dc96d5b0-3f07-4795-9eb0-3b9dc3bd22ae req-6d3b4361-1af9-4adf-ae2a-82b8f85b3a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "name": "network-vif-plugged", "status": "completed", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:37.298880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:37.301063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:37.340210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.340707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.346567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.353182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.357814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dc96d5b0-3f07-4795-9eb0-3b9dc3bd22ae req-6d3b4361-1af9-4adf-ae2a-82b8f85b3a93 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.357973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.358962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.369869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dc96d5b0-3f07-4795-9eb0-3b9dc3bd22ae req-6d3b4361-1af9-4adf-ae2a-82b8f85b3a93 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.370884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dc96d5b0-3f07-4795-9eb0-3b9dc3bd22ae req-6d3b4361-1af9-4adf-ae2a-82b8f85b3a93 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.405483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] HTTP exception thrown: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.408449 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-dc96d5b0-3f07-4795-9eb0-3b9dc3bd22ae req-6d3b4361-1af9-4adf-ae2a-82b8f85b3a93 service nova] Creating event network-vif-plugged:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Request method failure captured: Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 HTTP/1.1 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK5nnFJigGeT8FeX7r51F2VAbToBaF46iFIRtIqs3EYFXzLkluktwOy5Ia3p9RgPP7L2zL3Gm7Z9wmf1XGIS0wBRz7LfNGj2X-DAhacLmx9Z9a63dStYD4QV6nq2YACEqQ2RsUqX7EtmbK1L67YqlLVhQELcbo4i5FgHXOC1qPtI724 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.32 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4366507f35354b8aa9c0aa47c2083242 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4366507f35354b8aa9c0aa47c2083242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4366507f35354b8aa9c0aa47c2083242", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4366507f35354b8aa9c0aa47c2083242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4366507f35354b8aa9c0aa47c2083242"}]}] Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4366507f35354b8aa9c0aa47c2083242 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TaggedBootDevicesTest-2104205019-project Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 096919930bd0421b878f7d5e32f1ec8e Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TaggedBootDevicesTest-2104205019-project Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '7f09139f-f2a8-45e4-ad00-f807d296de06'} Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:37.408877 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Returning 404 to user: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:37.413032 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-714f3ef3-eb9f-444c-8882-1f4edb9cd527 tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 404 len: 111 microversion: 2.32 time: 0.130284 Aug 23 10:46:37.417022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1356/2635] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:46:37 2022] DELETE /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:46:37.421635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:37.422442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:37.435620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.436136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.436983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.437862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.438933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.440128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-dc96d5b0-3f07-4795-9eb0-3b9dc3bd22ae req-6d3b4361-1af9-4adf-ae2a-82b8f85b3a93 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168763 Aug 23 10:46:37.446026 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1280/2636] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:37.449149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.453009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:37.455725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] [instance: 7f09139f-f2a8-45e4-ad00-f807d296de06] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:37.471591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.473287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.478986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.483969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:37.486479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:37.491149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:37.535136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] HTTP exception thrown: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Request method failure captured: Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 HTTP/1.1 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK5nnFJigGeT8FeX7r51F2VAbToBaF46iFIRtIqs3EYFXzLkluktwOy5Ia3p9RgPP7L2zL3Gm7Z9wmf1XGIS0wBRz7LfNGj2X-DAhacLmx9Z9a63dStYD4QV6nq2YACEqQ2RsUqX7EtmbK1L67YqlLVhQELcbo4i5FgHXOC1qPtI724 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.32 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4366507f35354b8aa9c0aa47c2083242 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4366507f35354b8aa9c0aa47c2083242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4366507f35354b8aa9c0aa47c2083242", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4366507f35354b8aa9c0aa47c2083242"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4366507f35354b8aa9c0aa47c2083242"}]}] Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4366507f35354b8aa9c0aa47c2083242 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2104205019 Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TaggedBootDevicesTest-2104205019-project Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 096919930bd0421b878f7d5e32f1ec8e Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TaggedBootDevicesTest-2104205019-project Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7f09139f-f2a8-45e4-ad00-f807d296de06'} Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.541901 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. Aug 23 10:46:37.546098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:37.550778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] Returning 404 to user: Instance 7f09139f-f2a8-45e4-ad00-f807d296de06 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:37.553407 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a2629bf-9565-4198-b9c4-bb85cac7ec2d tempest-TaggedBootDevicesTest-2104205019 tempest-TaggedBootDevicesTest-2104205019-project] 10.222.0.78 "GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06" status: 404 len: 111 microversion: 2.32 time: 0.105296 Aug 23 10:46:37.559909 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1281/2637] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:46:37 2022] GET /compute/v2.1/servers/7f09139f-f2a8-45e4-ad00-f807d296de06 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:46:38.291221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:38.292613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 317a9f9b-a033-4e93-b427-b945cda21208] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:38.310521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:38.312682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:38.316031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:38.319717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:38.321600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:38.323264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:38.403270 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] HTTP exception thrown: Instance 317a9f9b-a033-4e93-b427-b945cda21208 could not be found. Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Request method failure captured: Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 HTTP/1.1 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK9l2Sgo6A_eIpy4OBWteW3aeacARVN8qGo7ygOjfKhOh2dgKNZB01RZ_OugVN_VVwAfwv31wNrfxpssKUH8d2D0p1s6eurx5g0xkAOwc35ya-IbpaSOgCvRBsC3Su6XogpbzWMsZrxA0JarYXiGDIfuFUMBuv5vIiw0lxfEqR4EMkM Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 876d31e066de4418a6ae43fafc095a9c Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/876d31e066de4418a6ae43fafc095a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_876d31e066de4418a6ae43fafc095a9c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/876d31e066de4418a6ae43fafc095a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/876d31e066de4418a6ae43fafc095a9c"}]}] Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 876d31e066de4418a6ae43fafc095a9c Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersAdminTestJSON-1719689223-project Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 65a60d0f17c14f40adbcc6460e09d725 Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersAdminTestJSON-1719689223-project Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 317a9f9b-a033-4e93-b427-b945cda21208 could not be found. Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '317a9f9b-a033-4e93-b427-b945cda21208'} Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317a9f9b-a033-4e93-b427-b945cda21208 could not be found. Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317a9f9b-a033-4e93-b427-b945cda21208 could not be found. Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:38.411057 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317a9f9b-a033-4e93-b427-b945cda21208 could not be found. Aug 23 10:46:38.415500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:46:38.421873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Returning 404 to user: Instance 317a9f9b-a033-4e93-b427-b945cda21208 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:38.427051 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-391d363d-8068-4321-9656-c3ee7b9065ec tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208" status: 404 len: 111 microversion: 2.1 time: 0.140473 Aug 23 10:46:38.434613 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1282/2638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:38 2022] GET /compute/v2.1/servers/317a9f9b-a033-4e93-b427-b945cda21208 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:38.450023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8ab65a5-949a-46a6-8523-08e0f14c427a tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cccfca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:38.458831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:38.474718 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1951c0a5-63a0-486a-95c2-012a0bb86ee0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1313 microversion: 2.1 time: 1.059020 Aug 23 10:46:38.480703 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1357/2639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:37 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:38.492673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:38.499110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:38.534361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:38.535163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:38.536585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:38.546318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:38.546712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:38.547177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:38.576785 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8ab65a5-949a-46a6-8523-08e0f14c427a tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.130866 Aug 23 10:46:38.578722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1283/2640] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:38 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:38.654708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:46:38.888859 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be970bef-2d6f-47b2-bf37-fcd9749914ff tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 204 len: 0 microversion: 2.1 time: 0.404317 Aug 23 10:46:38.894729 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1358/2641] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:46:38 2022] DELETE /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:46:38.902460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:38.905463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:38.922175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:38.922932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:38.923687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:38.924867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:38.926863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:38.928218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:39.335676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:39.346645 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cff6024-d7d3-4c7c-bacc-61f846b7f2bc tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1468 microversion: 2.1 time: 0.448126 Aug 23 10:46:39.347415 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1284/2642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:38 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1468 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:39.513332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:39.515011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:39.527742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:39.529633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:39.530304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:39.531210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:39.532115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:39.535168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:39.536455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:39.593405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d01f3897-c0fa-44a5-8052-89c466a86f83 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9ca53940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:39.694309 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d01f3897-c0fa-44a5-8052-89c466a86f83 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.103774 Aug 23 10:46:39.710542 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1285/2643] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:39 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:46:40.153169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:40.168141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:40.182495 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d44fa40-f07f-4491-8002-c633db6def7f tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1313 microversion: 2.1 time: 0.675640 Aug 23 10:46:40.183936 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1359/2644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:39 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:40.370326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:40.371436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:40.388830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:40.390609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:40.391622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:40.397276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:40.398811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:40.400547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:40.717189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14c3862a-827a-4c3b-8a5b-9963c9624362 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1d37b80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:40.804266 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14c3862a-827a-4c3b-8a5b-9963c9624362 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1455 microversion: 2.1 time: 0.090884 Aug 23 10:46:40.805568 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1360/2645] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:40 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:41.043469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:41.059060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb822828-b56c-4080-b304-1cc8e5314c41 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1468 microversion: 2.1 time: 0.691411 Aug 23 10:46:41.073694 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1286/2646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:40 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1468 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:41.206911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:41.210310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:41.251883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:41.252785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:41.253512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:41.254551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:41.255284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:41.256009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:41.719163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-682f76d8-9cef-4b8c-8445-09b9df7047f3 req-c9f17f13-19cb-45b8-be58-e209d1a24ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-plugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:41.749274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-682f76d8-9cef-4b8c-8445-09b9df7047f3 req-c9f17f13-19cb-45b8-be58-e209d1a24ec9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:41.750101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-682f76d8-9cef-4b8c-8445-09b9df7047f3 req-c9f17f13-19cb-45b8-be58-e209d1a24ec9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:41.750572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-682f76d8-9cef-4b8c-8445-09b9df7047f3 req-c9f17f13-19cb-45b8-be58-e209d1a24ec9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:41.783533 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-682f76d8-9cef-4b8c-8445-09b9df7047f3 req-c9f17f13-19cb-45b8-be58-e209d1a24ec9 service nova] Creating event network-vif-plugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:46:41.817808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-682f76d8-9cef-4b8c-8445-09b9df7047f3 req-c9f17f13-19cb-45b8-be58-e209d1a24ec9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102793 Aug 23 10:46:41.822181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1287/2647] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:41.839028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2f7b77e-99bb-4ac8-8eae-6e1c9d317831 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb2fdc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:42.764527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:42.776322 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44e21b07-c0b1-489c-b53c-66f9b6144d96 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1334 microversion: 2.1 time: 1.573210 Aug 23 10:46:42.792641 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1361/2648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:41 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1334 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:42.792641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:42.792641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:42.804763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:42.805450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:42.806399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:42.807372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:42.808010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:42.811461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:42.865662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:42.866198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:42.866930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:42.867090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lazy-loading 'fault' on Instance uuid 1e86e83a-eb70-4e79-a2fa-92d93ad91433 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:46:42.997957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a60d0f17c14f40adbcc6460e09d725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876d31e066de4418a6ae43fafc095a9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:43.012882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e79175a0-c6f9-4cfb-8bea-ffa35c029a6e tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 200 len: 1303 microversion: 2.1 time: 0.227205 Aug 23 10:46:43.025907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1362/2649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:42 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:43.036258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-70756903-6018-4c53-997f-24868b415364 req-6f4ab7f6-2475-466c-95c6-684196052f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e86e83a-eb70-4e79-a2fa-92d93ad91433", "name": "network-vif-deleted", "tag": "4f596234-786b-48b5-8473-cee0c5bc7a57"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:43.083523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-70756903-6018-4c53-997f-24868b415364 req-6f4ab7f6-2475-466c-95c6-684196052f6f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:43.083997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-70756903-6018-4c53-997f-24868b415364 req-6f4ab7f6-2475-466c-95c6-684196052f6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:43.084433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-70756903-6018-4c53-997f-24868b415364 req-6f4ab7f6-2475-466c-95c6-684196052f6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:43.111860 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-70756903-6018-4c53-997f-24868b415364 req-6f4ab7f6-2475-466c-95c6-684196052f6f service nova] Creating event network-vif-deleted:4f596234-786b-48b5-8473-cee0c5bc7a57 for instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 on n-h1-847009-13 Aug 23 10:46:43.119634 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-70756903-6018-4c53-997f-24868b415364 req-6f4ab7f6-2475-466c-95c6-684196052f6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086985 Aug 23 10:46:43.123996 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1363/2650] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:44.190304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0cbd0d52-f30a-4b93-ae21-6c48deb04f45 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Action: 'create', calling method: .version_select at 0x7fdc9cbb9dc0>, body: {"keypair": {"name": "tempest-keypair-1859971234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBww8YvLi2BRUae9+DXzTkQu4rCJEv6FqbnSVxNkRs8sRplU5MKkIQ3ap0s0hTlIHhnhzNzHRih1Qs/yJtmfxMQ7njUIJM39ngLJwVBTT/vbB1Wa3NP7ZxfH6xg20WiaZQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:44.263157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0cbd0d52-f30a-4b93-ae21-6c48deb04f45 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Getting quotas for project 2dbc35e84eeb42f098704bf9f10a8e89. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:46:44.310716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0cbd0d52-f30a-4b93-ae21-6c48deb04f45 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Getting quotas for user 20231dbe3db344ba9f690607a4a80ee9 and project 2dbc35e84eeb42f098704bf9f10a8e89. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:46:44.389747 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0cbd0d52-f30a-4b93-ae21-6c48deb04f45 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.145867 Aug 23 10:46:44.394162 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1364/2651] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:46:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:44.414164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:44.418654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:44.439058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:44.446085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:44.447178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:44.450213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:44.450923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:44.461422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:45.400455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:45.424184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6dce088d-ae0b-48c9-842d-fea5e60247bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 1.019480 Aug 23 10:46:45.428411 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1365/2652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:44 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:45.445979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:45.450449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] [instance: 1e86e83a-eb70-4e79-a2fa-92d93ad91433] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:45.471240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:45.482263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:45.483076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:45.485777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:45.487411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:45.489384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:45.540442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] HTTP exception thrown: Instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 could not be found. Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Request method failure captured: Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 HTTP/1.1 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK9l2Sgo6A_eIpy4OBWteW3aeacARVN8qGo7ygOjfKhOh2dgKNZB01RZ_OugVN_VVwAfwv31wNrfxpssKUH8d2D0p1s6eurx5g0xkAOwc35ya-IbpaSOgCvRBsC3Su6XogpbzWMsZrxA0JarYXiGDIfuFUMBuv5vIiw0lxfEqR4EMkM Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 876d31e066de4418a6ae43fafc095a9c Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/876d31e066de4418a6ae43fafc095a9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_876d31e066de4418a6ae43fafc095a9c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/876d31e066de4418a6ae43fafc095a9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/876d31e066de4418a6ae43fafc095a9c"}]}] Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 876d31e066de4418a6ae43fafc095a9c Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminTestJSON-1719689223 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminTestJSON-1719689223-project Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 65a60d0f17c14f40adbcc6460e09d725 Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminTestJSON-1719689223-project Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 could not be found. Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1e86e83a-eb70-4e79-a2fa-92d93ad91433'} Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 could not be found. Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 could not be found. Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:45.551587 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 could not be found. Aug 23 10:46:45.556583 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:45.558940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] Returning 404 to user: Instance 1e86e83a-eb70-4e79-a2fa-92d93ad91433 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:45.561081 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14fa1fa0-8485-40cd-83b9-c67e258cfbb5 tempest-ServersAdminTestJSON-1719689223 tempest-ServersAdminTestJSON-1719689223-project] 10.222.0.78 "GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433" status: 404 len: 111 microversion: 2.1 time: 0.131276 Aug 23 10:46:45.576729 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1366/2653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:45 2022] GET /compute/v2.1/servers/1e86e83a-eb70-4e79-a2fa-92d93ad91433 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:46:46.451106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:46.451890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:46.464377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:46.481558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:46.482946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:46.484790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:46.486519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:46.488081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:47.375073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:47.383926 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7279c6db-0e2e-411f-bacf-cc6e1ffc8cad tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.939504 Aug 23 10:46:47.384519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1367/2654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:46 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:47.918522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cdc87626-c281-4bd4-adca-f6df0aa6e9ed req-c8094875-39ff-40e4-be94-1cc46da6f7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "tag": "615979c2-0fc3-4f5c-9542-b5a53102d8b7"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:47.957330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdc87626-c281-4bd4-adca-f6df0aa6e9ed req-c8094875-39ff-40e4-be94-1cc46da6f7c9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:47.959422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdc87626-c281-4bd4-adca-f6df0aa6e9ed req-c8094875-39ff-40e4-be94-1cc46da6f7c9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:47.960037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdc87626-c281-4bd4-adca-f6df0aa6e9ed req-c8094875-39ff-40e4-be94-1cc46da6f7c9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:47.986658 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cdc87626-c281-4bd4-adca-f6df0aa6e9ed req-c8094875-39ff-40e4-be94-1cc46da6f7c9 service nova] Creating event network-changed:615979c2-0fc3-4f5c-9542-b5a53102d8b7 for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:46:48.015923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cdc87626-c281-4bd4-adca-f6df0aa6e9ed req-c8094875-39ff-40e4-be94-1cc46da6f7c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096982 Aug 23 10:46:48.016786 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1368/2655] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:46:48.436364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:48.446290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:48.483152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:48.483258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:48.489082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:48.495866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:48.499644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:48.500118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:49.500425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:49.538922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04044e9f-365c-481c-9dad-b7db39717066 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 1.131552 Aug 23 10:46:49.539988 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1369/2656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:48 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:50.586566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Action: 'update', calling method: .version_select at 0x7fdca1e549d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:51.342239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:51.367916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:51.368423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:51.369096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:51.369853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:51.374121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:51.378281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:51.583537 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c3194a7-e8e0-4765-814b-38f650f42924 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb" status: 200 len: 240 microversion: 2.36 time: 1.467650 Aug 23 10:46:51.590778 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1370/2657] 10.222.0.78 () {62 vars in 1303 bytes} [Tue Aug 23 10:46:50 2022] PUT /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb => generated 240 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:46:51.596720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ff58c706-80ca-4c0f-9989-da02d0b832c0 req-2285c710-5230-4849-ad43-d95e39f3e46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "tag": "4fac0e90-f15c-479b-b987-ce7eeac5170e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:51.612586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ff58c706-80ca-4c0f-9989-da02d0b832c0 req-2285c710-5230-4849-ad43-d95e39f3e46f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:51.621075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ff58c706-80ca-4c0f-9989-da02d0b832c0 req-2285c710-5230-4849-ad43-d95e39f3e46f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:51.621909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ff58c706-80ca-4c0f-9989-da02d0b832c0 req-2285c710-5230-4849-ad43-d95e39f3e46f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:51.636218 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ff58c706-80ca-4c0f-9989-da02d0b832c0 req-2285c710-5230-4849-ad43-d95e39f3e46f service nova] Creating event network-changed:4fac0e90-f15c-479b-b987-ce7eeac5170e for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:46:51.641881 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ff58c706-80ca-4c0f-9989-da02d0b832c0 req-2285c710-5230-4849-ad43-d95e39f3e46f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049057 Aug 23 10:46:51.642811 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1371/2658] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:51.653239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:51.658251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:51.684611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:51.685583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:51.686251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:51.688607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:51.689342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:51.692337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:51.744270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=24 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:51.761309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:52.711760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:52.730943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1be9f8ef-277a-4442-8db1-48bc4773c8a1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 1.086472 Aug 23 10:46:52.746964 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1372/2659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:51 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:52.748621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Calling method '.version_select at 0x7fdca1e54430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:53.372502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:53.376178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:53.377336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:53.380578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:53.381754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:53.383965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:53.488606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-151f95be-a467-4f68-afff-8e68fb37478b tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb/detail" status: 200 len: 672 microversion: 2.36 time: 0.754085 Aug 23 10:46:53.494820 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1373/2660] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Aug 23 10:46:52 2022] GET /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb/detail => generated 672 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:46:53.731894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2fd91628-bbbc-4e1f-b52a-5e8bbc2c2a25 req-fdc26db7-136c-4d27-837c-822d265e346f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "tag": "09837e97-80ba-48f6-b008-903d8af429a2"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:53.774094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2fd91628-bbbc-4e1f-b52a-5e8bbc2c2a25 req-fdc26db7-136c-4d27-837c-822d265e346f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:53.774720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2fd91628-bbbc-4e1f-b52a-5e8bbc2c2a25 req-fdc26db7-136c-4d27-837c-822d265e346f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:53.775178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2fd91628-bbbc-4e1f-b52a-5e8bbc2c2a25 req-fdc26db7-136c-4d27-837c-822d265e346f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:53.837241 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2fd91628-bbbc-4e1f-b52a-5e8bbc2c2a25 req-fdc26db7-136c-4d27-837c-822d265e346f service nova] Creating event network-changed:09837e97-80ba-48f6-b008-903d8af429a2 for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:46:53.851389 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2fd91628-bbbc-4e1f-b52a-5e8bbc2c2a25 req-fdc26db7-136c-4d27-837c-822d265e346f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120778 Aug 23 10:46:53.853420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1374/2661] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:46:53.865933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:53.868420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:53.887173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:53.893650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:53.896204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:53.898018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:53.899064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:53.900713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:54.742769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:54.759540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30387228-d988-4d47-bdb2-71746446ec7c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.902963 Aug 23 10:46:54.774008 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1375/2662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:53 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:54.788454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Action: 'update', calling method: .version_select at 0x7fdca1da2c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:46:55.667255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:55.679632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:55.680697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:55.690077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:55.696018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:55.698400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:55.823525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:55.826561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:55.828271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:55.830154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:55.833443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:55.834357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:55.994634 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff46d7f1-abca-41d1-8520-846ac6ab1d41 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb?user_id=4ea86f2ea0db486ca882ff6d44b3ddc9" status: 200 len: 240 microversion: 2.36 time: 1.218263 Aug 23 10:46:55.996296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1376/2663] 10.222.0.78 () {62 vars in 1384 bytes} [Tue Aug 23 10:46:54 2022] PUT /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb?user_id=4ea86f2ea0db486ca882ff6d44b3ddc9 => generated 240 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:46:56.002787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:56.007224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:56.031858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:56.034298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:56.056305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:56.060630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:56.061898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:56.064627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:57.278425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:57.298270 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-63288a57-2cbd-4512-846e-78a943d9e8d1 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 1.300726 Aug 23 10:46:57.300932 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1377/2664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:55 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:57.312230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efee4b81-cc55-4030-a0da-ccca42e62cc9 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] Calling method '.version_select at 0x7fdca1d87700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:57.676879 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efee4b81-cc55-4030-a0da-ccca42e62cc9 tempest-QuotasAdminTestV236-1938041383 tempest-QuotasAdminTestV236-1938041383-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb?user_id=4ea86f2ea0db486ca882ff6d44b3ddc9" status: 200 len: 282 microversion: 2.36 time: 0.369311 Aug 23 10:46:57.677876 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1378/2665] 10.222.0.78 () {60 vars in 1364 bytes} [Tue Aug 23 10:46:57 2022] GET /compute/v2.1/os-quota-sets/6d39843fe03f40e383794988ef6ad7bb?user_id=4ea86f2ea0db486ca882ff6d44b3ddc9 => generated 282 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:46:58.222695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.226978 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:58.226978 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:58.231622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.233602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.235785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.236888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.240215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.245763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.267923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:46:58.285156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9369744-b181-499e-82d5-af7b880d6bbb tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.605848 Aug 23 10:46:58.287245 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1379/2666] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:46:57 2022] GET /compute/v2.1/os-services => generated 949 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:58.300866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.308140 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:58.308140 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:58.311473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.311972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.312415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.313175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.313633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.314191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.350037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0f5426d-2f7d-4cdf-8687-5d7da4af56fe tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.054132 Aug 23 10:46:58.358595 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1380/2667] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 23 10:46:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:46:58.363984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.364607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:58.383184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.383690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.384133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.385816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.389287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.389768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.632640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:58.641958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-afecd16e-4266-4acb-af3e-d0a6a6387dea tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.289803 Aug 23 10:46:58.658956 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1381/2668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:58 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:58.670791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.674911 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:58.674911 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:58.681680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.682919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.683831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.685262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.686290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.687071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.725125 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64ad455b-c91c-44b6-af72-56b8c1ee9e99 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.064762 Aug 23 10:46:58.726401 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1382/2669] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:46:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:58.740064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.744081 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:58.744081 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:58.746485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.747457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.748443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.750832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.751552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.752215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.814118 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66bbbd80-f42c-4f5a-8769-ef849b73d103 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-847009-13&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.079999 Aug 23 10:46:58.821715 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1383/2670] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Aug 23 10:46:58 2022] GET /compute/v2.1/os-services?host=n-d-847009-13&binary=xxx => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:46:58.843898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.858738 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:58.858738 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:58.858738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.858738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.858738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.859495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.859933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.874463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.959249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fdaa52da-4a59-4f45-96b2-3cf7d8d1a271 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.129786 Aug 23 10:46:58.969407 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1384/2671] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:46:58 2022] GET /compute/v2.1/os-services => generated 949 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:46:58.974619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:58.977266 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:58.977266 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:58.986900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.986900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.986900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:58.986900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:58.994448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:58.995554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:59.016556 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2f7b77e-99bb-4ac8-8eae-6e1c9d317831 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1464 microversion: 2.1 time: 17.192700 Aug 23 10:46:59.020618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1288/2672] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:41 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1464 bytes in 17197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:59.031738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ad1d148-1e8e-40e8-b319-f530915de0d3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cdcedc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:59.058929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33211b08-4561-4936-b537-9fc5b15dbbd2 tempest-ServicesAdminNegativeTestJSON-1358831677 tempest-ServicesAdminNegativeTestJSON-1358831677-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.088014 Aug 23 10:46:59.072790 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1385/2673] 10.222.0.78 () {58 vars in 1198 bytes} [Tue Aug 23 10:46:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:46:59.229704 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ad1d148-1e8e-40e8-b319-f530915de0d3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 200 len: 1464 microversion: 2.1 time: 0.202089 Aug 23 10:46:59.230284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1289/2674] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:46:59 2022] GET /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:59.255746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:59.256624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:59.295359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:59.296121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:59.296722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:59.305721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:59.307734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:59.308350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:59.748506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:59.772733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02bddefd-5505-4363-bbb9-19fd7373bad1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1480 microversion: 2.1 time: 0.532700 Aug 23 10:46:59.790020 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1290/2675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:59 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1480 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:46:59.810176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:59.818155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:46:59.850840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:59.853726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:59.854572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:59.855929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:46:59.857025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:46:59.857725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:46:59.894318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82c9cabd-4ed6-4554-851a-8dd3c7b4f970 tempest-ServicesAdminNegativeTestJSON-179154374 tempest-ServicesAdminNegativeTestJSON-179154374-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:46:59.897048 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:46:59.897048 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:46:59.898160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82c9cabd-4ed6-4554-851a-8dd3c7b4f970 tempest-ServicesAdminNegativeTestJSON-179154374 tempest-ServicesAdminNegativeTestJSON-179154374-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a5da809ff3604eae8308c674b796ade3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563a8fe162b94d41b928cfff48738d11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82c9cabd-4ed6-4554-851a-8dd3c7b4f970 tempest-ServicesAdminNegativeTestJSON-179154374 tempest-ServicesAdminNegativeTestJSON-179154374-project] Request method failure captured: Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLAefRjwKmW07w6FnD-R_NilsE7_ZnoMcAyynrXFSZujX9THjhJgTMd97ylYjmwDjwdcOC2koZtXdyXZQABHw33i6O-7CiZGEBjJ6GCfvd6e6skXuPga3CUeTluD_9OeNkbA3AFho_yjYwvp5-NxXdPJRlB288hW7SyuWLbYBMG1UVw Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 563a8fe162b94d41b928cfff48738d11 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-179154374 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "tempest-type-381828432", "name": "tempest-service-1822770510", "endpoints": [{"region": "tempest-region-2037940859", "publicURL": "https://url-2068844389.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/563a8fe162b94d41b928cfff48738d11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_563a8fe162b94d41b928cfff48738d11", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/563a8fe162b94d41b928cfff48738d11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/563a8fe162b94d41b928cfff48738d11"}]}] Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-179154374 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 563a8fe162b94d41b928cfff48738d11 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-179154374 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServicesAdminNegativeTestJSON-179154374-project Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a5da809ff3604eae8308c674b796ade3 Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-179154374-project Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: action_args: {} Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:46:59.923036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:46:59.927232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82c9cabd-4ed6-4554-851a-8dd3c7b4f970 tempest-ServicesAdminNegativeTestJSON-179154374 tempest-ServicesAdminNegativeTestJSON-179154374-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:46:59.930629 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82c9cabd-4ed6-4554-851a-8dd3c7b4f970 tempest-ServicesAdminNegativeTestJSON-179154374 tempest-ServicesAdminNegativeTestJSON-179154374-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.855967 Aug 23 10:46:59.949555 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1386/2676] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:46:59 2022] GET /compute/v2.1/os-services => generated 112 bytes in 874 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:00.482537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:00.496869 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0597f09c-00ac-4c1f-b9ac-0a3d93918cde tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.703421 Aug 23 10:47:00.511737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1291/2677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:46:59 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:00.796877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:00.797488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:00.812712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:00.813238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:00.813678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:00.814389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:00.814846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:00.815266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:01.262016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:01.276784 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9cd81e63-df0c-4b2f-be34-3461eab7dd08 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1467 microversion: 2.1 time: 0.484390 Aug 23 10:47:01.301296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1387/2678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:00 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1467 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:01.306517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2099509133"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:01.308983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:01.329223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:01.329732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:01.330178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:01.330912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:01.331374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:01.332556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:01.522274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:01.523055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:01.536858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:01.540257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:01.541039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:01.544666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:01.547893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:01.549100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:01.918983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:01.929906 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46c10718-053f-441d-b283-bac80c79153d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.413435 Aug 23 10:47:01.947299 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1388/2679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:01 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:02.958977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:02.959627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:03.011654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:03.015493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:03.017549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:03.027043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:03.028878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:03.029773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:03.478447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:03.497358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f80c81ad-2036-47f1-9454-a55839026ba0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.544866 Aug 23 10:47:03.502036 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1389/2680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:02 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:03.904086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-bd45d833-1af3-43e7-a16d-677f6e62145d req-00118bac-1dcf-42da-8c7e-9408edb038fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "name": "network-vif-unplugged", "status": "completed", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:03.934713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bd45d833-1af3-43e7-a16d-677f6e62145d req-00118bac-1dcf-42da-8c7e-9408edb038fe service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:03.942268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bd45d833-1af3-43e7-a16d-677f6e62145d req-00118bac-1dcf-42da-8c7e-9408edb038fe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:03.943972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bd45d833-1af3-43e7-a16d-677f6e62145d req-00118bac-1dcf-42da-8c7e-9408edb038fe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:04.003464 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-bd45d833-1af3-43e7-a16d-677f6e62145d req-00118bac-1dcf-42da-8c7e-9408edb038fe service nova] Creating event network-vif-unplugged:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:47:04.014062 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-bd45d833-1af3-43e7-a16d-677f6e62145d req-00118bac-1dcf-42da-8c7e-9408edb038fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115014 Aug 23 10:47:04.023844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1390/2681] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:47:04.525565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:04.526438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:04.539283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:04.541975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:04.543364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:04.546191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:04.546191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:04.557121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:05.671527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:05.692526 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91c79916-619b-48b0-ae38-ecd4a2476182 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 1.169418 Aug 23 10:47:05.694800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1391/2682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:04 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:47:06.224353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b2804198-9e63-4b68-b69a-9e8f9607221f req-202d9556-1d50-4fe1-a696-7dde9cc573a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-plugged", "status": "completed", "tag": "09837e97-80ba-48f6-b008-903d8af429a2"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:06.267199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b2804198-9e63-4b68-b69a-9e8f9607221f req-202d9556-1d50-4fe1-a696-7dde9cc573a9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:06.268016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b2804198-9e63-4b68-b69a-9e8f9607221f req-202d9556-1d50-4fe1-a696-7dde9cc573a9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:06.268722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b2804198-9e63-4b68-b69a-9e8f9607221f req-202d9556-1d50-4fe1-a696-7dde9cc573a9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:06.313324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b2804198-9e63-4b68-b69a-9e8f9607221f req-202d9556-1d50-4fe1-a696-7dde9cc573a9 service nova] Creating event network-vif-plugged:09837e97-80ba-48f6-b008-903d8af429a2 for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:06.335206 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b2804198-9e63-4b68-b69a-9e8f9607221f req-202d9556-1d50-4fe1-a696-7dde9cc573a9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131614 Aug 23 10:47:06.336457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1392/2683] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:47:06.724249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:06.725812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:06.737082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:06.740376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:06.741168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:06.743327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:06.745915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:06.746581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:07.236166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:07.247263 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5c099141-22cf-41ab-a746-52d1e31e78f4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.530437 Aug 23 10:47:07.260452 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1393/2684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:06 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:47:08.291389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:08.292972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:08.309188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=30 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:08.312440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:08.321134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:08.322746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:08.325826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:08.327393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:08.329458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:08.330270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:08.823861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:08.839218 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ec32419-fd67-4a5b-a9b1-b69b0c8823bb tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.550449 Aug 23 10:47:08.861017 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1394/2685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:08 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:09.006617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=21 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:09.584864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da03dfcd-fe08-4c05-a70c-e1254d036ca6 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Calling method '.version_select at 0x7fdca1d5c3a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:10.187243 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da03dfcd-fe08-4c05-a70c-e1254d036ca6 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 371 microversion: 2.1 time: 1.324861 Aug 23 10:47:10.195318 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1395/2686] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 10:47:08 2022] GET /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 371 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:10.211420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-plugged", "status": "completed", "tag": "4fac0e90-f15c-479b-b987-ce7eeac5170e"}, {"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-plugged", "status": "completed", "tag": "615979c2-0fc3-4f5c-9542-b5a53102d8b7"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:10.247640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:10.254407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:10.255185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:10.293044 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] Creating event network-vif-plugged:4fac0e90-f15c-479b-b987-ce7eeac5170e for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:10.305160 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] Creating event network-vif-plugged:615979c2-0fc3-4f5c-9542-b5a53102d8b7 for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:10.316647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7be6eb41-5f0d-44cd-8399-6b4f64c82bda req-06f8b35c-07d0-414c-a629-dfb7ae37c95b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119540 Aug 23 10:47:10.317316 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1396/2687] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:10.338556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:10.348995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:10.368482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:10.376723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:10.385578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:10.386921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:10.387591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:10.388227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:11.048994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:11.058620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4de80266-d5dd-47f3-94ca-72db89ce3520 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.729777 Aug 23 10:47:11.064267 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1397/2688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:10 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:11.073607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Action: 'update', calling method: .version_select at 0x7fdca1e54a60>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:11.269476 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94f18c0c-3cbc-4877-95c5-2735f1e6b90e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "POST /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1/action" status: 202 len: 0 microversion: 2.1 time: 9.966310 Aug 23 10:47:11.271368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1292/2689] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:47:01 2022] POST /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1/action => generated 0 bytes in 9969 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:47:11.277082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:11.278272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:11.287049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:11.287680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:11.288329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:11.289489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:11.290395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:11.291160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:11.561664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:11.563286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:11.565522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:11.566775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:11.567676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:11.568123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:11.674715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d8f0628-b70d-42d0-8a5a-b7c84167e852 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 328 microversion: 2.1 time: 0.608853 Aug 23 10:47:11.685100 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1398/2690] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:11 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 328 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:11.990756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:12.002875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30c87143-38f9-4b38-bb4e-de820028bf4f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.730262 Aug 23 10:47:12.003769 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1293/2691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:11 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:12.012872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da8bc23e-c731-481c-9e24-3605ff56a360 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cbce430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:12.080508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da8bc23e-c731-481c-9e24-3605ff56a360 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1455 microversion: 2.1 time: 0.075629 Aug 23 10:47:12.090151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1294/2692] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:12 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:12.109738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9c3cb9d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:12.113014 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:12.113014 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:47:12.114196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.114988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.115703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.131516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.133872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.134578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.142531 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] HTTP exception thrown: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Request method failure captured: Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237 HTTP/1.1 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 56 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLAugmvipcPpkpMncANKXMKg9aBN-fKpVeMzWRjQlKokQqyRyAbdkFa2aXTl6GRcAbJqH61WYhLnrLQK0bpcio_lDlAieprEBzlyRKpjhDBB_IZoggKm3l4Oc_0QoEZXT4CMnL_CkypVv00RtnCw1lMMLcxCLTuOI-wBcy-87rTcTYI Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 5f45d81fc5414947b4ccf454200e1007 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5f45d81fc5414947b4ccf454200e1007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5f45d81fc5414947b4ccf454200e1007", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5f45d81fc5414947b4ccf454200e1007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5f45d81fc5414947b4ccf454200e1007"}]}] Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 5f45d81fc5414947b4ccf454200e1007 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ce89dc38e4d0423195f4e9f7ec2eec75 Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: exception: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '52704ec1-f4a9-4d14-9160-8586056e8237', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:12.146012 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.149868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.152322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Returning 404 to user: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:12.153484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5164bfda-2540-4636-9596-b3acd420bfa0 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237" status: 404 len: 110 microversion: 2.53 time: 0.476233 Aug 23 10:47:12.154739 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1399/2693] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Aug 23 10:47:11 2022] PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237 => generated 110 bytes in 478 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:47:12.161639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:12.162820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:12.169793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.170631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.171308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.172391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.173153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.173800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.228647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1252634726", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:12.298948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:12.441728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:12.449978 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b7bf6168-37aa-4a52-a064-22cd43bd4ce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1355 microversion: 2.1 time: 0.294062 Aug 23 10:47:12.466387 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1400/2694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:12 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1355 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:12.473390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Action: 'update', calling method: .version_select at 0x7fdca1e81940>, body: {"status": "disabled"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:12.477293 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:12.477293 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:47:12.478713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.479517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.480565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.488879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.498175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.498748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.511387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] HTTP exception thrown: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Request method failure captured: Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237 HTTP/1.1 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 22 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLAugmvipcPpkpMncANKXMKg9aBN-fKpVeMzWRjQlKokQqyRyAbdkFa2aXTl6GRcAbJqH61WYhLnrLQK0bpcio_lDlAieprEBzlyRKpjhDBB_IZoggKm3l4Oc_0QoEZXT4CMnL_CkypVv00RtnCw1lMMLcxCLTuOI-wBcy-87rTcTYI Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 5f45d81fc5414947b4ccf454200e1007 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5f45d81fc5414947b4ccf454200e1007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5f45d81fc5414947b4ccf454200e1007", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5f45d81fc5414947b4ccf454200e1007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5f45d81fc5414947b4ccf454200e1007"}]}] Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 5f45d81fc5414947b4ccf454200e1007 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ce89dc38e4d0423195f4e9f7ec2eec75 Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: {"status": "disabled"} Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: exception: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '52704ec1-f4a9-4d14-9160-8586056e8237', 'body': {'status': 'disabled'}} Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:12.516835 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Returning 404 to user: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:12.521584 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-545b7b32-c887-444a-8e48-21bbff5b25ec tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237" status: 404 len: 110 microversion: 2.53 time: 0.051096 Aug 23 10:47:12.524371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1401/2695] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Aug 23 10:47:12 2022] PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:47:12.531978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9c2e04c0>, body: {"status": "enabled"} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:12.570950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.571456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.571901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.589503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.590000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.590447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.603560 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] HTTP exception thrown: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Request method failure captured: Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237 HTTP/1.1 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 21 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLAugmvipcPpkpMncANKXMKg9aBN-fKpVeMzWRjQlKokQqyRyAbdkFa2aXTl6GRcAbJqH61WYhLnrLQK0bpcio_lDlAieprEBzlyRKpjhDBB_IZoggKm3l4Oc_0QoEZXT4CMnL_CkypVv00RtnCw1lMMLcxCLTuOI-wBcy-87rTcTYI Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 5f45d81fc5414947b4ccf454200e1007 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5f45d81fc5414947b4ccf454200e1007"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5f45d81fc5414947b4ccf454200e1007", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5f45d81fc5414947b4ccf454200e1007"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5f45d81fc5414947b4ccf454200e1007"}]}] Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 5f45d81fc5414947b4ccf454200e1007 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ce89dc38e4d0423195f4e9f7ec2eec75 Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: {"status": "enabled"} Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: exception: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '52704ec1-f4a9-4d14-9160-8586056e8237', 'body': {'status': 'enabled'}} Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:12.606468 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Returning 404 to user: Service 52704ec1-f4a9-4d14-9160-8586056e8237 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:12.610169 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09916ea6-97e9-4361-a0f6-755a2e8c4588 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237" status: 404 len: 110 microversion: 2.53 time: 0.084486 Aug 23 10:47:12.621854 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1402/2696] 10.222.0.78 () {62 vars in 1309 bytes} [Tue Aug 23 10:47:12 2022] PUT /compute/v2.1/os-services/52704ec1-f4a9-4d14-9160-8586056e8237 => generated 110 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:47:12.635345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:12.652142 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:12.652142 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:47:12.654140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.654694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.655150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.657292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.657763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.658198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.709494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:12.710673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:12.711800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:12.712413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:12.713030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:12.744167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.757105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.757775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.758786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.759444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.760089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.766249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3f28a5d-2227-405d-b730-bd08fa5e9f0c tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.138924 Aug 23 10:47:12.778757 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1403/2697] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Aug 23 10:47:12 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:47:12.788602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:12.795621 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:12.795621 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:47:12.804798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.805517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.805682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.808850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.809799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.810251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.817194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Getting quotas for project 880cbdc3cc64416a844e1523b1932545. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:12.824268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Getting quotas for user 57a05c912579493f85c24de646ab6547 and project 880cbdc3cc64416a844e1523b1932545. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:12.840223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.utils [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] cores quota exceeded for 880cbdc3cc64416a844e1523b1932545, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128860) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 23 10:47:12.841246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Request method failure captured: Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 145 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLApBkdYcn7C1Zxg_qd_1yBDjy-CTIVrhq-_sn6ckMDIZsIAVXEYFr6RAp11hh38PvPVQI3yE-gbpTq0R5olugagMlSAp4-aSOuTgwbmhxIMczThZ80ntNHYuHeAp-031Q7qYUIjuZ42THQNZZBtVpf3CIYy1nYSMO-bohig3R3oZGw Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_880cbdc3cc64416a844e1523b1932545", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}] Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 57a05c912579493f85c24de646ab6547 Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1252634726", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1252634726', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452'}}} Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:47:12.856499 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 10:47:12.860133 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:12.866198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:12.866198 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7936f716-03c7-44f2-b2e1-3fa54c1d57f5 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.769933 Aug 23 10:47:12.866198 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1295/2698] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 771 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:12.871823 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb172adb-5a33-4126-87e0-98ab1dda76c1 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.091321 Aug 23 10:47:12.876426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Action: 'update', calling method: .version_select at 0x7fdca1dd3790>, body: {"quota_set": {"cores": 20}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:12.884517 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1404/2699] 10.222.0.78 () {60 vars in 1211 bytes} [Tue Aug 23 10:47:12 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:47:12.893723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:12.913479 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:12.913479 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:47:12.917937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.923741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.924283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:12.925179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:12.926029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:12.926430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.039120 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f8b37b5f-8ceb-48e7-b35d-8b4176356a8a tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.149019 Aug 23 10:47:13.039746 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1405/2700] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Aug 23 10:47:12 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:47:13.059862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:13.060389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:13.073610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.074136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.074907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.078515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.079748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.080201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.359907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:13.380606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69d8a378-8bcc-4070-a60f-00f97403eda9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.324574 Aug 23 10:47:13.381635 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1406/2701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:13 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:13.392485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:13.399668 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:13.399668 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:47:13.401246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.402028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.402628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.403743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.404374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.404981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.432165 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1d9df13-713b-4b0a-af45-ae65ab4b3593 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-847009-13&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.048884 Aug 23 10:47:13.441320 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1407/2702] 10.222.0.78 () {60 vars in 1237 bytes} [Tue Aug 23 10:47:13 2022] GET /compute/v2.1/os-services?host=n-d-847009-13&binary=xxx => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:13.469713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe4c81ad-c8ad-49ac-8736-e654666249cb tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1d1e040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:13.510743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.511931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.514290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.515352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.519939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.520522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.557121 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe4c81ad-c8ad-49ac-8736-e654666249cb tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1455 microversion: 2.1 time: 0.118027 Aug 23 10:47:13.558233 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1408/2703] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:13 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:13.564627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1059258469"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:13.569476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:13.579807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.581142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.583187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.584187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.584921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.585625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.707648 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb9985b9-623c-47a9-8306-58eb3ffe25cc tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 329 microversion: 2.1 time: 0.840052 Aug 23 10:47:13.709187 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1296/2704] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:12 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 329 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:13.720492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:13.724031 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:13.724031 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:47:13.725799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.726557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.727198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.729208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.729861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.730528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.762490 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc82cfcb-231a-451c-8d22-95319d37240e tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.051990 Aug 23 10:47:13.763807 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1297/2705] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Aug 23 10:47:13 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:47:13.777683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:13.779186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:13.789791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.790726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.791668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.794388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:13.795143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:13.795909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:13.870432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:13.950273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99897963-b33b-49cd-8ba1-b0d19b73bcd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.388436 Aug 23 10:47:13.956025 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1409/2706] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:47:13 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 23 10:47:13.982010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4babbde3-e326-4402-a059-1ca9924cef76 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Calling method '.version_select at 0x7fdca1e0e8b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:14.188573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:14.199347 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd81bdfb-fd52-46a4-9749-1908a6a1d5ee tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1804 microversion: 2.1 time: 0.434268 Aug 23 10:47:14.199934 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1298/2707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:13 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1804 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:14.205630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:14.209380 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:14.209380 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:47:14.210784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:14.211307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:14.211759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:14.212500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:14.212994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:14.213605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:14.238673 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06fcb1d7-2435-4305-8ccc-3610648ac763 tempest-ServicesAdminNegativeV253TestJSON-971373080 tempest-ServicesAdminNegativeV253TestJSON-971373080-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.036734 Aug 23 10:47:14.239840 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1299/2708] 10.222.0.78 () {60 vars in 1239 bytes} [Tue Aug 23 10:47:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:14.251733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:14.254387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:14.269809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:14.270427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:14.270906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:14.272011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:14.272484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:14.272970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:14.314247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e8786ee4-4f19-4417-8614-7dabb5cadce3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c/ips" status: 200 len: 217 microversion: 2.1 time: 0.072706 Aug 23 10:47:14.320823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1300/2709] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 10:47:14 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c/ips => generated 217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:14.428593 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4babbde3-e326-4402-a059-1ca9924cef76 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 371 microversion: 2.1 time: 0.460008 Aug 23 10:47:14.430872 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1410/2710] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 10:47:13 2022] GET /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:14.440493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:14.442946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:14.459917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:14.462557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:14.464647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:14.465562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:14.471119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:14.471900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:14.523145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:47:14.707311 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a04f0a8b-00f9-4fc8-9219-fa9fed7aa920 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 204 len: 0 microversion: 2.1 time: 0.273861 Aug 23 10:47:14.709652 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1411/2711] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:47:14 2022] DELETE /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:47:14.720787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9d272f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:14.860731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5dabdd0-5fe8-416a-8361-46aba3735a54 tempest-ServicesAdminNegativeV253TestJSON-1582472366 tempest-ServicesAdminNegativeV253TestJSON-1582472366-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:14.864094 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:47:14.864094 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 10:47:14.867679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5dabdd0-5fe8-416a-8361-46aba3735a54 tempest-ServicesAdminNegativeV253TestJSON-1582472366 tempest-ServicesAdminNegativeV253TestJSON-1582472366-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '935b61f7f9a34454963d0acca38766dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dba4f83133d49c7824f6a7c14cdfd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5dabdd0-5fe8-416a-8361-46aba3735a54 tempest-ServicesAdminNegativeV253TestJSON-1582472366 tempest-ServicesAdminNegativeV253TestJSON-1582472366-project] Request method failure captured: Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLAsdb-6LtFdCX5TGBjrSz0Macm5KzCdeQUGRGLw6OFcRmDO0XnrMJijoXU_8j4e71PJuZnVFs3W8gFzbRiIX5m4qvk-Uiz0uCDlZKG_KTns63sIAG6eDnYIE6kWzgXLqtRRswvq5A5GY7JZ6KBBK5vzZqlaCL0vk0uncXKjedpPpM8 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 9dba4f83133d49c7824f6a7c14cdfd06 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1582472366 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9dba4f83133d49c7824f6a7c14cdfd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9dba4f83133d49c7824f6a7c14cdfd06", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dba4f83133d49c7824f6a7c14cdfd06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9dba4f83133d49c7824f6a7c14cdfd06"}]}] Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1582472366 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 9dba4f83133d49c7824f6a7c14cdfd06 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1582472366 Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1582472366-project Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 935b61f7f9a34454963d0acca38766dd Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1582472366-project Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:47:14.869992 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5dabdd0-5fe8-416a-8361-46aba3735a54 tempest-ServicesAdminNegativeV253TestJSON-1582472366 tempest-ServicesAdminNegativeV253TestJSON-1582472366-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:14.874240 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5dabdd0-5fe8-416a-8361-46aba3735a54 tempest-ServicesAdminNegativeV253TestJSON-1582472366 tempest-ServicesAdminNegativeV253TestJSON-1582472366-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.554619 Aug 23 10:47:14.880782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1301/2712] 10.222.0.78 () {60 vars in 1178 bytes} [Tue Aug 23 10:47:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 565 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:47:14.900471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a69a7e44-7e57-4b52-801c-b31ae8a9845c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e871f0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:15.009369 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a69a7e44-7e57-4b52-801c-b31ae8a9845c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1455 microversion: 2.1 time: 0.121761 Aug 23 10:47:15.010955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1302/2713] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:14 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:15.027985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:15.029535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:15.049362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:15.060278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:15.062449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:15.063231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:15.063717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:15.064162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:15.080331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:15.086911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:15.088327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:15.089189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:15.089667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:15.090111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:15.297165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:15.310935 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37e59257-9590-4b24-802f-d282548a671c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1810 microversion: 2.1 time: 0.298614 Aug 23 10:47:15.314426 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1303/2714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:15 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1810 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:15.327742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69af144a-f02d-42dc-a8a9-d64d9d47a583 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 328 microversion: 2.1 time: 0.615805 Aug 23 10:47:15.329852 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1412/2715] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:14 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 328 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:15.735505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1911546784", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:15.851791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:15.999020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ec960d73-d64b-4914-bb17-98a73276a844 req-218db8ac-b136-4fc9-b68e-a71294d19cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-unplugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:16.034516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ec960d73-d64b-4914-bb17-98a73276a844 req-218db8ac-b136-4fc9-b68e-a71294d19cff service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:16.038174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ec960d73-d64b-4914-bb17-98a73276a844 req-218db8ac-b136-4fc9-b68e-a71294d19cff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:16.039600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ec960d73-d64b-4914-bb17-98a73276a844 req-218db8ac-b136-4fc9-b68e-a71294d19cff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:16.099336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ec960d73-d64b-4914-bb17-98a73276a844 req-218db8ac-b136-4fc9-b68e-a71294d19cff service nova] Creating event network-vif-unplugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:47:16.125648 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ec960d73-d64b-4914-bb17-98a73276a844 req-218db8ac-b136-4fc9-b68e-a71294d19cff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132348 Aug 23 10:47:16.126875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1413/2716] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:47:16.152927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff4b64ee-150f-4f78-b3b0-5f43ee6f74aa tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e91700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:16.355886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff4b64ee-150f-4f78-b3b0-5f43ee6f74aa tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1455 microversion: 2.1 time: 0.223891 Aug 23 10:47:16.358404 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1414/2717] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:16 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:16.379452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:16.382785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:16.391734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:16.392727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:16.393365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:16.396799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:16.398802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:16.399402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:16.566557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:16.567094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:16.567480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:16.568094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:16.568670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:16.600268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:16.600846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:16.601267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:16.602022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:16.617529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:16.618007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:16.658130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Getting quotas for project 880cbdc3cc64416a844e1523b1932545. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:16.680573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Getting quotas for user 57a05c912579493f85c24de646ab6547 and project 880cbdc3cc64416a844e1523b1932545. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:16.729938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.utils [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] instances quota exceeded for 880cbdc3cc64416a844e1523b1932545, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128860) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 23 10:47:16.730507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Request method failure captured: Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 145 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLApBkdYcn7C1Zxg_qd_1yBDjy-CTIVrhq-_sn6ckMDIZsIAVXEYFr6RAp11hh38PvPVQI3yE-gbpTq0R5olugagMlSAp4-aSOuTgwbmhxIMczThZ80ntNHYuHeAp-031Q7qYUIjuZ42THQNZZBtVpf3CIYy1nYSMO-bohig3R3oZGw Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_880cbdc3cc64416a844e1523b1932545", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}] Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 57a05c912579493f85c24de646ab6547 Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1911546784", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1911546784', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452'}}} Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:47:16.740914 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:16.745573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05151d50-1c8b-403d-8bac-d6261ab86ea8 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.012594 Aug 23 10:47:16.751590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1304/2718] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:15 2022] POST /compute/v2.1/servers => generated 119 bytes in 1020 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:16.798435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9cebae50>, body: {"quota_set": {"instances": 10}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:16.884601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:16.921888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfa9dc52-78bd-496e-809e-e5048d42e746 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1810 microversion: 2.1 time: 0.562179 Aug 23 10:47:16.923193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1415/2719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:16 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1810 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:17.363008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:17.364307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:17.364935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:17.366352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:17.368032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:17.368032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:17.378997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcfb1905-d3ce-41ec-bf7f-b56f6cc01b3d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb41ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:17.499009 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e615572b-875e-413a-b2ec-3729b779853c tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 329 microversion: 2.1 time: 0.744308 Aug 23 10:47:17.501625 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1305/2720] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:16 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 329 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:17.517440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04d6ffc4-24e1-43dc-aeba-0ffae323f170 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Calling method '.version_select at 0x7fdc9cbce040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:19.043871 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04d6ffc4-24e1-43dc-aeba-0ffae323f170 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 371 microversion: 2.1 time: 1.531471 Aug 23 10:47:19.054524 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1306/2721] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 10:47:17 2022] GET /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 371 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:19.069034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:19.076008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:19.098871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:19.100270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:19.105466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:19.109690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:19.110205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:19.110663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:19.431177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:19.444145 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06dd6101-bd31-4348-a8c9-e4eceb76aca5 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1789 microversion: 2.1 time: 0.385287 Aug 23 10:47:19.445639 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1307/2722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:19 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1789 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:19.461108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f783a2ed-a230-4099-940a-a77f079fb1c2 req-a94e2a5e-3902-4665-bb18-0aee99f87d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9681ff3-1da2-44b0-97bf-a8150364c2f1", "name": "network-vif-plugged", "status": "completed", "tag": "e7a53fbb-1132-4ee6-99d6-efddacd5d957"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:19.474194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f783a2ed-a230-4099-940a-a77f079fb1c2 req-a94e2a5e-3902-4665-bb18-0aee99f87d93 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:19.475206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f783a2ed-a230-4099-940a-a77f079fb1c2 req-a94e2a5e-3902-4665-bb18-0aee99f87d93 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:19.475858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f783a2ed-a230-4099-940a-a77f079fb1c2 req-a94e2a5e-3902-4665-bb18-0aee99f87d93 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:19.492490 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f783a2ed-a230-4099-940a-a77f079fb1c2 req-a94e2a5e-3902-4665-bb18-0aee99f87d93 service nova] Creating event network-vif-plugged:e7a53fbb-1132-4ee6-99d6-efddacd5d957 for instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 on n-h2-847009-13 Aug 23 10:47:19.498349 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f783a2ed-a230-4099-940a-a77f079fb1c2 req-a94e2a5e-3902-4665-bb18-0aee99f87d93 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050279 Aug 23 10:47:19.499450 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1308/2723] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:19.908514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-23673bde-79e5-406f-aa29-13d7ac4dd88c req-1790572f-539a-459c-b5f6-e0dc71f7c12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-deleted", "tag": "09837e97-80ba-48f6-b008-903d8af429a2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:19.944634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-23673bde-79e5-406f-aa29-13d7ac4dd88c req-1790572f-539a-459c-b5f6-e0dc71f7c12d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:19.951883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-23673bde-79e5-406f-aa29-13d7ac4dd88c req-1790572f-539a-459c-b5f6-e0dc71f7c12d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:19.953758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-23673bde-79e5-406f-aa29-13d7ac4dd88c req-1790572f-539a-459c-b5f6-e0dc71f7c12d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:20.035748 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-23673bde-79e5-406f-aa29-13d7ac4dd88c req-1790572f-539a-459c-b5f6-e0dc71f7c12d service nova] Creating event network-vif-deleted:09837e97-80ba-48f6-b008-903d8af429a2 for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:20.068254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-23673bde-79e5-406f-aa29-13d7ac4dd88c req-1790572f-539a-459c-b5f6-e0dc71f7c12d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.564171 Aug 23 10:47:20.072501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1309/2724] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:20.097490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Action: 'update', calling method: .version_select at 0x7fdca1e965e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:20.831112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:20.831839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:20.832470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:20.833633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:20.834493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:20.834986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:21.019591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:21.065614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb9e0190-8873-4eb2-b462-e20782540403 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 325 microversion: 2.1 time: 0.986609 Aug 23 10:47:21.067553 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1310/2725] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:20 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 325 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:21.073637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:21.075098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:21.091009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:21.091803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:21.092628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:21.093546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:21.094275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:21.094725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:21.208700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:21.225823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4559635e-6eaa-4b6e-ab92-f8815aa90df3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 200 len: 1612 microversion: 2.1 time: 0.156694 Aug 23 10:47:21.228988 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1311/2726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:21 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 1612 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:21.419208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1023320898", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:22.997944 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcfb1905-d3ce-41ec-bf7f-b56f6cc01b3d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1455 microversion: 2.1 time: 5.627041 Aug 23 10:47:23.001438 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1416/2727] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:17 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1455 bytes in 5632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:47:23.016110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:23.126448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c0ca9625-04d9-4238-976c-52cc0eadfda2 req-1f5dcc30-4a4b-4691-872c-1643bc26b623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-unplugged", "status": "completed", "tag": "4fac0e90-f15c-479b-b987-ce7eeac5170e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:23.170096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c0ca9625-04d9-4238-976c-52cc0eadfda2 req-1f5dcc30-4a4b-4691-872c-1643bc26b623 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:23.170594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c0ca9625-04d9-4238-976c-52cc0eadfda2 req-1f5dcc30-4a4b-4691-872c-1643bc26b623 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:23.171035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c0ca9625-04d9-4238-976c-52cc0eadfda2 req-1f5dcc30-4a4b-4691-872c-1643bc26b623 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:23.229228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c0ca9625-04d9-4238-976c-52cc0eadfda2 req-1f5dcc30-4a4b-4691-872c-1643bc26b623 service nova] Creating event network-vif-unplugged:4fac0e90-f15c-479b-b987-ce7eeac5170e for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:23.240150 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c0ca9625-04d9-4238-976c-52cc0eadfda2 req-1f5dcc30-4a4b-4691-872c-1643bc26b623 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.234705 Aug 23 10:47:23.244453 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1417/2728] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:23.254763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-deleted", "tag": "615979c2-0fc3-4f5c-9542-b5a53102d8b7"}, {"server_uuid": "c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c", "name": "network-vif-deleted", "tag": "4fac0e90-f15c-479b-b987-ce7eeac5170e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:23.283439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:23.285128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:23.287349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:23.314911 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] Creating event network-vif-deleted:615979c2-0fc3-4f5c-9542-b5a53102d8b7 for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:23.317514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] Creating event network-vif-deleted:4fac0e90-f15c-479b-b987-ce7eeac5170e for instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c on n-h1-847009-13 Aug 23 10:47:23.325949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0a74bce1-e168-4a6d-9248-21ef67e03203 req-a7fb857b-e327-4554-aa14-9fabed199eba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079631 Aug 23 10:47:23.339292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1418/2729] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:23.345109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:23.345826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:23.371209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:23.373556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:23.374194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:23.376159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:23.377143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:23.379284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:23.402942 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] HTTP exception thrown: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Request method failure captured: Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c HTTP/1.1 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_51e16FPEBDS16bM92eKMc2Tq4OMPGfoCpCLC_K7vWmQYcD6c5UI2IcbLsQXpak3Txiofd-Luo56Q-M0wu8lcINHMG38qCy8IpJ2xr6T9NhL3bZF_Jm1kRYCDi28fBi3ykSnnmp5Q53_E1PblhV9Map5JWWxqloIBcGYvNQYzb4ik Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4672980399e34e3d94dd82f7c375e2e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}] Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestMultiNic-1244710478 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7bea2324e2b4416e9f39c0e47b2ce15d Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c'} Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:23.408244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:47:23.412821 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.418380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Returning 404 to user: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:23.434442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd93aa7e-ee5b-4679-8639-ac75db0c3ac3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 404 len: 111 microversion: 2.1 time: 0.093083 Aug 23 10:47:23.435711 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1419/2730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:23 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:23.459087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:23.460007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:23.460520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:23.460984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:23.461413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:23.483911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:23.484390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:23.493750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:23.495049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:23.497008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:23.499153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:23.522660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:23.559594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Getting quotas for project 880cbdc3cc64416a844e1523b1932545. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:23.575063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Getting quotas for user 57a05c912579493f85c24de646ab6547 and project 880cbdc3cc64416a844e1523b1932545. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:23.605196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.utils [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] ram quota exceeded for 880cbdc3cc64416a844e1523b1932545, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128860) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 23 10:47:23.606278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Request method failure captured: Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 145 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLApBkdYcn7C1Zxg_qd_1yBDjy-CTIVrhq-_sn6ckMDIZsIAVXEYFr6RAp11hh38PvPVQI3yE-gbpTq0R5olugagMlSAp4-aSOuTgwbmhxIMczThZ80ntNHYuHeAp-031Q7qYUIjuZ42THQNZZBtVpf3CIYy1nYSMO-bohig3R3oZGw Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_880cbdc3cc64416a844e1523b1932545", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}] Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 57a05c912579493f85c24de646ab6547 Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1023320898", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1023320898', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452'}}} Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:47:23.613265 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 10:47:23.617319 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:47:23.636042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:23.639339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85dc3d64-93b6-4645-baa4-dc874ff7520a tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.225129 Aug 23 10:47:23.642771 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1312/2731] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:21 2022] POST /compute/v2.1/servers => generated 110 bytes in 2229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:23.653057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Action: 'update', calling method: .version_select at 0x7fdc9c528ca0>, body: {"quota_set": {"ram": 51200}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:24.017139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c905d0e2-fe7d-40b0-aa95-f69d6b95a37b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e96dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:25.121023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:25.122280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:25.122902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:25.123802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:25.124529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:25.125409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:25.281494 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49a64a0a-ba61-4b88-b9bf-0cc6f783cd63 tempest-QuotasAdminNegativeTest-94494944 tempest-QuotasAdminNegativeTest-94494944-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 200 len: 329 microversion: 2.1 time: 1.633412 Aug 23 10:47:25.282604 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1420/2732] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:23 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 329 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:25.290782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-eeb4f6ff-4833-4d74-940e-49f9e9d62f6c req-753a708e-78e4-4839-917a-8cb7ec99945e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-plugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:25.327893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeb4f6ff-4833-4d74-940e-49f9e9d62f6c req-753a708e-78e4-4839-917a-8cb7ec99945e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:25.329557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeb4f6ff-4833-4d74-940e-49f9e9d62f6c req-753a708e-78e4-4839-917a-8cb7ec99945e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:25.332360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeb4f6ff-4833-4d74-940e-49f9e9d62f6c req-753a708e-78e4-4839-917a-8cb7ec99945e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:25.357412 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-eeb4f6ff-4833-4d74-940e-49f9e9d62f6c req-753a708e-78e4-4839-917a-8cb7ec99945e service nova] Creating event network-vif-plugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:47:25.363938 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-eeb4f6ff-4833-4d74-940e-49f9e9d62f6c req-753a708e-78e4-4839-917a-8cb7ec99945e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079957 Aug 23 10:47:25.365232 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1421/2733] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:25.379712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b41f6e3f-2c56-4dbd-affe-e5d6c56bea19 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Action: 'update', calling method: .version_select at 0x7fdc9c253310>, body: {"quota_set": {"ram": 0}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:25.389092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b41f6e3f-2c56-4dbd-affe-e5d6c56bea19 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '57a05c912579493f85c24de646ab6547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880cbdc3cc64416a844e1523b1932545', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b41f6e3f-2c56-4dbd-affe-e5d6c56bea19 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Request method failure captured: Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 HTTP/1.1 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 25 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLApBkdYcn7C1Zxg_qd_1yBDjy-CTIVrhq-_sn6ckMDIZsIAVXEYFr6RAp11hh38PvPVQI3yE-gbpTq0R5olugagMlSAp4-aSOuTgwbmhxIMczThZ80ntNHYuHeAp-031Q7qYUIjuZ42THQNZZBtVpf3CIYy1nYSMO-bohig3R3oZGw Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_880cbdc3cc64416a844e1523b1932545", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/880cbdc3cc64416a844e1523b1932545"}]}] Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 880cbdc3cc64416a844e1523b1932545 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1019514452 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 57a05c912579493f85c24de646ab6547 Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-QuotasAdminNegativeTest-1019514452-project Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: {"quota_set": {"ram": 0}} Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '880cbdc3cc64416a844e1523b1932545', 'body': {'quota_set': {'ram': 0}}} Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:47:25.401103 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 23 10:47:25.404943 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:25.408390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b41f6e3f-2c56-4dbd-affe-e5d6c56bea19 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:25.411701 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b41f6e3f-2c56-4dbd-affe-e5d6c56bea19 tempest-QuotasAdminNegativeTest-1019514452 tempest-QuotasAdminNegativeTest-1019514452-project] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545" status: 403 len: 116 microversion: 2.1 time: 0.044890 Aug 23 10:47:25.415240 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1422/2734] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 10:47:25 2022] PUT /compute/v2.1/os-quota-sets/880cbdc3cc64416a844e1523b1932545 => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:27.466111 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48f35f60-275f-4ea0-80c0-ea5db2709753 tempest-TenantUsagesNegativeTestJSON-109653668 tempest-TenantUsagesNegativeTestJSON-109653668-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-22T10%3A47%3A27.127762&end=2022-08-24T10%3A47%3A27.127762" status: 404 len: 112 microversion: - time: 0.333826 Aug 23 10:47:27.467343 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1423/2735] 10.222.0.78 () {58 vars in 1316 bytes} [Tue Aug 23 10:47:27 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-22T10%3A47%3A27.127762&end=2022-08-24T10%3A47%3A27.127762 => generated 112 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 10:47:27.477287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b8305ea-ec34-473e-8d52-b9e934f97bbc tempest-TenantUsagesNegativeTestJSON-109653668 tempest-TenantUsagesNegativeTestJSON-109653668-project-admin] Calling method '.version_select at 0x7fdca1e54a60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:27.481709 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3b8305ea-ec34-473e-8d52-b9e934f97bbc tempest-TenantUsagesNegativeTestJSON-109653668 tempest-TenantUsagesNegativeTestJSON-109653668-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b8305ea-ec34-473e-8d52-b9e934f97bbc tempest-TenantUsagesNegativeTestJSON-109653668 tempest-TenantUsagesNegativeTestJSON-109653668-project-admin] Request method failure captured: Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-simple-tenant-usage/4204f10adf5349b1a300fb7c7dffe6d3?start=2022-08-24T10%3A47%3A27.127762&end=2022-08-22T10%3A47%3A27.127762 HTTP/1.1 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLA-B9hsUS2F8wzz3CmZ84xOmvIKkOuwByfYYjlkod4UaWBmvXep6MtX54v4IhOq5tEB7wpszQvUfWNtnBtGz-KVKLDdXnJnIATif5Tcf9Py5iAOSJSq7auQRpzXhJemXVO60c2rVm_VjHNnIQeeElImWZSnKwroRCgIlsxgzUw7zII Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 3a11bed8a95a49e29b669abee80aaad7 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-109653668 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3a11bed8a95a49e29b669abee80aaad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3a11bed8a95a49e29b669abee80aaad7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3a11bed8a95a49e29b669abee80aaad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3a11bed8a95a49e29b669abee80aaad7"}]}] Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-109653668 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 3a11bed8a95a49e29b669abee80aaad7 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-109653668 Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TenantUsagesNegativeTestJSON-109653668-project-admin Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4d33a4ba14194d4cb42c31db4443d87e Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-109653668-project-admin Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid start time. The start time cannot occur after the end time. Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '4204f10adf5349b1a300fb7c7dffe6d3'} Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 23 10:47:27.500062 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:27.506170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b8305ea-ec34-473e-8d52-b9e934f97bbc tempest-TenantUsagesNegativeTestJSON-109653668 tempest-TenantUsagesNegativeTestJSON-109653668-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:27.507199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b8305ea-ec34-473e-8d52-b9e934f97bbc tempest-TenantUsagesNegativeTestJSON-109653668 tempest-TenantUsagesNegativeTestJSON-109653668-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/4204f10adf5349b1a300fb7c7dffe6d3?start=2022-08-24T10%3A47%3A27.127762&end=2022-08-22T10%3A47%3A27.127762" status: 400 len: 111 microversion: 2.1 time: 0.033702 Aug 23 10:47:27.507929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1424/2736] 10.222.0.78 () {58 vars in 1412 bytes} [Tue Aug 23 10:47:27 2022] GET /compute/v2.1/os-simple-tenant-usage/4204f10adf5349b1a300fb7c7dffe6d3?start=2022-08-24T10%3A47%3A27.127762&end=2022-08-22T10%3A47%3A27.127762 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:47:27.794937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a61440e-fc21-42eb-8e80-a585c650f5f5 tempest-TenantUsagesNegativeTestJSON-109934587 tempest-TenantUsagesNegativeTestJSON-109934587-project] Calling method '.version_select at 0x7fdc9c2580d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:27.798720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a61440e-fc21-42eb-8e80-a585c650f5f5 tempest-TenantUsagesNegativeTestJSON-109934587 tempest-TenantUsagesNegativeTestJSON-109934587-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '112bd1057d084d57a82262004a9155e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4204f10adf5349b1a300fb7c7dffe6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a61440e-fc21-42eb-8e80-a585c650f5f5 tempest-TenantUsagesNegativeTestJSON-109934587 tempest-TenantUsagesNegativeTestJSON-109934587-project] Request method failure captured: Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T10%3A47%3A27.127762&end=2022-08-24T10%3A47%3A27.127762&detailed=1 HTTP/1.1 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLA7xVZWRcZODHYcsp27Q7kuD-mGxxfT6149PGcLMhfTl61mp-vA2JO74xD5OaDdTyeMLN6I9Vk2YTalJCgofivNgTOWBDzIQC7KZ2_gg76x0QYuSIHOsr4lrx-8-33RIqUBg2cwHI9NhrhHd5-STWpQZzLNbCVM5kJjsxljzN4cGYU Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4204f10adf5349b1a300fb7c7dffe6d3 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-109934587 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4204f10adf5349b1a300fb7c7dffe6d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4204f10adf5349b1a300fb7c7dffe6d3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4204f10adf5349b1a300fb7c7dffe6d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4204f10adf5349b1a300fb7c7dffe6d3"}]}] Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-109934587 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4204f10adf5349b1a300fb7c7dffe6d3 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-109934587 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TenantUsagesNegativeTestJSON-109934587-project Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 112bd1057d084d57a82262004a9155e7 Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-109934587-project Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: action_args: {} Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 10:47:27.811693 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 23 10:47:27.816144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:47:27.818011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a61440e-fc21-42eb-8e80-a585c650f5f5 tempest-TenantUsagesNegativeTestJSON-109934587 tempest-TenantUsagesNegativeTestJSON-109934587-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:47:27.830503 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a61440e-fc21-42eb-8e80-a585c650f5f5 tempest-TenantUsagesNegativeTestJSON-109934587 tempest-TenantUsagesNegativeTestJSON-109934587-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T10%3A47%3A27.127762&end=2022-08-24T10%3A47%3A27.127762&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.304739 Aug 23 10:47:27.837335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1425/2737] 10.222.0.78 () {58 vars in 1335 bytes} [Tue Aug 23 10:47:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T10%3A47%3A27.127762&end=2022-08-24T10%3A47%3A27.127762&detailed=1 => generated 123 bytes in 322 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:47:33.522957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:33.552648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:33.588528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=44 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:33.593657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:35.244058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=20 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:35.248999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-816934180", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "e3965eff-0719-4184-ad5f-5370ba10a1b3"}, {"uuid": "7303747d-d28e-442e-8625-b26fc5de17de"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:35.273590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=28 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:35.287325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:35.357486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:40.789023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c905d0e2-fe7d-40b0-aa95-f69d6b95a37b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1455 microversion: 2.1 time: 16.775473 Aug 23 10:47:40.796559 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1313/2738] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:24 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1455 bytes in 16777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:41.041875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] validate_networks() for [('e3965eff-0719-4184-ad5f-5370ba10a1b3', None, None, None, None, None), ('7303747d-d28e-442e-8625-b26fc5de17de', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:41.323850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1599583344", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:41.445488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:42.063674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:42.064711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:42.065368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:42.065913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:42.066362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:42.101125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:42.101645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:42.102107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:42.102879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:42.103920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:42.111067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:42.200023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Getting quotas for project 2561ce8d69dd447cb108ed8fb9e8bf7d. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:42.225631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Getting quotas for user 670582f204b54a0a97fa7f14c315801e and project 2561ce8d69dd447cb108ed8fb9e8bf7d. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:42.295051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:47:42.317908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:47:42.511228 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fabb2152-1425-42cd-a130-ad52657f1c27 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.720268 Aug 23 10:47:42.521862 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1314/2739] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:47:42.561307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72286153-12c7-4e6e-b2f5-0032290b4b73 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1ec95e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:42.730187 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72286153-12c7-4e6e-b2f5-0032290b4b73 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1464 microversion: 2.1 time: 0.205367 Aug 23 10:47:42.731489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1315/2740] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:42 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:42.737426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1aa3291f-52c0-433f-8103-ac80f2b063da tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:42.746960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1aa3291f-52c0-433f-8103-ac80f2b063da tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:42.942179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aa3291f-52c0-433f-8103-ac80f2b063da tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:42.968418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1aa3291f-52c0-433f-8103-ac80f2b063da tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1222 microversion: 2.1 time: 0.234001 Aug 23 10:47:42.978782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1316/2741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:42 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:43.010827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72ad6079-275c-4ce0-ab20-e21447a51111 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cd848b0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:43.122915 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72ad6079-275c-4ce0-ab20-e21447a51111 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 200 len: 1464 microversion: 2.1 time: 0.142908 Aug 23 10:47:43.124190 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1317/2742] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:42 2022] GET /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:43.144577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:43.156364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:43.188410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:43.195599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:43.196777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:43.201040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:43.201487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:43.201934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:43.628689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:43.641703 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cbba09df-cf17-4e3e-a375-daa4d8f210a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1467 microversion: 2.1 time: 0.507660 Aug 23 10:47:43.645229 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1318/2743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:43 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1467 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:43.698215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-231651372"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:43.723853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:43.739282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:43.742345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:43.743000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:43.746749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:43.748115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:43.748920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:44.371946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15c99133-bd6f-4af5-81ad-614758911105 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "POST /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f/action" status: 202 len: 0 microversion: 2.1 time: 0.695219 Aug 23 10:47:44.373097 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1319/2744] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:47:43 2022] POST /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:47:44.396488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:44.397245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:44.433740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:44.434567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:44.437597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:44.438715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:44.439396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:44.440303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:44.573542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:44.598960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bdbb69f9-0063-4707-be04-e9e0698b27e1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1226 microversion: 2.1 time: 0.215247 Aug 23 10:47:44.600197 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1320/2745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:44 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:45.018881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1989872874", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "091ada19-c78b-4d45-977b-7bccd35994d7"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:45.155690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] validate_networks() for [('091ada19-c78b-4d45-977b-7bccd35994d7', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:46.106689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:46.107815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:46.108488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:46.109160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:46.109768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:46.122487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:46.124227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:46.124888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:46.125817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:46.126442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:46.127064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:46.184603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Getting quotas for project 77f0c7aa2fac4f6bba7f101521460c0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:46.191822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Getting quotas for user 50ab419a5b2d4cc0b6d56cc268bc2d0a and project 77f0c7aa2fac4f6bba7f101521460c0d. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:46.231440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Going to run 3 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:47:46.233931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:47:46.335483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=2e10e25a-81dc-4d94-9759-3ecaa31dee18,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:47:46.455629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=9f1396f4-2e29-40ab-a2e5-9d003fdfc623,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:47:46.612478 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d99d3499-c0f3-460f-80fc-f824b32f69b8 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.010763 Aug 23 10:47:46.613877 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1321/2746] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:47:46.625906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-607c44ae-ce53-4ed1-b48a-a1a3a5f05992 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cdbe040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:46.747513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-607c44ae-ce53-4ed1-b48a-a1a3a5f05992 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.131708 Aug 23 10:47:46.756133 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1322/2747] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:46 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:46.763129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:46.767480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:46.786260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:46.787280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:46.789804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:46.791436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:46.800399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:46.801043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:46.872409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:46.873374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:46.873937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:46.874453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:46.880203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:46.923313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:46.923849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:46.938629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:46.950020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:46.950626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:46.951092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:47.010504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:47.020354 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56f31f51-414a-4dfa-9645-eeb5ab916b25 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1280 microversion: 2.1 time: 0.269256 Aug 23 10:47:47.044786 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1323/2748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:46 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:47.045707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Getting quotas for project 4672980399e34e3d94dd82f7c375e2e5. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:47.050579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:47.062845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Getting quotas for user 7bea2324e2b4416e9f39c0e47b2ce15d and project 4672980399e34e3d94dd82f7c375e2e5. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:47.089808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:47.095125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:47:47.102318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:47:47.116010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:47:47.221217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8616eef4-a7a9-4328-9fc1-9c37c41a0bb0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.978896 Aug 23 10:47:47.222654 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1426/2749] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 11982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:47:47.239041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:47.239534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:47.245334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:47.248971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:47.254797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:47.255684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:47.559326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f375804-acd1-4fea-8bb5-f4f070f23f4d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.525742 Aug 23 10:47:47.560028 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1324/2750] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:47:47 2022] GET /compute/v2.1/servers => generated 1018 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:47.578917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a6df663-6e62-4957-846d-be2f2c00be1e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:47.579567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a6df663-6e62-4957-846d-be2f2c00be1e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:47.718431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a6df663-6e62-4957-846d-be2f2c00be1e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:47.730843 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a6df663-6e62-4957-846d-be2f2c00be1e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1212 microversion: 2.1 time: 0.162253 Aug 23 10:47:47.731444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1325/2751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:47 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1212 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:47.745750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-953f21f9-d9ff-46fd-8f06-2e68684e4c62 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:47.746552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-953f21f9-d9ff-46fd-8f06-2e68684e4c62 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:47.840240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-dfe7fafe-5c58-43b0-be08-9704ef9280a3 req-89d9504e-b08e-4dc9-ab37-e90bad79b3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9681ff3-1da2-44b0-97bf-a8150364c2f1", "name": "network-vif-unplugged", "status": "completed", "tag": "e7a53fbb-1132-4ee6-99d6-efddacd5d957"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:47.858187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dfe7fafe-5c58-43b0-be08-9704ef9280a3 req-89d9504e-b08e-4dc9-ab37-e90bad79b3f0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:47.859002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dfe7fafe-5c58-43b0-be08-9704ef9280a3 req-89d9504e-b08e-4dc9-ab37-e90bad79b3f0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:47.861476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dfe7fafe-5c58-43b0-be08-9704ef9280a3 req-89d9504e-b08e-4dc9-ab37-e90bad79b3f0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:47.874811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-953f21f9-d9ff-46fd-8f06-2e68684e4c62 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:47.887707 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-953f21f9-d9ff-46fd-8f06-2e68684e4c62 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1223 microversion: 2.1 time: 0.149264 Aug 23 10:47:47.888588 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1326/2752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:47 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:47.905243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39a81eda-fa39-4ad9-8001-f338241434d6 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1dd34c0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:47.911615 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-dfe7fafe-5c58-43b0-be08-9704ef9280a3 req-89d9504e-b08e-4dc9-ab37-e90bad79b3f0 service nova] Creating event network-vif-unplugged:e7a53fbb-1132-4ee6-99d6-efddacd5d957 for instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 on n-h2-847009-13 Aug 23 10:47:47.931362 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-dfe7fafe-5c58-43b0-be08-9704ef9280a3 req-89d9504e-b08e-4dc9-ab37-e90bad79b3f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.706991 Aug 23 10:47:47.936862 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1427/2753] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:47.968663 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39a81eda-fa39-4ad9-8001-f338241434d6 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.072830 Aug 23 10:47:47.969783 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1327/2754] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:47 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:48.069877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:48.071651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:48.097792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:48.102198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:48.104263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:48.109632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:48.115326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:48.116768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:48.560088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:48.584669 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1895457-a428-44a4-8bce-5f87dde992a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1280 microversion: 2.1 time: 0.521152 Aug 23 10:47:48.592990 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1428/2755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:48 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1280 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:48.755996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:48.757500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:48.834855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:48.835366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:48.835813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:48.836540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:48.837040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:48.837480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:48.914855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07992739-0646-4559-9dd8-ba7946efeda1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:48.916485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-07992739-0646-4559-9dd8-ba7946efeda1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:49.021227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:49.032844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e323daf-3fec-48da-90aa-db4c47375d9d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1216 microversion: 2.1 time: 0.282158 Aug 23 10:47:49.037996 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1328/2756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:48 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:49.044682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a72611c6-21ae-49bb-a433-b00d5a25f42c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1dd3310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:49.139858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a72611c6-21ae-49bb-a433-b00d5a25f42c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.100433 Aug 23 10:47:49.156560 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1329/2757] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:49 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:49.414061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-07992739-0646-4559-9dd8-ba7946efeda1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:49.422903 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07992739-0646-4559-9dd8-ba7946efeda1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1223 microversion: 2.1 time: 0.515991 Aug 23 10:47:49.427518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1429/2758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:48 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1223 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:47:49.607732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:49.608360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:49.616709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:49.633674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:49.634138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:49.634905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:49.635377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:49.635808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:49.943869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:49.996378 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9426578-b355-45d0-b3fa-38324652a301 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1280 microversion: 2.1 time: 0.389994 Aug 23 10:47:50.001339 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1330/2759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:49 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:50.063282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:50.064860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:50.078362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:50.085862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:50.086581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:50.087544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:50.088189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:50.090922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:50.167982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74415e44-d352-4327-8ad1-73131f909e23 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9d5e65e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:50.450101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:50.497099 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bae1a95e-7620-4d08-97be-d65e1857855d tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1264 microversion: 2.1 time: 0.437804 Aug 23 10:47:50.497697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1430/2760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:50 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1264 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:50.505972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:50.512578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:50.552603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:50.554515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:50.556157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:50.562592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:50.578965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:50.581619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:50.982398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:51.023542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0369c7ef-6716-4567-bf1a-f5e71f437841 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1275 microversion: 2.1 time: 0.518308 Aug 23 10:47:51.025428 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1431/2761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:50 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1275 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:51.032528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:51.036164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:51.101419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:51.111479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:51.118022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:51.119240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:51.126304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:51.126773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:51.679901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:51.690090 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c31fd422-72bc-41b9-bd14-89430c6d9da7 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 0.662159 Aug 23 10:47:51.711894 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1432/2762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:51 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:51.722361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:51.729005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:51.757170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:51.770212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:51.774876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:51.776360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:51.782709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:51.783202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:52.089506 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74415e44-d352-4327-8ad1-73131f909e23 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 1.925949 Aug 23 10:47:52.096435 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1331/2763] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:50 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:52.118540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:52.121543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:52.148892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:52.150565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:52.152429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:52.154342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:52.155378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:52.159344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:52.622096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:52.641134 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9367d6b8-3a3f-4b8f-8836-a858a91e3dc8 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1270 microversion: 2.1 time: 0.924617 Aug 23 10:47:52.644557 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1433/2764] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:51 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1270 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:52.742974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:52.744096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:52.805433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:52.805433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:52.805433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:52.805433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:52.805433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:52.805433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:53.179998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:53.189434 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3db433a-5d31-4ecf-821e-2652687b9157 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1275 microversion: 2.1 time: 1.090246 Aug 23 10:47:53.197749 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1332/2765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:52 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1275 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:53.208668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ddc22b6-8b55-4cb4-b9d2-cfc9ba6ec0a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9ca3f430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:54.308784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:54.343063 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a3445e6-2492-4169-824a-e29205328bcd tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 1.602623 Aug 23 10:47:54.368194 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1434/2766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:52 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:54.380042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:54.383667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:54.406037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:54.414880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:54.415646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:54.416622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:54.418449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:54.421384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.032482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:55.048992 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69c15816-9be2-43fd-8332-c41eb7e297b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1270 microversion: 2.1 time: 0.675104 Aug 23 10:47:55.050721 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1435/2767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:54 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1270 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:55.075837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:55.079155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:55.104829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:55.107756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:55.111630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.112681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:55.121110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:55.121780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.446195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:55.459756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea28a168-9185-4f56-9bd3-cbd91138ec9e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1281 microversion: 2.1 time: 0.407426 Aug 23 10:47:55.464892 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1436/2768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:55 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1281 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:55.481818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a19ae4fd-409f-4474-813b-f93e924d2615 req-2f4d75c6-01fb-42ee-8c2e-26263935bf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "name": "network-vif-plugged", "status": "completed", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:55.522462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a19ae4fd-409f-4474-813b-f93e924d2615 req-2f4d75c6-01fb-42ee-8c2e-26263935bf24 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:55.523475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a19ae4fd-409f-4474-813b-f93e924d2615 req-2f4d75c6-01fb-42ee-8c2e-26263935bf24 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:55.525488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a19ae4fd-409f-4474-813b-f93e924d2615 req-2f4d75c6-01fb-42ee-8c2e-26263935bf24 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.554925 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a19ae4fd-409f-4474-813b-f93e924d2615 req-2f4d75c6-01fb-42ee-8c2e-26263935bf24 service nova] Creating event network-vif-plugged:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:47:55.576122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a19ae4fd-409f-4474-813b-f93e924d2615 req-2f4d75c6-01fb-42ee-8c2e-26263935bf24 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109679 Aug 23 10:47:55.576794 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1437/2769] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:55.591459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:55.593647 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ddc22b6-8b55-4cb4-b9d2-cfc9ba6ec0a2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 2.393795 Aug 23 10:47:55.594460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:55.594935 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1333/2770] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:53 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:55.608942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:55.613460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:55.614212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.620514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:55.622728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:55.625004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.638072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-95be8456-efeb-4303-a8a6-54b8e84197d0 req-b6e64558-4872-4c7c-beb5-2a19a11eb24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c", "tag": "a5cc99f8-7d9d-4280-9928-7c0296613e2b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:55.716333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95be8456-efeb-4303-a8a6-54b8e84197d0 req-b6e64558-4872-4c7c-beb5-2a19a11eb24f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:55.716851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95be8456-efeb-4303-a8a6-54b8e84197d0 req-b6e64558-4872-4c7c-beb5-2a19a11eb24f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:55.717289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95be8456-efeb-4303-a8a6-54b8e84197d0 req-b6e64558-4872-4c7c-beb5-2a19a11eb24f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:55.804887 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-95be8456-efeb-4303-a8a6-54b8e84197d0 req-b6e64558-4872-4c7c-beb5-2a19a11eb24f service nova] Creating event network-changed:a5cc99f8-7d9d-4280-9928-7c0296613e2b for instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c on n-h1-847009-13 Aug 23 10:47:55.843613 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-95be8456-efeb-4303-a8a6-54b8e84197d0 req-b6e64558-4872-4c7c-beb5-2a19a11eb24f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241457 Aug 23 10:47:55.850737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1334/2771] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:47:55.987408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:55.988122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:56.013410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:56.020087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:56.024297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:56.031912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:56.037127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:56.037590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:56.997107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:57.009661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:57.051923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89a4b908-7423-429b-bcc6-d8b530dfea5b tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 1.467670 Aug 23 10:47:57.057051 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1438/2772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:55 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:57.077652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:57.078286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:57.095520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:57.097655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:57.098122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:57.098869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:57.099345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:57.099780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:57.443294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:57.862265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:57.872493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fd51f1d0-e571-43fe-944c-b41fb637e866 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1312 microversion: 2.1 time: 0.812639 Aug 23 10:47:57.872493 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1439/2773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:57 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1312 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:57.880542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=18 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:47:57.890181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:57.897761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:57.914229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:57.915013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:57.916463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:57.919201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:57.921079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:57.921731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:58.015949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:58.026667 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86ef0214-61ca-4a8e-9ec0-29824b73db7d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 2.044037 Aug 23 10:47:58.045904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1335/2774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:55 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:47:58.051164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f32f870-07a8-490e-bf38-09ad152b0822 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cdce670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:58.074146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:58.087414 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d0a6f2cb-ff46-4e54-b5f6-132d8c44444c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1281 microversion: 2.1 time: 0.200994 Aug 23 10:47:58.087951 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1440/2775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:57 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:58.093362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-499928707", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7ea6137e-5ec7-4e6e-83e4-f0ed2a9da9c8"}], "security_groups": [{"name": "tempest-securitygroup--1894177504"}], "key_name": "tempest-keypair-1859971234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ed588a91-b0d9-4f15-b662-1925ff28c54e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:47:58.150321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f32f870-07a8-490e-bf38-09ad152b0822 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.102974 Aug 23 10:47:58.159284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1336/2776] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:47:58 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:58.164968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:58.165926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:58.180491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:58.181025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:58.181479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:58.182203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:58.182671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:58.183106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:58.329611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] validate_networks() for [('7ea6137e-5ec7-4e6e-83e4-f0ed2a9da9c8', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:47:58.946681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:58.965012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74be385f-a6f0-4530-ae15-09262aec16e8 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 0.804224 Aug 23 10:47:58.971879 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1337/2777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:58 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:58.989785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:58.990757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:59.010501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.013296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.014018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.015016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.018437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.019208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.072538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Getting quotas for project 2dbc35e84eeb42f098704bf9f10a8e89. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:59.080801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Getting quotas for user 20231dbe3db344ba9f690607a4a80ee9 and project 2dbc35e84eeb42f098704bf9f10a8e89. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:59.101169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:47:59.101883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:47:59.103082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:47:59.106602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:47:59.107697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:47:59.154558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.155125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.155903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.161278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.162054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.162684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.212716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Getting quotas for project 2dbc35e84eeb42f098704bf9f10a8e89. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:47:59.227282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Getting quotas for user 20231dbe3db344ba9f690607a4a80ee9 and project 2dbc35e84eeb42f098704bf9f10a8e89. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:47:59.355690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:47:59.358714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed588a91-b0d9-4f15-b662-1925ff28c54e',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:47:59.678165 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a512e8f1-131b-41aa-a204-53c058b7a1cd tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.589106 Aug 23 10:47:59.687367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1441/2778] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:47:58 2022] POST /compute/v2.1/servers => generated 407 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:47:59.694559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:59.701648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:59.710814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.730087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.730087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.732714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.736019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.742426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.813981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:47:59.832094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5bc64220-46bf-4253-89db-ccb3bd753155 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1312 microversion: 2.1 time: 0.858568 Aug 23 10:47:59.837691 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1338/2779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:58 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1312 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:47:59.842738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:47:59.849662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:47:59.865900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.868974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.869910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:47:59.875921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:47:59.876654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:47:59.877824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:00.173189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:00.181824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27e3f0be-4a7d-421b-add7-3b3d315794a1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1281 microversion: 2.1 time: 0.342758 Aug 23 10:48:00.202008 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1339/2780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:59 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1281 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:00.211585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b6a64e3-3674-4e49-8a35-1ace016da142 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1dc7820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:00.310751 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b6a64e3-3674-4e49-8a35-1ace016da142 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.107486 Aug 23 10:48:00.317353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1340/2781] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:00 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:00.323381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55783d67-3fe0-44f8-b1da-fb378ebcbaa1 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:00.333740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55783d67-3fe0-44f8-b1da-fb378ebcbaa1 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:00.514921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55783d67-3fe0-44f8-b1da-fb378ebcbaa1 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:00.526657 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55783d67-3fe0-44f8-b1da-fb378ebcbaa1 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1121 microversion: 2.1 time: 0.207526 Aug 23 10:48:00.530446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1341/2782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:00 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1121 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:00.540350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:00.541033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:00.558007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:00.558595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:00.559260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:00.561788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:00.562473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:00.566584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:00.809646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:00.825204 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74bd4919-5449-486f-8b80-6377c6e47d41 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 1.134414 Aug 23 10:48:00.843246 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1442/2783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:47:59 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:00.848649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-62517395-89f7-4b5a-bce6-f9af0edf2466 req-8576a407-cb93-4c7c-886a-a4c24a2661a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-unplugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:00.874999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-62517395-89f7-4b5a-bce6-f9af0edf2466 req-8576a407-cb93-4c7c-886a-a4c24a2661a4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:00.875744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-62517395-89f7-4b5a-bce6-f9af0edf2466 req-8576a407-cb93-4c7c-886a-a4c24a2661a4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:00.876461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-62517395-89f7-4b5a-bce6-f9af0edf2466 req-8576a407-cb93-4c7c-886a-a4c24a2661a4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:00.898934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-62517395-89f7-4b5a-bce6-f9af0edf2466 req-8576a407-cb93-4c7c-886a-a4c24a2661a4 service nova] Creating event network-vif-unplugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:48:00.910614 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-62517395-89f7-4b5a-bce6-f9af0edf2466 req-8576a407-cb93-4c7c-886a-a4c24a2661a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065723 Aug 23 10:48:00.918948 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1443/2784] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:00.929494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-534683807"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:00.941351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:00.951759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:00.952611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:00.955952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:00.959051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:00.959791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:00.960463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:01.478127 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-890ae184-86c6-443c-b5ce-caca9a13a5b1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.556492 Aug 23 10:48:01.479338 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1444/2785] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:00 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 23 10:48:01.501192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:01.506253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:01.539441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:01.541039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:01.541925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:01.547369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:01.549551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:01.553042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:01.577718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:01.992610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:02.001424 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f11fb6e-d37f-4ee6-acd1-460c115fc514 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1312 microversion: 2.1 time: 0.510267 Aug 23 10:48:02.002534 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1445/2786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:01 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1312 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:02.007218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:02.008007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:02.022677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:02.023804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:02.024473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:02.025492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:02.028236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:02.030404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:02.113302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:02.124832 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df414b87-158b-4a86-94a4-692befbbafb3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 1.593092 Aug 23 10:48:02.127781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1342/2787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:00 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:02.137847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93183c52-d6a0-4a4e-9eaf-d0ee3a24ca69 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1dacf70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:02.210560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93183c52-d6a0-4a4e-9eaf-d0ee3a24ca69 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.079740 Aug 23 10:48:02.211337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1343/2788] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:02 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:02.240287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:02.240865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:02.279083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:02.281408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:02.282123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:02.282593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:02.283905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:02.284381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:02.284848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:02.294498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d687621a-7093-422f-b24a-485c48df8712 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 0.290349 Aug 23 10:48:02.296008 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1446/2789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:02 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:02.301816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:02.302741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:02.309431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:02.310235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:02.310739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:02.311526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:02.312039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:02.312522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:02.448143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:02.461556 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21c98d07-631c-400c-a789-bd9dd2c47a67 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1219 microversion: 2.1 time: 0.164125 Aug 23 10:48:02.463429 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1447/2790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:02 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:03.023266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:03.023910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:03.039709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:03.040390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:03.040867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:03.043783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:03.044291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:03.045886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:03.740439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:03.756887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e44c9272-705c-4308-9845-0d2475acda90 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.738637 Aug 23 10:48:03.758077 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1448/2791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:03 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:03.767685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e3a5e3c3-c2ee-40d2-90fa-5ae485ae12a3 req-c3a37f3e-f8a4-4de4-8643-8a63b46d8e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c", "name": "network-vif-plugged", "status": "completed", "tag": "a5cc99f8-7d9d-4280-9928-7c0296613e2b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:03.785977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e3a5e3c3-c2ee-40d2-90fa-5ae485ae12a3 req-c3a37f3e-f8a4-4de4-8643-8a63b46d8e72 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:03.786743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e3a5e3c3-c2ee-40d2-90fa-5ae485ae12a3 req-c3a37f3e-f8a4-4de4-8643-8a63b46d8e72 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:03.787474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e3a5e3c3-c2ee-40d2-90fa-5ae485ae12a3 req-c3a37f3e-f8a4-4de4-8643-8a63b46d8e72 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:03.805866 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e3a5e3c3-c2ee-40d2-90fa-5ae485ae12a3 req-c3a37f3e-f8a4-4de4-8643-8a63b46d8e72 service nova] Creating event network-vif-plugged:a5cc99f8-7d9d-4280-9928-7c0296613e2b for instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c on n-h1-847009-13 Aug 23 10:48:03.812625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e3a5e3c3-c2ee-40d2-90fa-5ae485ae12a3 req-c3a37f3e-f8a4-4de4-8643-8a63b46d8e72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053001 Aug 23 10:48:03.816154 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1449/2792] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:03.822414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:03.823327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:03.832509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:03.834605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:03.835820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:03.836962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:03.837933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:03.838835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:04.199366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:04.210703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:04.214260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dcb6619c-503d-4980-a127-f02fef47b5d4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 1.985373 Aug 23 10:48:04.234654 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1344/2793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:02 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:04.246220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11792f7e-29fa-4a51-a973-39b8546144b2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e871f0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:04.369429 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11792f7e-29fa-4a51-a973-39b8546144b2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.132994 Aug 23 10:48:04.378128 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1345/2794] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:04 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:04.385408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:04.386338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:04.393089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:04.395487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:04.396200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:04.397024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:04.397944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:04.398956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:04.399616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:04.495471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:04.505159 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41780c27-ace6-4a5a-80d1-55a7a0fafb18 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 0.687507 Aug 23 10:48:04.506036 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1450/2795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:03 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:04.516872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:04.518110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:04.540395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:04.540958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:04.541408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:04.542129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:04.542599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:04.543044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:04.874884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:04.904836 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8bd97809-d322-4454-9208-cd26873629ca tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1237 microversion: 2.1 time: 0.394697 Aug 23 10:48:04.907828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1451/2796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:04 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1237 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:04.934631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-28dc1e6b-7019-40c3-9fef-711d64c761a1 req-0e5db141-da4f-4bbe-9a17-5abca423a728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd3faf7-6fdb-4f61-adb9-42a59c6e468e", "tag": "8496dec9-182b-4fcd-8e86-3c94916ad5b4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:04.966189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-28dc1e6b-7019-40c3-9fef-711d64c761a1 req-0e5db141-da4f-4bbe-9a17-5abca423a728 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:04.966189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-28dc1e6b-7019-40c3-9fef-711d64c761a1 req-0e5db141-da4f-4bbe-9a17-5abca423a728 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:04.967848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-28dc1e6b-7019-40c3-9fef-711d64c761a1 req-0e5db141-da4f-4bbe-9a17-5abca423a728 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:04.993891 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-28dc1e6b-7019-40c3-9fef-711d64c761a1 req-0e5db141-da4f-4bbe-9a17-5abca423a728 service nova] Creating event network-changed:8496dec9-182b-4fcd-8e86-3c94916ad5b4 for instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e on n-h2-847009-13 Aug 23 10:48:05.004557 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-28dc1e6b-7019-40c3-9fef-711d64c761a1 req-0e5db141-da4f-4bbe-9a17-5abca423a728 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089800 Aug 23 10:48:05.008194 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1452/2797] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:05.020588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:05.024769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:05.041198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.041946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.048343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:05.050534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.051173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.051939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:05.148312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:05.162154 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b353455-c92d-405a-82f6-1c5382bbfee7 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 0.782587 Aug 23 10:48:05.165289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1346/2798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:04 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:05.572527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2578ff2d-20e4-4de0-affb-0af394af6c3a req-c3fcdc46-f313-4935-86f8-a346ce32cab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f1396f4-2e29-40ab-a2e5-9d003fdfc623", "tag": "9fc11122-48f8-4e1c-a8fe-6aaf47bf126d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:05.611959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2578ff2d-20e4-4de0-affb-0af394af6c3a req-c3fcdc46-f313-4935-86f8-a346ce32cab0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.612767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2578ff2d-20e4-4de0-affb-0af394af6c3a req-c3fcdc46-f313-4935-86f8-a346ce32cab0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.614258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2578ff2d-20e4-4de0-affb-0af394af6c3a req-c3fcdc46-f313-4935-86f8-a346ce32cab0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:05.655507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2578ff2d-20e4-4de0-affb-0af394af6c3a req-c3fcdc46-f313-4935-86f8-a346ce32cab0 service nova] Creating event network-changed:9fc11122-48f8-4e1c-a8fe-6aaf47bf126d for instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 on n-h1-847009-13 Aug 23 10:48:05.668726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2578ff2d-20e4-4de0-affb-0af394af6c3a req-c3fcdc46-f313-4935-86f8-a346ce32cab0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.463052 Aug 23 10:48:05.673469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1347/2799] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:48:05.676341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:05.685933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:05.687986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:05.688098 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89e2e5b7-8795-49f1-b358-57568b52e582 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.677388 Aug 23 10:48:05.698265 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1453/2800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:05 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:05.715653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.715908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-951dfd3d-fc07-4453-bb55-b099c24312c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9d23db80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:05.720021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.721601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:05.722689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.724981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.727606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:05.868031 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-951dfd3d-fc07-4453-bb55-b099c24312c4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.168331 Aug 23 10:48:05.869538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1454/2801] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:05 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:05.882075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:05.883218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:05.899872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.900402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.904519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:05.905629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:05.906904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:05.909350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:06.815980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:06.832811 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e474a56-4c90-414d-a708-9509cb52f904 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1322 microversion: 2.1 time: 0.961007 Aug 23 10:48:06.833526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1455/2802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:05 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1322 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:06.848602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:06.851426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:06.864891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:06.867857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:06.869613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:06.874140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:06.875823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:06.878301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:07.173687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:07.185511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b96b6ebd-39d3-4572-b66c-b69729c13272 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1688 microversion: 2.1 time: 1.510137 Aug 23 10:48:07.198505 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1348/2803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:05 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1688 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:07.203960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:07.207171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:07.228096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:07.229604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:07.230792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:07.239538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:07.241416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:07.242196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:08.436351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:08.462543 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3921d514-dc8d-4e45-b263-e48f66692b5a tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 1.260497 Aug 23 10:48:08.463344 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1349/2804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:07 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:08.484683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:08.485722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:08.510882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:08.512868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:08.515457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:08.516364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:08.517018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:08.523072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:09.164450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:09.183179 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58a1639a-c71a-43a8-8f12-ddebf8b9d9e2 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.714195 Aug 23 10:48:09.184981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:09.187085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1350/2805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:08 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:09.204094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78e45223-cb8c-458a-89cb-3fbd379e12c9 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cdcedc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:09.239877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=18 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:09.303684 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78e45223-cb8c-458a-89cb-3fbd379e12c9 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.108516 Aug 23 10:48:09.304290 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1351/2806] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:09 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:09.326002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e10e25a-81dc-4d94-9759-3ecaa31dee18", "tag": "89b3bb1e-ab50-45f9-b82e-10d20b781c4d"}, {"name": "network-changed", "server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "tag": "a566ffd6-3723-4cbe-a18a-7c4bd605d819"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:09.327943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:09.354642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-05dbd2a0-4fdd-445e-8b55-2a018a2b1118 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1305 microversion: 2.1 time: 2.514569 Aug 23 10:48:09.364161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1456/2807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:06 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1305 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:09.379803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:09.385410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:09.397443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:09.405693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:09.405887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:09.407296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:09.411495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:09.411927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:09.412367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:09.415336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:09.415833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:09.416276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:09.464897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] Creating event network-changed:89b3bb1e-ab50-45f9-b82e-10d20b781c4d for instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 on n-h2-847009-13 Aug 23 10:48:09.469587 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] Creating event network-changed:a566ffd6-3723-4cbe-a18a-7c4bd605d819 for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:09.531297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-38f9ad6c-0af4-42b8-bc66-a65dc4c94e0c req-42c3d209-d1aa-4a45-a5f4-ed9776b1158e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.219986 Aug 23 10:48:09.539023 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1352/2808] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:09.599483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:09.636611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:09.685049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:09.707426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:09.711644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:09.715337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:09.719204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:09.721681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:10.083031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:10.092840 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df87db20-85aa-44ee-8edc-4b64828a9fd3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1688 microversion: 2.1 time: 0.551174 Aug 23 10:48:10.108832 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1353/2809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:09 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1688 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:10.114056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:10.114688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:10.131990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:10.137417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:10.138271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:10.139207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:10.139835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:10.140429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:10.520711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:10.779447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:10.835238 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b42a019d-51f5-4c69-94ca-8c0d50c32425 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1471 microversion: 2.1 time: 1.468448 Aug 23 10:48:10.836682 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1457/2810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:09 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1471 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:10.850460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a5c8d0c5-6e1b-40df-b7f9-543000cd2efd req-25099547-a4a5-4abb-b4af-1947823e935d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-plugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:10.897486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a5c8d0c5-6e1b-40df-b7f9-543000cd2efd req-25099547-a4a5-4abb-b4af-1947823e935d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:10.904873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a5c8d0c5-6e1b-40df-b7f9-543000cd2efd req-25099547-a4a5-4abb-b4af-1947823e935d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:10.905359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a5c8d0c5-6e1b-40df-b7f9-543000cd2efd req-25099547-a4a5-4abb-b4af-1947823e935d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:10.913940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:10.923255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5803d612-17c2-4b06-a0ce-f995af8b9cf1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 0.813246 Aug 23 10:48:10.924782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1354/2811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:10 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:10.931079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:10.932123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:10.947144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:10.948102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:10.948790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:10.952604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a5c8d0c5-6e1b-40df-b7f9-543000cd2efd req-25099547-a4a5-4abb-b4af-1947823e935d service nova] Creating event network-vif-plugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:48:10.954594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:10.955958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:10.967624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:10.974266 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a5c8d0c5-6e1b-40df-b7f9-543000cd2efd req-25099547-a4a5-4abb-b4af-1947823e935d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134957 Aug 23 10:48:10.979774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1458/2812] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:11.006485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5df90f90-6f93-4266-86b3-87f966b3dd9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c258dc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:11.094606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5df90f90-6f93-4266-86b3-87f966b3dd9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1454 microversion: 2.1 time: 0.111731 Aug 23 10:48:11.098127 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1459/2813] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:10 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:11.109162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:11.110109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:11.118125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:11.119016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:11.119927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:11.121056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:11.121916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:11.122591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:11.746643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:11.758933 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a99f1ce-6e91-4c7a-8704-cbc776ce8126 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1305 microversion: 2.1 time: 0.658842 Aug 23 10:48:11.775802 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1460/2814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:11 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1305 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:12.518119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb2115b6-a493-47e6-bba1-47f1c7b9071e tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:12.518819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb2115b6-a493-47e6-bba1-47f1c7b9071e tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] [instance: ae053a19-7d9a-401c-8bba-9d597d776f25] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:12.533946 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-fb2115b6-a493-47e6-bba1-47f1c7b9071e tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] HTTP exception thrown: Instance ae053a19-7d9a-401c-8bba-9d597d776f25 could not be found. Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb2115b6-a493-47e6-bba1-47f1c7b9071e tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Request method failure captured: Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/ae053a19-7d9a-401c-8bba-9d597d776f25/action HTTP/1.1 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 15 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBIcnYfCrwVBYKPjLHyV_HJw3ONDHOgX8AGjqLo--EJTKs0vy4nPGqQ587tjH-lp8P71psE2KkhRCFavv-vrRFdMDMw5aacT2Bjyq4myK5qRohSsSJwnxIIpsTUpMcPj7P0Cyh3Puf9NNqsTbXwF5KwEt14a0lsu29iRUJcBZipxk0 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e2d64b547b54bce8cd3d98492d2595f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}] Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9efe86ae4aec4b7ea99bd823f0f6f6c1 Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: {"migrate": {}} Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ae053a19-7d9a-401c-8bba-9d597d776f25 could not be found. Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ae053a19-7d9a-401c-8bba-9d597d776f25', 'body': {'migrate': {}}} Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae053a19-7d9a-401c-8bba-9d597d776f25 could not be found. Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae053a19-7d9a-401c-8bba-9d597d776f25 could not be found. Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:12.543713 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:12.549008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:12.549008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:12.549008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:12.549008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:12.549008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae053a19-7d9a-401c-8bba-9d597d776f25 could not be found. Aug 23 10:48:12.549008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:12.551780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb2115b6-a493-47e6-bba1-47f1c7b9071e tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Returning 404 to user: Instance ae053a19-7d9a-401c-8bba-9d597d776f25 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:12.563552 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb2115b6-a493-47e6-bba1-47f1c7b9071e tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ae053a19-7d9a-401c-8bba-9d597d776f25/action" status: 404 len: 111 microversion: 2.1 time: 0.777803 Aug 23 10:48:12.568244 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1461/2815] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:11 2022] POST /compute/v2.1/servers/ae053a19-7d9a-401c-8bba-9d597d776f25/action => generated 111 bytes in 791 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:12.613313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:12.615247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:12.649889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:12.665851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:12.670230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:12.677672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:12.684624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:12.685504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:13.105368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:13.133973 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8702525-74ab-4017-b3cb-37a796f60658 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 2.207119 Aug 23 10:48:13.155080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1355/2816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:10 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:13.169226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:13.174030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:13.196401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:13.204185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:13.210665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:13.211790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:13.212645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:13.213333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:14.484076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:14.501520 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b36a61e3-d74d-437d-ae77-3f94fed0b71f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 1.344360 Aug 23 10:48:14.503074 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1356/2817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:13 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:14.515376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-efdc8a6c-fad7-44ef-8e72-e6101daf5433 req-f740fc33-9224-4aed-a00c-14762f9fa025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc65a8e-0c41-4b26-91b9-a5e4526e3e32", "tag": "136b0631-86a8-4413-a1b1-726c1e833124"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:14.546292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-efdc8a6c-fad7-44ef-8e72-e6101daf5433 req-f740fc33-9224-4aed-a00c-14762f9fa025 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:14.546778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-efdc8a6c-fad7-44ef-8e72-e6101daf5433 req-f740fc33-9224-4aed-a00c-14762f9fa025 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:14.547226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-efdc8a6c-fad7-44ef-8e72-e6101daf5433 req-f740fc33-9224-4aed-a00c-14762f9fa025 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:14.588296 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-efdc8a6c-fad7-44ef-8e72-e6101daf5433 req-f740fc33-9224-4aed-a00c-14762f9fa025 service nova] Creating event network-changed:136b0631-86a8-4413-a1b1-726c1e833124 for instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 on n-h1-847009-13 Aug 23 10:48:14.612535 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-efdc8a6c-fad7-44ef-8e72-e6101daf5433 req-f740fc33-9224-4aed-a00c-14762f9fa025 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107940 Aug 23 10:48:14.615534 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1357/2818] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:14.628121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73f92649-7c73-4dc8-a3ae-a24deb0cd394 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cac4b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:15.384617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:15.398358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7518ad10-3822-4166-b99b-1d4804ce8a79 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 2.828698 Aug 23 10:48:15.400012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1462/2819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:12 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:15.420699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:15.423106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:15.449782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:15.457219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:15.457875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:15.459892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:15.460842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:15.461614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:16.784535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:16.802363 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2185a23d-14a4-4ef8-b7f3-310a26eee140 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 1.397717 Aug 23 10:48:16.823304 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1463/2820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:15 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:16.842454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1221695689", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:19.762106 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73f92649-7c73-4dc8-a3ae-a24deb0cd394 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1463 microversion: 2.1 time: 5.145121 Aug 23 10:48:19.763784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1358/2821] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:14 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1463 bytes in 5147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:19.774415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:19.783977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:48:19.790731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:19.801417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:19.802266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:19.803003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:19.803971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:19.804877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:19.806146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:19.996666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:20.007841 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-907c7bde-8a33-4219-8c83-1da47174b074 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.242753 Aug 23 10:48:20.009245 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1359/2822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:19 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:20.039662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2cfa4f2a-5bd9-4e77-94cd-285c30cc17ad req-2f5d0c4f-3d2c-41fc-a714-b3bdd5d8218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd3faf7-6fdb-4f61-adb9-42a59c6e468e", "name": "network-vif-plugged", "status": "completed", "tag": "8496dec9-182b-4fcd-8e86-3c94916ad5b4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:20.077872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2cfa4f2a-5bd9-4e77-94cd-285c30cc17ad req-2f5d0c4f-3d2c-41fc-a714-b3bdd5d8218b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.081045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2cfa4f2a-5bd9-4e77-94cd-285c30cc17ad req-2f5d0c4f-3d2c-41fc-a714-b3bdd5d8218b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.081901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2cfa4f2a-5bd9-4e77-94cd-285c30cc17ad req-2f5d0c4f-3d2c-41fc-a714-b3bdd5d8218b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.094876 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2cfa4f2a-5bd9-4e77-94cd-285c30cc17ad req-2f5d0c4f-3d2c-41fc-a714-b3bdd5d8218b service nova] Creating event network-vif-plugged:8496dec9-182b-4fcd-8e86-3c94916ad5b4 for instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e on n-h2-847009-13 Aug 23 10:48:20.100943 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2cfa4f2a-5bd9-4e77-94cd-285c30cc17ad req-2f5d0c4f-3d2c-41fc-a714-b3bdd5d8218b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090300 Aug 23 10:48:20.102187 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1360/2823] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:20.110259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:20.111770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:20.119413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.120202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.120830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.121692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.122857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.123695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.492177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:20.506227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2320c1bc-4390-4807-904d-dba35db2ab39 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 0.402440 Aug 23 10:48:20.507454 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1361/2824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:20 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:20.513457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:20.514847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:20.522525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.523693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.524325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.525259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.525884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.526496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.726314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:48:20.726742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:48:20.727219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:48:20.727988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:48:20.728086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:48:20.755001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:20.757127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.757717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.758476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.759445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.760155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.760834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.766653 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c0fd9b3-6438-44ce-873c-1de8a3f60d3b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.257195 Aug 23 10:48:20.768316 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1362/2825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:20 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:20.773792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1d60b992-622d-4812-babc-be6e13486767 req-71b3f8b9-488a-49c4-b63b-9530fce90bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "tag": "cc66fa78-76e9-43da-94d2-947dc3ccd8be"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:20.786917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d60b992-622d-4812-babc-be6e13486767 req-71b3f8b9-488a-49c4-b63b-9530fce90bc3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.787729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d60b992-622d-4812-babc-be6e13486767 req-71b3f8b9-488a-49c4-b63b-9530fce90bc3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.788779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d60b992-622d-4812-babc-be6e13486767 req-71b3f8b9-488a-49c4-b63b-9530fce90bc3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.803888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1d60b992-622d-4812-babc-be6e13486767 req-71b3f8b9-488a-49c4-b63b-9530fce90bc3 service nova] Creating event network-changed:cc66fa78-76e9-43da-94d2-947dc3ccd8be for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:20.809451 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1d60b992-622d-4812-babc-be6e13486767 req-71b3f8b9-488a-49c4-b63b-9530fce90bc3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039546 Aug 23 10:48:20.809652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Getting quotas for project 2561ce8d69dd447cb108ed8fb9e8bf7d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:48:20.812349 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1363/2826] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:20.815963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Getting quotas for user 670582f204b54a0a97fa7f14c315801e and project 2561ce8d69dd447cb108ed8fb9e8bf7d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:48:20.820214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:20.821920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:20.829748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.830588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.831405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.832345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:20.833163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:20.833792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:20.850513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:48:20.853338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:48:20.955555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f127ca2-0bcb-4801-9e5c-f662db2045b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.117019 Aug 23 10:48:20.957967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1464/2827] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:48:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:48:20.966036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2314fe7d-203f-49ba-a9c8-f437860d5022 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e1e280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.057710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2314fe7d-203f-49ba-a9c8-f437860d5022 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 200 len: 1463 microversion: 2.1 time: 0.096890 Aug 23 10:48:21.058661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1465/2828] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:20 2022] GET /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 1463 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.066073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4eb2b8b1-23ed-4fa8-a45b-ab8cc51213a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.067286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4eb2b8b1-23ed-4fa8-a45b-ab8cc51213a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:21.158625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:21.163506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4eb2b8b1-23ed-4fa8-a45b-ab8cc51213a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:21.171518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4eb2b8b1-23ed-4fa8-a45b-ab8cc51213a9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1222 microversion: 2.1 time: 0.109994 Aug 23 10:48:21.172477 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15dfb9ea-5c5b-4340-b1a0-bbcf8623166c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 0.358628 Aug 23 10:48:21.172720 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1466/2829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.178772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.179896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:21.193463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1364/2830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:20 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.200580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.205766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.210525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:21.211431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.212239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.213859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.214750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.216209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.219148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.219891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.220364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.221338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.221890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.223102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.418938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:21.436770 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e439fa9c-6784-49b6-89d8-62c86935e3b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1467 microversion: 2.1 time: 0.241259 Aug 23 10:48:21.456944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1365/2831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.466275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ff0632c-677c-43a3-924c-b935706597c2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e87820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.612609 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ff0632c-677c-43a3-924c-b935706597c2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?changes-since=2022-08-23T10%3A45%3A56Z" status: 200 len: 2376 microversion: 2.1 time: 0.153606 Aug 23 10:48:21.614605 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1366/2832] 10.222.0.78 () {58 vars in 1199 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/images?changes-since=2022-08-23T10%3A45%3A56Z => generated 2376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.620224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.621094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:21.630038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.630879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.631475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.632455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.633148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.633825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.792068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:21.804213 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d2e3488-ec96-466f-9b22-3c2d2ae1b5bc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.629209 Aug 23 10:48:21.807921 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1467/2833] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.825407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-906347d6-1228-4732-99e1-599923e93aea tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c1b9310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.918004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:21.934839 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19282809-8c16-4787-9769-e073e30c3ffd tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 0.318733 Aug 23 10:48:21.935992 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1367/2834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:21.946148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:21.947021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:21.960384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.967829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.968292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:21.970038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:21.972955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:21.974923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.039112 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-906347d6-1228-4732-99e1-599923e93aea tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-442918371" status: 200 len: 484 microversion: 2.1 time: 0.228425 Aug 23 10:48:22.047916 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1468/2835] 10.222.0.78 () {58 vars in 1229 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-442918371 => generated 484 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:22.059822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2bcfcffb-ad09-4cb4-a2d8-39ba73edc693 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c1bf820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.242366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2bcfcffb-ad09-4cb4-a2d8-39ba73edc693 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?server=831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 957 microversion: 2.1 time: 0.188881 Aug 23 10:48:22.242963 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1469/2836] 10.222.0.78 () {58 vars in 1209 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/images?server=831fba09-82b8-4491-926a-23dea171108f => generated 957 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:22.262389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e10e25a-81dc-4d94-9759-3ecaa31dee18", "name": "network-vif-plugged", "status": "completed", "tag": "89b3bb1e-ab50-45f9-b82e-10d20b781c4d"}, {"server_uuid": "9f1396f4-2e29-40ab-a2e5-9d003fdfc623", "name": "network-vif-plugged", "status": "completed", "tag": "9fc11122-48f8-4e1c-a8fe-6aaf47bf126d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:22.264211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:22.271557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:22.273975 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39bf897a-0cc1-4098-8928-1b8a1c5dde69 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.336710 Aug 23 10:48:22.274679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1368/2837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:21 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:22.291259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.292213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:22.301468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.302223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.302854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.303787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.304152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.304636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.304964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.305088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.305678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.342906 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] Creating event network-vif-plugged:89b3bb1e-ab50-45f9-b82e-10d20b781c4d for instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 on n-h2-847009-13 Aug 23 10:48:22.343653 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] Creating event network-vif-plugged:9fc11122-48f8-4e1c-a8fe-6aaf47bf126d for instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 on n-h1-847009-13 Aug 23 10:48:22.353754 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-62456caf-2758-40d5-afd0-36c4552a331c req-535c74ac-46ea-4519-ad59-28ba835ae17c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096965 Aug 23 10:48:22.354613 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1470/2838] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:22.361137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.362036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:22.376999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.377965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.378976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.381184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.382366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.383531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.410429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:22.433294 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d32f4a3-c419-4489-ac2b-4b9630bb81ef tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1218 microversion: 2.1 time: 0.157459 Aug 23 10:48:22.434520 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1369/2839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:22.440047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c48af6b7-61e9-4492-a4c1-686d41ed7b45 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1ed9160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.535916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c48af6b7-61e9-4492-a4c1-686d41ed7b45 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 485 microversion: 2.1 time: 0.100050 Aug 23 10:48:22.536508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1370/2840] 10.222.0.78 () {58 vars in 1317 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 485 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:22.548278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99d98cd8-ad3a-44b9-bfdc-40d31f6c963f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e87ca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.622793 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99d98cd8-ad3a-44b9-bfdc-40d31f6c963f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 485 microversion: 2.1 time: 0.078357 Aug 23 10:48:22.624230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1371/2841] 10.222.0.78 () {58 vars in 1303 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 485 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:48:22.636190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e91752b0-0521-474c-bfc0-3d9f4ba590d1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1ed9700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.871636 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e91752b0-0521-474c-bfc0-3d9f4ba590d1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.239140 Aug 23 10:48:22.875624 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1372/2842] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:22.893127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:22.896124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:22.914390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.915409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.916075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:22.917079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:22.917716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:22.918342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.153543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:23.164024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-575f0d68-9619-47fe-ae82-40c7f3515b1c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.284809 Aug 23 10:48:23.164989 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1373/2843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:23.169786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2b6111e-c810-46b0-9683-9caee547d69e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1de8c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:23.187742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:23.210989 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5bace6d-4c11-4b43-a021-8f04a07d3d4d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 0.846387 Aug 23 10:48:23.214212 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1471/2844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:22 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:23.232457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:23.236019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:23.259268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:23.271443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:23.273306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.275546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:23.278634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:23.283859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.325648 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2b6111e-c810-46b0-9683-9caee547d69e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.159289 Aug 23 10:48:23.328683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1374/2845] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:48:23 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:23.336899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:23.343490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:23.345392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:23.396439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:23.397034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:23.404654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.405558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:23.411118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:23.414153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.526580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:23.547557 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b446e135-5857-455a-ab8b-95badafa6a77 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1323 microversion: 2.1 time: 0.331905 Aug 23 10:48:23.549391 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1472/2846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:23 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1323 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:23.558854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17f11c83-2edf-478e-8edd-33e8f80d0302 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c1f31f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:23.698953 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17f11c83-2edf-478e-8edd-33e8f80d0302 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.148269 Aug 23 10:48:23.699648 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1473/2847] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:48:23 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:23.716869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:23.731143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:23.742321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:23.745215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:23.746838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.749285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:23.757021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:23.758642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:23.858143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:23.873271 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98ca7e8c-c960-4dcc-b365-8474250902c6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.539041 Aug 23 10:48:23.889234 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1375/2848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:23 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:23.899199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e378cf7-656d-4c59-bde0-9a053f875788 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e0a310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:24.180531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e378cf7-656d-4c59-bde0-9a053f875788 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?changes-since=2022-08-23T10%3A45%3A52Z" status: 200 len: 6334 microversion: 2.1 time: 0.290076 Aug 23 10:48:24.193562 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1376/2849] 10.222.0.78 () {58 vars in 1220 bytes} [Tue Aug 23 10:48:23 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-23T10%3A45%3A52Z => generated 6334 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:24.199836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:24.200484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:24.222362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:24.222886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:24.223339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:24.224077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:24.233492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:24.234042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:24.650921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:24.679886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2dc2e106-e4ef-48e2-8346-51e5d484c535 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1218 microversion: 2.1 time: 0.968433 Aug 23 10:48:24.680561 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1474/2850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:23 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1218 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:24.700257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5a8182f-b6f8-41b7-9309-b3cf0484f1f2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c1e6e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:24.847918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5a8182f-b6f8-41b7-9309-b3cf0484f1f2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-442918371" status: 200 len: 664 microversion: 2.1 time: 0.163310 Aug 23 10:48:24.848772 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1475/2851] 10.222.0.78 () {58 vars in 1250 bytes} [Tue Aug 23 10:48:24 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-442918371 => generated 664 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:24.865619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:24.866523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:24.877436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:24.878774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:24.879421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:24.881100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:24.881757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:24.882428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:24.950698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:24.966340 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5cc8d04-e988-48e5-85ef-49c6887024d0 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.771352 Aug 23 10:48:24.966948 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1377/2852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:24 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:24.989858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-568920a6-2799-4ab9-a410-8a6878b30ac2 req-c661c00f-bcb4-404f-8ac7-e820096805f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "name": "network-vif-unplugged", "status": "completed", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:25.016448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-568920a6-2799-4ab9-a410-8a6878b30ac2 req-c661c00f-bcb4-404f-8ac7-e820096805f5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.018189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-568920a6-2799-4ab9-a410-8a6878b30ac2 req-c661c00f-bcb4-404f-8ac7-e820096805f5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.018988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-568920a6-2799-4ab9-a410-8a6878b30ac2 req-c661c00f-bcb4-404f-8ac7-e820096805f5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:25.035338 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-568920a6-2799-4ab9-a410-8a6878b30ac2 req-c661c00f-bcb4-404f-8ac7-e820096805f5 service nova] Creating event network-vif-unplugged:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:48:25.041736 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-568920a6-2799-4ab9-a410-8a6878b30ac2 req-c661c00f-bcb4-404f-8ac7-e820096805f5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069077 Aug 23 10:48:25.043034 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1378/2853] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:25.051372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:25.052489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:25.061717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.062436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.063109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:25.068035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.068035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.068632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:25.398370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:25.429932 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9c6a8e9-5d1b-4675-bff1-b0c5c92aaff4 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1516 microversion: 2.1 time: 0.385087 Aug 23 10:48:25.434159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1379/2854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:25 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1516 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:25.440368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f94ad3cb-a01b-494b-95bd-894e90b91dba tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1e87040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:25.527441 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f94ad3cb-a01b-494b-95bd-894e90b91dba tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1467 microversion: 2.1 time: 0.090931 Aug 23 10:48:25.528046 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1380/2855] 10.222.0.78 () {58 vars in 1338 bytes} [Tue Aug 23 10:48:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:25.541316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:25.541950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:25.558543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.558671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.562649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:25.565567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.566261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.567053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:25.857607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:25.872166 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31849c8d-8bd8-4255-95fc-86d7352a894f tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 1.020205 Aug 23 10:48:25.875886 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1476/2856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:24 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:25.893653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:25.894612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:25.905692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.910485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.911203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:25.912130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:25.913278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:25.916776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:26.043821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:26.061136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae14fd82-5732-4300-be69-ae6358330511 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.531995 Aug 23 10:48:26.064370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1381/2857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:25 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:26.069632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0669a468-9b3a-4996-b6a6-9f5c0ccfa45b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb7fee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:26.187129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0669a468-9b3a-4996-b6a6-9f5c0ccfa45b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1467 microversion: 2.1 time: 0.121055 Aug 23 10:48:26.190593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1382/2858] 10.222.0.78 () {58 vars in 1324 bytes} [Tue Aug 23 10:48:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2Fc9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1467 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:26.200958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:26.201793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:26.216373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:26.217143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:26.217743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:26.218611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:26.222616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:26.223318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:26.380807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:26.393910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe7f9e91-8dcc-4599-b049-ae2919390493 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1280 microversion: 2.1 time: 0.201026 Aug 23 10:48:26.410142 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1383/2859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:26 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:26.419262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:26.425094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:26.432868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:26.433380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:26.436102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:26.438613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:26.441710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:26.443100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:26.944258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:26.965258 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53badf90-5bfb-4c58-9bb8-9d68461e4707 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1323 microversion: 2.1 time: 1.082578 Aug 23 10:48:26.966026 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1477/2860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:25 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1323 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:26.980835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f628613d-6090-49d4-bb04-0f607dab03e4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c1f33a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:27.297492 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f628613d-6090-49d4-bb04-0f607dab03e4 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.324696 Aug 23 10:48:27.300838 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1478/2861] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 23 10:48:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:27.306832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:27.308042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:27.318579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:27.319368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:27.321410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:27.322454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:27.323508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:27.324560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:27.393724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:27.404087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a70ea190-6fec-4768-87f4-dda57d734160 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.991982 Aug 23 10:48:27.418363 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1384/2862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:26 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:27.428852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:27.434855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:27.449321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:27.451058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:27.451689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:27.452652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:27.453462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:27.454051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:27.758385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:27.766655 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29d0b154-a8de-4375-8aef-9450e8865696 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.346560 Aug 23 10:48:27.771196 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1385/2863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:27 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:27.781539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4ebe7f4-df05-48c2-a7e5-a6b03de7fa0d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1ec9700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:27.853815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:27.872613 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ad835a7-55a2-4837-9e4e-7add0481d91d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 0.570269 Aug 23 10:48:27.881072 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1479/2864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:27 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:27.886869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:27.887693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:27.909927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:27.913707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:27.914401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:27.915327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:27.915942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:27.916524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:27.937047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4ebe7f4-df05-48c2-a7e5-a6b03de7fa0d tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.164386 Aug 23 10:48:27.939697 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1386/2865] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 23 10:48:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:27.958408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88c6f4b1-791a-4822-a393-3379986f069c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9ca53820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:28.063337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88c6f4b1-791a-4822-a393-3379986f069c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/b4ffccc2-7c96-4941-8a42-0d5d5e6236b8" status: 200 len: 784 microversion: 2.1 time: 0.113055 Aug 23 10:48:28.064984 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1387/2866] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:48:27 2022] GET /compute/v2.1/images/b4ffccc2-7c96-4941-8a42-0d5d5e6236b8 => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:28.077110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:28.077988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:28.092034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:28.093542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:28.095567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:28.097462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:28.103620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:28.105013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:28.528097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:28.559680 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b96bfb8-bafa-40cc-925c-c032bc986750 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1515 microversion: 2.1 time: 0.476573 Aug 23 10:48:28.560763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1388/2867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:28 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1515 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:28.565706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6593902c-7b1f-40fb-a2e4-cc5698a8eb95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9caf5dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:28.652711 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6593902c-7b1f-40fb-a2e4-cc5698a8eb95 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.090691 Aug 23 10:48:28.653614 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1389/2868] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:48:28 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:28.663543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:28.664507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:28.687554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:28.688058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:28.695531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:28.696671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:28.698321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:28.698929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:28.737933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:28.746533 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59d8c439-e145-4f80-b767-85bdadde20cc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.864152 Aug 23 10:48:28.752885 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1480/2869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:27 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:28.757803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:28.760485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:28.775912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:28.776659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:28.779213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:28.780091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:28.780698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:28.784138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:29.196535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:29.214906 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09a5f749-5566-46c7-9216-76fa71f3b4dc tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.558070 Aug 23 10:48:29.217405 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1390/2870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:28 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:29.225697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-530eca4f-090a-48f2-89ef-caec870419b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdca1de8ee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:29.375673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:29.390249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-deb71e66-cb1e-4d98-bb2a-a63d6e26a490 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 200 len: 1516 microversion: 2.1 time: 0.635447 Aug 23 10:48:29.391853 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1481/2871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:28 2022] GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:29.404343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:29.405331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:29.427437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:29.428279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:29.431373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:29.432386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:29.434927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:29.435617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:30.592542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:30.610791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7898a2c5-c5f3-450f-9a60-1af204511523 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 1.215211 Aug 23 10:48:30.617075 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1482/2872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:29 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:30.622415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:30.625486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:30.641508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:30.641815 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-530eca4f-090a-48f2-89ef-caec870419b0 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158" status: 204 len: 0 microversion: 2.1 time: 1.423089 Aug 23 10:48:30.644273 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1391/2873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:29 2022] DELETE /compute/v2.1/images/c56205c3-c21e-4abb-ad1e-a291efba6158 => generated 0 bytes in 1426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:30.645079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:30.647981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:30.649114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:30.649844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:30.650054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:30.651887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:30.652228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:30.671192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:30.673089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:30.674455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:30.676192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:30.680021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:30.681525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:30.762196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:30.774716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:31.028206 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c838d88-6f3f-43ac-8e2e-f22f91c121e9 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 204 len: 0 microversion: 2.1 time: 0.382203 Aug 23 10:48:31.029284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1392/2874] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:30 2022] DELETE /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:31.037726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:31.041349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:31.055426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:31.059648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:31.060298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:31.061075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:31.061557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:31.064350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:31.168366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:31.243180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:31.255059 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08ea3db7-6045-42d8-b6e5-65079893a03c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 0.636545 Aug 23 10:48:31.271283 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1483/2875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:30 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:31.276068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-49ddf209-8cb9-4349-97b3-dc424df522ca req-331d8f66-222f-4bd0-a3e2-b29238164a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec352dda-b4b2-45f5-8671-bd6627827f6c", "tag": "b4ce707e-2107-43ba-a55e-531aa974e49c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:31.317400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49ddf209-8cb9-4349-97b3-dc424df522ca req-331d8f66-222f-4bd0-a3e2-b29238164a54 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:31.320064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49ddf209-8cb9-4349-97b3-dc424df522ca req-331d8f66-222f-4bd0-a3e2-b29238164a54 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:31.323576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49ddf209-8cb9-4349-97b3-dc424df522ca req-331d8f66-222f-4bd0-a3e2-b29238164a54 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:31.387015 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-49ddf209-8cb9-4349-97b3-dc424df522ca req-331d8f66-222f-4bd0-a3e2-b29238164a54 service nova] Creating event network-changed:b4ce707e-2107-43ba-a55e-531aa974e49c for instance ec352dda-b4b2-45f5-8671-bd6627827f6c on n-h1-847009-13 Aug 23 10:48:31.402631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-49ddf209-8cb9-4349-97b3-dc424df522ca req-331d8f66-222f-4bd0-a3e2-b29238164a54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129950 Aug 23 10:48:31.409476 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1484/2876] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:31.415077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:31.424506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:31.446572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:31.447308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:31.447930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:31.461023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:31.461944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:31.462556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:31.542294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:31.555242 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7ac57fe-f730-4341-a94e-ff12cabbdcca tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.524405 Aug 23 10:48:31.569824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1393/2877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:31 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:31.575550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d1776ace-88b4-4583-900b-1d638058a97c req-5730b168-d24c-4bb8-826b-07828b55b1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc65a8e-0c41-4b26-91b9-a5e4526e3e32", "name": "network-vif-plugged", "status": "completed", "tag": "136b0631-86a8-4413-a1b1-726c1e833124"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:31.613960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1776ace-88b4-4583-900b-1d638058a97c req-5730b168-d24c-4bb8-826b-07828b55b1d2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:31.614854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1776ace-88b4-4583-900b-1d638058a97c req-5730b168-d24c-4bb8-826b-07828b55b1d2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:31.617398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1776ace-88b4-4583-900b-1d638058a97c req-5730b168-d24c-4bb8-826b-07828b55b1d2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:31.678859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d1776ace-88b4-4583-900b-1d638058a97c req-5730b168-d24c-4bb8-826b-07828b55b1d2 service nova] Creating event network-vif-plugged:136b0631-86a8-4413-a1b1-726c1e833124 for instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 on n-h1-847009-13 Aug 23 10:48:31.731025 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d1776ace-88b4-4583-900b-1d638058a97c req-5730b168-d24c-4bb8-826b-07828b55b1d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156224 Aug 23 10:48:31.732285 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1394/2878] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:31.750966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ef4ec5a-532a-4222-83ea-ed05b8bffd9e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9f3e5040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:32.182790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:32.198892 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a872f83e-b114-4451-a0b9-47a6bbca8bce tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.787767 Aug 23 10:48:32.210417 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1485/2879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:31 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:32.219661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:32.232777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:32.240213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:32.241041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:32.248823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:32.249707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:32.250268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:32.252812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:32.598178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:32.621844 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e70ac9f-7809-4d53-8dc1-af1553e508aa tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 200 len: 1522 microversion: 2.1 time: 0.409513 Aug 23 10:48:32.625777 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1486/2880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:32 2022] GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:32.638940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:32.643966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:32.661986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:32.662827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:32.664508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:32.667911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:32.668615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:32.669380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:33.123152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:33.139220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b32e8154-01a9-43ed-9182-4b60d1aa6608 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.511863 Aug 23 10:48:33.140187 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1487/2881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:32 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:33.150066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:33.153815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:33.166687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:33.168991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:33.174099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:33.175336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:33.176020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:33.176675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:33.994889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:34.010985 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ebd2089-c7b7-42ca-a2c2-817087794750 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1293 microversion: 2.1 time: 0.867224 Aug 23 10:48:34.011634 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1488/2882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:33 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1293 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:34.043747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:34.044527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:34.066078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:34.066586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:34.067032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:34.077068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:34.077857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:34.078413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:34.605666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:34.628765 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f94dbd99-25b4-4007-b424-80d86411f2d0 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.615999 Aug 23 10:48:34.629376 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1489/2883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:34 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:34.651575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:34.666552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:34.695316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:34.695894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:34.696296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:34.704398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:34.704398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:34.705107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:35.885479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:35.900425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be85008c-1873-4687-87ab-0d19402b7959 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 1.269668 Aug 23 10:48:35.908297 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1490/2884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:34 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:35.917825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:35.935487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:35.959408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:35.959903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:35.960350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:35.971069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:35.971610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:35.972066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:36.110101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:36.111089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:36.111089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:36.111660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lazy-loading 'fault' on Instance uuid 2e10e25a-81dc-4d94-9759-3ecaa31dee18 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:36.254687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:36.274977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-512f597f-0227-4d8a-95ca-53bbd3147b7f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 200 len: 1313 microversion: 2.1 time: 0.350621 Aug 23 10:48:36.288113 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1491/2885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:35 2022] GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:36.306374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "name": "network-vif-plugged", "status": "completed", "tag": "a566ffd6-3723-4cbe-a18a-7c4bd605d819"}, {"server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "name": "network-vif-plugged", "status": "completed", "tag": "cc66fa78-76e9-43da-94d2-947dc3ccd8be"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:36.387422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:36.390944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:36.391510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:36.452701 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] Creating event network-vif-plugged:a566ffd6-3723-4cbe-a18a-7c4bd605d819 for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:36.465157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] Creating event network-vif-plugged:cc66fa78-76e9-43da-94d2-947dc3ccd8be for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:36.490966 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-07651426-2620-44e2-bafd-cd383342abcd req-c839b81f-45cc-43c9-a066-db8e9f516d4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.201191 Aug 23 10:48:36.491589 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1492/2886] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:36.524389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:36.529669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:36.561416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:36.564412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:36.565224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:36.566431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:36.567063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:36.567849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:36.651602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:36.970404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:36.996680 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-855c711c-768d-45de-87d1-72ef5cea11d0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.503428 Aug 23 10:48:37.017891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1493/2887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:36 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:37.049141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:37.049895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:37.082695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.083196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.083653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:37.084376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.091592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.092276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:37.404598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ef4ec5a-532a-4222-83ea-ed05b8bffd9e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f" status: 204 len: 0 microversion: 2.1 time: 5.670760 Aug 23 10:48:37.409378 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1395/2888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:31 2022] DELETE /compute/v2.1/images/4f01de4d-6fb9-4b78-9b66-7668cf480a9f => generated 0 bytes in 5672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:37.411044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:37.412439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:37.425228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:37.451881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.452527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.453028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:37.454044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.458943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.459430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:37.630617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:37.639228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ea312f5-0c84-4694-aefe-d0b505591e90 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1485 microversion: 2.1 time: 0.619974 Aug 23 10:48:37.639825 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1494/2889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:37 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1485 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:37.652614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d2bb075b-8b33-41be-89b9-7d1101972359 req-b9c36090-424f-4f64-84b5-99fb536a90b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e10e25a-81dc-4d94-9759-3ecaa31dee18", "name": "network-vif-deleted", "tag": "89b3bb1e-ab50-45f9-b82e-10d20b781c4d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:37.671322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d2bb075b-8b33-41be-89b9-7d1101972359 req-b9c36090-424f-4f64-84b5-99fb536a90b4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.671818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d2bb075b-8b33-41be-89b9-7d1101972359 req-b9c36090-424f-4f64-84b5-99fb536a90b4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.672257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d2bb075b-8b33-41be-89b9-7d1101972359 req-b9c36090-424f-4f64-84b5-99fb536a90b4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:37.702406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d2bb075b-8b33-41be-89b9-7d1101972359 req-b9c36090-424f-4f64-84b5-99fb536a90b4 service nova] Creating event network-vif-deleted:89b3bb1e-ab50-45f9-b82e-10d20b781c4d for instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 on n-h2-847009-13 Aug 23 10:48:37.715260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d2bb075b-8b33-41be-89b9-7d1101972359 req-b9c36090-424f-4f64-84b5-99fb536a90b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074214 Aug 23 10:48:37.724316 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1495/2890] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:37.740046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:37.743302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:37.760624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.765834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.766544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:37.767615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:37.768423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:37.769517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:38.182151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:38.192132 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51099179-ad62-4563-bf79-935c514eb2b9 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1333 microversion: 2.1 time: 0.466070 Aug 23 10:48:38.192751 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1496/2891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:37 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1333 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:38.226350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:38.227734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:38.242316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:38.242828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:38.243345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:38.244338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:38.245156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:38.246027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:38.265066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] HTTP exception thrown: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 HTTP/1.1 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2e10e25a-81dc-4d94-9759-3ecaa31dee18'} Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:38.266875 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 404 to user: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3869d647-1521-4a5c-944f-c0df3a56d31b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 404 len: 111 microversion: 2.1 time: 0.074714 Aug 23 10:48:38.275367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1497/2892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:38 2022] GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:38.276717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc76ab33-efdc-4ba2-b17b-11d47a2f49af tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c1cc280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:38.339686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:38.348330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d1efea8-b610-4191-9cb0-c1f15668a9b9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.942045 Aug 23 10:48:38.356493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1396/2893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:37 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:38.379264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:38.379818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:38.387972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:38.393040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:38.393695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:38.394596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:38.395217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:38.395818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:38.448920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:38.612979 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-463ed419-62d7-4aff-ab49-b79233f2af6d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250766 Aug 23 10:48:38.614169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1397/2894] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:48:38 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32/os-interface => generated 285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:38.619292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:38.620144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:38.638202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:38.638965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:38.639644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:38.640598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:38.647790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:38.648708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.080791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:39.096022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db57bc3d-c0f1-4fa2-af28-ac70b77affd5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1683 microversion: 2.1 time: 0.480618 Aug 23 10:48:39.096912 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1398/2895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:38 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1683 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:39.116171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:39.141069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:39.143419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:39.154696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.155482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.156456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc76ab33-efdc-4ba2-b17b-11d47a2f49af tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37" status: 204 len: 0 microversion: 2.1 time: 0.884982 Aug 23 10:48:39.158512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.158847 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1498/2896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:38 2022] DELETE /compute/v2.1/images/3aaef852-ab7f-42ac-8fed-b385654bcc37 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:39.161993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.162726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.163502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.168609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:39.169401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:39.182387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.184078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.184591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.186570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.187058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.187500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.219618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:39.333688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e5e7df9-d71c-4ac9-9c86-455ed710fb9f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 204 len: 0 microversion: 2.1 time: 0.170451 Aug 23 10:48:39.338726 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1499/2897] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:39 2022] DELETE /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:48:39.346866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:39.348256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:39.366687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.368424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.369713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.370682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.371658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.372586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.390661 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44b3c3b4-6a1f-406c-8345-78327145ec33 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.280407 Aug 23 10:48:39.391467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1399/2898] 10.222.0.78 () {58 vars in 1230 bytes} [Tue Aug 23 10:48:39 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:48:39.399426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:39.413637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:39.424947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.433379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.434127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.435097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:39.435782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:39.436434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:39.939841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:39.955941 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b8233b6-6d8c-4bd6-a83d-a0bde4395943 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1669 microversion: 2.1 time: 0.612892 Aug 23 10:48:39.966292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1500/2899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:39 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1669 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:39.966807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:39.967440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:39.969649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:40.028585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.029822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.030277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.031209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.032094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.033628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.183916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:40.202544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cb4ae87-66d5-4095-a69d-e722f083b00b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1473 microversion: 2.1 time: 0.809875 Aug 23 10:48:40.203148 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1400/2900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:39 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1473 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:40.226892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafce3dc-780e-459c-9132-11779dc35f65 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafce3dc-780e-459c-9132-11779dc35f65 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 23 10:48:40.230950 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafce3dc-780e-459c-9132-11779dc35f65 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:40.235307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dafce3dc-780e-459c-9132-11779dc35f65 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.026522 Aug 23 10:48:40.242704 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1401/2901] 10.222.0.78 () {58 vars in 1182 bytes} [Tue Aug 23 10:48:40 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:48:40.262839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:40.263866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:40.316614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.317605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.318884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.320272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.321240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.322059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.411274 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2bde5bc4-ed61-4615-b7f8-50a868e90e75 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d/ips" status: 200 len: 180 microversion: 2.1 time: 0.166134 Aug 23 10:48:40.416157 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1402/2902] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 10:48:40 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d/ips => generated 180 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:40.428481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:40.429649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:40.445086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.446378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.448236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.449267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.453383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.454183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.649231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:40.663119 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34cc4b2a-fcb7-471a-9bfc-dd59a8556e15 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.704248 Aug 23 10:48:40.663636 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1501/2903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:39 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:40.671730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:40.681597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:40.685286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:40.695613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.697628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.698089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.699108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.700423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.700973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.842395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:48:40.850124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:40.859949 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd5a8e6a-375b-4297-9590-c0a4b4f349d6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.442277 Aug 23 10:48:40.865106 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1403/2904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:40 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:40.875850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:40.900321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:40.925178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e40af5dc-714d-4488-962e-13dd942fbb7d tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.260161 Aug 23 10:48:40.932530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1502/2905] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:48:40 2022] GET /compute/v2.1/servers => generated 683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:40.937811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:40.939089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.939779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.940330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.942081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.943813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.946170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:40.946541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.947058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.servers [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Removing options 'limit' from query {{(pid=128859) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 10:48:40.947899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:40.954840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.955865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.956458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:40.957564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:40.958168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:40.958758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.011949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:48:41.045735 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-585c93df-6e5e-4664-a7ce-92258add7868 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.111047 Aug 23 10:48:41.046958 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1503/2906] 10.222.0.78 () {58 vars in 1144 bytes} [Tue Aug 23 10:48:40 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:41.049413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:41.053052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.054024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:41.061564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.062422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.063047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.064150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.064993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.065581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.170406 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-930600a4-a9c1-43ac-93bf-b6b7d10c4990 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 204 len: 0 microversion: 2.1 time: 0.303541 Aug 23 10:48:41.174141 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1404/2907] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:40 2022] DELETE /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:41.195103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a8fcc47-c801-4ed5-8dc4-2a89f450fd2b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a8fcc47-c801-4ed5-8dc4-2a89f450fd2b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: action_args: {} Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi '-1' Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 23 10:48:41.201505 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 23 10:48:41.207628 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.210191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a8fcc47-c801-4ed5-8dc4-2a89f450fd2b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:41.211260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a8fcc47-c801-4ed5-8dc4-2a89f450fd2b tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.035569 Aug 23 10:48:41.211994 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1405/2908] 10.222.0.78 () {58 vars in 1142 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:48:41.216932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.227070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:41.237376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.238244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.239160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.240085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.240878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.241493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.368357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:41.388923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-074b1328-c824-49ae-bc13-2f878f9a587d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.340065 Aug 23 10:48:41.390116 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1504/2909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:41.397091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28290b38-82e7-47a0-92fd-4fc733756e00 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28290b38-82e7-47a0-92fd-4fc733756e00 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: action_args: {} Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'testing' Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 23 10:48:41.402833 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 23 10:48:41.410706 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:41.445998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28290b38-82e7-47a0-92fd-4fc733756e00 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:41.450135 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28290b38-82e7-47a0-92fd-4fc733756e00 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.058282 Aug 23 10:48:41.465061 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1505/2910] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:48:41.482787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.483776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:41.535218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.538281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.538977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.540071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.541729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.543966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.681551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:41.691345 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dde3aadd-34e5-44ee-a935-71fd4e34031c tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1675 microversion: 2.1 time: 0.478156 Aug 23 10:48:41.695875 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1406/2911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1675 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:41.705649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74568d30-ae15-479f-a43c-1a6e5e90aca3 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.733679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74568d30-ae15-479f-a43c-1a6e5e90aca3 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:41.736112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74568d30-ae15-479f-a43c-1a6e5e90aca3 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:41.744732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.compute.servers [None req-74568d30-ae15-479f-a43c-1a6e5e90aca3 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Flavor 'non_existing_flavor' could not be found {{(pid=128860) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 23 10:48:41.746099 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74568d30-ae15-479f-a43c-1a6e5e90aca3 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.049257 Aug 23 10:48:41.767531 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1407/2912] 10.222.0.78 () {58 vars in 1178 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:48:41.781422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:41.783142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:41.796599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.797554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.799268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:41.827611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:41.831737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:41.832785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.070343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:42.079416 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-70a07532-d70e-4bb9-be92-582d0f9ac6da tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1473 microversion: 2.1 time: 0.610396 Aug 23 10:48:42.091303 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1506/2913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:42.103830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:42.104801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:42.112857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.113672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.114342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.115333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.116181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.116868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.145957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:42.158317 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e43cf27a-d253-46e9-bd50-a521e1ab28d5 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.386114 Aug 23 10:48:42.159434 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1408/2914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:41 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:42.164503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-17292c54-f769-4d6f-86c0-d821e665ad1a req-db44dd72-25e9-4495-9393-2cb1c3ab43f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc65a8e-0c41-4b26-91b9-a5e4526e3e32", "tag": "136b0631-86a8-4413-a1b1-726c1e833124"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:42.191569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-17292c54-f769-4d6f-86c0-d821e665ad1a req-db44dd72-25e9-4495-9393-2cb1c3ab43f0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.192051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-17292c54-f769-4d6f-86c0-d821e665ad1a req-db44dd72-25e9-4495-9393-2cb1c3ab43f0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.199708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-17292c54-f769-4d6f-86c0-d821e665ad1a req-db44dd72-25e9-4495-9393-2cb1c3ab43f0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.217176 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-17292c54-f769-4d6f-86c0-d821e665ad1a req-db44dd72-25e9-4495-9393-2cb1c3ab43f0 service nova] Creating event network-changed:136b0631-86a8-4413-a1b1-726c1e833124 for instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 on n-h1-847009-13 Aug 23 10:48:42.236753 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-17292c54-f769-4d6f-86c0-d821e665ad1a req-db44dd72-25e9-4495-9393-2cb1c3ab43f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075682 Aug 23 10:48:42.238736 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1409/2915] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:42.247359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:42.254654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:42.256356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:42.264023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.265313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.266581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.267894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.268716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.269419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.439918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:42.448538 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e81ab38a-a96b-40b7-8507-dabb9a46be22 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1485 microversion: 2.1 time: 0.355828 Aug 23 10:48:42.467297 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1507/2916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:42 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1485 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:42.501651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9ff1af15-4996-45a4-833e-4b77b262b745 req-6d53078e-3c9a-4c5f-9f02-9de34e7f6920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec352dda-b4b2-45f5-8671-bd6627827f6c", "name": "network-vif-plugged", "status": "completed", "tag": "b4ce707e-2107-43ba-a55e-531aa974e49c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:42.519295 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87e06d90-9354-4e07-a690-9c5559ca87b0 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.275716 Aug 23 10:48:42.531620 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1410/2917] 10.222.0.78 () {58 vars in 1174 bytes} [Tue Aug 23 10:48:42 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:48:42.543838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9ff1af15-4996-45a4-833e-4b77b262b745 req-6d53078e-3c9a-4c5f-9f02-9de34e7f6920 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.544785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9ff1af15-4996-45a4-833e-4b77b262b745 req-6d53078e-3c9a-4c5f-9f02-9de34e7f6920 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.546693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9ff1af15-4996-45a4-833e-4b77b262b745 req-6d53078e-3c9a-4c5f-9f02-9de34e7f6920 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.552764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:42.571560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:42.572278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:42.581834 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9ff1af15-4996-45a4-833e-4b77b262b745 req-6d53078e-3c9a-4c5f-9f02-9de34e7f6920 service nova] Creating event network-vif-plugged:b4ce707e-2107-43ba-a55e-531aa974e49c for instance ec352dda-b4b2-45f5-8671-bd6627827f6c on n-h1-847009-13 Aug 23 10:48:42.588299 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9ff1af15-4996-45a4-833e-4b77b262b745 req-6d53078e-3c9a-4c5f-9f02-9de34e7f6920 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119666 Aug 23 10:48:42.589382 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1508/2918] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:42.619651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.620151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.620598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.627719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.629321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.629779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.730822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:42.732417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:42.753843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.762875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.767757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.773901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.774527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.776132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.910152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ba79aef-cead-4464-ad61-c89868013602 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.375427 Aug 23 10:48:42.921436 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1411/2919] 10.222.0.78 () {58 vars in 1184 bytes} [Tue Aug 23 10:48:42 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:48:42.933940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:42.951795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:42.953462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:42.961087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.962365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.963048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:42.964017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:42.965090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:42.965885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:43.030651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:48:43.125555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:43.138816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:43.139734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:43.140398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:43.479204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5580776c-dfd9-40b7-aa39-9b6e2b935e98 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.552500 Aug 23 10:48:43.492160 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1412/2920] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:48:42 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:43.507959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:43.507959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:43.520581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:43.525369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:43.526887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:43.527765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:43.530215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:43.530944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:43.897216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:43.913048 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76ad5fce-bc4a-484c-ac9c-e6829d08640e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1473 microversion: 2.1 time: 0.416053 Aug 23 10:48:43.913687 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1413/2921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:43 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1473 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:43.935675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:43.950266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:43.970856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:43.974534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:43.975204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:43.976128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:43.979703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:43.980384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.050736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:44.066145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0bcd1eda-ee12-4fb3-85b6-3ecc9cd5b4a4 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1675 microversion: 2.1 time: 1.340982 Aug 23 10:48:44.073559 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1509/2922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:42 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1675 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:44.091100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.095944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.113081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.113664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.114619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.115374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.115843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.116280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.209522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:44.222514 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00a8da39-9287-428b-87e8-3cfd1eaccd17 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.302891 Aug 23 10:48:44.223499 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1414/2923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:43 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:44.235090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6117245b-a13b-448b-855c-4a38b766da53 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.245423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6117245b-a13b-448b-855c-4a38b766da53 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:44.246871 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6117245b-a13b-448b-855c-4a38b766da53 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.020737 Aug 23 10:48:44.247619 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1415/2924] 10.222.0.78 () {58 vars in 1178 bytes} [Tue Aug 23 10:48:44 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:48:44.264213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.282765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:44.283978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Searching by: {'deleted': False, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:48:44.291993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.292419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.292892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.295027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.295607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.296059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.331367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:48:44.405692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-334c6c55-38dd-4458-b611-9a66aaceac22 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.145858 Aug 23 10:48:44.407070 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1416/2925] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:48:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:44.420798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.421694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.429693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.430329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.430881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.431898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.432397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.432912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] HTTP exception thrown: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 HTTP/1.1 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '2e10e25a-81dc-4d94-9759-3ecaa31dee18'} Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:48:44.465390 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 404 to user: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aab1a39e-dd34-45d5-a785-5cd8b11d5f81 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 404 len: 111 microversion: 2.1 time: 0.045316 Aug 23 10:48:44.469821 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1417/2926] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:44 2022] DELETE /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:48:44.475709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.476693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.484863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.486335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.486738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.487467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.487940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.488380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.543658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:44.570807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:44.673323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f205e5f3-a4c4-4f22-998d-4799ae873696 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 204 len: 0 microversion: 2.1 time: 0.200991 Aug 23 10:48:44.674992 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1418/2927] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:44 2022] DELETE /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:44.682435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4f49d2cf-4cac-447d-8969-8dbc0e84b816 req-45e94adf-5358-44fb-9613-563828950e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-unplugged", "status": "completed", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:44.693947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4f49d2cf-4cac-447d-8969-8dbc0e84b816 req-45e94adf-5358-44fb-9613-563828950e59 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.693947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4f49d2cf-4cac-447d-8969-8dbc0e84b816 req-45e94adf-5358-44fb-9613-563828950e59 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.694290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4f49d2cf-4cac-447d-8969-8dbc0e84b816 req-45e94adf-5358-44fb-9613-563828950e59 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.707365 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4f49d2cf-4cac-447d-8969-8dbc0e84b816 req-45e94adf-5358-44fb-9613-563828950e59 service nova] Creating event network-vif-unplugged:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:48:44.712346 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4f49d2cf-4cac-447d-8969-8dbc0e84b816 req-45e94adf-5358-44fb-9613-563828950e59 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034013 Aug 23 10:48:44.713321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1419/2928] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:44.718394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.718975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.727079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.727270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.727576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.728282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.728823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.729194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.759196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:44.771364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:44.805931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b7742ddf-eca1-4d04-8928-ceca742d4310 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.729395 Aug 23 10:48:44.808208 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1510/2929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:44.837884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.838744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.861934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.862909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.863615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.864571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.866311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.866997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.904937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2b9b587-6aa2-4086-86c1-c042da32da5f tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "DELETE /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 204 len: 0 microversion: 2.1 time: 0.189347 Aug 23 10:48:44.906291 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1420/2930] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:44 2022] DELETE /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:44.916773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:44.917910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.918812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 2e10e25a-81dc-4d94-9759-3ecaa31dee18] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.927935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.928447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.929012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.929786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.930705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.931329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.951404 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] HTTP exception thrown: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 HTTP/1.1 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '2e10e25a-81dc-4d94-9759-3ecaa31dee18'} Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.953501 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 404 to user: Instance 2e10e25a-81dc-4d94-9759-3ecaa31dee18 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99442c99-271a-47fd-bb8d-b10dad213311 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18" status: 404 len: 111 microversion: 2.1 time: 0.044587 Aug 23 10:48:44.959515 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1421/2931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:44 2022] GET /compute/v2.1/servers/2e10e25a-81dc-4d94-9759-3ecaa31dee18 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:44.983594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:44.984282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:44.991478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.991956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.992397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:44.993112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:44.994173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:44.994315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.173270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:45.181770 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abe0f26b-e9e9-4199-8eb7-46bd3a3effc3 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1473 microversion: 2.1 time: 0.212217 Aug 23 10:48:45.182703 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1422/2932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:44 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:45.187430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:45.187913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:45.195331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.195963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.196256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.196998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.197461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.197889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.322075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:45.334793 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28f11819-9a31-4dae-ad9c-f6efd1e982ba tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.502760 Aug 23 10:48:45.336010 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1511/2933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:45.341889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:45.342584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:45.350000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.350760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.351200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.351914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.352377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.352824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.396211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:45.405430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ae32042-9892-4dfd-b9ec-6ead0300f31c tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1521 microversion: 2.1 time: 0.221725 Aug 23 10:48:45.406228 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1423/2934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:45 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:45.412274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:45.412922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:45.424798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.424798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.424798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.424798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.424798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.433227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.695705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:45.706614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a370e5e-be5e-4119-90e0-4e20876bb4b3 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.299124 Aug 23 10:48:45.721890 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1424/2935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:45 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:45.727544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:45.732026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:45.742121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.742865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.743557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.744757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.745365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.746032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.887458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:45.900630 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9bc53409-ed37-466d-a77b-68f34cc6082b tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1675 microversion: 2.1 time: 0.563129 Aug 23 10:48:45.901296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1512/2936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:45 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1675 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:45.917108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9b747efc-79e3-48dc-8528-0706e2b8ed90 req-f2b74538-fd2a-4a45-97b2-0562e1a4c145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "name": "network-vif-deleted", "tag": "cc66fa78-76e9-43da-94d2-947dc3ccd8be"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:45.940780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9b747efc-79e3-48dc-8528-0706e2b8ed90 req-f2b74538-fd2a-4a45-97b2-0562e1a4c145 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:45.941478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9b747efc-79e3-48dc-8528-0706e2b8ed90 req-f2b74538-fd2a-4a45-97b2-0562e1a4c145 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:45.942082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9b747efc-79e3-48dc-8528-0706e2b8ed90 req-f2b74538-fd2a-4a45-97b2-0562e1a4c145 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:45.964276 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9b747efc-79e3-48dc-8528-0706e2b8ed90 req-f2b74538-fd2a-4a45-97b2-0562e1a4c145 service nova] Creating event network-vif-deleted:cc66fa78-76e9-43da-94d2-947dc3ccd8be for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:45.989949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9b747efc-79e3-48dc-8528-0706e2b8ed90 req-f2b74538-fd2a-4a45-97b2-0562e1a4c145 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087372 Aug 23 10:48:45.991122 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1513/2937] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:46.005989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:46.015183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17adbee5-85b7-4acc-a210-f4c2e1cf07f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.291908 Aug 23 10:48:46.015957 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1425/2938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:45 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:46.037745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:46.040571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:46.047082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.047735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.048421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.049681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.050318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.050937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.182266 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef88a863-84a1-4854-8af8-c2d4603ae0fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.149654 Aug 23 10:48:46.183924 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1514/2939] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:46 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:48:46.199117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:46.200015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:46.206103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:46.207085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:46.212753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.213338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.213847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.214625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.215149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.220005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.221398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.225086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.225830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.230036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.230433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.231314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.369235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:46.385790 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0cc61df4-b638-44a7-a9a9-8684f6d2adc2 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1431 microversion: 2.1 time: 0.186949 Aug 23 10:48:46.386385 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1515/2940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:46 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1431 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:46.432495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:46.433155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:46.443176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.443682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.444129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.452355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.452893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.453355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.599607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:46.617225 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12f198de-96a6-4a2e-85d0-356ed5469990 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1672 microversion: 2.1 time: 0.426406 Aug 23 10:48:46.636715 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1426/2941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:46 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1672 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:46.733918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:46.736554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:46.765674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:46.766419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.767297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.768219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.769354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.770767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.771381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.787846 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89f94fc8-6bc7-46e6-8240-b41c6bf02b0e tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1521 microversion: 2.1 time: 0.356078 Aug 23 10:48:46.791113 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1516/2942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:46 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:46.930617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:46.931229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:46.942615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.955699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.959549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:46.978251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:46.979208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:46.979878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.134411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:47.146898 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83b5257f-2b24-44f2-918f-a5ebea39afd9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1322 microversion: 2.1 time: 0.414099 Aug 23 10:48:47.161742 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1427/2943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:46 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:47.406373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:47.407802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:47.419933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.421371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.422136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.424330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.424866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.425311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.445294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:47.459856 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7cd724d5-ea90-4a1f-a63f-20325cca8902 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1496 microversion: 2.1 time: 0.535061 Aug 23 10:48:47.477159 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1517/2944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:46 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1496 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:47.497399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c1738b57-0794-42e7-9510-aa471782c95e req-5057c055-1e26-4362-95da-3d43f8a4636d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "name": "network-vif-unplugged", "status": "completed", "tag": "a566ffd6-3723-4cbe-a18a-7c4bd605d819"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:47.515702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c1738b57-0794-42e7-9510-aa471782c95e req-5057c055-1e26-4362-95da-3d43f8a4636d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.525025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c1738b57-0794-42e7-9510-aa471782c95e req-5057c055-1e26-4362-95da-3d43f8a4636d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.525560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c1738b57-0794-42e7-9510-aa471782c95e req-5057c055-1e26-4362-95da-3d43f8a4636d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.538041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.539645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.541678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.542492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lazy-loading 'fault' on Instance uuid c9681ff3-1da2-44b0-97bf-a8150364c2f1 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:47.551190 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c1738b57-0794-42e7-9510-aa471782c95e req-5057c055-1e26-4362-95da-3d43f8a4636d service nova] Creating event network-vif-unplugged:a566ffd6-3723-4cbe-a18a-7c4bd605d819 for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:47.565361 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c1738b57-0794-42e7-9510-aa471782c95e req-5057c055-1e26-4362-95da-3d43f8a4636d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070461 Aug 23 10:48:47.579337 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1518/2945] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:48:47.606348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:47.615108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9cabf4f1-e493-4036-accd-a794cede7545 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 200 len: 1308 microversion: 2.1 time: 0.212606 Aug 23 10:48:47.628787 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1428/2946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:47 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:47.640715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:47.642680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:47.659845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.660356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.661483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.662762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.663642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.667212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.815310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:47.816733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:47.834149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.838712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.839875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:47.848848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:47.849684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:47.850364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.069195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:48.079749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-970e9177-a672-4f32-a138-9300c2b871fc tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1521 microversion: 2.1 time: 0.269016 Aug 23 10:48:48.081407 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1429/2947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:47 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:48.086364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-95baaec7-b812-4baa-9500-4310c247b4a5 req-c092d2a8-26bc-49c1-b0ec-403b64d6bd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9681ff3-1da2-44b0-97bf-a8150364c2f1", "name": "network-vif-deleted", "tag": "e7a53fbb-1132-4ee6-99d6-efddacd5d957"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:48.099062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95baaec7-b812-4baa-9500-4310c247b4a5 req-c092d2a8-26bc-49c1-b0ec-403b64d6bd40 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.099677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95baaec7-b812-4baa-9500-4310c247b4a5 req-c092d2a8-26bc-49c1-b0ec-403b64d6bd40 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.100223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-95baaec7-b812-4baa-9500-4310c247b4a5 req-c092d2a8-26bc-49c1-b0ec-403b64d6bd40 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.114229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-95baaec7-b812-4baa-9500-4310c247b4a5 req-c092d2a8-26bc-49c1-b0ec-403b64d6bd40 service nova] Creating event network-vif-deleted:e7a53fbb-1132-4ee6-99d6-efddacd5d957 for instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 on n-h2-847009-13 Aug 23 10:48:48.121150 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-95baaec7-b812-4baa-9500-4310c247b4a5 req-c092d2a8-26bc-49c1-b0ec-403b64d6bd40 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038186 Aug 23 10:48:48.122721 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1430/2948] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:48.172569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:48.173474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:48.183612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.183612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.183924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.184575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.185521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.186053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.281122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:48.292764 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-842f9f9e-e8de-4a46-a0c6-da4b0f95851c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1672 microversion: 2.1 time: 0.656373 Aug 23 10:48:48.294470 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1519/2949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:47 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1672 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:48.395309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:48.412636 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99890283-9e59-499c-a3b8-3a36936c1428 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1471 microversion: 2.1 time: 0.246264 Aug 23 10:48:48.413738 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1431/2950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:48 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:48.434832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:48.435369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:48.441896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.442809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.443446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.444157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.444789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.445375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.472294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lazy-loading 'flavor' on Instance uuid ec352dda-b4b2-45f5-8671-bd6627827f6c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:48.500796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:48.502517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:48.515770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.516321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.516789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.524094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.525044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.525193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.607502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4831e92b-5a39-4e33-93b6-dacab2ca0a94 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c/action" status: 202 len: 0 microversion: 2.1 time: 0.174272 Aug 23 10:48:48.612268 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1520/2951] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:48 2022] POST /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:48:48.618430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:48.619653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:48.628257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.629057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.629661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.630537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.631142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.631727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.687853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:48.700432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-070f460c-e014-4fab-855b-76d569bcdfe3 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1454 microversion: 2.1 time: 0.212848 Aug 23 10:48:48.705528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1432/2952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:48 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1454 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:48.716991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:48.716991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: c9681ff3-1da2-44b0-97bf-a8150364c2f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:48.733067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.733717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.734545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.735344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.737244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.738361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.765016 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] HTTP exception thrown: Instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 could not be found. Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Request method failure captured: Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 HTTP/1.1 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_foucVkFqZC27yX1XDTSeeh0dvnWyOtek2SIqtp6Hg8m9o6tfqfIm66FXsP6WW0PS02mOrmex0he-MpvZcrMOj09bpdVnug1p78C_VQeQjUkzvMXuG5002NhN3aGsMUBbFh2FYDNOd3IJn-c5YDocQePfHgLHfDbsNRUtwenH7Bgo Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b08e0d2ea0914fdb8bc77193f1ffe659 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListImageFiltersTestJSON-1561725926 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b08e0d2ea0914fdb8bc77193f1ffe659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b08e0d2ea0914fdb8bc77193f1ffe659", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b08e0d2ea0914fdb8bc77193f1ffe659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b08e0d2ea0914fdb8bc77193f1ffe659"}]}] Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListImageFiltersTestJSON-1561725926 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b08e0d2ea0914fdb8bc77193f1ffe659 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1561725926 Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListImageFiltersTestJSON-1561725926-project Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d169ff5df3a64b94a10742bca2ace9de Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListImageFiltersTestJSON-1561725926-project Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 could not be found. Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'c9681ff3-1da2-44b0-97bf-a8150364c2f1'} Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 could not be found. Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 could not be found. Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:48.773185 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 could not be found. Aug 23 10:48:48.777903 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:48.779798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Returning 404 to user: Instance c9681ff3-1da2-44b0-97bf-a8150364c2f1 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:48.781340 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7598e9b3-9209-4fbf-b922-ccb0078371e7 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1" status: 404 len: 111 microversion: 2.1 time: 0.074812 Aug 23 10:48:48.782664 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1433/2953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:48 2022] GET /compute/v2.1/servers/c9681ff3-1da2-44b0-97bf-a8150364c2f1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:48.793046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:48.793843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:48.802835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.803558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.804159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.805125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:48.805732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:48.806319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:48.842835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:48.845041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:48.998569 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffe47d80-09e0-4812-a9be-ae4fadd6752b tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 204 len: 0 microversion: 2.1 time: 0.210928 Aug 23 10:48:48.999765 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1434/2954] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:48 2022] DELETE /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:49.013727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:49.015121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:49.017844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:49.027391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.028822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.029439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.030577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.031934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.032855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.324113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:49.335746 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28da7c12-9ba1-4655-9383-474441fdcb9c tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1473 microversion: 2.1 time: 0.329482 Aug 23 10:48:49.336552 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1435/2955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:49 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1473 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:49.343804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:49.344537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:49.367656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.368146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.368587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.377289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.378139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.378735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.567388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:49.592961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1ba98c7-479f-4de9-98f0-9333bd494be1 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1479 microversion: 2.1 time: 0.252762 Aug 23 10:48:49.602547 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1436/2956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:49 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1479 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:49.603273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f728bc7-16e1-402d-bfed-137caf0b440c tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1632 microversion: 2.1 time: 0.989371 Aug 23 10:48:49.604729 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1521/2957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:48 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1632 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:49.610121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:49.611546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:49.630839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-47961102-6162-48bf-9670-b5e05cf46713 req-d93b0546-3757-4d1b-a407-29d3c429232d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f1396f4-2e29-40ab-a2e5-9d003fdfc623", "name": "network-vif-deleted", "tag": "9fc11122-48f8-4e1c-a8fe-6aaf47bf126d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:49.635069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.635601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.636008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.643009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.643933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.644547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.662252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-47961102-6162-48bf-9670-b5e05cf46713 req-d93b0546-3757-4d1b-a407-29d3c429232d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.663023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-47961102-6162-48bf-9670-b5e05cf46713 req-d93b0546-3757-4d1b-a407-29d3c429232d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.663628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-47961102-6162-48bf-9670-b5e05cf46713 req-d93b0546-3757-4d1b-a407-29d3c429232d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.684317 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-47961102-6162-48bf-9670-b5e05cf46713 req-d93b0546-3757-4d1b-a407-29d3c429232d service nova] Creating event network-vif-deleted:9fc11122-48f8-4e1c-a8fe-6aaf47bf126d for instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 on n-h1-847009-13 Aug 23 10:48:49.709708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-47961102-6162-48bf-9670-b5e05cf46713 req-d93b0546-3757-4d1b-a407-29d3c429232d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082602 Aug 23 10:48:49.710611 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1522/2958] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:49.730339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:49.731605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:49.749594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.752454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.753333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.755065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:49.755925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:49.756507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:49.905996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:49.919460 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e62bb29d-2ef6-4b19-9499-fadd8107be83 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1297 microversion: 2.1 time: 0.191184 Aug 23 10:48:49.920587 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1523/2959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:49 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1297 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:49.942692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:49.955446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-060dbd6c-78d2-4ab2-b2d3-7a8c0cde7e6a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1672 microversion: 2.1 time: 0.350648 Aug 23 10:48:49.956997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1437/2960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:49 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1672 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:50.143562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca78158-2096-4917-b184-9b95f8ea809d", "name": "network-vif-deleted", "tag": "a566ffd6-3723-4cbe-a18a-7c4bd605d819"}, {"server_uuid": "efd3faf7-6fdb-4f61-adb9-42a59c6e468e", "name": "network-vif-deleted", "tag": "8496dec9-182b-4fcd-8e86-3c94916ad5b4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:50.160111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.160968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.161718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.181471 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] Creating event network-vif-deleted:a566ffd6-3723-4cbe-a18a-7c4bd605d819 for instance 6ca78158-2096-4917-b184-9b95f8ea809d on n-h2-847009-13 Aug 23 10:48:50.182817 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] Creating event network-vif-deleted:8496dec9-182b-4fcd-8e86-3c94916ad5b4 for instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e on n-h2-847009-13 Aug 23 10:48:50.190431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5f5244bc-bed6-477c-b182-f61424ad5cb3 req-76e98362-328e-4e4b-b049-07ada749f0bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051813 Aug 23 10:48:50.191537 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1524/2961] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:50.357697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:50.358879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:50.365405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.366454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.367473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.368445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.369282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.369878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.579424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:50.589062 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5da44771-167d-4162-900c-84a2cf04416e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1473 microversion: 2.1 time: 0.235668 Aug 23 10:48:50.590181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1438/2962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:50 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1473 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:50.624572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:50.626430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:50.634185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:50.634868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:50.648340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.651850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.652929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.654830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.657884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.659443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.664562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.666188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.667708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.671927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.673755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.676320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.774410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.775237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.775912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.776566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lazy-loading 'fault' on Instance uuid 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:50.873501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:50.885877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d04ac48-fb1e-490a-a0a3-1cf089545f90 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 200 len: 1313 microversion: 2.1 time: 0.264603 Aug 23 10:48:50.887120 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1439/2963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:50 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:50.946826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:50.948227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:50.968932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:50.976543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.978494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.979125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:50.981879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:50.983295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:50.991208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.155024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:51.167255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-489d2176-4b0d-4c7d-8d6c-c10120c9bb7e tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1297 microversion: 2.1 time: 0.225288 Aug 23 10:48:51.168371 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1440/2964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:50 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1297 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:51.174903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:51.176041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:51.185344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.186126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.186823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.188694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.203366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19289afa-38d1-4962-9e30-85be810fe1dc tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1615 microversion: 2.1 time: 0.582530 Aug 23 10:48:51.216485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.216485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.222199 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1525/2965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:50 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1615 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:51.255316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:51.256507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:51.273998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.274712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.275271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.276609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.277226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.277804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.392547 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] HTTP exception thrown: Cannot 'migrate' instance ec352dda-b4b2-45f5-8671-bd6627827f6c while it is in vm_state suspended Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Request method failure captured: Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c/action HTTP/1.1 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 15 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBIcnYfCrwVBYKPjLHyV_HJw3ONDHOgX8AGjqLo--EJTKs0vy4nPGqQ587tjH-lp8P71psE2KkhRCFavv-vrRFdMDMw5aacT2Bjyq4myK5qRohSsSJwnxIIpsTUpMcPj7P0Cyh3Puf9NNqsTbXwF5KwEt14a0lsu29iRUJcBZipxk0 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e2d64b547b54bce8cd3d98492d2595f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}] Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9efe86ae4aec4b7ea99bd823f0f6f6c1 Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: {"migrate": {}} Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'migrate' instance ec352dda-b4b2-45f5-8671-bd6627827f6c while it is in vm_state suspended Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ec352dda-b4b2-45f5-8671-bd6627827f6c', 'body': {'migrate': {}}} Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c in vm_state suspended. Cannot resize while the instance is in this state. Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:51.395160 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance ec352dda-b4b2-45f5-8671-bd6627827f6c while it is in vm_state suspended Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance ec352dda-b4b2-45f5-8671-bd6627827f6c while it is in vm_state suspended Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Returning 409 to user: Cannot 'migrate' instance ec352dda-b4b2-45f5-8671-bd6627827f6c while it is in vm_state suspended {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8063b903-4d49-41b5-b873-23150b9ca17f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c/action" status: 409 len: 148 microversion: 2.1 time: 0.163771 Aug 23 10:48:51.405902 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1526/2966] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:51 2022] POST /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c/action => generated 148 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:48:51.412465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2fe4ff1-a2e3-4c99-9b85-e8b7f5a3acc3 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2fe4ff1-a2e3-4c99-9b85-e8b7f5a3acc3 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Request method failure captured: Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c/action HTTP/1.1 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 39 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBIcnYfCrwVBYKPjLHyV_HJw3ONDHOgX8AGjqLo--EJTKs0vy4nPGqQ587tjH-lp8P71psE2KkhRCFavv-vrRFdMDMw5aacT2Bjyq4myK5qRohSsSJwnxIIpsTUpMcPj7P0Cyh3Puf9NNqsTbXwF5KwEt14a0lsu29iRUJcBZipxk0 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e2d64b547b54bce8cd3d98492d2595f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}] Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9efe86ae4aec4b7ea99bd823f0f6f6c1 Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: {"os-resetState": {"state": "invalid"}} Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:48:51.416709 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2fe4ff1-a2e3-4c99-9b85-e8b7f5a3acc3 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2fe4ff1-a2e3-4c99-9b85-e8b7f5a3acc3 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c/action" status: 400 len: 144 microversion: 2.1 time: 0.011058 Aug 23 10:48:51.420945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1527/2967] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:51 2022] POST /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c/action => generated 144 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:48:51.470584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1c9b2af-ca4b-41c7-b04c-12a045d06242 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1c9b2af-ca4b-41c7-b04c-12a045d06242 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Request method failure captured: Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c/action HTTP/1.1 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 31 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBIcnYfCrwVBYKPjLHyV_HJw3ONDHOgX8AGjqLo--EJTKs0vy4nPGqQ587tjH-lp8P71psE2KkhRCFavv-vrRFdMDMw5aacT2Bjyq4myK5qRohSsSJwnxIIpsTUpMcPj7P0Cyh3Puf9NNqsTbXwF5KwEt14a0lsu29iRUJcBZipxk0 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e2d64b547b54bce8cd3d98492d2595f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}] Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9efe86ae4aec4b7ea99bd823f0f6f6c1 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: {"os-resetState": {"state": 1}} Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c', 'body': {'os-resetState': {'state': 1}}} Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 1 Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 23 10:48:51.490452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1c9b2af-ca4b-41c7-b04c-12a045d06242 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:51.495333 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1c9b2af-ca4b-41c7-b04c-12a045d06242 tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c/action" status: 400 len: 120 microversion: 2.1 time: 0.067668 Aug 23 10:48:51.497919 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1528/2968] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:51 2022] POST /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c/action => generated 120 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:48:51.515280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7db170d8-aa63-4fcb-97d4-e2172b92278f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:51.521579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7db170d8-aa63-4fcb-97d4-e2172b92278f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Failed to fetch instance by id 999 {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:48:51.523933 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7db170d8-aa63-4fcb-97d4-e2172b92278f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7db170d8-aa63-4fcb-97d4-e2172b92278f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Request method failure captured: Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 37 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBIcnYfCrwVBYKPjLHyV_HJw3ONDHOgX8AGjqLo--EJTKs0vy4nPGqQ587tjH-lp8P71psE2KkhRCFavv-vrRFdMDMw5aacT2Bjyq4myK5qRohSsSJwnxIIpsTUpMcPj7P0Cyh3Puf9NNqsTbXwF5KwEt14a0lsu29iRUJcBZipxk0 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0e2d64b547b54bce8cd3d98492d2595f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0e2d64b547b54bce8cd3d98492d2595f"}]}] Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0e2d64b547b54bce8cd3d98492d2595f Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1857960692 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9efe86ae4aec4b7ea99bd823f0f6f6c1 Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1857960692-project-admin Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: {"os-resetState": {"state": "error"}} Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 999 could not be found. Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:51.535292 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:51.539733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:51.539733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 23 10:48:51.539733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:51.539733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7db170d8-aa63-4fcb-97d4-e2172b92278f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:51.539733 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7db170d8-aa63-4fcb-97d4-e2172b92278f tempest-ServersAdminNegativeTestJSON-1857960692 tempest-ServersAdminNegativeTestJSON-1857960692-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.029588 Aug 23 10:48:51.544836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1529/2969] 10.222.0.78 () {60 vars in 1179 bytes} [Tue Aug 23 10:48:51 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:48:51.556687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:51.565027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:51.589071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.591666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.594748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.597811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.601624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.602334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.660350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:51.706701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:51.788808 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e41e5f94-eda4-4c67-b18e-a7fb5d703a9a tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 204 len: 0 microversion: 2.1 time: 0.238618 Aug 23 10:48:51.790001 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1530/2970] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:51 2022] DELETE /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:51.801988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:51.803483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:51.811679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:51.818411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.819091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.819674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.820783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.821537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.822909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.829707 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4812b58-c4ed-454a-842a-d58941789859 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1672 microversion: 2.1 time: 0.656329 Aug 23 10:48:51.843498 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1441/2971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:51 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1672 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:51.858159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:51.862165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:51.870708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.871521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.872388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:51.873147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:51.874297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:51.874897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.071619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:52.082223 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7e71245-843f-4032-93a2-084df9d879c1 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1473 microversion: 2.1 time: 0.288769 Aug 23 10:48:52.097325 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1531/2972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:51 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:52.102759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:52.103386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: 9f1396f4-2e29-40ab-a2e5-9d003fdfc623] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:52.122637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.123680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.124221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.125807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.129199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.130871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.151577 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] HTTP exception thrown: Instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 could not be found. Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 HTTP/1.1 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 could not be found. Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9f1396f4-2e29-40ab-a2e5-9d003fdfc623'} Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 could not be found. Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 could not be found. Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:52.153436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 could not be found. Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 404 to user: Instance 9f1396f4-2e29-40ab-a2e5-9d003fdfc623 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:52.159659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c3a2fca-0ce4-45f5-9a43-3d0cf98a3f14 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623" status: 404 len: 111 microversion: 2.1 time: 0.056006 Aug 23 10:48:52.161698 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1532/2973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:52 2022] GET /compute/v2.1/servers/9f1396f4-2e29-40ab-a2e5-9d003fdfc623 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:52.166589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:52.167543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:52.177134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.177726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.178367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.179152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.179307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:52.179909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.180521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.201519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23b76e2f-d235-425f-bfab-0ed8034798dc tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1468 microversion: 2.1 time: 0.349326 Aug 23 10:48:52.202498 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1442/2974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:51 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1468 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:52.212673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:52.213353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:52.232935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.233445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.234353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.248595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.255723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.257710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.337413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.345496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.346413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.352327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lazy-loading 'fault' on Instance uuid efd3faf7-6fdb-4f61-adb9-42a59c6e468e {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:52.432959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.433795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.434435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.435181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lazy-loading 'fault' on Instance uuid 6ca78158-2096-4917-b184-9b95f8ea809d {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:52.497695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bea2324e2b4416e9f39c0e47b2ce15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4672980399e34e3d94dd82f7c375e2e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:52.509331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ab419a5b2d4cc0b6d56cc268bc2d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f0c7aa2fac4f6bba7f101521460c0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:52.534922 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b1c0db0-1f0f-45ad-9ab8-ea754fc006c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 200 len: 1302 microversion: 2.1 time: 0.325153 Aug 23 10:48:52.536318 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1443/2975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:52 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 1302 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:52.539901 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48cad11e-0d67-4906-ae55-baf3ebeb7678 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 200 len: 1313 microversion: 2.1 time: 0.375907 Aug 23 10:48:52.550865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1533/2976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:52 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:52.660954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d0d7be8c-0a63-4ba9-b933-d3d504d213f2 req-897d4fcb-c3bc-4668-a27d-4b8756450dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831fba09-82b8-4491-926a-23dea171108f", "name": "network-vif-deleted", "tag": "daea525c-3cc0-411b-bed6-bc0d1d443e23"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:52.673931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d0d7be8c-0a63-4ba9-b933-d3d504d213f2 req-897d4fcb-c3bc-4668-a27d-4b8756450dc8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.674815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d0d7be8c-0a63-4ba9-b933-d3d504d213f2 req-897d4fcb-c3bc-4668-a27d-4b8756450dc8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.675591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d0d7be8c-0a63-4ba9-b933-d3d504d213f2 req-897d4fcb-c3bc-4668-a27d-4b8756450dc8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.688224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d0d7be8c-0a63-4ba9-b933-d3d504d213f2 req-897d4fcb-c3bc-4668-a27d-4b8756450dc8 service nova] Creating event network-vif-deleted:daea525c-3cc0-411b-bed6-bc0d1d443e23 for instance 831fba09-82b8-4491-926a-23dea171108f on n-h2-847009-13 Aug 23 10:48:52.693370 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d0d7be8c-0a63-4ba9-b933-d3d504d213f2 req-897d4fcb-c3bc-4668-a27d-4b8756450dc8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037223 Aug 23 10:48:52.697849 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1444/2977] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:52.857807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:52.858588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:52.882214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.882702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.886587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:52.890060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:52.891988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:52.892453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.107652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:53.108860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:53.124648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:53.129948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.133333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.133990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.135085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.135860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.137815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.213076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:53.227157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.229542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e225d45d-0d3f-4318-b80b-c12e4c7a4486 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1677 microversion: 2.1 time: 0.372637 Aug 23 10:48:53.248032 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1534/2978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:52 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1677 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:53.248731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.249318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.249791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lazy-loading 'fault' on Instance uuid 831fba09-82b8-4491-926a-23dea171108f {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:48:53.256287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:53.256959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:53.273800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.274295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.274740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.275456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.275912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.276335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.342060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd169ff5df3a64b94a10742bca2ace9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b08e0d2ea0914fdb8bc77193f1ffe659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:53.358309 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca010665-ac02-4dfb-b47f-016b9d05933f tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 200 len: 1308 microversion: 2.1 time: 0.258317 Aug 23 10:48:53.359183 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1445/2979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:53 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:53.543379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:53.566333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:53.567170 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1d329e8-c7cb-464f-8041-2b15a086b8f2 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1468 microversion: 2.1 time: 0.316617 Aug 23 10:48:53.567291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:53.568121 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1535/2980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:53 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:53.576395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.576611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:53.577504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] [instance: efd3faf7-6fdb-4f61-adb9-42a59c6e468e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:53.577618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.578006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.579974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.581033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.581882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.585836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.586305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.586799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.587812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:53.588271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:53.588729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:53.600597 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] HTTP exception thrown: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Request method failure captured: Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d HTTP/1.1 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_51e16FPEBDS16bM92eKMc2Tq4OMPGfoCpCLC_K7vWmQYcD6c5UI2IcbLsQXpak3Txiofd-Luo56Q-M0wu8lcINHMG38qCy8IpJ2xr6T9NhL3bZF_Jm1kRYCDi28fBi3ykSnnmp5Q53_E1PblhV9Map5JWWxqloIBcGYvNQYzb4ik Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4672980399e34e3d94dd82f7c375e2e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}] Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestMultiNic-1244710478 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 7bea2324e2b4416e9f39c0e47b2ce15d Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6ca78158-2096-4917-b184-9b95f8ea809d'} Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:53.602520 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Returning 404 to user: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:53.607212 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-554a4b58-eb9e-40f0-8162-5b37936f3ee7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 404 len: 111 microversion: 2.1 time: 0.046378 Aug 23 10:48:53.607773 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] HTTP exception thrown: Instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e could not be found. Aug 23 10:48:53.607854 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1446/2981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:53 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Request method failure captured: Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e HTTP/1.1 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBPqQ5YUnAONvvVXauud0VCk7EBJwDd3QXtWiDOBrkSZHMPw67GgsNqO4bmODP57I7CqU7jbyLIAfmJvR2_K49hlOwDOosNjKoqYcJwqS9l_E5IJq0vy0jteQgKCrb41EhswVkrC5okb22FbRatuEbtF1gaZC8cmL0Y-MUIlEYTw0E Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_77f0c7aa2fac4f6bba7f101521460c0d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/77f0c7aa2fac4f6bba7f101521460c0d"}]}] Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 77f0c7aa2fac4f6bba7f101521460c0d Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-558505119 Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 50ab419a5b2d4cc0b6d56cc268bc2d0a Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ListServersNegativeTestJSON-558505119-project Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e could not be found. Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'efd3faf7-6fdb-4f61-adb9-42a59c6e468e'} Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e could not be found. Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e could not be found. Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.607928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e could not be found. Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] Returning 404 to user: Instance efd3faf7-6fdb-4f61-adb9-42a59c6e468e could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f71cf91f-10f3-4f51-939e-0ec9fe04a552 tempest-ListServersNegativeTestJSON-558505119 tempest-ListServersNegativeTestJSON-558505119-project] 10.222.0.78 "GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e" status: 404 len: 111 microversion: 2.1 time: 0.039772 Aug 23 10:48:53.617026 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1536/2982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:53 2022] GET /compute/v2.1/servers/efd3faf7-6fdb-4f61-adb9-42a59c6e468e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:54.252007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:54.256225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:54.271486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:54.282791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:54.283429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:54.290881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:54.291631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:54.295076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:54.309621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:54.383068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:54.386189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] [instance: 831fba09-82b8-4491-926a-23dea171108f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:54.396785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:54.397296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:54.397745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:54.398899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:54.399061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:54.399433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:54.438123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] HTTP exception thrown: Instance 831fba09-82b8-4491-926a-23dea171108f could not be found. Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Request method failure captured: Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f HTTP/1.1 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_foucVkFqZC27yX1XDTSeeh0dvnWyOtek2SIqtp6Hg8m9o6tfqfIm66FXsP6WW0PS02mOrmex0he-MpvZcrMOj09bpdVnug1p78C_VQeQjUkzvMXuG5002NhN3aGsMUBbFh2FYDNOd3IJn-c5YDocQePfHgLHfDbsNRUtwenH7Bgo Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b08e0d2ea0914fdb8bc77193f1ffe659 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ListImageFiltersTestJSON-1561725926 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b08e0d2ea0914fdb8bc77193f1ffe659"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b08e0d2ea0914fdb8bc77193f1ffe659", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b08e0d2ea0914fdb8bc77193f1ffe659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b08e0d2ea0914fdb8bc77193f1ffe659"}]}] Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ListImageFiltersTestJSON-1561725926 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b08e0d2ea0914fdb8bc77193f1ffe659 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1561725926 Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ListImageFiltersTestJSON-1561725926-project Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: d169ff5df3a64b94a10742bca2ace9de Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ListImageFiltersTestJSON-1561725926-project Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 831fba09-82b8-4491-926a-23dea171108f could not be found. Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '831fba09-82b8-4491-926a-23dea171108f'} Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831fba09-82b8-4491-926a-23dea171108f could not be found. Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831fba09-82b8-4491-926a-23dea171108f could not be found. Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:54.439180 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831fba09-82b8-4491-926a-23dea171108f could not be found. Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Returning 404 to user: Instance 831fba09-82b8-4491-926a-23dea171108f could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7e3a8e1-7bd4-42dd-bc1f-83a99ca9c518 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f" status: 404 len: 111 microversion: 2.1 time: 0.061534 Aug 23 10:48:54.443022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1537/2983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:54 2022] GET /compute/v2.1/servers/831fba09-82b8-4491-926a-23dea171108f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:48:54.456395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-853d16de-16d2-4121-ae6f-6b6f9ee1b936 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9cb214c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:54.887900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:54.898561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f93d5764-7097-4855-b311-48033a40bc0a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.651768 Aug 23 10:48:54.899452 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1447/2984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:54 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:54.907483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:54.908150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:54.926463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:54.926959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:54.927402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:54.928119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:54.928575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:54.933874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:54.979609 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-853d16de-16d2-4121-ae6f-6b6f9ee1b936 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/images/efca15b7-3b0d-4108-a7a5-eb1db2fb6277" status: 204 len: 0 microversion: 2.1 time: 0.533670 Aug 23 10:48:54.980488 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1538/2985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:54 2022] DELETE /compute/v2.1/images/efca15b7-3b0d-4108-a7a5-eb1db2fb6277 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:54.994380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:55.002418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:55.021784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:55.023123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:55.023822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:55.024853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:55.025928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:55.027886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:55.145304 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44397c37-6063-47cb-ab3f-9627fbd63a5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 200 len: 324 microversion: 2.1 time: 0.149633 Aug 23 10:48:55.146730 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1539/2986] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:48:54 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:55.155334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-811f3af9-7eab-4676-ba26-44509922681e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9d23db80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:55.220145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:55.232999 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ec9b0b1-bd81-4493-b04b-71aadfc55c51 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1468 microversion: 2.1 time: 0.332470 Aug 23 10:48:55.233584 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1448/2987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:54 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:55.243035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:55.243909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:55.256601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:55.257225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:55.257578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:55.261246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:55.261962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:55.264782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:55.516619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:55.525247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2990748b-d0fb-41bf-8f21-cfa1857e4aa5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.290608 Aug 23 10:48:55.529060 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1449/2988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:55 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:55.555999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:55.556618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:55.565763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:55.567067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:55.568122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:55.570224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:55.571162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:55.573525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:55.580784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:48:55.755635 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-811f3af9-7eab-4676-ba26-44509922681e tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/images/abc78397-c87d-4b15-9c92-b7424c3cd444" status: 204 len: 0 microversion: 2.1 time: 0.607287 Aug 23 10:48:55.757192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1540/2989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:55 2022] DELETE /compute/v2.1/images/abc78397-c87d-4b15-9c92-b7424c3cd444 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:55.781703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04379f5c-6fd6-4012-b260-559349007355 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] Calling method '.version_select at 0x7fdc9c0210d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:56.016867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:56.028635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d519713-2c93-4682-a8ce-ad782d816d54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.476312 Aug 23 10:48:56.049376 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1450/2990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:55 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:56.064330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:56.065222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:56.077192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.077694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.079135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.080169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.080829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.081416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.481824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:56.501581 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55425324-d72d-41b8-9002-bcb968adf356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.449558 Aug 23 10:48:56.502226 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1451/2991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:56 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:56.523914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:56.530342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:56.560722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.565528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.566765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.569957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.572492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.576321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.635271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04379f5c-6fd6-4012-b260-559349007355 tempest-ListImageFiltersTestJSON-1561725926 tempest-ListImageFiltersTestJSON-1561725926-project] 10.222.0.78 "DELETE /compute/v2.1/images/f4951779-8f23-4afc-9326-ea736e0d8cb9" status: 204 len: 0 microversion: 2.1 time: 0.872513 Aug 23 10:48:56.636038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1541/2992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:55 2022] DELETE /compute/v2.1/images/f4951779-8f23-4afc-9326-ea736e0d8cb9 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:48:56.649236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:56.654253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:56.691589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.692850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.698503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.709119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.709737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.710197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.865017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:56.876794 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41ee778c-a35c-40da-8713-8f84ae5c5e92 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 200 len: 1426 microversion: 2.1 time: 0.363781 Aug 23 10:48:56.882955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1452/2993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:56 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 1426 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:56.894332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-be85baf1-989b-40e5-89b9-a4f17d9f0402 req-7d237429-6afa-451c-bf06-c36084044f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec352dda-b4b2-45f5-8671-bd6627827f6c", "name": "network-vif-deleted", "tag": "b4ce707e-2107-43ba-a55e-531aa974e49c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:56.917541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-be85baf1-989b-40e5-89b9-a4f17d9f0402 req-7d237429-6afa-451c-bf06-c36084044f87 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:56.920938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-be85baf1-989b-40e5-89b9-a4f17d9f0402 req-7d237429-6afa-451c-bf06-c36084044f87 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:56.921609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-be85baf1-989b-40e5-89b9-a4f17d9f0402 req-7d237429-6afa-451c-bf06-c36084044f87 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:56.948686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-be85baf1-989b-40e5-89b9-a4f17d9f0402 req-7d237429-6afa-451c-bf06-c36084044f87 service nova] Creating event network-vif-deleted:b4ce707e-2107-43ba-a55e-531aa974e49c for instance ec352dda-b4b2-45f5-8671-bd6627827f6c on n-h1-847009-13 Aug 23 10:48:56.961643 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-be85baf1-989b-40e5-89b9-a4f17d9f0402 req-7d237429-6afa-451c-bf06-c36084044f87 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075789 Aug 23 10:48:56.965657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1453/2994] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:48:57.217746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:57.232226 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c609b323-9cea-454a-849c-c6327a91a810 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.594798 Aug 23 10:48:57.233684 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1542/2995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:56 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:48:57.417246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1402081813", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "1c5fdc6a-1777-4c61-b011-ad5f4ef33812"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:48:57.523416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] validate_networks() for [('1c5fdc6a-1777-4c61-b011-ad5f4ef33812', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:48:57.906289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:57.908348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: ec352dda-b4b2-45f5-8671-bd6627827f6c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:57.920662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:57.926289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:57.928871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:57.935289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:57.936045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:57.936716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:58.000271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] HTTP exception thrown: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c could not be found. Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Request method failure captured: Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c HTTP/1.1 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBGyywwPJhGwTSYs9yAsO0RfgJGSYkzweal6A4iFPsw5F03dMuiJTImGHWTYK5Bg5NCB1PDvvaMtg60TUhhcXIS0brj7FJWrL8fVEJCa24XFZh3MVz6BlU-MqshcgzAe2FV39sTvU6-hZl0SYmDCKMcUgu2Lc518kht5Kzkb251sEk Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 2561ce8d69dd447cb108ed8fb9e8bf7d Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1573465145 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2561ce8d69dd447cb108ed8fb9e8bf7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2561ce8d69dd447cb108ed8fb9e8bf7d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2561ce8d69dd447cb108ed8fb9e8bf7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2561ce8d69dd447cb108ed8fb9e8bf7d"}]}] Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1573465145 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 2561ce8d69dd447cb108ed8fb9e8bf7d Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1573465145 Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-1573465145-project Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 670582f204b54a0a97fa7f14c315801e Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1573465145-project Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c could not be found. Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ec352dda-b4b2-45f5-8671-bd6627827f6c'} Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c could not be found. Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c could not be found. Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:58.003478 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c could not be found. Aug 23 10:48:58.007382 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:48:58.022751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Returning 404 to user: Instance ec352dda-b4b2-45f5-8671-bd6627827f6c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:48:58.025659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efcd8c81-91a8-4f96-a497-5757f9662ed9 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c" status: 404 len: 111 microversion: 2.1 time: 0.123875 Aug 23 10:48:58.029877 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1543/2996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:57 2022] GET /compute/v2.1/servers/ec352dda-b4b2-45f5-8671-bd6627827f6c => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:48:58.041588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:58.042217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:58.052492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:58.053879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:58.054671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:58.055526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:58.056126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:58.056974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:58.132615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:48:58.316305 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fdd53a70-07ce-4ce3-8574-9da8edee22d4 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 204 len: 0 microversion: 2.1 time: 0.281549 Aug 23 10:48:58.317035 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1544/2997] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:48:58 2022] DELETE /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:48:58.334604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:58.335502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:58.349096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:58.349591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:58.350024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:58.350731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:58.351186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:58.351606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:58.779729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:48:58.792965 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82cab1dc-58de-4317-9a69-82e6aba0004e tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1477 microversion: 2.1 time: 0.471494 Aug 23 10:48:58.796599 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1545/2998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:58 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1477 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:48:59.817700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:48:59.818464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:48:59.851216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:59.852017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:59.861066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:48:59.861066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:48:59.861066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:48:59.861066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:00.140006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:00.142064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:00.142821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:00.143445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:00.144049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:00.160557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:00.163527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:00.165156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:00.168843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:00.169835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:00.170521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:00.241615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:00.251879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for user ca80ea2c8904468d9e6944fc274afdb8 and project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:00.281596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:00.285466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:00.401714 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-661f573b-6be8-4bec-842d-bcb6e51e36b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.988991 Aug 23 10:49:00.409118 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1454/2999] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:49:00.419247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b8adbe7-efda-403d-a2e8-190492e0cac3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:00.422163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b8adbe7-efda-403d-a2e8-190492e0cac3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:00.716998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b8adbe7-efda-403d-a2e8-190492e0cac3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:00.727380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b8adbe7-efda-403d-a2e8-190492e0cac3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1215 microversion: 2.1 time: 0.314254 Aug 23 10:49:00.732992 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1455/3000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:00 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:00.753222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:00.753745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:00.783501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:00.784018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:00.784471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:00.792933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:00.793459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:00.793911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:00.860952 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] HTTP exception thrown: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Request method failure captured: Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d HTTP/1.1 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK_51e16FPEBDS16bM92eKMc2Tq4OMPGfoCpCLC_K7vWmQYcD6c5UI2IcbLsQXpak3Txiofd-Luo56Q-M0wu8lcINHMG38qCy8IpJ2xr6T9NhL3bZF_Jm1kRYCDi28fBi3ykSnnmp5Q53_E1PblhV9Map5JWWxqloIBcGYvNQYzb4ik Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4672980399e34e3d94dd82f7c375e2e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}] Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 7bea2324e2b4416e9f39c0e47b2ce15d Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6ca78158-2096-4917-b184-9b95f8ea809d'} Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:00.874799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:00.879922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Returning 404 to user: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:00.882854 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28660019-0aac-4946-bdfd-5caf58cd1006 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 404 len: 111 microversion: 2.1 time: 0.145068 Aug 23 10:49:00.883589 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1456/3001] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:49:00 2022] DELETE /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:01.063498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:01.076307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-405c566d-36c0-40f1-827e-570f1f35aed1 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1477 microversion: 2.1 time: 1.264399 Aug 23 10:49:01.089674 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1546/3002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:48:59 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1477 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:01.102656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:01.103527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: 6ca78158-2096-4917-b184-9b95f8ea809d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:01.111335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.112067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.112714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.113650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.114267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.114864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.136635 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] HTTP exception thrown: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Request method failure captured: Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d HTTP/1.1 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_51e16FPEBDS16bM92eKMc2Tq4OMPGfoCpCLC_K7vWmQYcD6c5UI2IcbLsQXpak3Txiofd-Luo56Q-M0wu8lcINHMG38qCy8IpJ2xr6T9NhL3bZF_Jm1kRYCDi28fBi3ykSnnmp5Q53_E1PblhV9Map5JWWxqloIBcGYvNQYzb4ik Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4672980399e34e3d94dd82f7c375e2e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}] Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7bea2324e2b4416e9f39c0e47b2ce15d Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6ca78158-2096-4917-b184-9b95f8ea809d'} Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:01.139293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. Aug 23 10:49:01.144090 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.146050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Returning 404 to user: Instance 6ca78158-2096-4917-b184-9b95f8ea809d could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:01.147141 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43872509-1883-45b0-85f0-d0d0fd9ce2bf tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d" status: 404 len: 111 microversion: 2.1 time: 0.051673 Aug 23 10:49:01.148221 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1547/3003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:01 2022] GET /compute/v2.1/servers/6ca78158-2096-4917-b184-9b95f8ea809d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:01.157853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:01.159131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:01.169384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.170220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.170863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.172283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.173307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.174587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.196126 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] HTTP exception thrown: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Request method failure captured: Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c HTTP/1.1 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_51e16FPEBDS16bM92eKMc2Tq4OMPGfoCpCLC_K7vWmQYcD6c5UI2IcbLsQXpak3Txiofd-Luo56Q-M0wu8lcINHMG38qCy8IpJ2xr6T9NhL3bZF_Jm1kRYCDi28fBi3ykSnnmp5Q53_E1PblhV9Map5JWWxqloIBcGYvNQYzb4ik Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4672980399e34e3d94dd82f7c375e2e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}] Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7bea2324e2b4416e9f39c0e47b2ce15d Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c'} Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:01.199196 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.202977 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.213837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Returning 404 to user: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:01.214726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3aa55062-199f-4c8c-9a91-e15cf38148da tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 404 len: 111 microversion: 2.1 time: 0.062612 Aug 23 10:49:01.215313 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1548/3004] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:49:01 2022] DELETE /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:01.224031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:01.224695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] [instance: c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:01.245329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5401e147-00e1-49c9-83f3-f9fb026b85ec tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Action: 'create', calling method: .version_select at 0x7fdc9c112790>, body: {"keypair": {"name": "tempest-keypair-2089458465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJPAU2cHWULY+oj5CSXOxE14BZxUQ3YL5PWD1eyTP//h1unnXfYGUgoRuVQT4galc2XUHP+SsEflEjJ38S5xUpC7OWGu5leWnyBZE5SKOADaBwpfLGQH5/gJVNH2H7GZQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:01.245832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.245938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.246389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.247060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.247525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.247946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.270929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] HTTP exception thrown: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Request method failure captured: Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c HTTP/1.1 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK_51e16FPEBDS16bM92eKMc2Tq4OMPGfoCpCLC_K7vWmQYcD6c5UI2IcbLsQXpak3Txiofd-Luo56Q-M0wu8lcINHMG38qCy8IpJ2xr6T9NhL3bZF_Jm1kRYCDi28fBi3ykSnnmp5Q53_E1PblhV9Map5JWWxqloIBcGYvNQYzb4ik Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4672980399e34e3d94dd82f7c375e2e5", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4672980399e34e3d94dd82f7c375e2e5"}]}] Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4672980399e34e3d94dd82f7c375e2e5 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestMultiNic-1244710478 Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7bea2324e2b4416e9f39c0e47b2ce15d Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestMultiNic-1244710478-project Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c'} Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:01.272475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] Returning 404 to user: Instance c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c0e0610-2514-4ee2-ae76-69bbe50354c7 tempest-ServersTestMultiNic-1244710478 tempest-ServersTestMultiNic-1244710478-project] 10.222.0.78 "GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c" status: 404 len: 111 microversion: 2.1 time: 0.055975 Aug 23 10:49:01.277065 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1549/3005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:01 2022] GET /compute/v2.1/servers/c1bbe1fb-e9ef-4e29-90d7-6f6e7f4c153c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:01.295171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5401e147-00e1-49c9-83f3-f9fb026b85ec tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:01.302235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5401e147-00e1-49c9-83f3-f9fb026b85ec tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for user bf56dcdf3dc84f798aacb80b862a4bda and project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:01.370120 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5401e147-00e1-49c9-83f3-f9fb026b85ec tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.481841 Aug 23 10:49:01.377609 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1457/3006] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:01.382820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba94ab41-c86a-4a2e-aa34-6263a2a257ae tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9c2583a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:01.404178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba94ab41-c86a-4a2e-aa34-6263a2a257ae tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-2089458465" status: 200 len: 498 microversion: 2.1 time: 0.025472 Aug 23 10:49:01.404783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1550/3007] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:49:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2089458465 => generated 498 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:01.417342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3dd4b90-d7dc-4f06-9a33-9a0abb5660c6 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9c0c8f70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:01.465316 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3dd4b90-d7dc-4f06-9a33-9a0abb5660c6 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089458465" status: 202 len: 0 microversion: 2.1 time: 0.051664 Aug 23 10:49:01.465876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1458/3008] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089458465 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:01.479859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d06d66cb-a1a0-46a9-89a9-e7d8fbc92538 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Action: 'create', calling method: .version_select at 0x7fdc9c099700>, body: {"keypair": {"name": "tempest-keypair-1982492609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdfdt6PIC9zBy72zqTwwF5pfc66wFShOee2i2jL+rohOa8qCrKLrbQ2kceMTn0pwKS5IPkKPzvqVlDofeFGSMIi2unEE5Aj2neixaQ1vhh6X1ZKyMoiPcZuf4lxpv0mvQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:01.500463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:01.521185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d06d66cb-a1a0-46a9-89a9-e7d8fbc92538 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:01.528206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d06d66cb-a1a0-46a9-89a9-e7d8fbc92538 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for user bf56dcdf3dc84f798aacb80b862a4bda and project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:01.558277 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d06d66cb-a1a0-46a9-89a9-e7d8fbc92538 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 10:49:01.748481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:01.749151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:01.761098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.761601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.762049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:01.762776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:01.768381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:01.769058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:02.022527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:02.038151 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f437318d-794a-45bb-9998-e8e3833e008d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1267 microversion: 2.1 time: 0.294534 Aug 23 10:49:02.047958 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1459/3009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:01 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1267 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:02.101773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:02.102393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:02.115424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:02.115931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:02.116385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:02.117130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:02.117594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:02.118029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:02.446533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:02.474035 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cd79189-fece-43f4-aa44-16a9ec73d55f tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1477 microversion: 2.1 time: 0.374738 Aug 23 10:49:02.477992 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1460/3010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:02 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:02.573210 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-d06d66cb-a1a0-46a9-89a9-e7d8fbc92538 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51934. Aug 23 10:49:02.615421 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d06d66cb-a1a0-46a9-89a9-e7d8fbc92538 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.140354 Aug 23 10:49:02.616980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1551/3011] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:02.630518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8017ba01-44d3-46c4-a30d-1c2e3d20e6a0 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9c0c7e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:02.694772 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8017ba01-44d3-46c4-a30d-1c2e3d20e6a0 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982492609" status: 202 len: 0 microversion: 2.1 time: 0.071701 Aug 23 10:49:02.695965 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1461/3012] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982492609 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:02.705897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b076b2a1-27db-4a0a-80d4-f69e0c71b3c2 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Action: 'create', calling method: .version_select at 0x7fdc9c038af0>, body: {"keypair": {"name": "tempest-keypair-6086689", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:02.751622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b076b2a1-27db-4a0a-80d4-f69e0c71b3c2 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:02.765467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b076b2a1-27db-4a0a-80d4-f69e0c71b3c2 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for user bf56dcdf3dc84f798aacb80b862a4bda and project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:02.832018 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b076b2a1-27db-4a0a-80d4-f69e0c71b3c2 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 571 microversion: 2.1 time: 0.130731 Aug 23 10:49:02.832724 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1552/3013] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:02 2022] POST /compute/v2.1/os-keypairs => generated 571 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:02.849187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5db1b9d-3d05-4a7e-93b9-41d3e0a96a70 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9c41b670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:02.894926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5db1b9d-3d05-4a7e-93b9-41d3e0a96a70 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-6086689" status: 202 len: 0 microversion: 2.1 time: 0.052104 Aug 23 10:49:02.895891 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1462/3014] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Aug 23 10:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-6086689 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:02.909268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee4b7192-8505-4e1b-9b06-e8847437d962 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Action: 'create', calling method: .version_select at 0x7fdc9c096940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-757111001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYg5YGZj2mro59f3wdt2xhBc9Siht4pakKomZ0ZP0SWvG+wSjBJgkBG5bzr5n31xraIJSklkDfOo+TL9dV6ddDxRySUHe6hk0VkgTwe4nmGPl2BJZc0VM4qwEzp9XLwAQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:02.951315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ee4b7192-8505-4e1b-9b06-e8847437d962 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:02.960038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ee4b7192-8505-4e1b-9b06-e8847437d962 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for user bf56dcdf3dc84f798aacb80b862a4bda and project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:03.019367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee4b7192-8505-4e1b-9b06-e8847437d962 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.114967 Aug 23 10:49:03.024248 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1553/3015] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:03.033774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-492f0286-93aa-4437-a204-812fdc78769d tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Action: 'create', calling method: .version_select at 0x7fdc9c07e820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1715198752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP94p8efyiyhwdj22vgHbow0BqpFdiBrkmU5y1Aux5090rcdSWUHSTRV2lPHBJ9S1gpVq0vnAGFF/OQpVb7KU2JqMSWbNrXvP6f783skUH5OA+n2a0v/ur+5zWJU0S4L0A=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:03.069827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-492f0286-93aa-4437-a204-812fdc78769d tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:03.070052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:03.074678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:03.088575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-492f0286-93aa-4437-a204-812fdc78769d tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for user bf56dcdf3dc84f798aacb80b862a4bda and project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:03.091439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:03.096813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:03.098053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:03.098724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:03.120231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:03.121267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:03.126778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:03.146418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-492f0286-93aa-4437-a204-812fdc78769d tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.117373 Aug 23 10:49:03.147181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1463/3016] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:03.162022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33dcc6ce-e0af-45e5-a71c-43e82ecfb597 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Action: 'create', calling method: .version_select at 0x7fdc9ccf3160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-719609700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNluZ2SzLTlS65svAp7S0OP+CnaVhSNhPUl+NtSjDQUcr8V7WTlKw3FkpPLYmOZehGN9g7u794sEYLguSTsLbcxDCoJGgU7Wv2A7nV76mRCH62wD4fFLbXeajcNQ9pTk7A=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:03.198180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-33dcc6ce-e0af-45e5-a71c-43e82ecfb597 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:03.214880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-33dcc6ce-e0af-45e5-a71c-43e82ecfb597 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Getting quotas for user bf56dcdf3dc84f798aacb80b862a4bda and project 510def5ba11e4833989fa1b39a5b892d. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:03.293146 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33dcc6ce-e0af-45e5-a71c-43e82ecfb597 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.135804 Aug 23 10:49:03.296060 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1464/3017] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:03 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:03.312046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-45bc41f4-0829-414e-bbc6-79c49a33c2d9 req-eabe9d01-8872-42e6-b846-2d5ec69dd0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c", "name": "network-vif-deleted", "tag": "a5cc99f8-7d9d-4280-9928-7c0296613e2b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:03.328412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-45bc41f4-0829-414e-bbc6-79c49a33c2d9 req-eabe9d01-8872-42e6-b846-2d5ec69dd0b2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:03.329502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-45bc41f4-0829-414e-bbc6-79c49a33c2d9 req-eabe9d01-8872-42e6-b846-2d5ec69dd0b2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:03.330125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-45bc41f4-0829-414e-bbc6-79c49a33c2d9 req-eabe9d01-8872-42e6-b846-2d5ec69dd0b2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:03.384512 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-45bc41f4-0829-414e-bbc6-79c49a33c2d9 req-eabe9d01-8872-42e6-b846-2d5ec69dd0b2 service nova] Creating event network-vif-deleted:a5cc99f8-7d9d-4280-9928-7c0296613e2b for instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c on n-h1-847009-13 Aug 23 10:49:03.394680 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-45bc41f4-0829-414e-bbc6-79c49a33c2d9 req-eabe9d01-8872-42e6-b846-2d5ec69dd0b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096184 Aug 23 10:49:03.396058 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1465/3018] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:03.402640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5756196-9f6f-4acb-91e7-341339d0d86f tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9f3e5160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:03.431074 n-d-847009-13 devstack@n-api.service[128860]: WARNING oslo_db.sqlalchemy.utils [None req-d5756196-9f6f-4acb-91e7-341339d0d86f tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 10:49:03.454736 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5756196-9f6f-4acb-91e7-341339d0d86f tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.056878 Aug 23 10:49:03.456387 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1466/3019] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:49:03 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:03.484301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e38dba6d-16d6-4a6a-94cd-fa7fedcde1dd tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9caf5b80>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:03.551314 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e38dba6d-16d6-4a6a-94cd-fa7fedcde1dd tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-719609700" status: 202 len: 0 microversion: 2.1 time: 0.071377 Aug 23 10:49:03.553408 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1467/3020] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:49:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-719609700 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:03.563372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:03.565573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:03.576571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:03.577502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:03.578916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:03.579989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:03.586754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:03.587630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:03.635923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:03.647869 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9d107ba6-e5cf-415b-8896-4a14a6c52578 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1273 microversion: 2.1 time: 0.583936 Aug 23 10:49:03.649712 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1554/3021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:03 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1273 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:03.670555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6aa98145-dc25-4328-89fc-04b4839f13da tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9c038a60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:03.722942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:03.723455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:03.725358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:03.726202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lazy-loading 'fault' on Instance uuid dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:49:03.726889 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6aa98145-dc25-4328-89fc-04b4839f13da tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1715198752" status: 202 len: 0 microversion: 2.1 time: 0.073147 Aug 23 10:49:03.728361 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1555/3022] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Aug 23 10:49:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1715198752 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:03.747362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46f7c6af-9c36-4628-bc5a-36bde4b500e0 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] Calling method '.version_select at 0x7fdc9c0218b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:03.788555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46f7c6af-9c36-4628-bc5a-36bde4b500e0 tempest-KeyPairsV2TestJSON-692001718 tempest-KeyPairsV2TestJSON-692001718-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-757111001" status: 202 len: 0 microversion: 2.1 time: 0.048276 Aug 23 10:49:03.789394 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1556/3023] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:49:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-757111001 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:03.852823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670582f204b54a0a97fa7f14c315801e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2561ce8d69dd447cb108ed8fb9e8bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:03.872361 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-474a4b97-7bb3-4357-bad3-eb0192e17eba tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 200 len: 1312 microversion: 2.1 time: 0.316055 Aug 23 10:49:03.882012 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1468/3024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:03 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:04.675209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:04.675998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:04.693769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:04.694425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:04.694978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:04.696484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:04.699389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:04.699945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:04.866768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:04.881022 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-673941c2-bcf6-44b7-aa88-0adbfe11a3c3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1273 microversion: 2.1 time: 0.213425 Aug 23 10:49:04.892967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1557/3025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:04 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:04.900307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:04.900965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] [instance: dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:04.910946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:04.911806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:04.912512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:04.913812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:04.914415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:04.915163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:04.934584 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] HTTP exception thrown: Instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c could not be found. Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Request method failure captured: Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c HTTP/1.1 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLBGyywwPJhGwTSYs9yAsO0RfgJGSYkzweal6A4iFPsw5F03dMuiJTImGHWTYK5Bg5NCB1PDvvaMtg60TUhhcXIS0brj7FJWrL8fVEJCa24XFZh3MVz6BlU-MqshcgzAe2FV39sTvU6-hZl0SYmDCKMcUgu2Lc518kht5Kzkb251sEk Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 2561ce8d69dd447cb108ed8fb9e8bf7d Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1573465145 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2561ce8d69dd447cb108ed8fb9e8bf7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2561ce8d69dd447cb108ed8fb9e8bf7d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2561ce8d69dd447cb108ed8fb9e8bf7d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2561ce8d69dd447cb108ed8fb9e8bf7d"}]}] Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1573465145 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 2561ce8d69dd447cb108ed8fb9e8bf7d Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1573465145 Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersAdminNegativeTestJSON-1573465145-project Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 670582f204b54a0a97fa7f14c315801e Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1573465145-project Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c could not be found. Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c'} Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c could not be found. Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c could not be found. Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:04.936931 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c could not be found. Aug 23 10:49:04.941113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:04.942703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] Returning 404 to user: Instance dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:04.944051 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c6b0b37-86de-4a28-a543-4faf33daa190 tempest-ServersAdminNegativeTestJSON-1573465145 tempest-ServersAdminNegativeTestJSON-1573465145-project] 10.222.0.78 "GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c" status: 404 len: 111 microversion: 2.1 time: 0.048212 Aug 23 10:49:04.945104 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1469/3026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:04 2022] GET /compute/v2.1/servers/dd92ae4d-3e7d-4c6d-9908-a3e7bfa25c5c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:05.635296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-523d4320-290c-43b1-848c-b7fcb43e2d72 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Action: 'create', calling method: .version_select at 0x7fdc9c08d4c0>, body: {"keypair": {"name": "tempest-keypair-383283840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFL/5HYno5sbKUUdo+Pae78+8rcrnzQEyZuMabHjIP/maAT2vKHV0MlUKnM2vzV4sBhTnZWWddRPD0sFvHWAdursfSyMBhhmyVkeafW09ZpeMHZzBXRZOsTRXdexPFddg=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:05.666157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-523d4320-290c-43b1-848c-b7fcb43e2d72 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Getting quotas for project 1af0e3fb36da41c9bb4ea1ac3372fdb2. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:05.677776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-523d4320-290c-43b1-848c-b7fcb43e2d72 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Getting quotas for user 3772a6b414424c1cab70261b8d5da918 and project 1af0e3fb36da41c9bb4ea1ac3372fdb2. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:05.719774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-523d4320-290c-43b1-848c-b7fcb43e2d72 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.580238 Aug 23 10:49:05.720849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1558/3027] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:49:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:05.901604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:05.902230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:05.912606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:05.913072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:05.913530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:05.914267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:05.914838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:05.915290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:06.353541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:06.363444 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63c7a544-26d0-4e00-b4a6-9022d3bc2d66 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 0.465705 Aug 23 10:49:06.379944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1470/3028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:05 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:07.340877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-643282f6-e97c-4b85-b782-94c3fa2fb2a4 req-8b54aafa-b907-4062-953f-4fc2c86e622d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3557b860-853d-4b7c-831c-de9d7f3f0ce2", "tag": "c4f6c5f9-a3ae-4ec7-9b27-4a31ac667e24"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:07.370209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-643282f6-e97c-4b85-b782-94c3fa2fb2a4 req-8b54aafa-b907-4062-953f-4fc2c86e622d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:07.370755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-643282f6-e97c-4b85-b782-94c3fa2fb2a4 req-8b54aafa-b907-4062-953f-4fc2c86e622d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:07.371237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-643282f6-e97c-4b85-b782-94c3fa2fb2a4 req-8b54aafa-b907-4062-953f-4fc2c86e622d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:07.390796 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-643282f6-e97c-4b85-b782-94c3fa2fb2a4 req-8b54aafa-b907-4062-953f-4fc2c86e622d service nova] Creating event network-changed:c4f6c5f9-a3ae-4ec7-9b27-4a31ac667e24 for instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 on n-h2-847009-13 Aug 23 10:49:07.399405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:07.404311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:07.407111 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-643282f6-e97c-4b85-b782-94c3fa2fb2a4 req-8b54aafa-b907-4062-953f-4fc2c86e622d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070120 Aug 23 10:49:07.407931 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1559/3029] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:07.446708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:07.447406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:07.450178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:07.452443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:07.453412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:07.454830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:08.030293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:08.049589 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53f57c43-05ec-4fe2-a8f2-015a5c31459b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 0.664897 Aug 23 10:49:08.051373 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1471/3030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:07 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:09.073365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:09.074188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:09.093299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:09.094588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:09.095398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:09.096187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:09.096807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:09.097478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:09.103742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:10.790306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:10.801549 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9d19af2-e606-40a2-ac79-60a4bc69f064 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 1.733436 Aug 23 10:49:10.805209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1560/3031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:09 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:11.826611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:11.827452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:11.857124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:11.863097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:11.864212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:11.866119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:11.868694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:11.872613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:11.873439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:12.149118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-979681430", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:12.223559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:12.233284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e400827a-5b83-46de-a4c3-cfb4d8710d3a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 0.413561 Aug 23 10:49:12.233565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:49:12.234191 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1472/3032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:11 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:13.255963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:13.256889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:13.259780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=20 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:13.265111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:13.266616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:13.267255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:13.268151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:13.268798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:13.269383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:13.525427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:13.526699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:13.527409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:13.527994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:13.528695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:13.532840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:13.540114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:13.540940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:13.541607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:13.542576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:13.543129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a13c8ca5-75f4-406e-aea7-5a8282b11d71 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 0.291858 Aug 23 10:49:13.543714 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1473/3033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:13 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:13.544011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:13.544651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:13.568591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:13.576456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:13.595161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:13.598951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:13.672668 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c6df6b92-1be1-49e9-8841-60f9ef503ddf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830188 Aug 23 10:49:13.673546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1561/3034] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:49:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:49:13.684587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-358e2f94-575e-40e5-b319-16a6ca1b8e5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:13.685531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-358e2f94-575e-40e5-b319-16a6ca1b8e5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:13.931441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-358e2f94-575e-40e5-b319-16a6ca1b8e5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:13.943497 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-358e2f94-575e-40e5-b319-16a6ca1b8e5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1216 microversion: 2.1 time: 0.262687 Aug 23 10:49:13.944450 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1474/3035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:13 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:13.976964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-56d18f8d-2a81-40d3-859a-1ff60350b079 req-82527a48-6447-4985-bb7f-b607bad17001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3557b860-853d-4b7c-831c-de9d7f3f0ce2", "name": "network-vif-plugged", "status": "completed", "tag": "c4f6c5f9-a3ae-4ec7-9b27-4a31ac667e24"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:13.993664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-56d18f8d-2a81-40d3-859a-1ff60350b079 req-82527a48-6447-4985-bb7f-b607bad17001 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:13.994933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-56d18f8d-2a81-40d3-859a-1ff60350b079 req-82527a48-6447-4985-bb7f-b607bad17001 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:13.995593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-56d18f8d-2a81-40d3-859a-1ff60350b079 req-82527a48-6447-4985-bb7f-b607bad17001 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:14.010987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-56d18f8d-2a81-40d3-859a-1ff60350b079 req-82527a48-6447-4985-bb7f-b607bad17001 service nova] Creating event network-vif-plugged:c4f6c5f9-a3ae-4ec7-9b27-4a31ac667e24 for instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 on n-h2-847009-13 Aug 23 10:49:14.019137 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-56d18f8d-2a81-40d3-859a-1ff60350b079 req-82527a48-6447-4985-bb7f-b607bad17001 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067853 Aug 23 10:49:14.020371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1562/3036] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:14.274356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1956031026", "imageRef": "0bd6417a-cc87-427a-a250-45822e84624d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f996271e-1c4a-4b01-b0ee-99d2466b8cdf"}], "security_groups": [{"name": "tempest-securitygroup--1273831787"}], "key_name": "tempest-keypair-383283840", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:14.568535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:14.572330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:14.592206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:14.592903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:14.594610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:14.598323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:14.599008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:14.599614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:14.674730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] validate_networks() for [('f996271e-1c4a-4b01-b0ee-99d2466b8cdf', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:49:15.077190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:15.098326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2f54cfc-d3a6-438e-af0b-0f9bc1f32b25 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 0.535517 Aug 23 10:49:15.098945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1563/3037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:14 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:15.112772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:15.113551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:15.123745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:15.124541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:15.125254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:15.125977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:15.126671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:15.127249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:15.274900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:15.291229 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24019f2f-3c34-48f6-91c9-62b4202941aa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1268 microversion: 2.1 time: 0.189143 Aug 23 10:49:15.291943 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1564/3038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:15 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:15.658543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:15.659402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:15.659890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:15.660317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:15.660861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:15.683710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:15.684228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:15.684695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:15.685567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:15.686039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:15.686476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:15.761930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Getting quotas for project 1af0e3fb36da41c9bb4ea1ac3372fdb2. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:15.787028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Getting quotas for user 3772a6b414424c1cab70261b8d5da918 and project 1af0e3fb36da41c9bb4ea1ac3372fdb2. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:15.811713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:15.845154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0bd6417a-cc87-427a-a250-45822e84624d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:15.918155 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2ba20c0-e6d0-41a9-bf16-99625205955f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.647747 Aug 23 10:49:15.918946 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1475/3039] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:49:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:49:15.930932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f0142a8-018c-47ec-9bfd-7969b811c693 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:15.931572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f0142a8-018c-47ec-9bfd-7969b811c693 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:16.122056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:16.122709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:16.135196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:16.141692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:16.143865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:16.144623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:16.145852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:16.149080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:16.276705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f0142a8-018c-47ec-9bfd-7969b811c693 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:16.292128 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f0142a8-018c-47ec-9bfd-7969b811c693 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1245 microversion: 2.1 time: 0.361908 Aug 23 10:49:16.293534 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1565/3040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:15 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1245 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:16.317946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:16.318599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:16.327656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:16.329432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:16.330096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:16.331151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:16.331830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:16.332517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:16.485832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:16.498379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-096b7efd-8e02-4538-a16a-d55b3b4d0e23 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1315 microversion: 2.1 time: 0.381299 Aug 23 10:49:16.517798 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1476/3041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:16 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:16.524340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:16.547379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08713c4e-b1b0-4dd0-8cda-bcd9e9ffc1fc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1274 microversion: 2.1 time: 0.235023 Aug 23 10:49:16.554025 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1566/3042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:16 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1274 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:17.325105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:17.326392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:17.351064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:17.351878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:17.352979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:17.354112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:17.354925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:17.355554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:17.480557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:17.494938 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62a3c0a6-9dc8-4394-859a-181026dd36bc tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1297 microversion: 2.1 time: 0.180047 Aug 23 10:49:17.495771 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1477/3043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:17 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:17.524486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:17.525090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:17.537386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:17.538643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:17.539692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:17.541021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:17.541695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:17.542474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:17.583155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:17.584298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:17.615368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:17.616019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:17.616678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:17.617788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:17.618256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:17.622768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:17.990172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:18.013529 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd1bf154-d84f-4100-9b0f-b349874777b8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1274 microversion: 2.1 time: 0.435923 Aug 23 10:49:18.021299 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1478/3044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:17 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1274 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:18.522599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:18.524065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:18.549932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:18.555703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:18.556318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:18.557257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:18.563963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:18.564508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:18.585153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:18.595297 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cbf9e578-de3e-4235-9146-dd8c0afb3bbc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1501 microversion: 2.1 time: 1.075513 Aug 23 10:49:18.598189 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1567/3045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:17 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1501 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:18.628487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1fb5439-71a3-43cc-b699-0ea15009261d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:18.645915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1fb5439-71a3-43cc-b699-0ea15009261d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:18.647089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1fb5439-71a3-43cc-b699-0ea15009261d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:18.647842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1fb5439-71a3-43cc-b699-0ea15009261d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:18.746598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:18.756485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09b0af79-e8c2-483c-a6b3-6ee7ae009828 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1303 microversion: 2.1 time: 0.240838 Aug 23 10:49:18.776500 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1479/3046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:18 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1303 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:18.858811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1fb5439-71a3-43cc-b699-0ea15009261d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Going to try to stop instance {{(pid=128859) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 10:49:18.938844 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1fb5439-71a3-43cc-b699-0ea15009261d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2/action" status: 202 len: 0 microversion: 2.1 time: 0.313823 Aug 23 10:49:18.940305 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1568/3047] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:49:18 2022] POST /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:49:18.950227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:18.950864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:18.970310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:18.971039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:18.971648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:18.972538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:18.973270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:18.974039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:19.021978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:19.045596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:19.046323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:19.061753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:19.062321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:19.065640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:19.066486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:19.067974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:19.068423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:19.819274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:19.833455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de144abc-27c3-46e1-827c-a3e1ba8b4dbf tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1274 microversion: 2.1 time: 0.794718 Aug 23 10:49:19.850225 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1569/3048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:19 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1274 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:19.868794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:19.869731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:19.890926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:19.891789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:19.892429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:19.893431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:19.894053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:19.894640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:20.064753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:20.073866 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a01e1896-ce32-4d2a-8c5e-df81c37d615d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1303 microversion: 2.1 time: 0.221614 Aug 23 10:49:20.097224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1570/3049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:19 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:20.454468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:20.492062 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4013c75c-5724-45e0-9651-ca2a374a9368 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 1.533617 Aug 23 10:49:20.492815 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1480/3050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:18 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:20.864330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:20.865610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:20.879440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:20.883806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:20.885784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:20.889001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:20.890166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:20.892600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:20.893340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:21.111182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:21.111850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:21.130658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:21.131463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:21.132108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:21.135552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:21.136408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:21.140094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:21.469066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:21.483470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79bcd6e3-ac8c-4e32-9d0f-8cebb0efd958 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1303 microversion: 2.1 time: 0.379514 Aug 23 10:49:21.484896 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1481/3051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:21 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1303 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:21.519781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:21.520649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:21.536203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:21.539550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:21.542232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:21.543080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:21.549144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:21.549849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:22.347761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:22.364523 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a54a43b7-bf7c-4006-bdb9-6cca707ef78f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 1.505678 Aug 23 10:49:22.367124 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1571/3052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:20 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:22.445339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:22.467274 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a69b0762-f2b5-4c03-8199-fdad198e5a68 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.952931 Aug 23 10:49:22.469119 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1482/3053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:21 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:22.513408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:22.514751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:22.545649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:22.546465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:22.549192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:22.550625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:22.552165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:22.555319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:22.766576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:22.783856 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c446feb1-f29b-43c5-b15e-a591ed5999d7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1303 microversion: 2.1 time: 0.274399 Aug 23 10:49:22.789717 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1572/3054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:22 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1303 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:23.394463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:23.395181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:23.415742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:23.417725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:23.420800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:23.427000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:23.428714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:23.429288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:23.492919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:23.494435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:23.523942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:23.526923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:23.528891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:23.532944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:23.533725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:23.534275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:24.446766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:24.690336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:24.704280 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fc9c172-0c2c-4aad-baa6-fdd11190a334 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 1.315381 Aug 23 10:49:24.708044 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1483/3055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:23 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:24.745540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:24.746286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:24.755468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:24.761602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:24.762388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:24.763603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:24.764342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:24.765112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:25.707885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:25.802340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:26.281988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=24 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:26.401079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:26.411879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e23b1aba-7363-47f3-9bfd-6c1743367a4d tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 1.684518 Aug 23 10:49:26.439887 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1484/3056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:24 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:26.455896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:26.456819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:26.481791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:26.482297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:26.482849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:26.483658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:26.491977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:26.492437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:26.747132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:26.767993 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82d3b415-ed90-4b72-a3ef-4e6481feba63 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 3.281170 Aug 23 10:49:26.769291 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1573/3057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:23 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 3284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:27.314287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:27.324669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:27.342193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Searching by: {'deleted': False, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:49:27.356271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:27.366318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:27.367565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:27.369122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:27.370098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:27.370910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:27.437841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:49:27.525204 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60bd644b-2ae1-4b5c-8749-4c57e0967471 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215967 Aug 23 10:49:27.535761 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1574/3058] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:49:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:27.554151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:27.557365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:27.569944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:27.576343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:27.577424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:27.579260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:27.580300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:27.581170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:28.022662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:28.060485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a5766da-8d8d-43b6-ac8c-d6e144d174a1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 1.619028 Aug 23 10:49:28.062672 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1485/3059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:26 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:28.076831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:28.101712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:28.105230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Searching by: {'deleted': False, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:49:28.116204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:28.121476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:28.122503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:28.123784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:28.124626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:28.125382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:28.186213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:49:28.286856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:28.297965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:28.299082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:28.299975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:28.934838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42a2daa1-2df1-4624-a83d-c6e323aa6e5e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1607 microversion: 2.1 time: 0.871040 Aug 23 10:49:28.935717 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1486/3060] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:49:28 2022] GET /compute/v2.1/servers/detail => generated 1607 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:28.941335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:28.942110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:28.954816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:28.961954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:28.962784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:28.963713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:28.964344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:28.964959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:29.347102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:29.355776 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24c95308-6336-47d1-8ca4-b9b8479997a8 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 1.818345 Aug 23 10:49:29.371290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1575/3061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:27 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:29.420079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6b04da1a-cdfb-4c1f-ac03-3d3cdca741be req-5f5a12a3-763b-4870-879a-f14087c8d7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94cbffe-d053-422b-bacb-6ab8fd02d551", "tag": "78817fdd-ea68-4303-b30e-22df6a4b0769"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:29.475223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6b04da1a-cdfb-4c1f-ac03-3d3cdca741be req-5f5a12a3-763b-4870-879a-f14087c8d7fd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:29.475733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6b04da1a-cdfb-4c1f-ac03-3d3cdca741be req-5f5a12a3-763b-4870-879a-f14087c8d7fd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:29.476177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6b04da1a-cdfb-4c1f-ac03-3d3cdca741be req-5f5a12a3-763b-4870-879a-f14087c8d7fd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:29.511934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6b04da1a-cdfb-4c1f-ac03-3d3cdca741be req-5f5a12a3-763b-4870-879a-f14087c8d7fd service nova] Creating event network-changed:78817fdd-ea68-4303-b30e-22df6a4b0769 for instance c94cbffe-d053-422b-bacb-6ab8fd02d551 on n-h1-847009-13 Aug 23 10:49:29.527068 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6b04da1a-cdfb-4c1f-ac03-3d3cdca741be req-5f5a12a3-763b-4870-879a-f14087c8d7fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154208 Aug 23 10:49:29.544668 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1576/3062] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:29.560971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c921f6e9-6cea-4703-bc25-22d9e0da20e2 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:29.585045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c921f6e9-6cea-4703-bc25-22d9e0da20e2 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038241 Aug 23 10:49:29.588854 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1577/3063] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:49:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:29.597646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:29.598784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:29.636036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:29.638092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:29.639512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:29.642552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:29.648048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:29.651095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:29.703185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:29.720542 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-654036b2-a8b5-4923-bea0-503992c56ae1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.783536 Aug 23 10:49:29.726388 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1487/3064] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:28 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:30.018900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1092404360", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "4e32341c-7ef6-4436-b058-bee2bf5df150"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:30.155573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] validate_networks() for [('4e32341c-7ef6-4436-b058-bee2bf5df150', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:49:30.294545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:30.309697 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1477f3c-5e4e-4a52-bf86-fc81a715e53c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.719316 Aug 23 10:49:30.310307 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1578/3065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:29 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:30.335409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:30.335941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:30.363313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:30.365845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:30.366323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:30.369515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:30.370009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:30.370451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:30.438692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:30.488031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:49:30.698550 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28ffad95-76cb-4f16-91d1-8e3e8f7947d4 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 204 len: 0 microversion: 2.1 time: 0.379667 Aug 23 10:49:30.703336 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1579/3066] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:49:30 2022] DELETE /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:49:30.722299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:30.723155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:30.754625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:30.755070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:30.758674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:30.759442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:30.762663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:30.763166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:31.281562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:31.290406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-886ebe00-72c9-4f17-b280-26340512dc0a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 0.584841 Aug 23 10:49:31.291010 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1580/3067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:30 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:31.304389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:31.305078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:31.321655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:31.322165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:31.322593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:31.323318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:31.323839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:31.324197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:31.639631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:31.654061 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77275a29-7119-4479-aea8-66a55e0226ac tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1610 microversion: 2.1 time: 0.362003 Aug 23 10:49:31.654998 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1581/3068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:31 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1610 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:31.670376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:31.671148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:31.683453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:31.683954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:31.688785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:31.689607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:31.690097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:31.690543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:32.260511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:32.274936 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-39ab9c32-4115-4c2f-b32c-0bf47ed6e562 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.615244 Aug 23 10:49:32.275770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1582/3069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:31 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:32.382108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Calling method '.version_select at 0x7fdc9c1105e0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:32.427190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:49:32.428100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Neutron security group 850b1459-e67f-49e9-a4bd-92b309134152 not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:49:32.433419 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] HTTP exception thrown: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.433419 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Request method failure captured: Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-security-groups/850b1459-e67f-49e9-a4bd-92b309134152 HTTP/1.1 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLC6-jmkuQ5CegbX8_VBSOPEAzpJ4D-2l5BDvmC32_rzKXkzKcMvTblUSN5hHBzG1f0X699vvARtj4ykUpXqcUZZzKbv66D60kdmBI2Y6U8rjXdDWj7kQlszTc3j82vTf6vRppM-OP50huVuszcXeN2CXDYVX8PbAC5SA1P2oJiZqcQ Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f593412f0eb44feaa43d861d046c8ab8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}] Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 85deb8b7b1624515b12f51067127c55c Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '850b1459-e67f-49e9-a4bd-92b309134152'} Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:49:32.440243 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] Aug 23 10:49:32.444501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:32.463848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Returning 404 to user: Security group 850b1459-e67f-49e9-a4bd-92b309134152 does not exist Aug 23 10:49:32.463848 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-9e647190-6198-4608-af2b-2e93061b6348'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:32.467990 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5eebfb7e-46cf-4af6-95d7-9d479476230f tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/850b1459-e67f-49e9-a4bd-92b309134152" status: 404 len: 194 microversion: 2.1 time: 0.185636 Aug 23 10:49:32.469741 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1583/3070] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:49:32 2022] DELETE /compute/v2.1/os-security-groups/850b1459-e67f-49e9-a4bd-92b309134152 => generated 194 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:32.489617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:32.490877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:32.518895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:32.524882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:32.526254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:32.529698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:32.530455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:32.532042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.011110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:33.020245 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3894755e-c65e-4ac5-ba8b-4c7cd299ad0d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.545783 Aug 23 10:49:33.021497 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1584/3071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:32 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:33.026334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7fd23471-7228-4df3-82ea-c1fd5e54a7f6 req-26a1bda8-2e1e-4c9b-b92d-6efc1f57b510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909e5550-fb4c-4d86-a36b-00637f8a0511", "tag": "fcbdc18f-319a-4b90-a01a-ea115cfd9f8a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:33.044075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7fd23471-7228-4df3-82ea-c1fd5e54a7f6 req-26a1bda8-2e1e-4c9b-b92d-6efc1f57b510 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.044577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7fd23471-7228-4df3-82ea-c1fd5e54a7f6 req-26a1bda8-2e1e-4c9b-b92d-6efc1f57b510 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.045056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7fd23471-7228-4df3-82ea-c1fd5e54a7f6 req-26a1bda8-2e1e-4c9b-b92d-6efc1f57b510 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.061460 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7fd23471-7228-4df3-82ea-c1fd5e54a7f6 req-26a1bda8-2e1e-4c9b-b92d-6efc1f57b510 service nova] Creating event network-changed:fcbdc18f-319a-4b90-a01a-ea115cfd9f8a for instance 909e5550-fb4c-4d86-a36b-00637f8a0511 on n-h2-847009-13 Aug 23 10:49:33.067641 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7fd23471-7228-4df3-82ea-c1fd5e54a7f6 req-26a1bda8-2e1e-4c9b-b92d-6efc1f57b510 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044868 Aug 23 10:49:33.068265 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1585/3072] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:33.079970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:33.080708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:33.103250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.103686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.104144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.107865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.108487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.109476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.116213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:33.116953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:33.117248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:33.117676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:33.118575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:33.152564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.153137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.157844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.162616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.164014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.164014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.199905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:33.214010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Getting quotas for project 437f772e94a94e168fada83021919902. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:33.239517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Getting quotas for user e178a0b7deb2422b8e8c55609dc027e7 and project 437f772e94a94e168fada83021919902. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:33.265695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:33.272922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:33.423184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f899211-dc75-45fe-9cc7-3aff14bc84b4 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.693589 Aug 23 10:49:33.424814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1488/3073] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:49:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:49:33.452085 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c21a858c-cc6c-493d-a389-1bac5c79fcb1 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.014286 Aug 23 10:49:33.456204 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1489/3074] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Aug 23 10:49:33 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 10:49:33.470441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:33.472223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:33.486659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.487475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.488553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.489529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.491398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.493050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:33.931112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:33.941955 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e79d97f-ad55-41b7-ba3d-93dc73a96156 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 0.872426 Aug 23 10:49:33.958800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1586/3075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:33 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:33.969945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:33.981207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:33.997342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:33.998129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:33.999204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:34.000543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:34.001269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:34.005519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:34.750749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:34.765418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f403970-bf35-4840-946a-22d4671857bc tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1610 microversion: 2.1 time: 1.304029 Aug 23 10:49:34.766862 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1490/3076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:33 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1610 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:34.779406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:34.782405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:34.793970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:34.804826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:34.807650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:34.808133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:34.810045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:34.813732 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b385d17d-cc81-41e0-9a6f-24861494fc5f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.852867 Aug 23 10:49:34.814932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:34.815509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:34.816002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1587/3077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:33 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:34.824878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-656dcc91-55d4-4a1c-a0ff-402cb6ab2121 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Calling method '.version_select at 0x7fdc9c09c0d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:35.092464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:35.106988 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f609f34b-fbb5-40aa-a12a-21dd059160b3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1229 microversion: 2.1 time: 0.338855 Aug 23 10:49:35.107606 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1491/3078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:34 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1229 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:35.119171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:35.119819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:35.149470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:35.149982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:35.150833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:35.151584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:35.152048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:35.152473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:35.657227 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-656dcc91-55d4-4a1c-a0ff-402cb6ab2121 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.839671 Aug 23 10:49:35.658445 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1588/3079] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 10:49:34 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:35.663324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:35.664139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:35.679313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:35.680243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:35.680928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:35.683010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:35.683691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:35.684301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:36.137009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:36.147685 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e3c16bf-371b-4474-ad41-7fb19c252cff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 1.038980 Aug 23 10:49:36.157281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1492/3080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:35 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:36.180653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a0d8d5a-a6ec-4a7a-861f-b2be85c852a6 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Calling method '.version_select at 0x7fdc9c0584c0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:36.832038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:36.853943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3704664d-b310-45bb-9d45-2b6f3eee2875 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 1.193268 Aug 23 10:49:36.855776 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1589/3081] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:35 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:36.871104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:36.877456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:36.908715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:36.909557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:36.910203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:36.911189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:36.911823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:36.912421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.167571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:37.181071 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-270b9221-58ec-4909-a7b8-83f1bebb8e6c tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1610 microversion: 2.1 time: 0.323951 Aug 23 10:49:37.182277 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1590/3082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:36 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1610 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:37.189375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:37.190760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:37.205014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.205929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.206764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.208311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.209321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.210095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.378667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:37.432576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-1a0d8d5a-a6ec-4a7a-861f-b2be85c852a6 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:49:37.433859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1a0d8d5a-a6ec-4a7a-861f-b2be85c852a6 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 23 10:49:37.433859 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a0d8d5a-a6ec-4a7a-861f-b2be85c852a6 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Request method failure captured: Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-security-groups/0c50e935-8dba-4e12-ac03-189252bae84f HTTP/1.1 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLC6-jmkuQ5CegbX8_VBSOPEAzpJ4D-2l5BDvmC32_rzKXkzKcMvTblUSN5hHBzG1f0X699vvARtj4ykUpXqcUZZzKbv66D60kdmBI2Y6U8rjXdDWj7kQlszTc3j82vTf6vRppM-OP50huVuszcXeN2CXDYVX8PbAC5SA1P2oJiZqcQ Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f593412f0eb44feaa43d861d046c8ab8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}] Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 85deb8b7b1624515b12f51067127c55c Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: exception: Insufficient rights for removing default security group. Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0c50e935-8dba-4e12-ac03-189252bae84f'} Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:49:37.437302 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a0d8d5a-a6ec-4a7a-861f-b2be85c852a6 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-91479e57-8b75-48a1-b099-5cc575877a00'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a0d8d5a-a6ec-4a7a-861f-b2be85c852a6 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/0c50e935-8dba-4e12-ac03-189252bae84f" status: 400 len: 182 microversion: 2.1 time: 1.280829 Aug 23 10:49:37.443425 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1493/3083] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:49:36 2022] DELETE /compute/v2.1/os-security-groups/0c50e935-8dba-4e12-ac03-189252bae84f => generated 182 bytes in 1282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:49:37.452229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:37.455128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:37.465961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.466568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.469158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.470367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.471461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.472101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.642864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:37.646591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:37.651273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-25161068-8c39-4d50-85a5-65f5d748898d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.467752 Aug 23 10:49:37.670566 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1591/3084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:37 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:37.679982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1ae7671c-1e32-4f90-94f1-d90da3523157 req-559c8674-a9ee-407b-a366-96ab3e4a220c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc65a8e-0c41-4b26-91b9-a5e4526e3e32", "name": "network-vif-unplugged", "status": "completed", "tag": "136b0631-86a8-4413-a1b1-726c1e833124"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:37.683262 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d975d3e2-1b21-4186-8b29-310caa7f2bb3 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1283 microversion: 2.1 time: 0.241004 Aug 23 10:49:37.684463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1494/3085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:37 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1283 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:37.696517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:37.699835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:37.713268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1ae7671c-1e32-4f90-94f1-d90da3523157 req-559c8674-a9ee-407b-a366-96ab3e4a220c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.714474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1ae7671c-1e32-4f90-94f1-d90da3523157 req-559c8674-a9ee-407b-a366-96ab3e4a220c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.715083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1ae7671c-1e32-4f90-94f1-d90da3523157 req-559c8674-a9ee-407b-a366-96ab3e4a220c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.716951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.718891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.721331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.723564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.725733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.726543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.741923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1ae7671c-1e32-4f90-94f1-d90da3523157 req-559c8674-a9ee-407b-a366-96ab3e4a220c service nova] Creating event network-vif-unplugged:136b0631-86a8-4413-a1b1-726c1e833124 for instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 on n-h1-847009-13 Aug 23 10:49:37.751631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1ae7671c-1e32-4f90-94f1-d90da3523157 req-559c8674-a9ee-407b-a366-96ab3e4a220c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078875 Aug 23 10:49:37.753406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1592/3086] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:37.766727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Calling method '.version_select at 0x7fdc9c09cf70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:37.899338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG neutronclient.v2_0.client [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist", "detail": ""}} {{(pid=128859) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:49:37.900803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.security_group_api [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Neutron security group 85a3cfaf-a742-498e-bf56-c33a46c53872 not found {{(pid=128859) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:49:37.901633 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] HTTP exception thrown: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.901633 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Request method failure captured: Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/os-security-groups/85a3cfaf-a742-498e-bf56-c33a46c53872 HTTP/1.1 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLC6-jmkuQ5CegbX8_VBSOPEAzpJ4D-2l5BDvmC32_rzKXkzKcMvTblUSN5hHBzG1f0X699vvARtj4ykUpXqcUZZzKbv66D60kdmBI2Y6U8rjXdDWj7kQlszTc3j82vTf6vRppM-OP50huVuszcXeN2CXDYVX8PbAC5SA1P2oJiZqcQ Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f593412f0eb44feaa43d861d046c8ab8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}] Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 85deb8b7b1624515b12f51067127c55c Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: exception: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '85a3cfaf-a742-498e-bf56-c33a46c53872'} Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:49:37.904944 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] Aug 23 10:49:37.909339 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:37.913574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Returning 404 to user: Security group 85a3cfaf-a742-498e-bf56-c33a46c53872 does not exist Aug 23 10:49:37.913574 n-d-847009-13 devstack@n-api.service[128859]: Neutron server returns request_ids: ['req-23602d8c-036d-4950-992e-59c1dc87e66b'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:37.914994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d5dcdbbd-1cf5-40cf-921e-bf4672547a51 tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/85a3cfaf-a742-498e-bf56-c33a46c53872" status: 404 len: 194 microversion: 2.1 time: 0.155037 Aug 23 10:49:37.915644 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1593/3087] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 10:49:37 2022] GET /compute/v2.1/os-security-groups/85a3cfaf-a742-498e-bf56-c33a46c53872 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:37.926411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:37.927169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:37.935278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.935790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.936232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:37.937594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:37.938664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:37.939655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:38.262904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:38.276511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c57c512a-4525-4aa4-bccf-e6bfdefae52c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.590702 Aug 23 10:49:38.280263 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1495/3088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:37 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:38.294669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Action: 'update', calling method: .version_select at 0x7fdc9c112790>, body: {"security_group": {"name": "tempest-sg-1624865123", "description": "tempest-description-1655336148"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:38.375252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:38.393995 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df83ed29-8c46-44d8-9503-e97af028012c tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 0.477222 Aug 23 10:49:38.394609 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1594/3089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:37 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:38.408485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:38.409152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:38.424196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:38.428203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:49:38.428690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:38.429184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:38.429297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Neutron security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 not found {{(pid=128860) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 10:49:38.430508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:38.430991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:38.431670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:38.434521 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] HTTP exception thrown: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.434521 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Request method failure captured: Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/os-security-groups/052a3c67-f4cc-4f9b-9a26-302e67ecdb37 HTTP/1.1 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 102 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLC6-jmkuQ5CegbX8_VBSOPEAzpJ4D-2l5BDvmC32_rzKXkzKcMvTblUSN5hHBzG1f0X699vvARtj4ykUpXqcUZZzKbv66D60kdmBI2Y6U8rjXdDWj7kQlszTc3j82vTf6vRppM-OP50huVuszcXeN2CXDYVX8PbAC5SA1P2oJiZqcQ Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f593412f0eb44feaa43d861d046c8ab8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f593412f0eb44feaa43d861d046c8ab8"}]}] Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: f593412f0eb44feaa43d861d046c8ab8 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-118059676 Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 85deb8b7b1624515b12f51067127c55c Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-118059676-project Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: {"security_group": {"name": "tempest-sg-1624865123", "description": "tempest-description-1655336148"}} Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: exception: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '052a3c67-f4cc-4f9b-9a26-302e67ecdb37', 'body': {'security_group': {'name': 'tempest-sg-1624865123', 'description': 'tempest-description-1655336148'}}} Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:49:38.437792 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] Aug 23 10:49:38.442407 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:38.448039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] Returning 404 to user: Security group 052a3c67-f4cc-4f9b-9a26-302e67ecdb37 does not exist Aug 23 10:49:38.448039 n-d-847009-13 devstack@n-api.service[128860]: Neutron server returns request_ids: ['req-e01c47c3-1610-4b99-8fb9-075d43458a24'] {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:38.449224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0342195a-14df-4935-9f8f-82872c91b89a tempest-SecurityGroupsNegativeTestJSON-118059676 tempest-SecurityGroupsNegativeTestJSON-118059676-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/052a3c67-f4cc-4f9b-9a26-302e67ecdb37" status: 404 len: 194 microversion: 2.1 time: 0.166214 Aug 23 10:49:38.458125 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1496/3090] 10.222.0.78 () {60 vars in 1290 bytes} [Tue Aug 23 10:49:38 2022] PUT /compute/v2.1/os-security-groups/052a3c67-f4cc-4f9b-9a26-302e67ecdb37 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:38.681376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:38.683001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:38.696815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:38.697725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:38.698388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:38.699298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:38.699938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:38.700540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:38.830305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:38.849379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5fa1afce-32ed-4cb6-98bd-8bfe6759ebab tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1542 microversion: 2.1 time: 0.452148 Aug 23 10:49:38.850750 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1595/3091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:38 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1542 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:38.856027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:38.856973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:38.866513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:38.867246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:38.868642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:38.870027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:38.870672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:38.871249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:39.273064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:39.302937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97d70ba2-2f88-4245-9ad2-80c88df18f28 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.627799 Aug 23 10:49:39.303540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1497/3092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:38 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:39.308442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:39.309353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:39.324349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:39.324889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:39.325668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:39.326659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:39.327380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:39.328098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:39.474846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:39.487502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14bc05a0-1f4d-4d87-82cd-5fcabb34c30a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 0.634878 Aug 23 10:49:39.500807 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1596/3093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:38 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:39.500807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:39.500807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:39.507420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:39.508061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:39.508617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:39.509975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:39.509975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:39.510645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:39.904569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:39.930395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-680f293a-e1a9-4e94-ab64-2b071656ddb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.625639 Aug 23 10:49:39.933051 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1498/3094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:39 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:39.940171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9b6e58af-4bc6-4d80-9752-35e726790780 req-680a3d16-fb95-403a-9b9f-74f30c4b43f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94cbffe-d053-422b-bacb-6ab8fd02d551", "name": "network-vif-plugged", "status": "completed", "tag": "78817fdd-ea68-4303-b30e-22df6a4b0769"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:39.966656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b6e58af-4bc6-4d80-9752-35e726790780 req-680a3d16-fb95-403a-9b9f-74f30c4b43f1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:39.977068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b6e58af-4bc6-4d80-9752-35e726790780 req-680a3d16-fb95-403a-9b9f-74f30c4b43f1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:39.977791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b6e58af-4bc6-4d80-9752-35e726790780 req-680a3d16-fb95-403a-9b9f-74f30c4b43f1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:39.997466 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9b6e58af-4bc6-4d80-9752-35e726790780 req-680a3d16-fb95-403a-9b9f-74f30c4b43f1 service nova] Creating event network-vif-plugged:78817fdd-ea68-4303-b30e-22df6a4b0769 for instance c94cbffe-d053-422b-bacb-6ab8fd02d551 on n-h1-847009-13 Aug 23 10:49:40.004877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9b6e58af-4bc6-4d80-9752-35e726790780 req-680a3d16-fb95-403a-9b9f-74f30c4b43f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070035 Aug 23 10:49:40.006594 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1499/3095] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:40.010041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:40.013607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:40.016059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:40.025174 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b88059d-32d1-4939-86e9-c33445f0e128 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 0.534763 Aug 23 10:49:40.027547 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1597/3096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:39 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:40.044867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.045221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-393d59a3-ddac-4e3b-9bb2-2dabf93deeb3 req-e4cce40e-ebf5-4fd5-b62b-092bb104de1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc65a8e-0c41-4b26-91b9-a5e4526e3e32", "name": "network-vif-deleted", "tag": "136b0631-86a8-4413-a1b1-726c1e833124"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:40.048528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.049205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.050129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.050761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.051490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.079895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-393d59a3-ddac-4e3b-9bb2-2dabf93deeb3 req-e4cce40e-ebf5-4fd5-b62b-092bb104de1a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.084200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-393d59a3-ddac-4e3b-9bb2-2dabf93deeb3 req-e4cce40e-ebf5-4fd5-b62b-092bb104de1a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.084834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-393d59a3-ddac-4e3b-9bb2-2dabf93deeb3 req-e4cce40e-ebf5-4fd5-b62b-092bb104de1a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.123113 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-393d59a3-ddac-4e3b-9bb2-2dabf93deeb3 req-e4cce40e-ebf5-4fd5-b62b-092bb104de1a service nova] Creating event network-vif-deleted:136b0631-86a8-4413-a1b1-726c1e833124 for instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 on n-h1-847009-13 Aug 23 10:49:40.139249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-393d59a3-ddac-4e3b-9bb2-2dabf93deeb3 req-e4cce40e-ebf5-4fd5-b62b-092bb104de1a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107420 Aug 23 10:49:40.143235 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1598/3097] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:40.305957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8bd4d02f-8224-4444-8295-c246de56cf44 req-e4050a73-1716-46da-82d1-cd0bf677e767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8d5c8a-eb86-43e6-8794-feef395b5f1b", "tag": "6fbcf453-9a47-44a6-987d-f83a44fdc196"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:40.308217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:40.323326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:40.327928 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8f5ef98-6c68-4089-a5cb-335a86c1001e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1252 microversion: 2.1 time: 0.319399 Aug 23 10:49:40.340769 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1500/3098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:40 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1252 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:40.356480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:40.356716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8bd4d02f-8224-4444-8295-c246de56cf44 req-e4050a73-1716-46da-82d1-cd0bf677e767 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.360615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8bd4d02f-8224-4444-8295-c246de56cf44 req-e4050a73-1716-46da-82d1-cd0bf677e767 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.360951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:40.362385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8bd4d02f-8224-4444-8295-c246de56cf44 req-e4050a73-1716-46da-82d1-cd0bf677e767 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.378711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.380914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.381646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.385016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.386938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.391976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.415266 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8bd4d02f-8224-4444-8295-c246de56cf44 req-e4050a73-1716-46da-82d1-cd0bf677e767 service nova] Creating event network-changed:6fbcf453-9a47-44a6-987d-f83a44fdc196 for instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b on n-h1-847009-13 Aug 23 10:49:40.421756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8bd4d02f-8224-4444-8295-c246de56cf44 req-e4050a73-1716-46da-82d1-cd0bf677e767 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123661 Aug 23 10:49:40.422727 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1599/3099] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:49:40.508982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:40.510459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:40.519780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.524910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.525629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.526558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:40.527182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:40.534259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:40.539708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:40.954667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:40.978859 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4878aae6-3540-4f21-b049-295f67da77f6 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 0.474389 Aug 23 10:49:40.979709 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1600/3100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:40 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:40.988280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:40.989196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:41.000609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:41.001228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:41.001733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:41.002576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:41.003046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:41.003518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:41.342303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:41.361710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b1409ef-ef3a-4f0a-9e9b-2a9d3e66d290 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.380750 Aug 23 10:49:41.363049 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1601/3101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:40 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:41.371140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:41.372307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:41.381067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:41.381865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:41.382586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:41.383631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:41.384333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:41.385066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:41.634708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:41.647960 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9bfa2767-0627-4b48-a372-a5dd58b284cb tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 0.283072 Aug 23 10:49:41.648563 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1602/3102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:41 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:41.662402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:41.669778 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07fad1ae-1234-4b47-af82-83634744b041 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 1.327426 Aug 23 10:49:41.670550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:41.671654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:41.683677 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1501/3103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:40 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:41.689493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:41.698402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:41.715075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:41.716198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:41.717480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:41.718705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.001704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:42.002506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:42.016433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.017560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:42.019187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.034816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.035057 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-37bc742a-7321-4f5b-b506-30e880fa01d0 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1252 microversion: 2.1 time: 0.369142 Aug 23 10:49:42.035494 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1603/3104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:41 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1252 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:42.037775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.042506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.045834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.060380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7e34d446-8dc2-4a0b-90d3-fe01134ce93e req-60cff469-40c2-4e55-b866-fad03f309a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909e5550-fb4c-4d86-a36b-00637f8a0511", "name": "network-vif-plugged", "status": "completed", "tag": "fcbdc18f-319a-4b90-a01a-ea115cfd9f8a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:42.076958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e34d446-8dc2-4a0b-90d3-fe01134ce93e req-60cff469-40c2-4e55-b866-fad03f309a6c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.095984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e34d446-8dc2-4a0b-90d3-fe01134ce93e req-60cff469-40c2-4e55-b866-fad03f309a6c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.096541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e34d446-8dc2-4a0b-90d3-fe01134ce93e req-60cff469-40c2-4e55-b866-fad03f309a6c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.128489 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7e34d446-8dc2-4a0b-90d3-fe01134ce93e req-60cff469-40c2-4e55-b866-fad03f309a6c service nova] Creating event network-vif-plugged:fcbdc18f-319a-4b90-a01a-ea115cfd9f8a for instance 909e5550-fb4c-4d86-a36b-00637f8a0511 on n-h2-847009-13 Aug 23 10:49:42.136600 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7e34d446-8dc2-4a0b-90d3-fe01134ce93e req-60cff469-40c2-4e55-b866-fad03f309a6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079784 Aug 23 10:49:42.142349 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1604/3105] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:42.384448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:42.385205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:42.399118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.399646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.400105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.400867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.402867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.405044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.676010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:42.685580 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c390621c-dbcb-4941-8912-b0e1d80f9fc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.305807 Aug 23 10:49:42.701343 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1605/3106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:42 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:42.708877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:42.709730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:42.738663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.742181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.744528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.748588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.750078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.753969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.870673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:42.897769 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-802c4428-a6ef-4a05-9a88-87150723c670 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 0.898426 Aug 23 10:49:42.900868 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1502/3107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:41 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:42.914529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:42.916164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:42.932626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.933167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.933621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:42.937270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:42.939181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:42.939644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:43.080083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:43.091011 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e02965b4-c302-4d57-a3ce-c96f4cbd606a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1371 microversion: 2.1 time: 0.386138 Aug 23 10:49:43.098137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1606/3108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:42 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:43.102741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:43.103365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:43.125469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:43.126080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:43.126618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:43.127599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:43.128142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:43.128650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:43.197917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:43.253309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:43.255130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:43.264548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-16d70347-1198-4829-b4bd-d70ddad9dd05 tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1252 microversion: 2.1 time: 0.165930 Aug 23 10:49:43.281326 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1607/3109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:43 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1252 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:43.652087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:43.666567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-223cc38e-7f73-49bb-917c-86b1cfce85f7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.764042 Aug 23 10:49:43.682691 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1503/3110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:42 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:43.716181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:43.716852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:43.740836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:43.743690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:43.744346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:43.745865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:43.747786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:43.749843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:43.925367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:43.926810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:43.940148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:43.941046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:43.942005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:43.945351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:43.946106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:43.949225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:44.167214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:44.176496 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e5a997d-ab7a-4741-a31f-0ebc8c3ad2ff tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1316 microversion: 2.1 time: 0.466023 Aug 23 10:49:44.181233 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1608/3111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:43 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:44.200052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:44.201189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:44.214463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:44.219684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:44.220302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:44.221227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:44.221960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:44.222500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:44.502984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:44.514379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eae33869-4f35-4072-b0e3-0ab83bf43678 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1556 microversion: 2.1 time: 0.329989 Aug 23 10:49:44.516332 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1609/3112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:44 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1556 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:44.528295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:44.529305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:44.545806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:44.547767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:44.550753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:44.551787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:44.555548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:44.556283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.110277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:45.122908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:45.140888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca404409-6451-44ad-834b-a4a457c1819a tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1252 microversion: 2.1 time: 0.622548 Aug 23 10:49:45.156498 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1610/3113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:44 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1252 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:45.161709 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f45f9b2-fb69-4406-b911-955d9ea360d1 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 1.241972 Aug 23 10:49:45.162763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:45.163230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1504/3114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:43 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:45.163396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:45.168811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:45.170314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:45.173381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:45.173900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:45.174350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.176302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:45.178311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:45.178925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.185849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:45.186515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:45.187565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.188781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:45.189517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:45.190191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.318915 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e86b2b42-f63e-4f7b-9d65-f8eef98791b7 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173233 Aug 23 10:49:45.333255 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1611/3115] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:49:45 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:45.340013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:45.341297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:45.349774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:45.350650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:45.351303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.353902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:45.356231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:45.356946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:45.886788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:45.895572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:45.901544 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6843a74-0170-410a-8c00-b351fdfac315 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1466 microversion: 2.1 time: 0.567084 Aug 23 10:49:45.904614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a321c276-64c1-476e-8757-97ebbd7358cd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.739882 Aug 23 10:49:45.905323 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1505/3116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:45 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:45.924256 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1612/3117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:45 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1466 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:46.184492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:46.186405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:46.233511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:46.247552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:46.248266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:46.249700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:46.251257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:46.251813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:46.481093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:46.483113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:46.511608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:46.512228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:46.512694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:46.521282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:46.522024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:46.522497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:46.529866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:46.544041 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac670853-a215-4cc1-8e54-f46114578a7d tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1252 microversion: 2.1 time: 0.381424 Aug 23 10:49:46.558765 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1613/3118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:46 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1252 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:46.564162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:46.565165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:46.572812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:46.573706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:46.574401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:46.575356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:46.576214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:46.578604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:47.269049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:47.283260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d41aadcd-9242-43cf-9a1f-a294dbefea04 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 0.722871 Aug 23 10:49:47.284523 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1614/3119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:46 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:47.291313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:47.292584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:47.315659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:47.316206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:47.316616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:47.317521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:47.318547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:47.319487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:47.680176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:47.693802 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf90f6b1-b24c-451a-a590-3fecc136d291 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 0.407967 Aug 23 10:49:47.694418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1615/3120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:47 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:47.718892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:47.719552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:47.753002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:47.753529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:47.757477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:47.758545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:47.759631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:47.761518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:47.972295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20231dbe3db344ba9f690607a4a80ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbc35e84eeb42f098704bf9f10a8e89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:47.986481 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a8fcd48b-1336-4671-bb32-6e860088dc3e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 200 len: 1252 microversion: 2.1 time: 0.276963 Aug 23 10:49:47.987062 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1616/3121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:47 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 1252 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:48.305799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:48.306432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:48.317299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:48.317852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:48.318240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:48.323103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:48.323843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:48.324655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:48.660695 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3f887a1-b719-4fc7-a3c4-307865f741de tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1619 microversion: 2.1 time: 2.730629 Aug 23 10:49:48.661781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1506/3122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:45 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1619 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:48.683254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11f241a2-4389-4c17-9246-a88486758c3a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: .version_select at 0x7fdc9c0c8c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-601542236", "policies": ["affinity"]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:48.709770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:48.713687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:48.733755 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-447a7caa-be5a-4be7-a1be-50d74eb8e06c tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 0.420929 Aug 23 10:49:48.747702 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1617/3123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:48 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:48.753531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:48.754389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:48.768162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-11f241a2-4389-4c17-9246-a88486758c3a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:48.771498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:48.772199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:48.772821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:48.773692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:48.774307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:48.774888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:48.786091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-11f241a2-4389-4c17-9246-a88486758c3a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:49.008080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-11f241a2-4389-4c17-9246-a88486758c3a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:49.032344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-11f241a2-4389-4c17-9246-a88486758c3a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:49.074139 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11f241a2-4389-4c17-9246-a88486758c3a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.396488 Aug 23 10:49:49.075086 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1507/3124] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Aug 23 10:49:48 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:49.082558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:49.084167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] [instance: ecc65a8e-0c41-4b26-91b9-a5e4526e3e32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:49.114279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:49.114788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:49.115360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:49.116177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:49.116649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:49.117118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:49.151194 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] HTTP exception thrown: Instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 could not be found. Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Request method failure captured: Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 HTTP/1.1 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLATm94mAqIVUOIcn0Yv4Ez9L59uCE_SZUfCFr7Ydw7Jmq-4ktxEqubs4zl98Rw9QtNaC1ypAmzbruhTsIf35V2OBg4aRHLakaC60DI-D9dp2NRUY68WFVZfCcH14i2i1UJHfQhFCNCaCcQPjMWbWqkjD1qS_O_9LMts705c39GI6VA Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 2dbc35e84eeb42f098704bf9f10a8e89 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestBootFromVolume-1321181261 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2dbc35e84eeb42f098704bf9f10a8e89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2dbc35e84eeb42f098704bf9f10a8e89", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2dbc35e84eeb42f098704bf9f10a8e89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2dbc35e84eeb42f098704bf9f10a8e89"}]}] Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestBootFromVolume-1321181261 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 2dbc35e84eeb42f098704bf9f10a8e89 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1321181261 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestBootFromVolume-1321181261-project Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 20231dbe3db344ba9f690607a4a80ee9 Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestBootFromVolume-1321181261-project Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 could not be found. Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ecc65a8e-0c41-4b26-91b9-a5e4526e3e32'} Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 could not be found. Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 could not be found. Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:49.157220 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 could not be found. Aug 23 10:49:49.162043 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:49:49.173403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Returning 404 to user: Instance ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:49.181666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e5c3e9b-ad45-44cc-ae70-60e10c2bd65e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32" status: 404 len: 111 microversion: 2.1 time: 0.098335 Aug 23 10:49:49.183299 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1508/3125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:49 2022] GET /compute/v2.1/servers/ecc65a8e-0c41-4b26-91b9-a5e4526e3e32 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:49:49.195190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ad24f079-7c95-4e1f-b6cf-01f602cad0cf req-e2df1238-6ef5-40e4-acd6-d8f7a02042b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909e5550-fb4c-4d86-a36b-00637f8a0511", "tag": "fcbdc18f-319a-4b90-a01a-ea115cfd9f8a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:49.217861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ad24f079-7c95-4e1f-b6cf-01f602cad0cf req-e2df1238-6ef5-40e4-acd6-d8f7a02042b6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:49.218535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ad24f079-7c95-4e1f-b6cf-01f602cad0cf req-e2df1238-6ef5-40e4-acd6-d8f7a02042b6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:49.218979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ad24f079-7c95-4e1f-b6cf-01f602cad0cf req-e2df1238-6ef5-40e4-acd6-d8f7a02042b6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:49.242282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ad24f079-7c95-4e1f-b6cf-01f602cad0cf req-e2df1238-6ef5-40e4-acd6-d8f7a02042b6 service nova] Creating event network-changed:fcbdc18f-319a-4b90-a01a-ea115cfd9f8a for instance 909e5550-fb4c-4d86-a36b-00637f8a0511 on n-h2-847009-13 Aug 23 10:49:49.255652 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ad24f079-7c95-4e1f-b6cf-01f602cad0cf req-e2df1238-6ef5-40e4-acd6-d8f7a02042b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067024 Aug 23 10:49:49.259351 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1509/3126] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:49.278072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d62ae2c3-373c-40bd-9748-2203a4e3645e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] Calling method '.version_select at 0x7fdca1e0adc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:49.317102 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d62ae2c3-373c-40bd-9748-2203a4e3645e tempest-ServersTestBootFromVolume-1321181261 tempest-ServersTestBootFromVolume-1321181261-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859971234" status: 202 len: 0 microversion: 2.1 time: 0.056323 Aug 23 10:49:49.318036 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1510/3127] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:49:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859971234 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:49:49.356001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-532315359", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a0c9895c-1c7c-41aa-ad89-4eca55effd24"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:49.492961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:49:49.941442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:49.963636 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c5f5025-ef4d-47df-bf87-4b3eb640bd72 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1511 microversion: 2.1 time: 1.214425 Aug 23 10:49:49.968202 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1618/3128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:48 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1511 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:49.978313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:49.984884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:49.998108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:50.003041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:50.006960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:50.008062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:50.010445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:50.011190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:50.096644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:50.097198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:50.097737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:50.098314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:50.098732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:50.524025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:50.524523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:50.525005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:50.525840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:50.526298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:50.526728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:50.546948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:50.553669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:50.568085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Going to run 2 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:50.570775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:50.633226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128860) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 23 10:49:50.658505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:50.680903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:50.694447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:50.810386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:50.835613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:50.880579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=fe7b1c36-2332-4704-9e10-abe75922884c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:51.050172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:51.062713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:51.082033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:51.094675 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8810aa98-3c91-41cc-9c81-6eaaa5fb445f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 1.120688 Aug 23 10:49:51.095280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1619/3129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:49 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:51.101405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-df215d36-8f6e-46b7-bdaf-75fd32de33ac req-3a2a6c5d-86b2-49d8-b1f9-409193ed74b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d5c8a-eb86-43e6-8794-feef395b5f1b", "name": "network-vif-plugged", "status": "completed", "tag": "6fbcf453-9a47-44a6-987d-f83a44fdc196"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:51.132540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:51.145610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-df215d36-8f6e-46b7-bdaf-75fd32de33ac req-3a2a6c5d-86b2-49d8-b1f9-409193ed74b4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:51.146317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-df215d36-8f6e-46b7-bdaf-75fd32de33ac req-3a2a6c5d-86b2-49d8-b1f9-409193ed74b4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:51.147031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-df215d36-8f6e-46b7-bdaf-75fd32de33ac req-3a2a6c5d-86b2-49d8-b1f9-409193ed74b4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:51.189026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:51.197461 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-df215d36-8f6e-46b7-bdaf-75fd32de33ac req-3a2a6c5d-86b2-49d8-b1f9-409193ed74b4 service nova] Creating event network-vif-plugged:6fbcf453-9a47-44a6-987d-f83a44fdc196 for instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b on n-h1-847009-13 Aug 23 10:49:51.207568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:51.220316 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-df215d36-8f6e-46b7-bdaf-75fd32de33ac req-3a2a6c5d-86b2-49d8-b1f9-409193ed74b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118861 Aug 23 10:49:51.223394 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1620/3130] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:51.253521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:51.254159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:51.264642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:51.265162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:51.265619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:51.266351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:51.266817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:51.273440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:51.332648 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa8738f3-bc28-4f35-bf23-6b9410d20bc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.013829 Aug 23 10:49:51.335482 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1511/3131] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:49:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 2017 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:49:51.343266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:51.363995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:51.368404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Searching by: {'deleted': False, 'project_id': '730a5bd640e2437cab0c302a1a03fb66'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:49:51.432619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:51.435320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:51.435795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:51.441033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:51.444254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:51.444775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:51.530800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:49:51.595756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c30409b9-859c-4d5f-9a71-e18436007b6b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.256326 Aug 23 10:49:51.597805 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1512/3132] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:49:51 2022] GET /compute/v2.1/servers => generated 1001 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:51.609839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f8103bf-9e84-4c93-ba9a-42e13c33817c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:51.610046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f8103bf-9e84-4c93-ba9a-42e13c33817c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:51.761167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f8103bf-9e84-4c93-ba9a-42e13c33817c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:51.773809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f8103bf-9e84-4c93-ba9a-42e13c33817c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1218 microversion: 2.1 time: 0.169193 Aug 23 10:49:51.776341 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1513/3133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:51 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:52.009996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:52.025205 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74293e06-9883-44ca-b575-fd9879e66102 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1488 microversion: 2.1 time: 0.800320 Aug 23 10:49:52.026035 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1621/3134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:51 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1488 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:52.047677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:52.050243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:52.092167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:52.095182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:52.095936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:52.096990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:52.099769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:52.100457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:52.117629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:52.118676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:52.127489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:52.130503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:52.131460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:52.133451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:52.134352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:52.137039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:52.431491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ecb563a2-f415-42dd-9c1f-b33efdcb92f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 200 len: 138 microversion: 2.1 time: 0.388553 Aug 23 10:49:52.439433 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1514/3135] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:49:52 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 138 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:49:52.447560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:52.448880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:52.477213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:52.477881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:52.479284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:52.481385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:52.482727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:52.483254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:52.808488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:52.821558 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0aeaae9-f087-4c8b-8d24-1606b2427feb tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1325 microversion: 2.1 time: 0.707898 Aug 23 10:49:52.824023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1622/3136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:52 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1325 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:52.838914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1bd9f829-6e62-4589-b58c-8d6db32e8241 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:52.844720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1bd9f829-6e62-4589-b58c-8d6db32e8241 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:53.096310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1bd9f829-6e62-4589-b58c-8d6db32e8241 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:53.109659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1bd9f829-6e62-4589-b58c-8d6db32e8241 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1218 microversion: 2.1 time: 0.276254 Aug 23 10:49:53.110375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1623/3137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:52 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:53.313045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:53.343104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24dfdd69-86c0-47c4-8be6-abb1af41e867 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.895064 Aug 23 10:49:53.346778 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1515/3138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:52 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:53.387039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:53.387917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:53.400711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:53.409800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:53.410474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:53.415369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:53.415982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:53.419138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:53.421438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1580958893", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": "none"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:53.548218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:53.548648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:53.550205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:53.550989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:53.552671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:53.580595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:53.581763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:53.582594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:53.583351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:53.583819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:53.584248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:53.635927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Getting quotas for project 1790e52b1986425d937bde202fa1eb27. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:53.669066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Getting quotas for user d741115e7b7b48e4848a2409f5015403 and project 1790e52b1986425d937bde202fa1eb27. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:53.704835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:53.722804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:53.829610 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d144e5b-ceb6-44fe-97ea-7d764d409c5d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.715860 Aug 23 10:49:53.836378 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1624/3139] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:49:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:49:53.856324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-86db54fb-d5b8-43ea-aef0-52e4fcac7137 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:53.857050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-86db54fb-d5b8-43ea-aef0-52e4fcac7137 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:53.935340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:53.950694 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff4e923e-0d8a-4139-be59-e177f72836f3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.568009 Aug 23 10:49:53.951689 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1516/3140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:53 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:53.964298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:53.981198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:53.994449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.000188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.001107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.002141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.005429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.006223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.315500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:54.333098 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c267958-df42-416b-b39d-bc6297e38d7f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1522 microversion: 2.1 time: 0.377194 Aug 23 10:49:54.333792 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1517/3141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:53 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:54.346156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:54.350297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:54.369912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.372130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.372440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.375376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.375929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.377431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.502287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86db54fb-d5b8-43ea-aef0-52e4fcac7137 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:54.516726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86db54fb-d5b8-43ea-aef0-52e4fcac7137 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:54.523223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86db54fb-d5b8-43ea-aef0-52e4fcac7137 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:54.525393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-86db54fb-d5b8-43ea-aef0-52e4fcac7137 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1278 microversion: 2.54 time: 0.687921 Aug 23 10:49:54.532422 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1625/3142] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:49:53 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1278 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:49:54.540207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:54.540864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:54.548699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.549373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.549865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.550781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.551399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.552317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.735343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:54.748554 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff9b2550-f30a-4f54-83b3-87c716440374 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1270 microversion: 2.1 time: 0.214888 Aug 23 10:49:54.756137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1626/3143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:54 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:54.761355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:54.761859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:54.778505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.785740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.786611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.787625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.788300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.788936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.837032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:54.852132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e33b474-1485-4d1d-939f-2cef8edc04a0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.516217 Aug 23 10:49:54.854074 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1518/3144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:54 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:54.875076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] HTTP exception thrown: Instance is not a member of specified network Aug 23 10:49:54.878467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:54.879563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Request method failure captured: Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b/ips/invalid HTTP/1.1 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLC5zHPwubpSWkY4YLFSFKiYyWCFWMXjFoxKO_MVgYtx1iUMJaIcv-mQFPcTEajHEW0iBSMvEOE0TKVTSl9ul3W8Wg-xVHikbCngZcsQbFMkii7DMITa3jhbl2vCerHZG8yFc0APKKZFaiknYYhSYUD7bcyIvOpYo9cRSaevnMO6j_4 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 437f772e94a94e168fada83021919902 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/437f772e94a94e168fada83021919902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_437f772e94a94e168fada83021919902", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f772e94a94e168fada83021919902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f772e94a94e168fada83021919902"}]}] Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 437f772e94a94e168fada83021919902 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerAddressesNegativeTestJSON-931703785-project Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e178a0b7deb2422b8e8c55609dc027e7 Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-931703785-project Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance is not a member of specified network Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '6f8d5c8a-eb86-43e6-8794-feef395b5f1b', 'id': 'invalid'} Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 23 10:49:54.885885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.892581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:54.893681 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-012619d0-edbd-4e80-bac2-6860698b6e3f tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.136400 Aug 23 10:49:54.894709 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1627/3145] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:49:54 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b/ips/invalid => generated 91 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:49:54.895905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.898108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.898591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.899912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:54.901615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:54.902333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:54.919165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61b82ed8-1510-4cc6-b8dc-8d52c6aa5ba8 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:54.922594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61b82ed8-1510-4cc6-b8dc-8d52c6aa5ba8 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Failed to fetch instance by id 999 {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:49:54.924682 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-61b82ed8-1510-4cc6-b8dc-8d52c6aa5ba8 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] HTTP exception thrown: Instance 999 could not be found. Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61b82ed8-1510-4cc6-b8dc-8d52c6aa5ba8 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Request method failure captured: Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLC5zHPwubpSWkY4YLFSFKiYyWCFWMXjFoxKO_MVgYtx1iUMJaIcv-mQFPcTEajHEW0iBSMvEOE0TKVTSl9ul3W8Wg-xVHikbCngZcsQbFMkii7DMITa3jhbl2vCerHZG8yFc0APKKZFaiknYYhSYUD7bcyIvOpYo9cRSaevnMO6j_4 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 437f772e94a94e168fada83021919902 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/437f772e94a94e168fada83021919902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_437f772e94a94e168fada83021919902", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f772e94a94e168fada83021919902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f772e94a94e168fada83021919902"}]}] Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 437f772e94a94e168fada83021919902 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerAddressesNegativeTestJSON-931703785-project Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e178a0b7deb2422b8e8c55609dc027e7 Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-931703785-project Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 999 could not be found. Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '999'} Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 23 10:49:54.929296 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:49:54.943149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61b82ed8-1510-4cc6-b8dc-8d52c6aa5ba8 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:49:54.945433 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61b82ed8-1510-4cc6-b8dc-8d52c6aa5ba8 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.044822 Aug 23 10:49:54.952891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1628/3146] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:49:54 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:49:54.988342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:54.989828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:55.008856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.009629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.017512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.019552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.021861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.022655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.098180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:49:55.282721 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93c4aa52-d6a8-4e67-b373-2764ae8f11e5 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 204 len: 0 microversion: 2.1 time: 0.315451 Aug 23 10:49:55.283891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1629/3147] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:49:54 2022] DELETE /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:49:55.293816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:55.294716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:55.305084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.317597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.318471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.319592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.320304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.321120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.566765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:55.576055 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6445f338-65e5-4233-98b1-a1762ff6a0b2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.703598 Aug 23 10:49:55.576641 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1519/3148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:54 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:55.590996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:55.594738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:55.606454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.607262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.607965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.609314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.610119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.610740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.830440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:55.848315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:55.859365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:55.863420 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a1fa5f0-cac1-4817-b51e-bb751c877d3f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1274 microversion: 2.54 time: 0.280647 Aug 23 10:49:55.864159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1520/3149] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:49:55 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:49:55.883476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:55.884120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:55.904848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.905919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.906723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:55.910646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:55.917583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:55.918332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:56.064880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:56.073538 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5c61efb-fa81-4e09-aa93-f951f3601859 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1276 microversion: 2.1 time: 0.203991 Aug 23 10:49:56.074761 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1521/3150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:55 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:56.080720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1063901035", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "1c5fdc6a-1777-4c61-b011-ad5f4ef33812"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:49:56.091701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:56.112268 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0cc910cc-85c7-4f5c-936c-137d3cb90b2a tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1528 microversion: 2.1 time: 0.816890 Aug 23 10:49:56.115455 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1630/3151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:55 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1528 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:49:56.161798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] validate_networks() for [('1c5fdc6a-1777-4c61-b011-ad5f4ef33812', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:49:56.892588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:56.893618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:56.908500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:56.909360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:56.910040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:56.912254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:56.914256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:56.914884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.079802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:57.090458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:57.094603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:57.098636 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0f89c11-76f6-460d-a7d3-60134d5bec4c tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1330 microversion: 2.54 time: 0.211339 Aug 23 10:49:57.101997 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1631/3152] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:49:56 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1330 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:49:57.115215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:57.116200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:57.127394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:57.127983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:57.128455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.130152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:57.130152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:57.135116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.179821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:49:57.181133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:49:57.181847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:49:57.182664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:49:57.183335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:49:57.207768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:57.213498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:57.214212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.216979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:57.219334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:57.221301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.267155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:49:57.281045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for user ca80ea2c8904468d9e6944fc274afdb8 and project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:49:57.335590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:49:57.344284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:49:57.399636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:57.418787 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-63f3d3bb-0c06-447d-b34c-caec042c70f9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1276 microversion: 2.1 time: 0.310574 Aug 23 10:49:57.419451 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1632/3153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:57 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:57.479297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:57.479936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:57.494526 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc070a68-8d34-4c8a-a653-a90ab2936113 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414227 Aug 23 10:49:57.502642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:57.503556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:57.503830 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1522/3154] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:49:57.504422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.505391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:57.506060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:57.506831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:57.521042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a05961c-212d-4cca-9858-4c8871931556 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:57.522706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a05961c-212d-4cca-9858-4c8871931556 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:57.924811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a05961c-212d-4cca-9858-4c8871931556 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:57.935720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a05961c-212d-4cca-9858-4c8871931556 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1215 microversion: 2.1 time: 0.430588 Aug 23 10:49:57.943776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1523/3155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:57 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1215 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:58.142354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:58.144346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:58.174570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:58.178299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:58.182198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:58.187758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:58.191391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:58.199669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:58.253405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:49:58.506311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:58.519069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:58.526093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:58.538315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b098037-fc31-4dfe-b4ac-ea6ff13d958b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1348 microversion: 2.54 time: 0.415028 Aug 23 10:49:58.565065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1524/3156] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:49:58 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1348 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:49:58.570230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:58.571653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:58.588274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:58.589084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:58.589752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:58.590634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:58.591630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:58.592267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:58.767475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:58.778390 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7615eae-dcd4-4830-971a-a8cebe689b46 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1276 microversion: 2.1 time: 0.211057 Aug 23 10:49:58.783682 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1525/3157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:58 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:58.983259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:58.984618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:59.005659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:59.006479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:59.007411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:59.008372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:59.009177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:59.012444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:59.165489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:59.182091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5d1eb0b-70d7-479e-a604-91746e0ccc80 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1211 microversion: 2.1 time: 0.217211 Aug 23 10:49:59.183348 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1526/3158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:58 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1211 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:59.281852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:49:59.291178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6eb11989-e1a9-43c2-9922-21a62977759e tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1528 microversion: 2.1 time: 1.840752 Aug 23 10:49:59.292379 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1633/3159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:57 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1528 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:49:59.564541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:59.565532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:59.576452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:59.577759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:59.578382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:59.579224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:59.580232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:59.582882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:59.806464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:49:59.807387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:49:59.821026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:59.822189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:59.823975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:49:59.826611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:49:59.829051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:49:59.831584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:00.065097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:00.080587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:00.082211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:00.083409 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4300327-c73f-4681-b119-7ef766dfb941 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1336 microversion: 2.54 time: 0.522921 Aug 23 10:50:00.083983 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1527/3160] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:49:59 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1336 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:00.206548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:00.207184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:00.218184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:00.223751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:00.224270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:00.224723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:00.229455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:00.232966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:00.233691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:00.335150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:00.346580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:00.349436 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce87f0ce-8079-4935-82a0-85c9f318375c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1276 microversion: 2.1 time: 0.546052 Aug 23 10:50:00.368295 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-837513a5-13eb-4c98-9d50-7955e66dd42b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1211 microversion: 2.1 time: 0.166175 Aug 23 10:50:00.368510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1634/3161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:49:59 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1276 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:00.368920 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1528/3162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:00 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1211 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:00.373518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:00.374557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:00.386880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:00.387872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:00.389817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:00.392983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:00.394632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:00.397854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:00.433793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c4ff503d-e2fc-4fcc-831c-38bfa8b0d9bc req-a53aa1b9-7fdc-4c4a-993d-ad18efef51b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8d5c8a-eb86-43e6-8794-feef395b5f1b", "name": "network-vif-deleted", "tag": "6fbcf453-9a47-44a6-987d-f83a44fdc196"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:00.449256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4ff503d-e2fc-4fcc-831c-38bfa8b0d9bc req-a53aa1b9-7fdc-4c4a-993d-ad18efef51b8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:00.458501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4ff503d-e2fc-4fcc-831c-38bfa8b0d9bc req-a53aa1b9-7fdc-4c4a-993d-ad18efef51b8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:00.458602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4ff503d-e2fc-4fcc-831c-38bfa8b0d9bc req-a53aa1b9-7fdc-4c4a-993d-ad18efef51b8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:00.476498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c4ff503d-e2fc-4fcc-831c-38bfa8b0d9bc req-a53aa1b9-7fdc-4c4a-993d-ad18efef51b8 service nova] Creating event network-vif-deleted:6fbcf453-9a47-44a6-987d-f83a44fdc196 for instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b on n-h1-847009-13 Aug 23 10:50:00.485292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c4ff503d-e2fc-4fcc-831c-38bfa8b0d9bc req-a53aa1b9-7fdc-4c4a-993d-ad18efef51b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054434 Aug 23 10:50:00.486874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1529/3163] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:50:00.661978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:00.681766 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6ccb33c-f1f7-4342-8fca-054caee1d628 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1486 microversion: 2.1 time: 0.312158 Aug 23 10:50:00.682564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1635/3164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:00 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:01.108946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:01.110032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:01.128020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.128637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.129364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.130354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.131613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.132267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.345898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:01.361750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:01.363718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:01.370319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9696fc9c-95e6-4d37-ad7a-86e53046746d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1336 microversion: 2.54 time: 0.266543 Aug 23 10:50:01.378472 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1530/3165] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:01 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1336 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:01.394515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:01.395147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:01.399106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:01.399816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:01.411786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.412296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.413025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.413778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.414260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.414695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.429929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.432931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.433437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.436618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.439725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.442967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.589475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:01.600205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eeafa8d4-0459-41ff-9819-ef19d38439e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1267 microversion: 2.1 time: 0.208558 Aug 23 10:50:01.601294 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1531/3166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:01 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:01.706723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:01.707624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:01.724335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.725330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.725961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.727156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.729269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.733739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.864662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:01.864808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:01.865186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:01.865666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lazy-loading 'fault' on Instance uuid 6f8d5c8a-eb86-43e6-8794-feef395b5f1b {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:50:02.005200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:02.021421 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7b1ab63-af2f-4ba5-abd9-0522b19b2598 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1315 microversion: 2.1 time: 0.319419 Aug 23 10:50:02.025377 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1532/3167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:01 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:02.261814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:02.290131 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eadf3e1c-ec67-4454-a4ee-b94cd7a0f5fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.901273 Aug 23 10:50:02.307869 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1636/3168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:01 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:02.404497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:02.408591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:02.450036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:02.451916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:02.454928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:02.460242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:02.464758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:02.466444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:02.535448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-21bfa36c-1d3c-4e9f-808b-02cd21dc1981 req-5200cfe3-df13-454e-8dbc-00f03cdd28e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7b1c36-2332-4704-9e10-abe75922884c", "tag": "c711af0e-e47e-47db-b55d-ac9c9f211c42"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:02.554920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-21bfa36c-1d3c-4e9f-808b-02cd21dc1981 req-5200cfe3-df13-454e-8dbc-00f03cdd28e0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:02.555419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-21bfa36c-1d3c-4e9f-808b-02cd21dc1981 req-5200cfe3-df13-454e-8dbc-00f03cdd28e0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:02.555869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-21bfa36c-1d3c-4e9f-808b-02cd21dc1981 req-5200cfe3-df13-454e-8dbc-00f03cdd28e0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:02.590262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-21bfa36c-1d3c-4e9f-808b-02cd21dc1981 req-5200cfe3-df13-454e-8dbc-00f03cdd28e0 service nova] Creating event network-changed:c711af0e-e47e-47db-b55d-ac9c9f211c42 for instance fe7b1c36-2332-4704-9e10-abe75922884c on n-h2-847009-13 Aug 23 10:50:02.609284 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-21bfa36c-1d3c-4e9f-808b-02cd21dc1981 req-5200cfe3-df13-454e-8dbc-00f03cdd28e0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076747 Aug 23 10:50:02.610500 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1637/3169] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:02.629015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:02.629734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:02.643862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:02.645229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:02.645739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:02.647669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:02.649935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:02.650408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:02.659870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:02.714026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:02.742671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:02.752047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:02.753790 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a1bbf51-ab6b-4cda-880d-9b1f7f78ed3e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1336 microversion: 2.54 time: 0.358032 Aug 23 10:50:02.770569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1533/3170] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:02 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1336 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:03.048197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:03.050012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:03.063310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.067131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.069439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:03.070422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.073389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.074065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:03.166924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.167441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.167882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:03.172027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lazy-loading 'fault' on Instance uuid 6f8d5c8a-eb86-43e6-8794-feef395b5f1b {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:50:03.228565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:03.246076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ed74e0b-9cbd-444f-8e22-a8ff80a128bd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1267 microversion: 2.1 time: 0.621875 Aug 23 10:50:03.265896 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1638/3171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:02 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1267 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:03.280460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e178a0b7deb2422b8e8c55609dc027e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '437f772e94a94e168fada83021919902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:03.291665 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3a73168-049d-4e1c-b305-508ab13a84aa tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 200 len: 1315 microversion: 2.1 time: 0.248634 Aug 23 10:50:03.292843 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1534/3172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:03 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:03.327923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:03.328679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:03.339429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.341114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.341814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:03.345671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.346378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.347668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:03.607987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:03.744530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:03.760276 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c15c2929-e5c6-4591-a2e1-04923d0463e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.434659 Aug 23 10:50:03.776514 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1639/3173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:03 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:03.787789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:03.788691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:03.801425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.802081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.803077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:03.803945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:03.804705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:03.805444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.005221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:04.035593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:04.040139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:04.041729 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f8ae122-a33d-4c79-97f4-2132344829f6 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1357 microversion: 2.54 time: 0.260661 Aug 23 10:50:04.042944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1535/3174] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:03 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:04.069308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c217d37-cc45-4dad-a1e3-64f6b3622455 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Action: 'create', calling method: .version_select at 0x7fdc9c2e0ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2056517451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2riUOT1M3fyEEi06imIgC1ViyBkyMg7hxOf+L5vFRahdS5tVjXgO/8oG8bCb47mr7gQd7mgQbu3X6nyFDkv8J8kQi9ihgj7UbJzn78s3Ljr7dYzlXaP000wHEuAi9esQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:04.089086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8c217d37-cc45-4dad-a1e3-64f6b3622455 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Getting quotas for project 1790e52b1986425d937bde202fa1eb27. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:04.095935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8c217d37-cc45-4dad-a1e3-64f6b3622455 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Getting quotas for user d741115e7b7b48e4848a2409f5015403 and project 1790e52b1986425d937bde202fa1eb27. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:04.132956 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c217d37-cc45-4dad-a1e3-64f6b3622455 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.068256 Aug 23 10:50:04.144608 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1640/3175] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:50:04 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 10:50:04.146332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2056517451", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:04.150170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:04.169837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.170407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.171043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.175226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.177201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.178804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.273497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:04.274365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:04.290201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.296209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.298266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.300973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.302227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.303190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.363894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:50:04.365437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:50:04.365957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:50:04.366378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:50:04.366801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:50:04.461667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:04.478189 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0055949f-a49b-4cd1-876c-04bb4085d926 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1273 microversion: 2.1 time: 0.210219 Aug 23 10:50:04.479300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1641/3176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:04 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:04.487275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:04.491116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] [instance: 6f8d5c8a-eb86-43e6-8794-feef395b5f1b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:04.508694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.509582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.510320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.511281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.511967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.512616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.553202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:04.555638 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] HTTP exception thrown: Instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b could not be found. Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Request method failure captured: Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b HTTP/1.1 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLC5zHPwubpSWkY4YLFSFKiYyWCFWMXjFoxKO_MVgYtx1iUMJaIcv-mQFPcTEajHEW0iBSMvEOE0TKVTSl9ul3W8Wg-xVHikbCngZcsQbFMkii7DMITa3jhbl2vCerHZG8yFc0APKKZFaiknYYhSYUD7bcyIvOpYo9cRSaevnMO6j_4 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 437f772e94a94e168fada83021919902 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/437f772e94a94e168fada83021919902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_437f772e94a94e168fada83021919902", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f772e94a94e168fada83021919902"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/437f772e94a94e168fada83021919902"}]}] Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 437f772e94a94e168fada83021919902 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-931703785 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerAddressesNegativeTestJSON-931703785-project Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e178a0b7deb2422b8e8c55609dc027e7 Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-931703785-project Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b could not be found. Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6f8d5c8a-eb86-43e6-8794-feef395b5f1b'} Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b could not be found. Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b could not be found. Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:50:04.561627 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b could not be found. Aug 23 10:50:04.565848 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:50:04.567949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] Returning 404 to user: Instance 6f8d5c8a-eb86-43e6-8794-feef395b5f1b could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:50:04.568523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.569672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1bc6171-9b81-4f3f-97fe-2be9bb32bfc2 tempest-ServerAddressesNegativeTestJSON-931703785 tempest-ServerAddressesNegativeTestJSON-931703785-project] 10.222.0.78 "GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b" status: 404 len: 111 microversion: 2.1 time: 0.089208 Aug 23 10:50:04.573495 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1642/3177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:04 2022] GET /compute/v2.1/servers/6f8d5c8a-eb86-43e6-8794-feef395b5f1b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:50:04.574261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.574740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.575503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.577912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.578495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.692222 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-117f96b2-4e37-4fad-8126-6644c411586a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "POST /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189/action" status: 202 len: 1140 microversion: 2.54 time: 0.550900 Aug 23 10:50:04.692916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1536/3178] 10.222.0.78 () {62 vars in 1320 bytes} [Tue Aug 23 10:50:04 2022] POST /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189/action => generated 1140 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 23 10:50:04.716651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:04.718645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:04.729269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.730495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.735910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.737109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.737828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.741683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.785662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:04.786320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:04.802257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.804373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.805586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:04.806606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:04.807310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:04.808193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:05.057476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:05.070812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:05.075707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:05.084341 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10c9bb75-7568-4df8-9f5e-f566d8a0211e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.369968 Aug 23 10:50:05.087510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1643/3179] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:04 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:05.109587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c7cc214c-d917-4c98-8ef2-275d983763df req-076dee9d-cb42-44f9-ade8-1eb14a84c49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f2b476b-849f-46ab-bc9a-78df551c80fc", "tag": "5ddc0565-0b27-457a-a0ba-1bfc35e5cd34"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:05.166237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c7cc214c-d917-4c98-8ef2-275d983763df req-076dee9d-cb42-44f9-ade8-1eb14a84c49a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:05.172800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c7cc214c-d917-4c98-8ef2-275d983763df req-076dee9d-cb42-44f9-ade8-1eb14a84c49a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:05.172800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c7cc214c-d917-4c98-8ef2-275d983763df req-076dee9d-cb42-44f9-ade8-1eb14a84c49a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:05.220085 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c7cc214c-d917-4c98-8ef2-275d983763df req-076dee9d-cb42-44f9-ade8-1eb14a84c49a service nova] Creating event network-changed:5ddc0565-0b27-457a-a0ba-1bfc35e5cd34 for instance 9f2b476b-849f-46ab-bc9a-78df551c80fc on n-h2-847009-13 Aug 23 10:50:05.246541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c7cc214c-d917-4c98-8ef2-275d983763df req-076dee9d-cb42-44f9-ade8-1eb14a84c49a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147518 Aug 23 10:50:05.248287 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1644/3180] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:05.500609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:05.502020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:05.505191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:05.516312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d530b2b5-2edc-4b93-b136-2fb6cfb0ec5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.736800 Aug 23 10:50:05.520654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:05.522255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:05.522945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:05.523906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:05.524595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:05.526286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:05.528151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1537/3181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:04 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:05.723818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:05.759000 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae61f57e-8397-4ea0-bcce-4a3479563b54 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1273 microversion: 2.1 time: 0.262684 Aug 23 10:50:05.771305 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1645/3182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:05 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:06.115968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:06.117439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:06.148538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:06.163544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:06.164121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:06.174263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:06.175947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:06.183421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:06.294194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:06.543770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:06.544889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:06.566564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:06.567075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:06.567517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:06.568246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:06.568711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:06.569162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:06.771975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:06.802798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:06.805300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:06.806967 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e11890a-f0e0-4b21-bdf4-ba2caa9755d4 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.697374 Aug 23 10:50:06.808485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1538/3183] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:06 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:06.829195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:06.830530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:06.845959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:06.848040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:06.849104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:06.851359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:06.852510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:06.854395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:07.230554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:07.258471 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-207e6c47-38fb-44ac-b1ad-93574234f4e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1273 microversion: 2.1 time: 0.448417 Aug 23 10:50:07.259401 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1539/3184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:06 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1273 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:07.522006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:07.534326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a23d454-a7a2-4a33-a94e-3ebf7e802b04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.993320 Aug 23 10:50:07.550874 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1646/3185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:06 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:07.835517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:07.836296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:07.848872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:07.863801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:07.865993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:07.866665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:07.883864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:07.884335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:07.886043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:07.942812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=40 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:08.096460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:08.115198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:08.121028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:08.126802 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90e7eba1-b95a-4bda-9c90-51b8bfe1fda5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.294009 Aug 23 10:50:08.128471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1540/3186] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:07 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:08.279595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:08.280634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:08.296009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:08.296464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:08.297551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:08.302032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:08.302995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:08.303825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:08.558575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:08.559813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:08.572444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:08.582168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:08.585367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:08.586160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:08.589086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:08.589583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:09.200450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:09.209796 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f243c634-3213-4dfe-ac84-ec3926426f5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.655229 Aug 23 10:50:09.213568 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1541/3187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:08 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:09.222730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:09.228078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:09.243305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:09.244103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:09.244718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:09.245657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:09.249974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:09.250448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:09.438634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:09.448523 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf67183c-27f0-4b8e-8971-77b1b6b84e9a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 1.172856 Aug 23 10:50:09.452659 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1647/3188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:08 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:09.480802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:09.491603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:09.493413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:09.494630 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5087ba66-e1e1-4f89-920f-6ab0ff87e427 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.277206 Aug 23 10:50:09.495204 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1542/3189] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:09 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:10.243542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:10.244197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:10.257533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:10.258305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:10.258916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:10.259959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:10.260600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:10.261212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:10.474200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:10.475391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:10.488342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:10.489222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:10.490837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:10.493105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:10.496345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:10.501921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:10.735094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:10.764546 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9445831e-f15e-4bce-b15e-4d0daaafd0d4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.529116 Aug 23 10:50:10.768137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1648/3190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:10 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:10.776937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:10.778366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:10.806733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:10.807508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:10.808187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:10.810615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:10.813104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:10.814376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:10.994031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:11.027433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:11.031477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:11.033919 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b3047643-8ad0-4657-8400-185f69063982 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.263720 Aug 23 10:50:11.040591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1649/3191] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:10 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:11.047108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8cb7265a-87b3-4ce8-b0c7-20b6c793478a req-25fb9d63-4d6f-4bb1-99ab-4660bcab62f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7b1c36-2332-4704-9e10-abe75922884c", "name": "network-vif-plugged", "status": "completed", "tag": "c711af0e-e47e-47db-b55d-ac9c9f211c42"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:11.064468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8cb7265a-87b3-4ce8-b0c7-20b6c793478a req-25fb9d63-4d6f-4bb1-99ab-4660bcab62f3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:11.065586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8cb7265a-87b3-4ce8-b0c7-20b6c793478a req-25fb9d63-4d6f-4bb1-99ab-4660bcab62f3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:11.066316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8cb7265a-87b3-4ce8-b0c7-20b6c793478a req-25fb9d63-4d6f-4bb1-99ab-4660bcab62f3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:11.094220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8cb7265a-87b3-4ce8-b0c7-20b6c793478a req-25fb9d63-4d6f-4bb1-99ab-4660bcab62f3 service nova] Creating event network-vif-plugged:c711af0e-e47e-47db-b55d-ac9c9f211c42 for instance fe7b1c36-2332-4704-9e10-abe75922884c on n-h2-847009-13 Aug 23 10:50:11.111979 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8cb7265a-87b3-4ce8-b0c7-20b6c793478a req-25fb9d63-4d6f-4bb1-99ab-4660bcab62f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069342 Aug 23 10:50:11.112461 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1650/3192] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:11.470855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:11.482968 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8833ff66-a3b8-41d1-811c-62648731a0f4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 1.013224 Aug 23 10:50:11.493545 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1543/3193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:10 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:11.791433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:11.792416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:11.811679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:11.812550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:11.813252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:11.814225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:11.814925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:11.816279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:12.066869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:12.067675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:12.083620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:12.087082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:12.087655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:12.088646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:12.089311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:12.092847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:12.281370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:12.291351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:12.306598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:12.314373 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ad3a47d-e9a0-47aa-ad38-6ba0a5038f7b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.251265 Aug 23 10:50:12.322383 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1544/3194] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:12 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:12.418252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0767ac22-2166-40e9-9963-f6a79662067e req-7b5d6c80-a9a2-4d0e-a9ac-498165156483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac63c0d-8cc0-42f9-a618-f01c54ff5346", "tag": "ad434aae-3b0c-40c6-8346-4f892b8d6e30"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:12.441562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0767ac22-2166-40e9-9963-f6a79662067e req-7b5d6c80-a9a2-4d0e-a9ac-498165156483 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:12.442345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0767ac22-2166-40e9-9963-f6a79662067e req-7b5d6c80-a9a2-4d0e-a9ac-498165156483 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:12.443046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0767ac22-2166-40e9-9963-f6a79662067e req-7b5d6c80-a9a2-4d0e-a9ac-498165156483 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:12.475072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0767ac22-2166-40e9-9963-f6a79662067e req-7b5d6c80-a9a2-4d0e-a9ac-498165156483 service nova] Creating event network-changed:ad434aae-3b0c-40c6-8346-4f892b8d6e30 for instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 on n-h1-847009-13 Aug 23 10:50:12.494292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0767ac22-2166-40e9-9963-f6a79662067e req-7b5d6c80-a9a2-4d0e-a9ac-498165156483 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079784 Aug 23 10:50:12.496370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1545/3195] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:50:12.516114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:12.517275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:12.543460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:12.544577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:12.545825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:12.547749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:12.550563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:12.551170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:13.004937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:13.018311 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6479957-283a-4c6e-89ed-d6e73c00d811 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.517279 Aug 23 10:50:13.018891 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1546/3196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:12 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:13.343531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:13.344178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:13.355520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:13.358500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:13.359174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:13.364311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:13.366869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:13.372258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:13.653465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:13.672008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a252e84e-077c-4462-a0fe-5bc532ec45ee tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 1.884487 Aug 23 10:50:13.673369 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1651/3197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:11 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:13.745214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:13.761520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:13.764861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:13.775842 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b163fdc-84c9-481f-a58b-606918afca78 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.430797 Aug 23 10:50:13.776592 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1547/3198] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:13 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:14.052106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:14.053500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:14.076091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:14.077944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:14.094788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:14.097190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:14.110180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:14.111941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:14.114969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=14 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:14.694740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:14.697226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:14.710059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:14.721605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:14.722360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:14.723286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:14.723919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:14.724519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:14.968731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:14.990957 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee269deb-1403-4005-9caf-89e71136c0e9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.945642 Aug 23 10:50:15.010020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1652/3199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:14 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:15.030207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:15.030889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:15.041124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:15.041626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:15.042068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:15.042791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:15.043499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:15.044115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:15.213317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:15.240482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:15.246724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:15.249884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-242dd05a-4430-48c5-98f3-a27742243527 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.238396 Aug 23 10:50:15.253946 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1653/3200] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:15 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:15.416477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:15.427418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dba3c1e-02ab-4b3d-aeed-0f62108ca34c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.736765 Aug 23 10:50:15.432175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1548/3201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:14 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:16.035135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:16.038908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:16.055418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:16.065191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:16.071469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:16.073062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:16.075703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:16.079184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:16.079886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:16.281470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:16.282171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:16.296489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:16.301424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:16.301943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:16.302717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:16.303206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:16.306378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:16.511070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:16.541254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:16.542945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:16.544201 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0af69506-f6d2-4f59-885f-1a85fb296ab8 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.270952 Aug 23 10:50:16.546701 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1549/3202] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:16 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:16.558372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:16.559064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:16.595687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:16.600675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:16.601242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:16.604899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:16.605499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:16.605975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:16.622138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:16.631616 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c949f8ab-572f-4e68-a842-82bdec914193 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.621813 Aug 23 10:50:16.649240 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1654/3203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:16 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:17.065287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:17.087562 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6c29877-59b9-4a2d-ad28-6912dd3b7e14 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.533324 Aug 23 10:50:17.090380 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1550/3204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:16 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:17.571943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:17.573183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:17.599794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:17.602502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:17.604210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:17.609964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:17.611872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:17.612779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:17.665184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:17.666839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:17.681778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:17.682347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:17.683531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:17.685027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:17.685510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:17.689782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:17.838603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:17.859894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:17.892552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:17.898579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1e65052-1584-4808-8cfa-903492ef811b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.327551 Aug 23 10:50:17.901282 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1655/3205] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:17 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:18.128470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:18.129632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:18.136930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:18.137800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:18.139599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:18.140802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:18.141527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:18.142107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:18.509049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:18.522930 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc078b22-2bdb-4a3d-888d-a95a58fa0841 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.870571 Aug 23 10:50:18.523541 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1551/3206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:17 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:18.849144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:18.863367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2ee7e90-8eeb-419d-903f-83bf7639ac0f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.745830 Aug 23 10:50:18.869102 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1656/3207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:18 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:18.930114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:18.931633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:18.947451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:18.948225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:18.948877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:18.949817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:18.950489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:18.951765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:19.156015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:19.178194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:19.187722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:19.192571 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0fc197c1-330c-40a6-98e7-904ee1035217 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.264030 Aug 23 10:50:19.193848 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1552/3208] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:18 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:19.549966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:19.550871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:19.581695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:19.582211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:19.587267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:19.590120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:19.591039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:19.595274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:19.616050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-490593603", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:19.719735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:50:20.017615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:20.029761 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e00f6789-20c9-486b-85ea-8341e42459d3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.484876 Aug 23 10:50:20.030389 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1553/3209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:19 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:20.046375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c4035aea-dc2f-4ab7-81c4-21dc4c0eb681 req-b8ed0662-df8e-48a3-945e-820ef091026d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b476b-849f-46ab-bc9a-78df551c80fc", "name": "network-vif-plugged", "status": "completed", "tag": "5ddc0565-0b27-457a-a0ba-1bfc35e5cd34"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:20.077671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4035aea-dc2f-4ab7-81c4-21dc4c0eb681 req-b8ed0662-df8e-48a3-945e-820ef091026d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:20.078428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4035aea-dc2f-4ab7-81c4-21dc4c0eb681 req-b8ed0662-df8e-48a3-945e-820ef091026d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:20.080888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4035aea-dc2f-4ab7-81c4-21dc4c0eb681 req-b8ed0662-df8e-48a3-945e-820ef091026d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:20.115846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c4035aea-dc2f-4ab7-81c4-21dc4c0eb681 req-b8ed0662-df8e-48a3-945e-820ef091026d service nova] Creating event network-vif-plugged:5ddc0565-0b27-457a-a0ba-1bfc35e5cd34 for instance 9f2b476b-849f-46ab-bc9a-78df551c80fc on n-h2-847009-13 Aug 23 10:50:20.133257 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c4035aea-dc2f-4ab7-81c4-21dc4c0eb681 req-b8ed0662-df8e-48a3-945e-820ef091026d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100026 Aug 23 10:50:20.133883 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1554/3210] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:20.145261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:20.149070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:20.165352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:20.165862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:20.166316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:20.172680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:20.173458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:20.175769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:20.601596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:20.617313 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9e1d4a6-44ed-4adb-bfb4-8a2e9e812f8d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.481264 Aug 23 10:50:20.618363 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1555/3211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:20 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:20.631164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:20.632101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:20.645265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:20.646070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:20.646676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:20.650826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:20.651519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:20.652152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:20.716151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:20.790682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:20.804048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:20.808454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:20.810110 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89c4987c-3b33-4737-862b-6a0359209983 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.189615 Aug 23 10:50:20.811463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1556/3212] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:20 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:21.054440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:21.055899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:21.067935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.070313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.075184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.080210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.081125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.082080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.293264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:50:21.294234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:50:21.294798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:50:21.295543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:50:21.296165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:50:21.316449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.319683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.320697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.321810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.327314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.328027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.385029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:21.393258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:21.416451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:50:21.419424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:50:21.505185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:21.512724 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-55b651a0-8f6a-4883-8777-0ef97cf6f8bc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175119 Aug 23 10:50:21.513970 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1657/3213] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:50:21.526053 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4be5818a-6ba5-4d47-b9f0-ad7081022a0f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.475754 Aug 23 10:50:21.530793 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1557/3214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:21 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:21.536196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b3089ee5-147c-4a52-a289-fb93e53d23af tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:21.540660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b3089ee5-147c-4a52-a289-fb93e53d23af tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:21.648990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:21.650706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:21.686927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.689441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.690550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.693664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.694297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.697088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.730413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b3089ee5-147c-4a52-a289-fb93e53d23af tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:21.742576 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b3089ee5-147c-4a52-a289-fb93e53d23af tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1214 microversion: 2.1 time: 0.221105 Aug 23 10:50:21.756425 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1658/3215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:21 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:21.839170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:21.840097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:21.861101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.861679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.862115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.862830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:21.865506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:21.869876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:21.966328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:22.129539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:22.143974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:22.145541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:22.154130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14069f2a-e1d8-4732-b1d3-d162fca83884 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.319269 Aug 23 10:50:22.171279 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1659/3216] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:21 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:50:22.391377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:22.406399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfc3ce68-123b-4090-9083-b40e02ec0863 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1318 microversion: 2.1 time: 0.771846 Aug 23 10:50:22.426053 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1558/3217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:21 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1318 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:22.566374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:22.574647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:22.623712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:22.628732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:22.629958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:22.633294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:22.635077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:22.635542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:22.767604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:22.767604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:22.789209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:22.791573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:22.792337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:22.795998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:22.797106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:22.799647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:23.107097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:23.127692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e560553-b7de-4a29-9fa4-c1190c339de9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1218 microversion: 2.1 time: 0.367939 Aug 23 10:50:23.146388 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1559/3218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:22 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1218 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:23.187687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:23.188818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:23.201968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:23.204952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:23.205574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:23.220628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:23.221364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:23.223188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:23.573925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:23.598460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:23.599068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:23.601432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:23.608700 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d9f4fc9-9fb2-46d7-809c-4897582dcdcb tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.425528 Aug 23 10:50:23.609907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1560/3219] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:23 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:23.616034 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41b2e3a9-7a1a-46fb-997c-2ed1bc9b5bd2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 1.052482 Aug 23 10:50:23.620645 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1660/3220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:22 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:23.621242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b3e0ab96-a89f-49bf-b7e0-6ca590665810 req-3be965e9-15cc-4037-877b-eafd136a90a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac63c0d-8cc0-42f9-a618-f01c54ff5346", "name": "network-vif-plugged", "status": "completed", "tag": "ad434aae-3b0c-40c6-8346-4f892b8d6e30"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:23.630717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:23.633089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:23.634853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b3e0ab96-a89f-49bf-b7e0-6ca590665810 req-3be965e9-15cc-4037-877b-eafd136a90a2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:23.635350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b3e0ab96-a89f-49bf-b7e0-6ca590665810 req-3be965e9-15cc-4037-877b-eafd136a90a2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:23.635815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b3e0ab96-a89f-49bf-b7e0-6ca590665810 req-3be965e9-15cc-4037-877b-eafd136a90a2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:23.649633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:23.652531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:23.653238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:23.655418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b3e0ab96-a89f-49bf-b7e0-6ca590665810 req-3be965e9-15cc-4037-877b-eafd136a90a2 service nova] Creating event network-vif-plugged:ad434aae-3b0c-40c6-8346-4f892b8d6e30 for instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 on n-h1-847009-13 Aug 23 10:50:23.659181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:23.659934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:23.661153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:23.666600 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b3e0ab96-a89f-49bf-b7e0-6ca590665810 req-3be965e9-15cc-4037-877b-eafd136a90a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055152 Aug 23 10:50:23.668394 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1561/3221] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:24.153347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:24.155497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:24.176222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.176779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.177270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.177961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.178433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.178874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.313302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.333573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dff702f-1dff-4452-856c-2020a0e1ffec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1266 microversion: 2.1 time: 0.185715 Aug 23 10:50:24.359077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1562/3222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:24 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:24.429111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.443759 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6d14112-40ce-4b33-af8a-03a9a303c312 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1467 microversion: 2.1 time: 0.821584 Aug 23 10:50:24.444344 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1661/3223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:23 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1467 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:24.465130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:24.465938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:24.473374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.474208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.474767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.475599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.476186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.476726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.655481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:24.657527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:24.667693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.668815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.669641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.671181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.672080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.672989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.803595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.815117 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2779a3b3-b02c-4504-95a2-46889ffc4583 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1468 microversion: 2.1 time: 0.354165 Aug 23 10:50:24.815714 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1563/3224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:24 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1468 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:24.839029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:24.847593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:24.859157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.859971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.861986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.863050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.870946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.871641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.875271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.893821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.896224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.897919 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2cb651e1-441c-49d6-8e10-c24865d50087 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.265342 Aug 23 10:50:24.898742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1662/3225] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:24 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:24.930425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:24.937614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:24.939866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Searching by: {'reservation_id': 'r-9ahsv0p4', 'deleted': False, 'project_id': '730a5bd640e2437cab0c302a1a03fb66'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:50:24.949892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.955526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.956234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:24.958050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:24.961097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:24.964226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:25.150766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:50:25.179938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:25.208666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b34bb78f-2444-4f32-bd72-c7233dd69473 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1315 microversion: 2.1 time: 0.378451 Aug 23 10:50:25.212009 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1564/3226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:24 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:25.270866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:25.305583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:25.308061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:25.308511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:25.357003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:25.359096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:25.411012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:25.411518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:25.411961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:25.412682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:25.416189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:25.416640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:25.571265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:25.583816 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4e7feab-6158-4986-b878-0eda579e4488 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1272 microversion: 2.1 time: 0.232440 Aug 23 10:50:25.585379 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1565/3227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:25 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:25.931112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:25.932600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:25.943690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:25.945803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:25.947805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:25.948763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:25.952359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:25.953069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.136411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be02ec5c-ad33-404b-9bb3-a4ff8966932c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-9ahsv0p4" status: 200 len: 2928 microversion: 2.1 time: 1.210141 Aug 23 10:50:26.137691 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1663/3228] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Aug 23 10:50:24 2022] GET /compute/v2.1/servers/detail?reservation_id=r-9ahsv0p4 => generated 2928 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:26.161871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ba4e9ba-b2f8-4bef-9a05-fbf2443a36cd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:26.231154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.server_groups [None req-8ba4e9ba-b2f8-4bef-9a05-fbf2443a36cd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Querying cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) for 2 instances {{(pid=128859) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 10:50:26.246611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ba4e9ba-b2f8-4bef-9a05-fbf2443a36cd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.247395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ba4e9ba-b2f8-4bef-9a05-fbf2443a36cd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.248609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ba4e9ba-b2f8-4bef-9a05-fbf2443a36cd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.296674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:26.306451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:26.315990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:26.317814 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dc6d414-39e6-4668-bcd6-657f65552fc7 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.391087 Aug 23 10:50:26.321283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1566/3229] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:25 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:50:26.325048 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ba4e9ba-b2f8-4bef-9a05-fbf2443a36cd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/a0c9895c-1c7c-41aa-ad89-4eca55effd24" status: 200 len: 265 microversion: 2.1 time: 0.157654 Aug 23 10:50:26.326815 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1664/3230] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:50:26 2022] GET /compute/v2.1/os-server-groups/a0c9895c-1c7c-41aa-ad89-4eca55effd24 => generated 265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:26.338242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:26.345294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:26.351569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:26.352303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:26.363884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.365619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.366300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.367225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.368162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.368860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.382776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.383731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.384372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.385444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.386155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.387178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.673768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:26.683159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a57eca9-6c67-4031-a333-e7250672f5c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1501 microversion: 2.1 time: 0.360594 Aug 23 10:50:26.684110 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1567/3231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:26 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1501 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:26.691717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:26.693190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:26.700346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.701817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.703705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.704435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.705110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.705870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.786804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:26.799210 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90e6f1f4-dbe7-4376-9394-b66f4728c8bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1272 microversion: 2.1 time: 0.113422 Aug 23 10:50:26.800127 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1568/3232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:26 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:26.835552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:26.844507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:26.861073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.861596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.862055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.867180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:26.868102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:26.868564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:26.981971 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63a41aa2-3d78-4e02-8126-e8fe2393d33a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.180220 Aug 23 10:50:26.987022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1569/3233] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:26 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:27.346545 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f10091e-dc72-454d-a610-63c2f9dce48f tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 200 len: 1620 microversion: 2.1 time: 1.012371 Aug 23 10:50:27.352859 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1665/3234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:26 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 1620 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:27.370021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:27.370765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:27.372858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:27.376368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:27.391388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:27.391840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:27.392492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:27.393424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:27.393591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:27.394186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:27.394441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:27.394915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:27.395240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:27.395767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:27.396244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:27.396681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:27.522641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:27.558431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:27.565445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:27.567106 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa7e65ca-4ea6-4c83-9b14-395930470f6f tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.227436 Aug 23 10:50:27.577454 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1570/3235] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:27 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:50:27.833083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:27.834700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:27.847551 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1164d42c-b44e-4f0e-bf8a-2da80b775289 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1621 microversion: 2.1 time: 0.476364 Aug 23 10:50:27.850552 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1666/3236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:27 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1621 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:27.851613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:27.853106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:27.853726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:27.855198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:27.855818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:27.856401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:27.879514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f365c7f-9760-4480-910a-b36588d5bf83 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: .version_select at 0x7fdca1d1e3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-683620030", "policies": ["anti-affinity"]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:27.922667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8f365c7f-9760-4480-910a-b36588d5bf83 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:27.938624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8f365c7f-9760-4480-910a-b36588d5bf83 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:28.037621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8f365c7f-9760-4480-910a-b36588d5bf83 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:28.043557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8f365c7f-9760-4480-910a-b36588d5bf83 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_groups'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:28.062808 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f365c7f-9760-4480-910a-b36588d5bf83 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.187008 Aug 23 10:50:28.075146 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1667/3237] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Aug 23 10:50:27 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:28.080848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:28.083314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:28.090166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:28.090729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:28.091180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:28.093084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:28.093576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:28.094055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:28.167782 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a02453c5-a7dc-412c-be76-6021fdf7a7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.090440 Aug 23 10:50:28.169831 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1668/3238] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:28 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:28.256097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1052100599", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c735150d-f266-4cf7-b2de-0084fdaf3da2"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:28.350927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:50:28.443627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:28.452142 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0765559-95b9-4ee5-84d6-65b1f4bbf873 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.630526 Aug 23 10:50:28.452707 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1571/3239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:27 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:28.609307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:28.609938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:28.625625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:28.629222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:28.633956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:28.635024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:28.635674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:28.636291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:28.801956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:28.811466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:28.825692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:28.830060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65fdec17-3b73-4703-8b4b-e60cf4142076 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.226321 Aug 23 10:50:28.830647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1572/3240] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:28 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:50:28.968304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:50:28.968764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:50:28.969246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:50:28.969806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:50:28.970227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:50:29.016674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.019124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.020763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.023957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.024714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.026556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.072575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:29.079016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:29.096408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Going to run 2 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:50:29.099870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:50:29.182214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:29.187260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:29.190310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128859) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 23 10:50:29.199579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:29.217660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.220055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.224065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.226375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.227006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.228390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.274174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:29.282124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:29.296346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:29.345625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c0a90bf-eeb0-46c8-863c-126ca7c412a4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.169293 Aug 23 10:50:29.347021 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1573/3241] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:29 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:50:29.410759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:29.430368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:29.473025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:29.474023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:29.487208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=2bd0133b-7a00-487c-9ea4-77c3d3a4771e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:50:29.502103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.504259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.504814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.507270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.509755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.511720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.561329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:29.665961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:29.678335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:29.777149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:29.798170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:29.899438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92f7e518-de98-4eb0-a2d0-c76ed80f1073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.646713 Aug 23 10:50:29.902499 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1669/3242] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:50:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1652 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:50:29.916885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:29.917916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:29.939575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.942931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.943752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:29.946083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:29.946730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:29.948642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:30.048013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:30.072387 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c11ebbf-70bc-496a-b71c-edf3067cf053 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.603669 Aug 23 10:50:30.073023 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1574/3243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:29 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:30.083442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:30.099214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:30.100188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Searching by: {'deleted': False, 'project_id': '730a5bd640e2437cab0c302a1a03fb66'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:50:30.135937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:30.136441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:30.137137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:30.139160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:30.139717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:30.140371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:30.171297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:30.188406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:30.190648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:50:30.191487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:30.194924 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78978518-be9e-41dd-a368-77daa43385b3 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.288883 Aug 23 10:50:30.195896 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1670/3244] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:29 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:30.208112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d06bfec2-2528-4ec5-8017-37a95a4137fa req-515f69bf-daf1-4396-8556-09fe87341276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b328dfb-1927-4dae-ab19-9bb1946bcdfb", "tag": "02c99cf4-9065-4db8-943b-6c414ac11137"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:30.229645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d06bfec2-2528-4ec5-8017-37a95a4137fa req-515f69bf-daf1-4396-8556-09fe87341276 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:30.230157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d06bfec2-2528-4ec5-8017-37a95a4137fa req-515f69bf-daf1-4396-8556-09fe87341276 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:30.231215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d06bfec2-2528-4ec5-8017-37a95a4137fa req-515f69bf-daf1-4396-8556-09fe87341276 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:30.268970 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-995fb974-5c8c-4b6e-b859-07bfe12eb0e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.194589 Aug 23 10:50:30.269781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1575/3245] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:50:30 2022] GET /compute/v2.1/servers => generated 1663 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:30.273916 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d06bfec2-2528-4ec5-8017-37a95a4137fa req-515f69bf-daf1-4396-8556-09fe87341276 service nova] Creating event network-changed:02c99cf4-9065-4db8-943b-6c414ac11137 for instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb on n-h2-847009-13 Aug 23 10:50:30.284834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f19a0503-14db-4dbf-ab59-ea633194a824 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:30.285580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f19a0503-14db-4dbf-ab59-ea633194a824 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:30.295517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d06bfec2-2528-4ec5-8017-37a95a4137fa req-515f69bf-daf1-4396-8556-09fe87341276 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094169 Aug 23 10:50:30.297166 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1671/3246] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:30.358788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:30.361423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:30.382929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:30.383703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:30.384319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:30.385243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:30.385889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:30.386490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:30.434916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f19a0503-14db-4dbf-ab59-ea633194a824 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:30.445012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f19a0503-14db-4dbf-ab59-ea633194a824 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1219 microversion: 2.1 time: 0.164398 Aug 23 10:50:30.446297 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1576/3247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:30 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:30.506746 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-322748a6-2e16-4b72-a0a5-e411cd168611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.152725 Aug 23 10:50:30.512352 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1672/3248] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:30 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:50:31.097624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:31.098408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:31.127762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.128262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.131411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.137150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.142461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.143237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.227120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:31.228319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:31.251340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.261096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.262486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.271730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.273912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.275632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.662154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:31.696154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:31.696589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:31.705640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:31.713375 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a1c0f28-200b-4785-9a23-4abf7c31ceb1 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.491347 Aug 23 10:50:31.713923 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aac14406-ec71-4b4e-bab4-32533bb4afed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.617132 Aug 23 10:50:31.715906 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1577/3249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:31 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:31.716317 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1673/3250] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:31 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:31.737356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:31.738154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:31.742460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:31.752078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:31.772759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.773264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.781503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.782618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.784877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.785943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.806499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.810009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.816346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.817790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:31.822459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:31.827287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:31.892509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf8e0d25-d126-47f2-8d7b-8d2434793e04 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.171009 Aug 23 10:50:31.893696 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1578/3251] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:31 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:32.399177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:32.419573 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edc194f6-97b8-4d60-b44a-c9c7ede11ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1215 microversion: 2.1 time: 0.697617 Aug 23 10:50:32.425710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1674/3252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:31 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1215 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:32.747033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:32.748940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:32.750023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:32.751348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:32.773644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:32.774328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:32.774844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:32.777079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:32.777775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:32.778471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:32.782191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:32.782860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:32.783343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:32.784474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:32.789333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:32.790330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:33.189960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:33.211088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:33.224325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:33.225826 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ac8ea99-4071-43ec-a17f-84eed0f06912 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1409 microversion: 2.54 time: 0.484836 Aug 23 10:50:33.226457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1675/3253] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:32 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1409 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:33.266709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:33.272598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:33.274922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:33.288732 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14c8f60c-81f8-4e57-97d8-6dee2d0d9a32 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.552796 Aug 23 10:50:33.290320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1579/3254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:32 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:33.299701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:33.302476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:33.303241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:33.304712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:33.305441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:33.306078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:33.378102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b14aaec-6c26-43f9-820c-ff41aad79262"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:33.381044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:33.391528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:33.392252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:33.392593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:33.393345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:33.393817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:33.394865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:33.957179 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70cf1bd8-d6de-4848-828e-181d392ac812 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "POST /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575057 Aug 23 10:50:33.960605 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1580/3255] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:50:33 2022] POST /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:50:33.972231 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4dee12d5-2bd0-4914-b1e9-3817a4d1b00f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.717950 Aug 23 10:50:33.980289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:33.982167 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1676/3256] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:33 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:33.983061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:34.009608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:34.011533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:34.017923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:34.026361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:34.027007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:34.028546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:34.270593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:34.285481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:34.286727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:34.306944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09df7966-169a-4d98-b8d5-51164128068d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1271 microversion: 2.1 time: 0.339880 Aug 23 10:50:34.309494 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1581/3257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:33 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1271 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:34.324805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:34.325889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:34.340707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:34.345497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:34.346285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:34.349096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:34.349814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:34.350281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:34.350979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:34.351375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:34.351502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:34.352206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:34.359009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:34.359523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:34.626060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:34.650646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:34.657960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:34.667373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3aea9efd-4507-4c1e-939a-c68420f47e97 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1427 microversion: 2.54 time: 0.393955 Aug 23 10:50:34.672923 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1677/3258] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:34 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1427 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:34.852294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:34.872671 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8edf16b5-bb5f-4858-a16e-d1d3c26bcc0f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.550039 Aug 23 10:50:34.878745 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1582/3259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:34 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:34.995742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:35.000125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:35.031724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:35.032422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:35.036574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:35.049057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:35.052967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:35.054091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:35.314373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1609751339", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:35.490903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] validate_networks() for [('efc6e76a-aa02-42d6-bc17-2e6f44b0a0c5', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:50:36.266590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:50:36.267448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:50:36.268192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:50:36.269015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:50:36.269795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:50:36.297111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.298677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.299702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.302757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.303660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.306149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.356451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Getting quotas for project be943232715d4de78de5bf47d056b11c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:36.376615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Getting quotas for user 268524fb46ef417b839c2b3af9b4edd3 and project be943232715d4de78de5bf47d056b11c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:36.396711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:50:36.401305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:50:36.476591 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d95e83a-96c1-46fa-8bce-3df5fbb0030a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.311903 Aug 23 10:50:36.478432 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1583/3260] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:50:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:50:36.484610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:36.485505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:36.497124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.498255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.499134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.501027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.502138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.503167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.639335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:36.653247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-291dcb61-fb17-444b-96b6-0a72d51dbfb6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1277 microversion: 2.1 time: 0.173125 Aug 23 10:50:36.655225 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1584/3261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:36 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:36.665989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:36.667417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:36.681667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.682187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.682639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.683373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.683844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.684283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.784289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:36.796241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:36.798163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:36.800204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb6c619a-727b-4fc0-ba16-4d7441fa0a2a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1415 microversion: 2.54 time: 0.141904 Aug 23 10:50:36.801329 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1585/3262] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:36 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1415 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:36.807269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:36.808006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:36.815510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.816597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.817182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:36.818163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:36.818874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:36.819461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:37.290095 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f89a01c-f9e1-4e86-b3af-1e9b559c25c5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 2.304163 Aug 23 10:50:37.295683 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1678/3263] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:34 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 2311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:37.306097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f02bce44-f083-478f-9fdc-eb5cb00d9a2a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:37.320824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f02bce44-f083-478f-9fdc-eb5cb00d9a2a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:37.416956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:37.425874 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b07c7f5-da1b-47e9-9ec0-de298e6644aa tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.623260 Aug 23 10:50:37.426473 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1586/3264] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:36 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:37.553293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f02bce44-f083-478f-9fdc-eb5cb00d9a2a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:37.561471 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f02bce44-f083-478f-9fdc-eb5cb00d9a2a tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1223 microversion: 2.1 time: 0.263709 Aug 23 10:50:37.562179 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1679/3265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:37 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:37.678044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:37.678678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:37.692836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:37.693361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:37.693864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:37.697053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:37.699954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:37.702169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:37.828373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:37.829307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:37.845866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:37.850893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:37.852626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:37.853455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:37.854407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:37.856643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:37.864003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:37.869919 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f87225b-310d-4e59-abe3-69e21275f2e0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1277 microversion: 2.1 time: 0.196309 Aug 23 10:50:37.871835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1587/3266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:37 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:37.943420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:38.136111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:38.155082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:38.157898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:38.159605 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19750996-3508-44f3-bf5d-0d4fe82d9392 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1415 microversion: 2.54 time: 0.336200 Aug 23 10:50:38.161270 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1680/3267] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:37 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1415 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:38.303191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:38.306040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:38.324536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:38.332671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:38.333414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:38.337367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:38.338075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:38.338725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:38.446895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:38.447775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:38.475228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:38.479308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:38.483064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:38.486274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:38.488197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:38.491194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:38.712205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddff5870-3947-4365-9098-bbf4818988f1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.412762 Aug 23 10:50:38.716602 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1588/3268] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:38 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:38.723717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:38.724403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:38.759852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:38.761126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:38.766615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:38.767445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:38.767946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:38.768400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:38.913911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:38.984251 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4add3a76-4ea4-4818-a23b-b66ebc9e58b7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1275 microversion: 2.1 time: 0.263855 Aug 23 10:50:39.004774 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1589/3269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:38 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:39.017163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:39.018438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:39.034466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:39.035338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:39.036076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:39.038837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:39.039619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:39.040328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:39.054236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:39.145354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:39.161739 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f5494c39-4707-4f5d-93e1-105bfb853665 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.718487 Aug 23 10:50:39.162368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1681/3270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:38 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:39.191130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:39.191580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:39.207417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:39.208245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:39.210433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:39.211377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:39.213742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:39.214388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:39.343634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:39.357407 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8576feb3-9df4-4989-a671-52ca7d0f282d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.350392 Aug 23 10:50:39.360691 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1590/3271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:39 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:39.646361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:39.662859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:39.665986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:39.671546 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcc3cbf1-eba2-4986-aefa-d1577347026e tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1415 microversion: 2.54 time: 0.487141 Aug 23 10:50:39.673163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1682/3272] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:39 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1415 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:39.727152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:39.730410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:39.746425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:39.746880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:39.750010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:39.751075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:39.751718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:39.752324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:39.878148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b714645-ba95-4dde-b615-beb32e762f33 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 14 microversion: 2.1 time: 0.157701 Aug 23 10:50:39.879564 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1591/3273] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:39 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:50:40.007358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:40.008207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:40.020622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:40.021099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:40.021540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:40.027163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:40.027671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:40.028143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:40.189584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:40.190316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:40.219161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:40.221629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:40.222410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:40.227445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:40.227962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:40.228412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:40.295512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:40.983809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:40.999523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d918f057-2823-43b9-a064-f48ac9abafa2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.815506 Aug 23 10:50:41.005860 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1592/3274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:40 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:41.018462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:41.019021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:41.031149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.031658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.032110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.032879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.033347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.037003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.213463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.247357 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-696e9896-e481-4f18-a7be-e4a28a86a737 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1283 microversion: 2.1 time: 1.243506 Aug 23 10:50:41.251248 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1683/3275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:40 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1283 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:41.258602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d175ea86-ef72-4875-b65f-521d5260787c req-4a82e51e-3167-4f71-8f11-36e1e92368f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b328dfb-1927-4dae-ab19-9bb1946bcdfb", "name": "network-vif-plugged", "status": "completed", "tag": "02c99cf4-9065-4db8-943b-6c414ac11137"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:41.290396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d175ea86-ef72-4875-b65f-521d5260787c req-4a82e51e-3167-4f71-8f11-36e1e92368f9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.291197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d175ea86-ef72-4875-b65f-521d5260787c req-4a82e51e-3167-4f71-8f11-36e1e92368f9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.291874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d175ea86-ef72-4875-b65f-521d5260787c req-4a82e51e-3167-4f71-8f11-36e1e92368f9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.301145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.314274 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51d69c06-851f-48e5-8836-cc70fe569d04 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.306195 Aug 23 10:50:41.315466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1593/3276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:41 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:41.320959 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d175ea86-ef72-4875-b65f-521d5260787c req-4a82e51e-3167-4f71-8f11-36e1e92368f9 service nova] Creating event network-vif-plugged:02c99cf4-9065-4db8-943b-6c414ac11137 for instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb on n-h2-847009-13 Aug 23 10:50:41.324369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:41.325499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:41.336548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d175ea86-ef72-4875-b65f-521d5260787c req-4a82e51e-3167-4f71-8f11-36e1e92368f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082545 Aug 23 10:50:41.344643 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1684/3277] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:41.350717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:41.352505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.360878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:41.368921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.369952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.370145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.373661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.374022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.374385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.375246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.376319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.378323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.379016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.379798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.491219 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44e594c2-df7d-45ad-b030-141dbd0de9d1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action" status: 200 len: 16366 microversion: 2.1 time: 0.143847 Aug 23 10:50:41.492251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1685/3278] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:41 2022] POST /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346/action => generated 16366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:50:41.507415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:41.508829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:41.523660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.524478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.525181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.526907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.527595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.528302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.549720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.575107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.580674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.583516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05e490a7-84ed-4538-8724-964a2c0af43d tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1400 microversion: 2.54 time: 0.266560 Aug 23 10:50:41.584997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1594/3279] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:41 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1400 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:41.611279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e272377e-6871-4a71-8a49-0b51fe8347b9 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '.version_select at 0x7fdc9cbe9820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:41.646422 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e272377e-6871-4a71-8a49-0b51fe8347b9 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2056517451" status: 204 len: 0 microversion: 2.54 time: 0.040509 Aug 23 10:50:41.647794 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1595/3280] 10.222.0.78 () {60 vars in 1319 bytes} [Tue Aug 23 10:50:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2056517451 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:50:41.666382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:41.667552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:41.674751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.675554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.676390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.677675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.678367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.679024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.712931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:50:41.827702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e02219c3-37de-4afb-b2b5-a99306328b4a tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 204 len: 0 microversion: 2.54 time: 0.163676 Aug 23 10:50:41.833810 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1596/3281] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:50:41 2022] DELETE /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:50:41.840171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:41.841952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:41.851103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.851598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.852037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.852928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:41.853451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:41.854327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:41.954191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.975874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.977458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:41.979771 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f75cda9b-778c-47ef-bda0-e9e70029e033 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1406 microversion: 2.54 time: 0.144552 Aug 23 10:50:41.995860 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1597/3282] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:41 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:42.032476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:42.033212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:42.046974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.047411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.047915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.048711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.049250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.049689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.235409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:42.262535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5bc02477-a2a2-4853-abe6-25fdf907246f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.762643 Aug 23 10:50:42.265609 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1686/3283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:41 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:42.277444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:42.279306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:42.306416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.309411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.311376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.312327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.314446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.316614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.362833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:42.373721 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0ad717a-0d79-46a5-8363-19320c51ad6f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.345685 Aug 23 10:50:42.384338 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1598/3284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:42 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:42.398561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:42.399235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:42.413617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.414126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.421524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.421843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.422134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.422595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.716899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:42.731201 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d28c374-f185-40a5-915a-c200bd38c019 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.462853 Aug 23 10:50:42.737071 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1687/3285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:42 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:42.751508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:42.754580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:42.771308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.771900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.772417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.775264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.776512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.781624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.885731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:42.903455 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fabd9418-3b6d-44a4-8554-0d6e0e68a401 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.516138 Aug 23 10:50:42.905423 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1599/3286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:42 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:42.917556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d1e1c312-76d3-49db-b90a-ed1b7498f053 req-20ccac65-e881-4b29-9aac-310eb8526d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:42.938338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1e1c312-76d3-49db-b90a-ed1b7498f053 req-20ccac65-e881-4b29-9aac-310eb8526d59 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:42.938842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1e1c312-76d3-49db-b90a-ed1b7498f053 req-20ccac65-e881-4b29-9aac-310eb8526d59 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:42.940083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1e1c312-76d3-49db-b90a-ed1b7498f053 req-20ccac65-e881-4b29-9aac-310eb8526d59 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:42.990183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d1e1c312-76d3-49db-b90a-ed1b7498f053 req-20ccac65-e881-4b29-9aac-310eb8526d59 service nova] Creating event network-changed:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:50:43.005427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d1e1c312-76d3-49db-b90a-ed1b7498f053 req-20ccac65-e881-4b29-9aac-310eb8526d59 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094923 Aug 23 10:50:43.007744 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1600/3287] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:43.016715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-68d9f12d-25a1-4df0-a06e-f4b6a15fa9ec req-817e76dc-9ca9-4baa-bc70-4fbac3d5ae9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd9db75-5081-47ca-9f3e-d73cdcfe1acd", "tag": "7d355080-2421-4394-93ef-99cf1fc6045f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:43.029285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-68d9f12d-25a1-4df0-a06e-f4b6a15fa9ec req-817e76dc-9ca9-4baa-bc70-4fbac3d5ae9c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.029595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-68d9f12d-25a1-4df0-a06e-f4b6a15fa9ec req-817e76dc-9ca9-4baa-bc70-4fbac3d5ae9c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.030188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-68d9f12d-25a1-4df0-a06e-f4b6a15fa9ec req-817e76dc-9ca9-4baa-bc70-4fbac3d5ae9c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.049439 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-68d9f12d-25a1-4df0-a06e-f4b6a15fa9ec req-817e76dc-9ca9-4baa-bc70-4fbac3d5ae9c service nova] Creating event network-changed:7d355080-2421-4394-93ef-99cf1fc6045f for instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd on n-h2-847009-13 Aug 23 10:50:43.054580 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-68d9f12d-25a1-4df0-a06e-f4b6a15fa9ec req-817e76dc-9ca9-4baa-bc70-4fbac3d5ae9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044184 Aug 23 10:50:43.055545 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1601/3288] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:43.071931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:43.073072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:43.083679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.084495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.085205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.086310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.087324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.087975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.302674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:43.312114 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9058f744-4a62-47ca-8ec6-2b02acb7468d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.567153 Aug 23 10:50:43.328871 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1688/3289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:42 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:43.344672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:43.345577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:43.356393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.357781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.358820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.359793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.360599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.361425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.462165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:43.479736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:43.481329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:43.484520 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8994de94-bf63-44d5-a1eb-621becf642e5 tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1406 microversion: 2.54 time: 0.149909 Aug 23 10:50:43.485439 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1689/3290] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:43 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:43.490352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:43.491176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:43.499980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.501226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.502101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.503091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.504050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.504849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.505529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:43.514787 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-581f0716-48df-4567-a5c4-336bcaf04bc9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.457944 Aug 23 10:50:43.522101 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1602/3291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:43 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:43.554916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:43.555565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:43.575381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.595828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.596243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.597188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:43.597731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:43.598259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:43.971339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:43.986103 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-139bf142-0ca3-4ac6-b7c4-8bf6d92c98f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.432187 Aug 23 10:50:43.986849 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1603/3292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:43 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:43.991828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:43.992723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:44.009785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.010547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.010733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.011467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.011936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.012372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.162502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:44.202237 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c25812e-ddfe-44eb-bfeb-d5bb3c759061 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1314 microversion: 2.1 time: 0.697261 Aug 23 10:50:44.204710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1690/3293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:43 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:44.220931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:44.224427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:44.240970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.242777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.243585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.245724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.246629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.248402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.356598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Locking {{(pid=128859) lock /opt/stack/nova/nova/compute/api.py:4828}} Aug 23 10:50:44.438678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:44.446484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8479928b-adb6-482f-ac51-2fd35bd78d5c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.238406 Aug 23 10:50:44.449403 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1691/3294] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:44 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:50:44.457489 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16c0c580-651a-48f2-b0ec-3643663b7225 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.469740 Aug 23 10:50:44.458092 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1604/3295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:43 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:44.461279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:44.461919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:44.462638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:44.463256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:44.469208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.469987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.470460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.471230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.471700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.472138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.477805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.478307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.478757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.479474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.479938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.480371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.816161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:44.831571 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-874bbee2-af2d-4f27-bafb-ca43e7f8762b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.372372 Aug 23 10:50:44.832151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1605/3296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:44.837113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:44.838079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:44.845830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.846841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.847449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.848595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.849381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.849977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.888871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:44.889598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:44.890280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:44.890903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lazy-loading 'fault' on Instance uuid e2dc371e-cae2-4ef3-a646-bbcd0f686189 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:50:44.972894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:44.985524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:44.987128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd741115e7b7b48e4848a2409f5015403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1790e52b1986425d937bde202fa1eb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:44.988490 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af7a938a-ab26-404a-858e-79a662f4738b tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 200 len: 1411 microversion: 2.54 time: 0.155252 Aug 23 10:50:44.989104 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1606/3297] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:44 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:50:45.007998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:45.015923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.016554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.017114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.041395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] HTTP exception thrown: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd is locked Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Request method failure captured: Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action HTTP/1.1 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 15 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-HidHNCiiYouTpQZNSTX6xSKmpIHn1LDJUIyrjpRRhD5fLRr1Oyn3WfLItexZQ089QBXqXC4xWwzl9mlyHsj-Cpf0IniFMcyW608Qn4n21ZrmY00zavgZR5tdAUEV_M1iOCrcccc9E5i7ZYpnh1Wq5GsZ5Ekr1iC4ukoJlwjCutcw Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7fefe975214d6a8482557904472914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7fefe975214d6a8482557904472914", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}] Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: ca80ea2c8904468d9e6944fc274afdb8 Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: {"os-stop": {}} Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd is locked Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd', 'body': {'os-stop': {}}} Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd is locked Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd is locked Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd is locked Aug 23 10:50:45.043202 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:45.049560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Returning 409 to user: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd is locked {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:50:45.049560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed1b9197-4603-4b5c-b445-26098ece6a10 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 409 len: 107 microversion: 2.1 time: 0.042993 Aug 23 10:50:45.049560 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1607/3298] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:45 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 107 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:50:45.055094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:45.055770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:45.063014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.063685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.064595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.065103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.065689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.066266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.113762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:45.124262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Unlocking {{(pid=128860) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 23 10:50:45.205776 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7289c868-826d-44da-aeed-784ed939e4a9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.154767 Aug 23 10:50:45.207018 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1608/3299] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:45 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:50:45.217031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b5dd234-dbfc-4c09-8228-06c964e13660 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:45.225860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b5dd234-dbfc-4c09-8228-06c964e13660 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.226629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b5dd234-dbfc-4c09-8228-06c964e13660 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.227289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b5dd234-dbfc-4c09-8228-06c964e13660 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.258186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:45.262466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b5dd234-dbfc-4c09-8228-06c964e13660 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 10:50:45.273769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61545ae5-6926-4357-b52e-4914f129cdeb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.820283 Aug 23 10:50:45.274364 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1692/3300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:44 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:45.279116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:45.287503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:45.295344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.297446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.298070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.301633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.302297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.302926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.384804 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b5dd234-dbfc-4c09-8228-06c964e13660 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.172823 Aug 23 10:50:45.390594 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1609/3301] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:45 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:50:45.418483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:45.420402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:45.439077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:45.441203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.442548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.443112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.449226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.449988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.450995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.691398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:45.700156 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-952d6c63-bb62-4cca-acc0-3f95b3e40140 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.294670 Aug 23 10:50:45.703367 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1610/3302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:45 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:45.722613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:45.723383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:45.730276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.731089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.731872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.734667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.735982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.736670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.830727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:45.843337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb71ab84-fe31-455b-9eb9-4832e367bb1e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1501 microversion: 2.1 time: 0.567675 Aug 23 10:50:45.844209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1693/3303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:45 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1501 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:45.864564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:45.866213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:45.875028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.875526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.875966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.876676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:45.877161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:45.877589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:45.940697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:45.953691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c862cac3-30a1-41a0-bb03-4c638d5b58c2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.248242 Aug 23 10:50:45.955215 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1611/3304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:45 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:45.959424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:50:46.011122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:46.017667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:46.018058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] [instance: e2dc371e-cae2-4ef3-a646-bbcd0f686189] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:46.031310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.032920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.033362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.034914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.035583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.036859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.057234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] HTTP exception thrown: Instance e2dc371e-cae2-4ef3-a646-bbcd0f686189 could not be found. Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Request method failure captured: Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 HTTP/1.1 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDQIyOJGuZAw3cG4exdK3HP5pJHsSJbTGy_P0ii1KNO1Z9xhL3pLsKFFzO2bO1U-VS4wVLPY8hJZuWolOnpkZL-4dg0YKiFf7n4MB_BcGYa8ExS981qFYyKsLyhgMhTq1-XTmqQC1zruyNUF4US7mN5G7TTwOjzi-bGCgx_iR35YeQ Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.54 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1790e52b1986425d937bde202fa1eb27 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerShowV254Test-867074168 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1790e52b1986425d937bde202fa1eb27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1790e52b1986425d937bde202fa1eb27", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1790e52b1986425d937bde202fa1eb27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1790e52b1986425d937bde202fa1eb27"}]}] Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerShowV254Test-867074168 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1790e52b1986425d937bde202fa1eb27 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerShowV254Test-867074168 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerShowV254Test-867074168-project Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: d741115e7b7b48e4848a2409f5015403 Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerShowV254Test-867074168-project Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance e2dc371e-cae2-4ef3-a646-bbcd0f686189 could not be found. Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'e2dc371e-cae2-4ef3-a646-bbcd0f686189'} Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2dc371e-cae2-4ef3-a646-bbcd0f686189 could not be found. Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2dc371e-cae2-4ef3-a646-bbcd0f686189 could not be found. Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:46.059063 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2dc371e-cae2-4ef3-a646-bbcd0f686189 could not be found. Aug 23 10:50:46.064002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:46.065397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] Returning 404 to user: Instance e2dc371e-cae2-4ef3-a646-bbcd0f686189 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:50:46.071649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:46.081237 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41c220af-cf9c-4839-9e62-ab47a9ad8eaf tempest-ServerShowV254Test-867074168 tempest-ServerShowV254Test-867074168-project] 10.222.0.78 "GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189" status: 404 len: 111 microversion: 2.54 time: 0.056938 Aug 23 10:50:46.094071 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cccef471-d337-4c6d-a2ac-8106d8ec9b07 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 204 len: 0 microversion: 2.1 time: 0.232934 Aug 23 10:50:46.100268 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1694/3306] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:50:45 2022] DELETE /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:50:46.103897 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1612/3306] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:50:46 2022] GET /compute/v2.1/servers/e2dc371e-cae2-4ef3-a646-bbcd0f686189 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:50:46.116465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:46.116924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:46.127353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.128391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.128833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.129882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.130472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.131460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.303814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:46.305749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:46.318179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.319683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.320640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.321716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.322624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.323393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.355868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:46.391251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:46.623110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:46.637039 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e6078f6-7b94-45a2-84e2-e16c32435d77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1507 microversion: 2.1 time: 0.532374 Aug 23 10:50:46.637770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1695/3307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:46 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:46.669607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b2f25aaa-43c5-40b6-ab10-ea4f6bc9305c req-c5d9f4bb-ee28-4ddd-932f-b234ddae161b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bd0133b-7a00-487c-9ea4-77c3d3a4771e", "tag": "7d70e389-7680-4da2-9e6e-41d17c1ecd30"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:46.701330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b2f25aaa-43c5-40b6-ab10-ea4f6bc9305c req-c5d9f4bb-ee28-4ddd-932f-b234ddae161b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.702379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b2f25aaa-43c5-40b6-ab10-ea4f6bc9305c req-c5d9f4bb-ee28-4ddd-932f-b234ddae161b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.703719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b2f25aaa-43c5-40b6-ab10-ea4f6bc9305c req-c5d9f4bb-ee28-4ddd-932f-b234ddae161b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.723435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:46.737988 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d428ed6-81d8-4d38-9054-7d6814a7520d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.445590 Aug 23 10:50:46.739923 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1613/3308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:46 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:46.753137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:46.755273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b2f25aaa-43c5-40b6-ab10-ea4f6bc9305c req-c5d9f4bb-ee28-4ddd-932f-b234ddae161b service nova] Creating event network-changed:7d70e389-7680-4da2-9e6e-41d17c1ecd30 for instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e on n-h1-847009-13 Aug 23 10:50:46.757265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:46.760439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b2f25aaa-43c5-40b6-ab10-ea4f6bc9305c req-c5d9f4bb-ee28-4ddd-932f-b234ddae161b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094679 Aug 23 10:50:46.762805 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1696/3309] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:50:46.772760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.775864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.776356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.780678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.783485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.785518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.978972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:46.979793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:46.994293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.994816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.995277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:46.996021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:46.996559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:46.997026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:47.225486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:47.246214 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa9b693b-550d-45f9-bc48-63ebe349f85f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.503934 Aug 23 10:50:47.257286 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1614/3310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:46 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:47.460551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:47.472368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5c10e132-a4bc-41cd-a738-480e87edbffb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.498073 Aug 23 10:50:47.473017 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1697/3311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:46 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:47.661988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:47.662625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:47.678262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:47.678767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:47.680397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:47.687716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:47.688340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:47.688894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:47.768723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:47.769438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:47.778028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=42 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:47.807290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:47.814907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:47.818082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:47.824610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:47.826513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:47.826996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:48.272634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:48.285603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7bbb4003-8a13-4efc-8d59-0d7449446941 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.528034 Aug 23 10:50:48.289787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1698/3312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:47 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:48.302526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:48.303168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:48.324777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:48.325934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:48.327163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:48.328201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:48.329388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:48.330034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:48.899827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:48.939590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad325ce9-6f08-48ca-b1bd-e4ab16b1d030 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.648551 Aug 23 10:50:48.941494 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1699/3313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:48 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:48.961432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:48.973735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:48.999291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:49.000279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:49.002015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:49.002981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:49.003780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:49.004881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:49.192489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:49.218043 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7be4878e-c816-4076-96cc-7d00c54b4593 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1507 microversion: 2.1 time: 1.560072 Aug 23 10:50:49.219644 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1615/3314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:47 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1507 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:49.312002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:49.312628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:49.319635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:49.320138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:49.320933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:49.321665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:49.322259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:49.322691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:49.489263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:49.503097 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0fca06d0-88e9-4df0-9687-84adf9a3e5f8 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.559206 Aug 23 10:50:49.503689 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1700/3315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:48 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:49.979409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:49.980852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:49.989367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:49.990152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:49.993872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:49.994985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:49.995619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:49.996298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:50.276537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:50.292710 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a3867905-b14d-4e04-80c1-225e015fcc90 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.984837 Aug 23 10:50:50.308688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1616/3316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:49 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:50.315543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:50.316453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:50.324260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:50.326423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:50.327119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:50.328014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:50.328649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:50.329289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:50.634153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:50.649030 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d1cb9be-95f0-401c-a266-b0c038523382 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.684260 Aug 23 10:50:50.651825 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1701/3317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:49 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:50.664694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:50.667245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:50.684430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:50.685591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:50.686047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:50.686842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:50.701982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:50.702678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:50.828707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:50.837457 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-444a8a68-dee2-446b-bdbd-7be1cd55cf24 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1507 microversion: 2.1 time: 0.527510 Aug 23 10:50:50.838737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1617/3318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:50 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:51.314686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:51.316272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:51.330602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.331360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.331963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.333579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.335353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.335966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.599140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:51.611229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ccda4ac-6749-4a04-8592-29c57f42096e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.300884 Aug 23 10:50:51.633756 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1618/3319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:51 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:51.641497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:51.645259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:51.651718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.652311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.654255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.655539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.656030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.657005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.711717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4c571df-0162-4356-952d-b2d67a44b623 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075920 Aug 23 10:50:51.713282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1619/3320] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:50:51 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:51.726707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:51.727570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:51.736761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.737516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.738120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.739488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.741667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.742539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.796520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:51.806977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-094d41e6-cee5-40e6-9de3-dd8f0b3b85cd tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 1.152551 Aug 23 10:50:51.823586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1702/3321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:50 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:51.830059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:51.831250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:51.838973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.839760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.840412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:51.843264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:51.844323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:51.845053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.006082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lazy-loading 'services' on Instance uuid 909e5550-fb4c-4d86-a36b-00637f8a0511 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:50:52.149733 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ea2e2ae-0728-4521-859d-37f79ed7e406 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments/1b14aaec-6c26-43f9-820c-ff41aad79262" status: 202 len: 0 microversion: 2.1 time: 0.322191 Aug 23 10:50:52.152533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:52.164188 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1703/3322] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 10:50:51 2022] DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments/1b14aaec-6c26-43f9-820c-ff41aad79262 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:50:52.168387 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-795227fd-f645-44de-95b1-b3a4ff060666 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.446782 Aug 23 10:50:52.170584 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1620/3323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:51 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:52.175237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:52.175957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:52.188846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-83768838-1323-4d56-9e42-8e0a3e1a2c3e req-bed994bd-94f6-4ec8-b3b1-36fb7d92327a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b328dfb-1927-4dae-ab19-9bb1946bcdfb", "name": "network-vif-deleted", "tag": "02c99cf4-9065-4db8-943b-6c414ac11137"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:52.202942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.203455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.203949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.204673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.216931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-83768838-1323-4d56-9e42-8e0a3e1a2c3e req-bed994bd-94f6-4ec8-b3b1-36fb7d92327a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.217455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-83768838-1323-4d56-9e42-8e0a3e1a2c3e req-bed994bd-94f6-4ec8-b3b1-36fb7d92327a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.217944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-83768838-1323-4d56-9e42-8e0a3e1a2c3e req-bed994bd-94f6-4ec8-b3b1-36fb7d92327a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.223512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.223984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.262392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-83768838-1323-4d56-9e42-8e0a3e1a2c3e req-bed994bd-94f6-4ec8-b3b1-36fb7d92327a service nova] Creating event network-vif-deleted:02c99cf4-9065-4db8-943b-6c414ac11137 for instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb on n-h2-847009-13 Aug 23 10:50:52.299612 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-83768838-1323-4d56-9e42-8e0a3e1a2c3e req-bed994bd-94f6-4ec8-b3b1-36fb7d92327a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124172 Aug 23 10:50:52.300466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1621/3324] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:52.323921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.332382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.335607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.338190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid 0b328dfb-1927-4dae-ab19-9bb1946bcdfb {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:50:52.474648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:52.491146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74522527-4f01-4143-87d2-4d3a4cdceda0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 200 len: 1304 microversion: 2.1 time: 0.325542 Aug 23 10:50:52.505784 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1704/3325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:52 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 1304 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:52.641666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:52.652622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:52.672447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.672985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.673487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.675187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.676090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.676541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.800332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7ab80cb-5877-47c0-a0ce-8ff4fa844b5f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Action: 'create', calling method: .version_select at 0x7fdc9c1e4f70>, body: {"keypair": {"name": "tempest-keypair-335380121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxIEvr+W06jntAprkBDkvwpu3Gvm6sXQBHfi4q5HsmZkzq0/qPOVeX86PzHpWRIt/UBLtmpYgL6tRWdfOMB5g6DwRjRxX+WyKjVgjM1fbGxz/IKKK00EwIjEYwk/B31dA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:52.829558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-f7ab80cb-5877-47c0-a0ce-8ff4fa844b5f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Getting quotas for project 32562dc9516b4d7c9694f3fe66ecf22e. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:52.836553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-f7ab80cb-5877-47c0-a0ce-8ff4fa844b5f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Getting quotas for user edca120d209c451c9f1060248decf0bf and project 32562dc9516b4d7c9694f3fe66ecf22e. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:52.880499 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7ab80cb-5877-47c0-a0ce-8ff4fa844b5f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.084871 Aug 23 10:50:52.882139 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1705/3326] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 10:50:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 10:50:52.894215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:52.895966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:52.909576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.910285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.910777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:52.925473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:52.926421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:52.927016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:53.101400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:53.118545 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6aa1e7b-a934-4bd7-85c8-c1718f216363 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.481362 Aug 23 10:50:53.119826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1622/3327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:52 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:53.203125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:53.205261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:53.228121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:53.231432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:53.235191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:53.237975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:53.241492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:53.243713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:53.759609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:53.772054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:53.782654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:53.789902 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c517a62d-fa69-43a3-b4e0-bf5abe4ae199 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.598506 Aug 23 10:50:53.796439 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1623/3328] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:53 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:53.799289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14b29997-e8dd-423f-9072-3d7c618a3f83 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.914654 Aug 23 10:50:53.802501 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1706/3329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:52 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:53.825004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:53.826175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:53.848833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:53.849770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:53.850828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:53.855314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:53.855822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:53.857529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:53.886006 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb HTTP/1.1 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0b328dfb-1927-4dae-ab19-9bb1946bcdfb'} Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:50:53.887995 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:50:53.892807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:50:53.895726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:50:53.896880 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-633615fa-c0da-4616-8fe1-181722594555 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 404 len: 111 microversion: 2.1 time: 0.095157 Aug 23 10:50:53.898269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1624/3330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:53 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:50:54.074550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2012705749", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:54.145882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:54.146715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:54.156528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:54.158053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:54.158508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:54.159235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:54.162931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:54.166666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:54.197782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:50:55.317846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:50:55.319304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:50:55.319978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:50:55.320587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:50:55.321686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:50:55.333990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:55.339530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:55.343117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:55.345706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:55.346869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:55.347385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:55.347855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:55.356284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8404cf99-ff66-4c61-a317-b5f11c35128f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 1.214432 Aug 23 10:50:55.374908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1625/3331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:54 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:55.391708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:55.392006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:55.406321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:55.407794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:55.408253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:55.412054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:55.412884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:55.413494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:55.420595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:50:55.466667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:50:55.503480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:50:55.506206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:50:55.638451 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d2cd80b5-a0cc-443e-a002-fb6263debc3c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569807 Aug 23 10:50:55.641708 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1707/3332] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:50:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:50:55.661996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:55.662867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:55.688097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:55.696689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:55.697853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:55.698803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:55.699444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:55.700077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:56.165439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:56.176940 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab990a67-1bb0-41a1-a991-dbc0db6f9400 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.798353 Aug 23 10:50:56.178607 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1626/3333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:55 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:56.187430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3e0cb519-d176-42c9-b434-2b8b5f2c6994 req-8d3fd299-0224-4602-ab19-7296da0de369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "name": "network-vif-plugged", "status": "completed", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:56.210786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3e0cb519-d176-42c9-b434-2b8b5f2c6994 req-8d3fd299-0224-4602-ab19-7296da0de369 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:56.218053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3e0cb519-d176-42c9-b434-2b8b5f2c6994 req-8d3fd299-0224-4602-ab19-7296da0de369 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:56.219088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3e0cb519-d176-42c9-b434-2b8b5f2c6994 req-8d3fd299-0224-4602-ab19-7296da0de369 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:56.241625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3e0cb519-d176-42c9-b434-2b8b5f2c6994 req-8d3fd299-0224-4602-ab19-7296da0de369 service nova] Creating event network-vif-plugged:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:50:56.255141 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3e0cb519-d176-42c9-b434-2b8b5f2c6994 req-8d3fd299-0224-4602-ab19-7296da0de369 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075099 Aug 23 10:50:56.260819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1627/3334] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:56.267063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b0bc3ff-6e28-4307-931a-f472d2eb9d08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:56.271646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b0bc3ff-6e28-4307-931a-f472d2eb9d08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:56.453380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b0bc3ff-6e28-4307-931a-f472d2eb9d08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:56.461958 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b0bc3ff-6e28-4307-931a-f472d2eb9d08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1215 microversion: 2.1 time: 0.199569 Aug 23 10:50:56.466721 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1628/3335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:56 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:56.478082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:56.488350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:56.502600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:56.503591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:56.504242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:56.505278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:56.505967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:56.506630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:56.523773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:56.533666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae9d2334-b60a-4301-a03e-950078a5ff0e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 0.890590 Aug 23 10:50:56.534271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1708/3336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:55 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:57.056193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:57.065657 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-969bb67c-ae02-440a-a830-edecf3b3a498 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.596625 Aug 23 10:50:57.069475 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1629/3337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:56 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:57.203466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:57.204311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:57.212399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.213295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.213974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.214935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.215643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.217491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.495466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:57.496018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:57.516370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.517138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.517766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.520704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.521546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.524542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.533233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:57.576584 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d8abaf6-e8be-4b95-ae99-756f66402aee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1657 microversion: 2.1 time: 0.378291 Aug 23 10:50:57.593410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1709/3338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:57 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1657 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:57.616447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:57.617580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:57.634298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.643784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.649268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.651984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.652697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.655500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.749431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:57.768308 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-753d754c-dbcd-4234-92dd-4a42e8368442 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1267 microversion: 2.1 time: 0.282769 Aug 23 10:50:57.786157 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1630/3339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:57 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:57.793341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7485f37b-0abd-473a-9a76-15e99f6542e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:57.802664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7485f37b-0abd-473a-9a76-15e99f6542e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.803288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7485f37b-0abd-473a-9a76-15e99f6542e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.803764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7485f37b-0abd-473a-9a76-15e99f6542e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.835697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7485f37b-0abd-473a-9a76-15e99f6542e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Going to try to start instance {{(pid=128860) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 10:50:57.956328 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7485f37b-0abd-473a-9a76-15e99f6542e7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.168331 Aug 23 10:50:57.961117 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1631/3340] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:50:57 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:50:57.969418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:57.970456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:57.978329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.979712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.980406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:57.981567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:57.982440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:57.983279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:58.233696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:58.253007 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af041bff-ed99-4a72-98ab-87041dadc9cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1666 microversion: 2.1 time: 0.288725 Aug 23 10:50:58.254143 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1632/3341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:57 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1666 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:58.284157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:58.287298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:58.308256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:58.312635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:58.313535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:58.315709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:58.317250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:58.321064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:58.625198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:58.638775 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efe42725-ec0b-47d9-9a3e-31eca554fe52 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1323 microversion: 2.1 time: 1.026821 Aug 23 10:50:58.645781 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1710/3342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:57 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1323 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:58.651378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-bf6027d6-c6f1-4185-be26-a867792de540 req-e05e93f6-987a-4980-a8d1-c80b68231014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd9db75-5081-47ca-9f3e-d73cdcfe1acd", "name": "network-vif-plugged", "status": "completed", "tag": "7d355080-2421-4394-93ef-99cf1fc6045f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:50:58.672059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bf6027d6-c6f1-4185-be26-a867792de540 req-e05e93f6-987a-4980-a8d1-c80b68231014 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:58.673209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bf6027d6-c6f1-4185-be26-a867792de540 req-e05e93f6-987a-4980-a8d1-c80b68231014 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:58.673922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bf6027d6-c6f1-4185-be26-a867792de540 req-e05e93f6-987a-4980-a8d1-c80b68231014 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:58.733036 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-bf6027d6-c6f1-4185-be26-a867792de540 req-e05e93f6-987a-4980-a8d1-c80b68231014 service nova] Creating event network-vif-plugged:7d355080-2421-4394-93ef-99cf1fc6045f for instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd on n-h2-847009-13 Aug 23 10:50:58.746759 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-bf6027d6-c6f1-4185-be26-a867792de540 req-e05e93f6-987a-4980-a8d1-c80b68231014 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097815 Aug 23 10:50:58.750183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1711/3343] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:50:58.787878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:58.803922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:58.805786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:58.806432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42917024-d4ae-4141-b14d-258fc01670e6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.531416 Aug 23 10:50:58.824108 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1633/3344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:58 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:58.829884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:58.834838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:58.838830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:58.839964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:58.843018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:58.845305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:59.282487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:59.283209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:59.302801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:59.304679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:59.307032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:50:59.309869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:59.310207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:59.311183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:59.312691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:59.314619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd93ddf3-86a0-44ac-9ef1-34e970e737a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1273 microversion: 2.1 time: 0.519002 Aug 23 10:50:59.315202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:59.319545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1712/3345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:58 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1273 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:50:59.666515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:59.667804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:59.678791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:59.679465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:59.680069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:59.680987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:59.683503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:59.685167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:59.704378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:50:59.715242 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f23c9a2-7b83-4628-960b-f734f6474a49 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1666 microversion: 2.1 time: 0.438383 Aug 23 10:50:59.731553 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1634/3346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:59 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1666 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:50:59.828752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:50:59.829457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:50:59.850301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:59.851101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:59.851543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:50:59.852428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:50:59.853068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:50:59.853755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:00.150312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:00.158849 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a094971e-e02a-40d7-8a05-a5f59e2673c9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1319 microversion: 2.1 time: 0.334307 Aug 23 10:51:00.174039 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1635/3347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:59 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:00.182636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1421991504", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "66ce9ac8-3de9-4dc7-90f1-20af09afc590"}, {"port": "e0790256-559e-4ed3-880d-a92da3742a25", "tag": "port-1"}, {"port": "c9bedf3a-d5d4-4fd2-bf39-515a26496926", "tag": "port-2"}, {"uuid": "2be6a480-34f1-4202-87f8-676c60f8d539", "tag": "net-1"}, {"uuid": "2be6a480-34f1-4202-87f8-676c60f8d539"}, {"uuid": "628bc567-7b75-4f12-96c0-194769a53f18", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "628bc567-7b75-4f12-96c0-194769a53f18", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "3f880646-0c06-46c3-9290-fa56b8340b7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "04d87d43-4b8b-4c69-aa55-755fcbee1bbc", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fe66181a-ce41-43ea-96fd-ca1a0df2365a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1441664807"}], "key_name": "tempest-keypair-335380121", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:00.334824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:00.339225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] validate_networks() for [('66ce9ac8-3de9-4dc7-90f1-20af09afc590', None, None, None, None, None), (None, None, 'e0790256-559e-4ed3-880d-a92da3742a25', None, None, None), (None, None, 'c9bedf3a-d5d4-4fd2-bf39-515a26496926', None, None, None), ('2be6a480-34f1-4202-87f8-676c60f8d539', None, None, None, None, None), ('2be6a480-34f1-4202-87f8-676c60f8d539', None, None, None, None, None), ('628bc567-7b75-4f12-96c0-194769a53f18', '10.2.2.100', None, None, None, None), ('628bc567-7b75-4f12-96c0-194769a53f18', '10.2.2.200', None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:51:00.344828 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b1227f8-682d-4d47-a851-3c244e5543ca tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1518 microversion: 2.1 time: 0.682304 Aug 23 10:51:00.347467 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1713/3348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:50:59 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1518 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:00.361257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:00.362201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:00.381702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:00.382205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:00.383680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:00.383680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:00.383900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:00.384238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:00.654724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:00.681354 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4a5fa79-80d7-42c4-9975-912fdc43af6a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1273 microversion: 2.1 time: 0.324506 Aug 23 10:51:00.682058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1714/3349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:00 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:00.699164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:00.702286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:00.751106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:00.754021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:00.764251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:00.765860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:00.766697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:00.767095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:00.802383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lazy-loading 'flavor' on Instance uuid 39350aa4-469c-448b-ab25-1da72fe77abf {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:51:00.941015 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01a256e5-eed4-43c2-afc5-a926eb2e4fc7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action" status: 200 len: 32 microversion: 2.1 time: 0.257447 Aug 23 10:51:00.942657 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1715/3350] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:00 2022] POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:51:00.956578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:00.963662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:00.978437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:00.979535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:00.980277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:00.983172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:00.984059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:00.985023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:01.829740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:01.840455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b539ed62-655e-40fb-b434-f277abdc4f19 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1666 microversion: 2.1 time: 0.896272 Aug 23 10:51:01.842621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1716/3351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:00 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1666 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:01.847455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:01.848464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:01.863608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:01.866122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:01.868996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:01.871527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:01.873475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:01.874936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:02.293525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:02.318519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80d1c868-1bbb-4c24-84c3-5120a828c3ee tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.474498 Aug 23 10:51:02.319550 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1717/3352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:01 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:02.353083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:02.362265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:02.377418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:02.380260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:02.384583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:02.385880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:02.386587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:02.388428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:02.871531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:02.891885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ddd0785-942e-4be7-bbfe-a295003a099e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1469 microversion: 2.1 time: 0.544885 Aug 23 10:51:02.893746 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1718/3353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:02 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1469 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:02.907335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-632511b9-6b19-4039-a8ec-232837d88c09 req-fa0c10de-2077-439e-a08e-7a6886826ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd0133b-7a00-487c-9ea4-77c3d3a4771e", "name": "network-vif-plugged", "status": "completed", "tag": "7d70e389-7680-4da2-9e6e-41d17c1ecd30"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:02.928109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-632511b9-6b19-4039-a8ec-232837d88c09 req-fa0c10de-2077-439e-a08e-7a6886826ec1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:02.928605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-632511b9-6b19-4039-a8ec-232837d88c09 req-fa0c10de-2077-439e-a08e-7a6886826ec1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:02.930640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-632511b9-6b19-4039-a8ec-232837d88c09 req-fa0c10de-2077-439e-a08e-7a6886826ec1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:02.951961 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-632511b9-6b19-4039-a8ec-232837d88c09 req-fa0c10de-2077-439e-a08e-7a6886826ec1 service nova] Creating event network-vif-plugged:7d70e389-7680-4da2-9e6e-41d17c1ecd30 for instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e on n-h1-847009-13 Aug 23 10:51:02.959145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-632511b9-6b19-4039-a8ec-232837d88c09 req-fa0c10de-2077-439e-a08e-7a6886826ec1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060927 Aug 23 10:51:02.960383 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1719/3354] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:02.968341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:02.972547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:03.010220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:03.011713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:03.014071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:03.015138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:03.016442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:03.017155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:03.097206 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91b794de-d8b6-44da-ac34-648da7203e1f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135297 Aug 23 10:51:03.105950 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1720/3355] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:51:02 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:51:03.115003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:03.115597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:03.125790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:03.126529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:03.127145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:03.128044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:03.128685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:03.129297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:03.677499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:03.687179 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a7476f2-113c-4e2c-8843-f5e754118c6e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.579634 Aug 23 10:51:03.688307 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1721/3356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:03 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:03.693753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:03.695618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:03.708420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:03.709220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:03.710670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:03.714160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:03.715961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:03.716583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:04.414898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:51:04.416077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:51:04.416639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:51:04.417171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:51:04.417694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:51:04.431892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:04.432526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:04.433084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:04.434256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:04.435305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:04.435750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:04.456181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Getting quotas for project 32562dc9516b4d7c9694f3fe66ecf22e. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:51:04.461794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Getting quotas for user edca120d209c451c9f1060248decf0bf and project 32562dc9516b4d7c9694f3fe66ecf22e. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:51:04.514136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:04.523666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7156a446-6817-4a78-9772-9478c3639db4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.834131 Aug 23 10:51:04.539106 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1722/3357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:03 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:04.546057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:04.547158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:04.556378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:04.557294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:04.557906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:04.558841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:04.559582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:04.560031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:04.648059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:51:04.650980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='3f880646-0c06-46c3-9290-fa56b8340b7b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='04d87d43-4b8b-4c69-aa55-755fcbee1bbc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe66181a-ce41-43ea-96fd-ca1a0df2365a',volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:51:04.992436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:05.002184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4894c0a9-dc97-43af-b717-b428babf9466 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1319 microversion: 2.1 time: 0.461697 Aug 23 10:51:05.008712 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1723/3358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:04 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:05.014142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:05.016407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:05.038839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.040680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.041186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.041925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.042399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.045634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.109934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad9d7aae-670e-4b22-b027-2df9ba88150b tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099532 Aug 23 10:51:05.119648 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1724/3359] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:51:05 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:51:05.125791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:05.126546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:05.145952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.146717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.147334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.148443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.149111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.149734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.151656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a42d01b3-1092-40c4-8e09-affd1b1fb8a1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.972937 Aug 23 10:51:05.171512 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1636/3360] 10.222.0.78 () {62 vars in 1189 bytes} [Tue Aug 23 10:51:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 4988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:51:05.179667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:05.185641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:05.194124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.195623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.196858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.198103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.215477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.216662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.393621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:05.490381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:05.563636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:05.572555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f88e88f-f4b5-467a-a52b-35ad8928b94c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.451503 Aug 23 10:51:05.585041 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1725/3361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:05 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:05.586068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:05.586894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:05.590174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:05.608136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-963688b5-5aaa-460d-92ae-8b70f2aa5a85 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.440396 Aug 23 10:51:05.608645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.609170 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1637/3362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:05 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:05.609530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.610129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.611021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.613328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.613936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.614802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-053b15ed-ee40-4561-8986-34a349319bc4 req-7fc75177-5b11-4963-8993-af8fb0d027ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1", "tag": "c7b4a576-d035-4d44-bdb3-269dd4ab3dc0"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:05.626042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-053b15ed-ee40-4561-8986-34a349319bc4 req-7fc75177-5b11-4963-8993-af8fb0d027ab service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:05.626619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-053b15ed-ee40-4561-8986-34a349319bc4 req-7fc75177-5b11-4963-8993-af8fb0d027ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:05.627124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-053b15ed-ee40-4561-8986-34a349319bc4 req-7fc75177-5b11-4963-8993-af8fb0d027ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:05.645261 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-053b15ed-ee40-4561-8986-34a349319bc4 req-7fc75177-5b11-4963-8993-af8fb0d027ab service nova] Creating event network-changed:c7b4a576-d035-4d44-bdb3-269dd4ab3dc0 for instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 on n-h2-847009-13 Aug 23 10:51:05.651523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-053b15ed-ee40-4561-8986-34a349319bc4 req-7fc75177-5b11-4963-8993-af8fb0d027ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039792 Aug 23 10:51:05.651523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1638/3363] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:05.728005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-732055666", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:05.825391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] validate_networks() for [('70891eb3-d931-4d2c-bee7-d99486f88b11', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:51:05.972018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:05.982979 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6ad3016-b137-4dac-b904-deb5c7f84a93 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.399344 Aug 23 10:51:05.996909 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1726/3364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:05 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:06.000643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc58bae7-4f1c-45b0-8e5b-62d6e1d9a420 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:06.001331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cc58bae7-4f1c-45b0-8e5b-62d6e1d9a420 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:06.197914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc58bae7-4f1c-45b0-8e5b-62d6e1d9a420 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:06.260441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc58bae7-4f1c-45b0-8e5b-62d6e1d9a420 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:06.267074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc58bae7-4f1c-45b0-8e5b-62d6e1d9a420 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:06.270683 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc58bae7-4f1c-45b0-8e5b-62d6e1d9a420 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1285 microversion: 2.42 time: 0.284184 Aug 23 10:51:06.290546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1727/3365] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:05 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:06.301833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:06.303850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:06.314811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:06.326126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.326794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.327430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.328531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.329978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.330477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.388199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:51:06.409129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:06.511178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e79aa60-856e-41cb-a7b8-1a483d63c32f tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 204 len: 0 microversion: 2.1 time: 0.219234 Aug 23 10:51:06.511978 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1728/3366] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:51:06 2022] DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:51:06.521988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:06.522880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:06.533314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.534583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.535302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.537170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.537887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.539321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.602604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Unlocking {{(pid=128859) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 23 10:51:06.634181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:51:06.634678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:51:06.635096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:51:06.635526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:51:06.635952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:51:06.648127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.649084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.653174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.654114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.654895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.655555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.683233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4c78f3c-79ab-4bbd-8eb1-a7e9bb985607 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.168482 Aug 23 10:51:06.685011 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1729/3367] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:06 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:51:06.694102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:06.695214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:06.706726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Getting quotas for project 298d46caabb746a2ba9abab15c248dc1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:51:06.708180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.708915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.710052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.711010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.713065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.713500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Getting quotas for user e397356a2f6349379d081d7381c18ec9 and project 298d46caabb746a2ba9abab15c248dc1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:51:06.714090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.732171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:51:06.735284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:51:06.816732 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0734eb90-2bed-4b2c-830a-8719d76ee8f5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164218 Aug 23 10:51:06.818435 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1639/3368] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:51:06.824037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:06.826107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:06.834476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.835134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.835906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.836641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:06.837166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:06.837601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:06.977585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:06.987754 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c375097b-2e90-471f-a4c9-87ea69a37f72 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1467 microversion: 2.1 time: 0.299346 Aug 23 10:51:06.989967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1730/3369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:06 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1467 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.009794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.010420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:07.036676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.041349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.042976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.045958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.048699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.049148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.073527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.084182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4803884-5440-4b96-b09d-d3e2bcd38ca9 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1681 microversion: 2.1 time: 0.264328 Aug 23 10:51:07.085621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1640/3370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:06 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.126111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.127000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:07.141320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.143953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.145065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.146059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.146799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.147560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.279263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.291143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ca0e186-6bba-4965-b6f5-64d2247d9b0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.299164 Aug 23 10:51:07.294817 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1731/3371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:06 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.313537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c83342ef-2f6c-41bd-96d7-129217e2f6b2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.314425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c83342ef-2f6c-41bd-96d7-129217e2f6b2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:07.410642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.412284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c83342ef-2f6c-41bd-96d7-129217e2f6b2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.421540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c83342ef-2f6c-41bd-96d7-129217e2f6b2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1216 microversion: 2.1 time: 0.124568 Aug 23 10:51:07.423026 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34d97cc7-3903-4f44-a1c1-a7107d9ee611 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.328382 Aug 23 10:51:07.423176 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1732/3372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.424147 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1641/3373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.433281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.443442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.444322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Searching by: {'reservation_id': 'r-hgkbis5v', 'deleted': False, 'project_id': '730a5bd640e2437cab0c302a1a03fb66'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:51:07.451119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.451813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:07.459702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.460236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.460768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.461117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.461746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.462666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.463324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.463463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.464145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.464271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.464726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.467896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.582634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:51:07.674407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.682027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.682519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.682962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.700991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.709293 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a2ef270-dc3d-44c8-91c8-336f69e21404 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.284922 Aug 23 10:51:07.709949 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1733/3374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.715505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.717108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:07.725732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.726616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.727270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.728242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.728970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.729687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.831848 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e78d1bb-f593-4d6c-8573-acba49283471 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-hgkbis5v" status: 200 len: 2929 microversion: 2.1 time: 0.405796 Aug 23 10:51:07.832456 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1642/3375] 10.222.0.78 () {58 vars in 1197 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/servers/detail?reservation_id=r-hgkbis5v => generated 2929 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:07.848811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.849421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:07.852803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:07.856685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.857223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.857680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.858409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.858860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.859293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:07.865826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:07.906558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.925601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.927935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:07.932239 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c1975ec-0b9a-4b29-9fc3-625d164586b2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1575 microversion: 2.42 time: 0.221098 Aug 23 10:51:07.934668 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1734/3376] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:07.942719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84ce9c20-59f7-4f79-b3b1-b91a3249ac32 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:07.979831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.server_groups [None req-84ce9c20-59f7-4f79-b3b1-b91a3249ac32 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Querying cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) for 2 instances {{(pid=128859) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 10:51:07.985896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ce9c20-59f7-4f79-b3b1-b91a3249ac32 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:07.986407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ce9c20-59f7-4f79-b3b1-b91a3249ac32 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:07.987345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ce9c20-59f7-4f79-b3b1-b91a3249ac32 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.029383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84ce9c20-59f7-4f79-b3b1-b91a3249ac32 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/c735150d-f266-4cf7-b2de-0084fdaf3da2" status: 200 len: 270 microversion: 2.1 time: 0.090887 Aug 23 10:51:08.035998 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1735/3377] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/os-server-groups/c735150d-f266-4cf7-b2de-0084fdaf3da2 => generated 270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:08.041189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:08.042051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:08.050715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.051701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.052314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.053432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.054542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.055138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.334999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:08.361320 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-050402f6-d59d-406b-9bc2-08e3c97c5135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.527572 Aug 23 10:51:08.362622 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1643/3378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:07 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:08.369459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:08.374607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:08.382831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.383669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.384313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.385664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.386337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.387021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.428372 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d21edfa5-53ba-48e3-9f31-0f3d0c3818ca tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1620 microversion: 2.1 time: 0.390832 Aug 23 10:51:08.432113 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1736/3379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:08 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1620 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:08.443733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:08.444353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:08.462658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.463449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.464068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.466273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.466954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.467606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.828851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:08.846157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2906cbb-0014-4e0f-8e35-a8bd61186391 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1681 microversion: 2.1 time: 0.482260 Aug 23 10:51:08.867311 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1644/3380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:08 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1681 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:08.873673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:08.874621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:08.884579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.885533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.886866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.888145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.888994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.891134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.917749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:08.937423 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a98efaf-ca08-4097-bcbf-bc5f58bcbc42 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.504061 Aug 23 10:51:08.955053 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1737/3381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:08 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:08.960439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:08.964803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:08.982003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.983352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.985037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:08.987777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:08.988842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:08.990955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.113643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:09.128676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb9ad3c0-b346-40f9-abb5-e64bf2136d67 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1268 microversion: 2.1 time: 0.172284 Aug 23 10:51:09.130440 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1738/3382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:08 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:09.135545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:09.136515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:09.144588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.146048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.146711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.147664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.148518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.149255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.322712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:09.341508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ca776e1-ef99-46d2-b8bc-ede116bee1c2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.471806 Aug 23 10:51:09.343525 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1645/3383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:08 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:09.355308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:09.356607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:09.372216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.374322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.375182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.377165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.377867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.380719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.672603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:09.689986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f981687e-5bb4-4fab-977b-e274cbe0ca5d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.344013 Aug 23 10:51:09.691782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1646/3384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:09 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:09.700522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:09.702168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:09.718201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.719966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.720785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.722267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.723146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.723889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.902825 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b1fcb13-71ae-4e16-9241-57ef82cf50f2 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1622 microversion: 2.1 time: 0.770952 Aug 23 10:51:09.908284 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1739/3385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:09 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1622 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:09.923400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:09.924093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:09.942622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.944565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.944565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:09.944565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:09.944879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:09.945165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:10.147022 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-330903cd-af8c-49de-8289-864fd4e2a281 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.235487 Aug 23 10:51:10.151016 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1740/3386] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:09 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:51:10.183285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:10.188008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:10.229447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:10.230724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:10.249427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:10.252856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:10.255430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:10.257619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:10.260529 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1f484ed-51b6-4d11-ae61-ec3ef0e64878 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1661 microversion: 2.42 time: 0.563394 Aug 23 10:51:10.260977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:10.264020 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1647/3387] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:09 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1661 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:10.264175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:10.266904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:10.275303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:10.276144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:10.291891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:10.294036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:10.295208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:10.298047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:10.298749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:10.300170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:10.647007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:10.660578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2de8e05-0a70-48ce-b616-59516a8029f2 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.394917 Aug 23 10:51:10.661281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1648/3388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:10 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:10.673896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:10.682975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:10.711041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:10.711580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:10.712046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:10.715071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:10.715848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:10.716320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:11.135087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:11.148282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:11.152386 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f01401b7-3609-43ee-97fe-b21dd33fbc79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1274 microversion: 2.1 time: 0.480956 Aug 23 10:51:11.152386 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1649/3389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:10 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1274 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:11.162485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:11.163118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:11.170735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:11.185405 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb4a4893-b1ea-4a3a-bfd3-63a358f0cdb2 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1681 microversion: 2.1 time: 1.029220 Aug 23 10:51:11.186412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1741/3390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:10 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1681 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:11.202366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:11.202366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:11.202366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:11.202366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:11.202366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:11.202366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:11.211149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-374814431", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "c94cbffe-d053-422b-bacb-6ab8fd02d551"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:11.301348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:51:11.788240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:11.797005 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-106b77b1-c469-4774-ae2b-07d366b09c51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1655 microversion: 2.1 time: 0.644444 Aug 23 10:51:11.797596 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1650/3391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:11 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1655 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:11.807217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:11.816019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:11.834728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:11.837024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:11.854090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:11.855776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:11.861722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:11.862243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:12.162368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:12.179260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f27ebc5-af57-4cf8-812f-a0ab39adf48d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.375640 Aug 23 10:51:12.195927 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1651/3392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:11 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:12.207813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:12.208430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:12.225885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:12.226447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:12.226894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:12.227601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:12.231936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:12.232820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.218022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:13.228687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:13.236617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:13.237939 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f370fea-e099-498a-82c8-578f3f568c75 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1708 microversion: 2.42 time: 1.036639 Aug 23 10:51:13.238433 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1652/3393] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:12 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1708 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:13.279293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:13.279947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:13.288860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.289369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.289796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.290519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.290994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.291425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.559417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:51:13.560980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:51:13.562166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:51:13.562853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:51:13.563494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:51:13.578380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.579219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.580444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.581693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.582748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:13.583504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.584325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.592121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f6814f7f-35df-42f2-b725-14dd02e5b431 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.331355 Aug 23 10:51:13.605750 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1653/3394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:13 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:13.610677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:13.611231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:13.623321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.623839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.624292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.633263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.634050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.634940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.682442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:51:13.692332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:51:13.727608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:51:13.734254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:51:13.770914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f442a6c-2ad0-4aa8-a417-e631c3ab9acb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.170489 Aug 23 10:51:13.784865 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1654/3395] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:13 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:51:13.791929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:13.795627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:13.805232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.806291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.807170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.808850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.811968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.813055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.866573 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84e5f162-2c4b-4177-9a60-23b60b8ac3a5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.660082 Aug 23 10:51:13.870375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1742/3396] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:51:13.880676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:13.889921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:13.898632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.899412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.899982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:13.900830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:13.901398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:13.901981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:14.270673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:14.299397 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a8b7f3f-d92f-4ac6-806b-bcdcfd5cd7c5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.493078 Aug 23 10:51:14.317500 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1655/3397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:13 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:14.347133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:14.347992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:14.371237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:14.375544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:14.378299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:14.379381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:14.380070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:14.381237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:14.814084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:14.822245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e17ec81-4354-4ee8-9b69-121bbe3e9e77 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.500014 Aug 23 10:51:14.827554 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1656/3398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:14 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:14.846656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-00964568-8a1e-44a8-b3f8-f22971c66281 req-50c96036-9e21-4e90-8957-0cabe94f6936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1", "name": "network-vif-plugged", "status": "completed", "tag": "c7b4a576-d035-4d44-bdb3-269dd4ab3dc0"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:14.863012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-00964568-8a1e-44a8-b3f8-f22971c66281 req-50c96036-9e21-4e90-8957-0cabe94f6936 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:14.863779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-00964568-8a1e-44a8-b3f8-f22971c66281 req-50c96036-9e21-4e90-8957-0cabe94f6936 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:14.864421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-00964568-8a1e-44a8-b3f8-f22971c66281 req-50c96036-9e21-4e90-8957-0cabe94f6936 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:14.883149 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-00964568-8a1e-44a8-b3f8-f22971c66281 req-50c96036-9e21-4e90-8957-0cabe94f6936 service nova] Creating event network-vif-plugged:c7b4a576-d035-4d44-bdb3-269dd4ab3dc0 for instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 on n-h2-847009-13 Aug 23 10:51:14.889810 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-00964568-8a1e-44a8-b3f8-f22971c66281 req-50c96036-9e21-4e90-8957-0cabe94f6936 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060601 Aug 23 10:51:14.891341 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1657/3399] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:14.907298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:14.909197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:14.917156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:14.918120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:14.919398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:14.921221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:14.922927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:14.924126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.055469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:15.065356 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-917be7f3-0d15-47dc-b1f9-dfeba217e886 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1681 microversion: 2.1 time: 1.193653 Aug 23 10:51:15.070384 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1743/3400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:13 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1681 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:15.083260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:15.084812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:15.102486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.103244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.103896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.104889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.105577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.106513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.237439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:15.265087 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af8a891d-5747-4eab-85ee-e563096c2c05 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1212 microversion: 2.1 time: 0.192990 Aug 23 10:51:15.281656 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1744/3401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:15 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1212 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:15.298644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:15.303403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:15.327631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.328419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.328894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.329720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.332818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.333281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.565095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:15.586128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74b26fbf-f58b-4ac8-a3c6-f7ccac89cf91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.692808 Aug 23 10:51:15.587043 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1658/3402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:14 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:15.596390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:15.603605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:15.623749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.624471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.625177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.626092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.627070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.627832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.654782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:15.857218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:15.896479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93738d66-1373-4154-b5a7-511e3f70e3ec tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.305294 Aug 23 10:51:15.897762 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1659/3403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:15 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:15.934042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:15.958988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:15.960008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:15.970255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.974685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.975320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:15.976228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:15.976874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:15.977460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.001291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:16.011295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:16.015753 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f955623c-f8e6-4462-9d53-972eb6a8d5e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1755 microversion: 2.42 time: 0.732703 Aug 23 10:51:16.018782 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1745/3404] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:15 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1755 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:16.036718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:16.037577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:16.053062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.053575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.054292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.055044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.055508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.056057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.466359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:16.477941 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36595d91-150b-4b19-bc96-2ef5a720c7bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.459394 Aug 23 10:51:16.478579 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1746/3405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:16 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:16.507283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:16.507906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:16.510746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:16.523514 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1758a9c-0bed-4e71-8ba5-47289a2aacf6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.621321 Aug 23 10:51:16.526700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.527068 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1660/3406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:15 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:16.527211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.527645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.528926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.529575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.530287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.539541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:16.544394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:16.560147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.560563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.561037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.561768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.562232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.562662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.719094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:16.732799 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29b26b88-a90d-4663-bf0f-84f674ed580a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1613 microversion: 2.1 time: 0.201364 Aug 23 10:51:16.733975 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1661/3407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:16 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1613 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:16.743723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:16.745154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:16.763393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.763976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.765174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.772015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:16.773325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:16.773866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:16.960280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:16.969579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3750193d-9ca7-42ef-91d6-dc84f2b52d75 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1315 microversion: 2.1 time: 0.470622 Aug 23 10:51:16.980610 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1747/3408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:16 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:16.986213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:16.989669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:17.004436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.007242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.007242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.007242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.007242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.008550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.067372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:17.092559 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5bf8e3e-4713-4f73-acf9-9cb6b1f4b8ef tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1268 microversion: 2.1 time: 0.357298 Aug 23 10:51:17.093100 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1662/3409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:16 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1268 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:17.099210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bd8e981f-0fae-48ee-b92e-e190bf4efa38 req-7338bb72-3a45-40c8-a4e7-22f53637d065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057c7307-04cc-43f0-8c9d-1233486e4b9e", "tag": "d4b89f90-900a-49c6-8ae6-8d854e7c5ffd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:17.125518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd8e981f-0fae-48ee-b92e-e190bf4efa38 req-7338bb72-3a45-40c8-a4e7-22f53637d065 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.125854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd8e981f-0fae-48ee-b92e-e190bf4efa38 req-7338bb72-3a45-40c8-a4e7-22f53637d065 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.130349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd8e981f-0fae-48ee-b92e-e190bf4efa38 req-7338bb72-3a45-40c8-a4e7-22f53637d065 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.152217 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bd8e981f-0fae-48ee-b92e-e190bf4efa38 req-7338bb72-3a45-40c8-a4e7-22f53637d065 service nova] Creating event network-changed:d4b89f90-900a-49c6-8ae6-8d854e7c5ffd for instance 057c7307-04cc-43f0-8c9d-1233486e4b9e on n-h1-847009-13 Aug 23 10:51:17.158922 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bd8e981f-0fae-48ee-b92e-e190bf4efa38 req-7338bb72-3a45-40c8-a4e7-22f53637d065 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063378 Aug 23 10:51:17.159970 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1663/3410] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:17.168225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:17.171671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:17.188808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.189313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.189756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.190473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.190924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.191352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.272212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:17.283970 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af276589-90a3-468f-a1c9-68e8efa3f386 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.299801 Aug 23 10:51:17.285846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1748/3411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:16 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:17.298400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1451abae-40a3-4103-8a29-ac6821ddd0c5 req-1f339fb1-f7f7-4ed9-82a8-517497ce835f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909e5550-fb4c-4d86-a36b-00637f8a0511", "name": "network-vif-unplugged", "status": "completed", "tag": "fcbdc18f-319a-4b90-a01a-ea115cfd9f8a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:17.338728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1451abae-40a3-4103-8a29-ac6821ddd0c5 req-1f339fb1-f7f7-4ed9-82a8-517497ce835f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.342025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1451abae-40a3-4103-8a29-ac6821ddd0c5 req-1f339fb1-f7f7-4ed9-82a8-517497ce835f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.346154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1451abae-40a3-4103-8a29-ac6821ddd0c5 req-1f339fb1-f7f7-4ed9-82a8-517497ce835f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.380457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1451abae-40a3-4103-8a29-ac6821ddd0c5 req-1f339fb1-f7f7-4ed9-82a8-517497ce835f service nova] Creating event network-vif-unplugged:fcbdc18f-319a-4b90-a01a-ea115cfd9f8a for instance 909e5550-fb4c-4d86-a36b-00637f8a0511 on n-h2-847009-13 Aug 23 10:51:17.385887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1451abae-40a3-4103-8a29-ac6821ddd0c5 req-1f339fb1-f7f7-4ed9-82a8-517497ce835f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092669 Aug 23 10:51:17.389217 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1749/3412] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:17.398148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:17.398864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:17.408112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.408700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.409272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.410306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.410826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.411261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.523918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:17.527194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:17.538776 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4de7a0a-6788-4091-a359-e9122037c390 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.377288 Aug 23 10:51:17.541657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1664/3413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:17 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:17.553913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:17.562433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:17.576002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.576929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.577537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.578462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:17.579083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:17.581500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:17.673286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:18.066924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.077268 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dec84aa0-c372-47ec-8d0e-7957028efce8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.533124 Aug 23 10:51:18.081478 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1665/3414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:17 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:18.087785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:18.090949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:18.105070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.105589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.106072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.116908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.117978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.118432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.406165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.418070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.421037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.422247 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34185515-6a8d-4b3b-a791-0b11a9e4939f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1802 microversion: 2.42 time: 1.028699 Aug 23 10:51:18.429238 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1750/3415] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:17 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1802 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:18.438309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:18.439174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:18.450790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.454818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.455455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.457612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.460099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.460780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.505194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.514639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.515429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.516050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.516689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lazy-loading 'fault' on Instance uuid 909e5550-fb4c-4d86-a36b-00637f8a0511 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:51:18.526868 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-921a4e40-cd12-4aaf-aa96-b0d7f0d2de3d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.441611 Aug 23 10:51:18.528328 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1666/3416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:18 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:18.553997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:18.554629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:18.568864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.569027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.569418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.570141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.570784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.571384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.641837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3772a6b414424c1cab70261b8d5da918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af0e3fb36da41c9bb4ea1ac3372fdb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.662532 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2f9ca79-bb7a-480d-aa03-0cd633c1a254 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 200 len: 1331 microversion: 2.1 time: 0.231749 Aug 23 10:51:18.663128 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1751/3417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:18 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 1331 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:18.682624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:18.686309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:18.727746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.728285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.728829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.729535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.733361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.734035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.851915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:18.877581 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16dd2666-fa1e-42ed-ac05-e7d36c74bc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1501 microversion: 2.1 time: 0.346461 Aug 23 10:51:18.909335 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1667/3418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:18 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:18.926300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:18.927853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:18.941860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.945143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.946252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:18.947558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:18.948821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:18.952104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.088830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:19.103060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aac2f840-5f0c-4ff6-9db8-12d85109b0da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1274 microversion: 2.1 time: 0.191886 Aug 23 10:51:19.104187 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1668/3419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:18 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:19.109964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:19.110810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:19.119631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.121005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.122999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.124095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.125795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.127547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.338108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:19.371931 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a893ec9c-a0cd-474d-bd22-ca7eb3268f0c tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.265784 Aug 23 10:51:19.373959 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1669/3420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:19 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:19.394724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-44b5a767-03ce-45aa-a9d1-8579503b674a req-3977a23b-a90f-412b-82d1-8fd51653b939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909e5550-fb4c-4d86-a36b-00637f8a0511", "name": "network-vif-deleted", "tag": "fcbdc18f-319a-4b90-a01a-ea115cfd9f8a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:19.408313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-44b5a767-03ce-45aa-a9d1-8579503b674a req-3977a23b-a90f-412b-82d1-8fd51653b939 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.409267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-44b5a767-03ce-45aa-a9d1-8579503b674a req-3977a23b-a90f-412b-82d1-8fd51653b939 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.410982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-44b5a767-03ce-45aa-a9d1-8579503b674a req-3977a23b-a90f-412b-82d1-8fd51653b939 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.431138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-44b5a767-03ce-45aa-a9d1-8579503b674a req-3977a23b-a90f-412b-82d1-8fd51653b939 service nova] Creating event network-vif-deleted:fcbdc18f-319a-4b90-a01a-ea115cfd9f8a for instance 909e5550-fb4c-4d86-a36b-00637f8a0511 on n-h2-847009-13 Aug 23 10:51:19.440755 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-44b5a767-03ce-45aa-a9d1-8579503b674a req-3977a23b-a90f-412b-82d1-8fd51653b939 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065335 Aug 23 10:51:19.442014 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1670/3421] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:19.473344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:19.474210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:19.480932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.482156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.487519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.488382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.489109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.489608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.520642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:19.541901 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61ac687b-768d-4011-bc6d-e1da55285254 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.865462 Aug 23 10:51:19.545998 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1752/3422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:18 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:19.554586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:19.555605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:19.565224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.566624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.567337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.568307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.569053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.569878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.873545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:19.889039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:19.893006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:19.895594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d474282-05d4-4f13-adad-48fd3d98d767 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1849 microversion: 2.42 time: 0.437661 Aug 23 10:51:19.896200 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1671/3423] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:19 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1849 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:19.909331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:19.909331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:19.922140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.922888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.923648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:19.924542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:19.925276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:19.926048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.118932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:20.129856 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a45af38f-b0e3-4b4a-87bb-626578e4dad4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.581410 Aug 23 10:51:20.133838 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1753/3424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:19 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:20.138915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:20.144486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:20.166119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.166906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.167545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.169152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.169814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.170407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.207907 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] HTTP exception thrown: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Request method failure captured: Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 HTTP/1.1 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBm50UqtqluKz0ktBa5rMZAkilYdTrOkkHofNJngfLr0BNil6LmhQKSKFGj26Ce88GPSPref2fKoo48lqHLiLqtFPv_AwfZVt1JaDyNtV2qefndU4x112js_pmcqo5mnOMta-Fg30JHODqlEG8hozq3N9yBP1CijA2VENCLVtoZUUk Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1af0e3fb36da41c9bb4ea1ac3372fdb2 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1af0e3fb36da41c9bb4ea1ac3372fdb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}] Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1af0e3fb36da41c9bb4ea1ac3372fdb2 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachSCSIVolumeTestJSON-2001141744-project Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 3772a6b414424c1cab70261b8d5da918 Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2001141744-project Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '909e5550-fb4c-4d86-a36b-00637f8a0511'} Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:51:20.211344 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:20.216841 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:20.217401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:20.220877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Returning 404 to user: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:51:20.221969 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5b86f86-6d84-4198-990a-74880a9d423a tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 404 len: 111 microversion: 2.1 time: 0.086990 Aug 23 10:51:20.224419 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1754/3425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:20 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:51:20.229475 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-47d52c64-e712-42d9-9240-1f1330174ff3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.330501 Aug 23 10:51:20.240817 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1672/3426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:19 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:20.240817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e312e32-0cb4-4e0c-8ef4-3240b74a6f5e tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '.version_select at 0x7fdc9ce1fdc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:20.251856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:20.252726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:20.267769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.268454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.269095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.273964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.274729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.275380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.299332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e312e32-0cb4-4e0c-8ef4-3240b74a6f5e tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383283840" status: 202 len: 0 microversion: 2.1 time: 0.066113 Aug 23 10:51:20.310767 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1673/3427] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383283840 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:51:20.397824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:20.399337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:20.410849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.416810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.417283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.418057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.421457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.428249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.432678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:20.442628 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-45efb5ac-7e90-4feb-a694-6364280d876f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1274 microversion: 2.1 time: 0.216935 Aug 23 10:51:20.456867 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1755/3428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:20 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:20.671694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:20.690412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9bba71e-9b77-4028-8e0d-c87824d0b6ce tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.296867 Aug 23 10:51:20.697104 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1674/3429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:20 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:20.920906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:20.921525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:20.935949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.936713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.937349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:20.938237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:20.940857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:20.945243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:21.153791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:21.155037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:21.170408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:21.173792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:21.174435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:21.175279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:21.177326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:21.178328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:21.576639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:21.591059 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-beabf206-cdec-455b-85d3-b546f029255d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.441444 Aug 23 10:51:21.594321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1675/3430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:21 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:21.606493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:21.622464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:21.658788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:21.661420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:21.661832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:21.662594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:21.663065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:21.663509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:21.979203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:21.994676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:21.999013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:22.002605 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0798933f-af56-421b-82fb-0132edb66803 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1849 microversion: 2.42 time: 1.086566 Aug 23 10:51:22.003209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1756/3431] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:20 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1849 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:22.018294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:22.020451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:22.035355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.037280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.040384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.042434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.043088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.045148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.159148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:22.171759 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1c883ef-be70-400a-a895-6ec5d74ba1da tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.576080 Aug 23 10:51:22.176337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1676/3432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:21 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:22.188373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e435a23-676d-4d24-9294-41f4700479a2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:22.191378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:22.210814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.211570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.212189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.213640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.214263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.214866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.641567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:22.680442 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09bb7c05-1d10-4508-9104-0ce0599089e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502311 Aug 23 10:51:22.681814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1677/3433] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:51:22 2022] POST /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:22.717942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-28ddda17-e468-4a6b-bcdb-dacf65be7c76 req-ba4edff2-b165-407b-9ed9-387ef0e5f497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "ada32124-6a26-48d3-b44a-884b21329b6e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:22.749442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-28ddda17-e468-4a6b-bcdb-dacf65be7c76 req-ba4edff2-b165-407b-9ed9-387ef0e5f497 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.750216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-28ddda17-e468-4a6b-bcdb-dacf65be7c76 req-ba4edff2-b165-407b-9ed9-387ef0e5f497 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.751288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-28ddda17-e468-4a6b-bcdb-dacf65be7c76 req-ba4edff2-b165-407b-9ed9-387ef0e5f497 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.787519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-28ddda17-e468-4a6b-bcdb-dacf65be7c76 req-ba4edff2-b165-407b-9ed9-387ef0e5f497 service nova] Creating event network-changed:ada32124-6a26-48d3-b44a-884b21329b6e for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:22.803941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-28ddda17-e468-4a6b-bcdb-dacf65be7c76 req-ba4edff2-b165-407b-9ed9-387ef0e5f497 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108964 Aug 23 10:51:22.805222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1678/3434] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:22.811497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:22.812224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:22.820812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.821328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.821894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.823385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:22.823385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:22.823385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:22.833629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:22.857796 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77b837f7-76f7-4e9b-8b0e-ffb0b033a063 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.850924 Aug 23 10:51:22.863238 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1757/3435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:22 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:23.031035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:23.032714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:23.040608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:23.041687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:23.045361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:23.046552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:23.047466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:23.048185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:23.623512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:23.705948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:23.877443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:23.893941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:23.900290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:23.901610 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f26fdc08-a400-415c-9a6c-f3e1331be121 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1849 microversion: 2.42 time: 0.876716 Aug 23 10:51:23.902185 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1758/3436] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:23 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1849 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:23.914519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:23.915310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:23.923487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:23.924214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:23.924863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:23.925771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:23.926401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:23.926995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:24.083815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:24.107986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69edd628-7100-48e8-8e7a-9d3dccb03eb1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 1.295619 Aug 23 10:51:24.109663 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1679/3437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:22 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:24.122460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:24.130719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:24.151967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:24.153802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:24.158523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:24.161254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:24.161910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:24.163350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:24.400786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:24.424861 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae4ebced-ca98-4846-81ad-b7c3bcf43ad9 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.313426 Aug 23 10:51:24.425828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1680/3438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:24 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:24.807230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:24.823944 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3407048-68d6-4efa-b386-a8b5bddda8a8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.915054 Aug 23 10:51:24.827554 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1759/3439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:23 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:24.932278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:24.932931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:24.940757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:24.941258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:24.941733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:24.942388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:24.943026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:24.943625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.078466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b96e3f4a-4a85-48d1-a224-c33080bb055d req-4fa3fced-2d36-4fa1-9ec2-5e6944fbcb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8b647c-8ac8-4d88-ad72-8723d3537613", "tag": "00498f2e-8ed2-404b-8fa7-79d6bcdb0c6b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:25.099207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b96e3f4a-4a85-48d1-a224-c33080bb055d req-4fa3fced-2d36-4fa1-9ec2-5e6944fbcb13 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.100596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b96e3f4a-4a85-48d1-a224-c33080bb055d req-4fa3fced-2d36-4fa1-9ec2-5e6944fbcb13 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.101237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b96e3f4a-4a85-48d1-a224-c33080bb055d req-4fa3fced-2d36-4fa1-9ec2-5e6944fbcb13 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.107972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:25.118006 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b96e3f4a-4a85-48d1-a224-c33080bb055d req-4fa3fced-2d36-4fa1-9ec2-5e6944fbcb13 service nova] Creating event network-changed:00498f2e-8ed2-404b-8fa7-79d6bcdb0c6b for instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 on n-h2-847009-13 Aug 23 10:51:25.159334 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b96e3f4a-4a85-48d1-a224-c33080bb055d req-4fa3fced-2d36-4fa1-9ec2-5e6944fbcb13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088772 Aug 23 10:51:25.160641 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1760/3440] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:25.167775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:25.170289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:25.179491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.180317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.181668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.182562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.183188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.184681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.310237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:25.326745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:25.329414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:25.331140 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f8ae4be-fc59-4dc2-bef7-85543e6afc8f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1870 microversion: 2.42 time: 0.404827 Aug 23 10:51:25.332382 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1681/3441] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:24 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1870 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:25.446542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:25.447621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:25.454863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.455627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.456315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.457330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.458109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.458780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.533038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:25.550052 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd7305a4-0c74-4a8c-ba01-e5a2af97ba0f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.387772 Aug 23 10:51:25.550969 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1761/3442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:25 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:25.619596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-99292256-0f36-4540-9a9b-38c94dc485ee req-899c2bf3-c7b7-4b14-9fb0-732b52bf2de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "e0790256-559e-4ed3-880d-a92da3742a25"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:25.638024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99292256-0f36-4540-9a9b-38c94dc485ee req-899c2bf3-c7b7-4b14-9fb0-732b52bf2de6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.644391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99292256-0f36-4540-9a9b-38c94dc485ee req-899c2bf3-c7b7-4b14-9fb0-732b52bf2de6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.645385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-99292256-0f36-4540-9a9b-38c94dc485ee req-899c2bf3-c7b7-4b14-9fb0-732b52bf2de6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.658865 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-99292256-0f36-4540-9a9b-38c94dc485ee req-899c2bf3-c7b7-4b14-9fb0-732b52bf2de6 service nova] Creating event network-changed:e0790256-559e-4ed3-880d-a92da3742a25 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:25.680563 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-99292256-0f36-4540-9a9b-38c94dc485ee req-899c2bf3-c7b7-4b14-9fb0-732b52bf2de6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062321 Aug 23 10:51:25.681581 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1762/3443] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:25.799541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9229bbbf-eeb8-44ed-bac0-a08335200536 req-d0abb41d-17ef-48c6-830c-2e21f3303081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057c7307-04cc-43f0-8c9d-1233486e4b9e", "name": "network-vif-plugged", "status": "completed", "tag": "d4b89f90-900a-49c6-8ae6-8d854e7c5ffd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:25.817708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9229bbbf-eeb8-44ed-bac0-a08335200536 req-d0abb41d-17ef-48c6-830c-2e21f3303081 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.818378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9229bbbf-eeb8-44ed-bac0-a08335200536 req-d0abb41d-17ef-48c6-830c-2e21f3303081 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.818620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9229bbbf-eeb8-44ed-bac0-a08335200536 req-d0abb41d-17ef-48c6-830c-2e21f3303081 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.838562 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9229bbbf-eeb8-44ed-bac0-a08335200536 req-d0abb41d-17ef-48c6-830c-2e21f3303081 service nova] Creating event network-vif-plugged:d4b89f90-900a-49c6-8ae6-8d854e7c5ffd for instance 057c7307-04cc-43f0-8c9d-1233486e4b9e on n-h1-847009-13 Aug 23 10:51:25.860282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9229bbbf-eeb8-44ed-bac0-a08335200536 req-d0abb41d-17ef-48c6-830c-2e21f3303081 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067035 Aug 23 10:51:25.863203 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1763/3444] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:51:25.880569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:25.887021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:25.908610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.910192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.911666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.916179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:25.916934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:25.919181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:25.923562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:25.942307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72611825-12ec-4c8a-9575-1f8db66d30ad tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.498558 Aug 23 10:51:25.944918 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1682/3445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:25 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:26.357104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:26.357845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:26.364613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:26.365379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:26.365995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:26.367392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:26.368019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:26.368599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:26.398203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:26.411761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33f5d702-217a-4ede-8b7e-1816d6bd8ef8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.542202 Aug 23 10:51:26.416511 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1764/3446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:25 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:26.573628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:26.574253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:26.587058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:26.589110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:26.591682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:26.592456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:26.593452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:26.596606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:26.597257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:26.808472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:26.830748 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c059963d-c7be-45c6-98ed-0dcf065fb7b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.261425 Aug 23 10:51:26.832968 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1765/3447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:26 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:26.922885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:26.976362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:26.977329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:26.989320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:26.995299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:26.996757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:26.998207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.002246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3296afe9-9dd1-4d6d-8172-1729e3ac1412 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.650524 Aug 23 10:51:27.002591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.003503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:27.004089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.009627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.010166 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1683/3448] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:26 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:27.436688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:27.438506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:27.453710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:27.454230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.454702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.455399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:27.455869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.456306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.627902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:27.641146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b7db233-8a12-45ac-abe4-0bc775d6ad5f tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.671179 Aug 23 10:51:27.643311 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1766/3449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:26 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:27.724321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "c9bedf3a-d5d4-4fd2-bf39-515a26496926"}, {"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "a864d661-858f-474f-ad0a-fcc083ec2074"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:27.736674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:27.737188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.737624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.759047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] Creating event network-changed:c9bedf3a-d5d4-4fd2-bf39-515a26496926 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:27.759560 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] Creating event network-changed:a864d661-858f-474f-ad0a-fcc083ec2074 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:27.774148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5f833ed0-dc02-4bb0-a954-ae4e7213adb0 req-f8d17e1d-2dca-4a05-8d06-c11b006c52c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053496 Aug 23 10:51:27.774946 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1767/3450] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:51:27.863835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:27.864497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:27.870562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:27.877176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:27.877564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.878396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.879295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:27.882638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:27.883299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:27.884196 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6262ab48-8fb0-4d62-80d6-7a80fcf9af7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.454387 Aug 23 10:51:27.886068 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1684/3451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:27 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:28.034002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:28.034890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:28.049652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:28.050400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:28.053672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:28.054634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:28.055260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:28.055861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:28.456718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:28.478202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:28.480220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:28.482988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:28.484604 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c6f8d43-df06-486d-8645-8444224156f6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.455302 Aug 23 10:51:28.496793 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4dae3e7-a69c-4576-89fc-7a61586e817e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1316 microversion: 2.1 time: 0.630938 Aug 23 10:51:28.496793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1768/3452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:27 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:28.498582 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1685/3453] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:28 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:51:28.663306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:28.663935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:28.671240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:28.673940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:28.677677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:28.678666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:28.680456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:28.685569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:28.908277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:28.909231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:28.925058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:28.926029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:28.926880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:28.936551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:28.937616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:28.938595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:29.274544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:29.288647 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-81eaf3b6-6f54-4875-ac72-4f19a3b42cc8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.385487 Aug 23 10:51:29.300773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1686/3454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:28 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:29.510734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:29.511365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:29.527194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:29.528378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:29.529068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:29.529801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:29.530262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:29.530893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:29.567885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:29.583161 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4582d28-366d-4052-a688-aa52f8baae8e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.920733 Aug 23 10:51:29.600196 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1769/3455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:28 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:29.612642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:29.621386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:29.631346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:29.633381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:29.634106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:29.635104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:29.637951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:29.638642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:29.854753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:29.872992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:29.877750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:29.881937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2be78307-ec65-4bfb-ab9c-9052364610bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.375062 Aug 23 10:51:29.882910 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1687/3456] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:29 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:29.892351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-64df2b68-488c-402c-b053-e6555f1df3c8 req-5c61e04d-1871-47bc-908c-4ebe4b0c2137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "c9d2120a-58d0-4732-aaa7-95b54da7b465"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:29.915050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-64df2b68-488c-402c-b053-e6555f1df3c8 req-5c61e04d-1871-47bc-908c-4ebe4b0c2137 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:29.915557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-64df2b68-488c-402c-b053-e6555f1df3c8 req-5c61e04d-1871-47bc-908c-4ebe4b0c2137 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:29.916430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-64df2b68-488c-402c-b053-e6555f1df3c8 req-5c61e04d-1871-47bc-908c-4ebe4b0c2137 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:29.943410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-64df2b68-488c-402c-b053-e6555f1df3c8 req-5c61e04d-1871-47bc-908c-4ebe4b0c2137 service nova] Creating event network-changed:c9d2120a-58d0-4732-aaa7-95b54da7b465 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:29.955760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-64df2b68-488c-402c-b053-e6555f1df3c8 req-5c61e04d-1871-47bc-908c-4ebe4b0c2137 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071322 Aug 23 10:51:29.967388 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1688/3457] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:30.216612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:30.224757 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec2c69e3-e9ff-4e46-bfcf-1fcadd022dc7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.623109 Aug 23 10:51:30.225369 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1770/3458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:29 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:30.318022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1066000205", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:30.332787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:30.335965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:30.360623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:30.361210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:30.361668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:30.365098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:30.365635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:30.366489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:30.436231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] validate_networks() for [('70891eb3-d931-4d2c-bee7-d99486f88b11', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:51:30.940881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:30.954034 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70f24c54-abb1-4e7b-80c2-630901ae158b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.644397 Aug 23 10:51:30.955359 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1689/3459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:30 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:30.964181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:30.965191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:30.977524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:30.978034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:30.978480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:30.979267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:30.979740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:30.980176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:31.051957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:51:31.052439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:51:31.053375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:51:31.054164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:51:31.054598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:51:31.065926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:31.066423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:31.066869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:31.067757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:31.068234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:31.068668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:31.087031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Getting quotas for project 298d46caabb746a2ba9abab15c248dc1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:51:31.093543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Getting quotas for user e397356a2f6349379d081d7381c18ec9 and project 298d46caabb746a2ba9abab15c248dc1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:51:31.106855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:51:31.109514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:51:31.165174 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-791af66a-8e50-48b2-bb68-d0558cb93cbb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854314 Aug 23 10:51:31.172039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1771/3460] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:51:31.172039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:31.172535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:31.180006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:31.180641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:31.181210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:31.182014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:31.182672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:31.184376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:31.292803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:31.312596 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57b43953-c93a-4c85-ba19-148942379519 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.354602 Aug 23 10:51:31.317771 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1690/3461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:30 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:31.327182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-804c4ca0-08a0-4c02-8948-dafda4beb9aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:31.334044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-804c4ca0-08a0-4c02-8948-dafda4beb9aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:31.363384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:31.510725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:31.530192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:31.532152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:31.533662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a97f6fde-a5c4-4791-be95-46b75c248ef2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.366620 Aug 23 10:51:31.534805 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1772/3462] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:31 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:31.575297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-804c4ca0-08a0-4c02-8948-dafda4beb9aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:31.584271 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-804c4ca0-08a0-4c02-8948-dafda4beb9aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1217 microversion: 2.1 time: 0.265343 Aug 23 10:51:31.585976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1691/3463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:31 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:31.982739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:31.984475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "d5c4df22-c16f-4712-83e2-870018b97e49"}, {"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "45b4a255-749d-4e2a-b1d9-2962413c0338"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:31.985741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:32.023428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.023930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.024378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.042453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.043098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.044346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.047420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.048315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.049548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.075790 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] Creating event network-changed:d5c4df22-c16f-4712-83e2-870018b97e49 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:32.080722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] Creating event network-changed:45b4a255-749d-4e2a-b1d9-2962413c0338 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:51:32.092823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-166d070c-aa00-4876-979c-f4b3a3ce1841 req-568f668d-39c2-4876-9fde-23939b9298da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112954 Aug 23 10:51:32.093876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1692/3464] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:32.245779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-94ad88d5-cdd1-400d-ae60-b5cfa38646f6 req-81843ce8-7854-4438-8cd7-4ae190b24725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8b647c-8ac8-4d88-ad72-8723d3537613", "name": "network-vif-plugged", "status": "completed", "tag": "00498f2e-8ed2-404b-8fa7-79d6bcdb0c6b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:32.269542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-94ad88d5-cdd1-400d-ae60-b5cfa38646f6 req-81843ce8-7854-4438-8cd7-4ae190b24725 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.270060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-94ad88d5-cdd1-400d-ae60-b5cfa38646f6 req-81843ce8-7854-4438-8cd7-4ae190b24725 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.270508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-94ad88d5-cdd1-400d-ae60-b5cfa38646f6 req-81843ce8-7854-4438-8cd7-4ae190b24725 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.298174 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-94ad88d5-cdd1-400d-ae60-b5cfa38646f6 req-81843ce8-7854-4438-8cd7-4ae190b24725 service nova] Creating event network-vif-plugged:00498f2e-8ed2-404b-8fa7-79d6bcdb0c6b for instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 on n-h2-847009-13 Aug 23 10:51:32.308171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-94ad88d5-cdd1-400d-ae60-b5cfa38646f6 req-81843ce8-7854-4438-8cd7-4ae190b24725 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067739 Aug 23 10:51:32.313535 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1693/3465] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:51:32.335526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:32.339995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:32.341357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:32.346958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4fed503-3756-4649-9be6-95f00b5a55c6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.374995 Aug 23 10:51:32.347558 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1773/3466] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:31 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:32.353884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.354701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.356114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.357101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.358928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.359647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.568310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:32.568993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:32.580980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.581490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.581940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.582670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.583137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.583572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.758655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:32.768972 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16ef8d52-a3dd-4095-815c-de733fb1b1cb tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.433928 Aug 23 10:51:32.779367 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1694/3467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:32 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:32.789939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:32.790565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:32.798069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.798734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.799290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.800076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:32.800545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:32.801005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:32.902655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:32.916672 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91fe8f81-2b4b-448a-ad01-ecf08166ce0e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1269 microversion: 2.1 time: 0.135264 Aug 23 10:51:32.918006 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1695/3468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:32 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:32.927645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:32.939568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:32.941881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:32.943358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92aba97a-0c9f-4a87-a118-ad4c7d02f054 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.380913 Aug 23 10:51:32.958305 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1774/3469] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:32 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:51:33.371509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:33.372113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:33.378439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:33.379293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:33.380117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:33.381148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:33.381835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:33.382483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:33.661712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:33.672795 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c75cedc4-3f3d-4793-9f46-ef9475589eb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.305522 Aug 23 10:51:33.685222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1696/3470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:33 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:33.791997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:33.792618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:33.811314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:33.812524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:33.813005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:33.813887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:33.814890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:33.815563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:33.939624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:33.940507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:33.954219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:33.954731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:33.955190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:33.955921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:33.956389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:33.956856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:34.008658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:34.071198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:34.084498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c5241f1-a563-48c5-9f1c-4a64d1e8b484 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.296592 Aug 23 10:51:34.104340 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1775/3471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:33 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:34.116196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:34.117933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:34.119634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:34.129255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:34.130522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:34.131507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:34.132460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:34.133489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:34.133705 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d08d14d-ba8b-4b0d-979d-2e58e3113236 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1277 microversion: 2.1 time: 0.199732 Aug 23 10:51:34.134449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:34.147895 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1697/3472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:33 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:34.636662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:34.655529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:34.657578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:34.658980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8d4fe49-9f81-46f4-97c6-6283257067d5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.551968 Aug 23 10:51:34.661827 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1776/3473] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:34 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:34.695900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:34.697329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:34.723541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:34.724714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:34.735305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:34.738166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:34.738976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:34.739650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:35.076324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:35.090670 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-905fd582-70d1-4b21-939d-04fab2486c09 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1316 microversion: 2.1 time: 0.396658 Aug 23 10:51:35.108145 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1698/3474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:34 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:35.111828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:35.112505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:35.126694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:35.129699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:35.132257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:35.133081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:35.133828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:35.135178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:35.156611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:35.157640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:35.165107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:35.166370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:35.167039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:35.168801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:35.169799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:35.170492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:35.320390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:35.333346 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa509441-fdd6-463f-a0bf-5cb91e7e54b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1275 microversion: 2.1 time: 0.181838 Aug 23 10:51:35.335445 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1699/3475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:35 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:35.673866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:35.686668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:35.687896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:35.689474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1949bfb-f6b8-49b2-b409-17d63fd5004e tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.585296 Aug 23 10:51:35.690105 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1777/3476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:35 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:35.703221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:35.704466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:35.705635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:35.706946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:35.710693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:35.711544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.123953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:36.128444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:36.154238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.155051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.155708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.156597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.157961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.158911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.274220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:36.296642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:36.306820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:36.308263 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c784732-50e9-4ba6-99e9-2225d4fef4e0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.627736 Aug 23 10:51:36.310368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1700/3477] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:35 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:36.356189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:36.357009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:36.374070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.375041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.378976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.381220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.383162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.385285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.594399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:36.609010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4801cc23-35a8-4f8c-afb1-338c91384073 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1465 microversion: 2.1 time: 0.493174 Aug 23 10:51:36.622707 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1778/3478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:36 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1465 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:36.631710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:36.633873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:36.643853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.645115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.645796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.646771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.647483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.648202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.715324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:36.734235 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1622d61b-36dc-4489-b3e9-7c96a23b5261 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.382438 Aug 23 10:51:36.740038 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1701/3479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:36 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:36.756689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:36.757679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:36.764670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.765442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.766696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:36.767422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:36.768085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:36.768727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:37.239079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:37.250875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56805bf7-da42-4429-a345-5e717a82970d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1524 microversion: 2.1 time: 0.510107 Aug 23 10:51:37.260239 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1702/3480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:36 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1524 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:37.331440 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-428d7600-4397-4b60-aaf5-4b152870cf32 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1618 microversion: 2.1 time: 0.704068 Aug 23 10:51:37.337260 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1779/3481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:36 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1618 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:37.344230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:37.346416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:37.364289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:37.370738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:37.373367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:37.375117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:37.375680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:37.378856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:37.412040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1140636084", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["c94cbffe-d053-422b-bacb-6ab8fd02d551"]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:37.519199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:51:37.834751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:37.848793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:37.851026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:37.853294 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b5b3de4-ee4f-43af-9525-67e11fe1e27e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.518708 Aug 23 10:51:37.883950 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1703/3482] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:37 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:37.892147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:37.893135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:37.901969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:37.903736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:37.905331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:37.906367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:37.907101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:37.907703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:37.955938 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] HTTP exception thrown: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Request method failure captured: Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 HTTP/1.1 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLBm50UqtqluKz0ktBa5rMZAkilYdTrOkkHofNJngfLr0BNil6LmhQKSKFGj26Ce88GPSPref2fKoo48lqHLiLqtFPv_AwfZVt1JaDyNtV2qefndU4x112js_pmcqo5mnOMta-Fg30JHODqlEG8hozq3N9yBP1CijA2VENCLVtoZUUk Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1af0e3fb36da41c9bb4ea1ac3372fdb2 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1af0e3fb36da41c9bb4ea1ac3372fdb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}] Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1af0e3fb36da41c9bb4ea1ac3372fdb2 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachSCSIVolumeTestJSON-2001141744-project Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 3772a6b414424c1cab70261b8d5da918 Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2001141744-project Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '909e5550-fb4c-4d86-a36b-00637f8a0511'} Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:51:37.974418 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:37.980079 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:51:37.984026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Returning 404 to user: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:51:37.988833 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2231ff51-2722-4062-85d8-041b5d45b135 tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 404 len: 111 microversion: 2.1 time: 0.101856 Aug 23 10:51:37.989922 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1704/3483] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:51:37 2022] DELETE /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:51:38.003849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:38.004961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:38.027010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.035411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.036191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.037233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.037921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.038606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.042229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:51:38.043516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:51:38.044171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:51:38.044770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:51:38.045375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:51:38.075247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.075966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.076432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.077315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.077881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.078325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.095124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:38.126852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:51:38.142128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:51:38.174308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:51:38.184765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:51:38.284989 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-70db8606-8584-4dc0-89e3-1155cc08fcb9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876804 Aug 23 10:51:38.286341 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1780/3484] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:51:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 10:51:38.295046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:38.296974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] [instance: 909e5550-fb4c-4d86-a36b-00637f8a0511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:38.306762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.307631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.308264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.311364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.312047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.312991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.330037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] HTTP exception thrown: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Request method failure captured: Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 HTTP/1.1 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLBm50UqtqluKz0ktBa5rMZAkilYdTrOkkHofNJngfLr0BNil6LmhQKSKFGj26Ce88GPSPref2fKoo48lqHLiLqtFPv_AwfZVt1JaDyNtV2qefndU4x112js_pmcqo5mnOMta-Fg30JHODqlEG8hozq3N9yBP1CijA2VENCLVtoZUUk Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1af0e3fb36da41c9bb4ea1ac3372fdb2 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1af0e3fb36da41c9bb4ea1ac3372fdb2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1af0e3fb36da41c9bb4ea1ac3372fdb2"}]}] Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1af0e3fb36da41c9bb4ea1ac3372fdb2 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2001141744 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachSCSIVolumeTestJSON-2001141744-project Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 3772a6b414424c1cab70261b8d5da918 Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2001141744-project Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '909e5550-fb4c-4d86-a36b-00637f8a0511'} Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:51:38.332289 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. Aug 23 10:51:38.337638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:51:38.339296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] Returning 404 to user: Instance 909e5550-fb4c-4d86-a36b-00637f8a0511 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:51:38.341557 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26e0a3e4-3afb-45f5-862e-73b4b2446ada tempest-AttachSCSIVolumeTestJSON-2001141744 tempest-AttachSCSIVolumeTestJSON-2001141744-project] 10.222.0.78 "GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511" status: 404 len: 111 microversion: 2.1 time: 0.053691 Aug 23 10:51:38.345804 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1781/3485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:38 2022] GET /compute/v2.1/servers/909e5550-fb4c-4d86-a36b-00637f8a0511 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:51:38.354641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b619188b-9468-4319-8464-6a36e5fa7212 req-ea8bdbbe-c0a3-49a9-92fb-aa8ca4836c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f8abe5-3fa8-45c1-9539-535d43d6f1fb", "tag": "caeb0ad7-b381-49ab-a011-b73673a3db8c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:38.370224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b619188b-9468-4319-8464-6a36e5fa7212 req-ea8bdbbe-c0a3-49a9-92fb-aa8ca4836c93 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.371911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b619188b-9468-4319-8464-6a36e5fa7212 req-ea8bdbbe-c0a3-49a9-92fb-aa8ca4836c93 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.372618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b619188b-9468-4319-8464-6a36e5fa7212 req-ea8bdbbe-c0a3-49a9-92fb-aa8ca4836c93 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.388885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b619188b-9468-4319-8464-6a36e5fa7212 req-ea8bdbbe-c0a3-49a9-92fb-aa8ca4836c93 service nova] Creating event network-changed:caeb0ad7-b381-49ab-a011-b73673a3db8c for instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb on n-h2-847009-13 Aug 23 10:51:38.395355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b619188b-9468-4319-8464-6a36e5fa7212 req-ea8bdbbe-c0a3-49a9-92fb-aa8ca4836c93 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049087 Aug 23 10:51:38.396584 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1782/3486] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:38.404113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:38.405137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:38.413762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.414522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.415155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.416057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.416687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.417410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.608908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:38.624237 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee42b991-6d8e-47d4-9e3b-677132d28da6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.629963 Aug 23 10:51:38.625032 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1705/3487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:37 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:38.630812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58926fbe-46c7-42f8-8417-90b2ea495c0c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:38.640654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58926fbe-46c7-42f8-8417-90b2ea495c0c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:38.865504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:38.877864 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec7160f4-ab62-4e48-baa8-6e268c421f0d tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1504 microversion: 2.1 time: 0.479837 Aug 23 10:51:38.878468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1783/3488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:38 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:38.891991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:38.892708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:38.909055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.909541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.910417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:38.911413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:38.912167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:38.912851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:39.193788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:39.206927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58926fbe-46c7-42f8-8417-90b2ea495c0c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:39.220386 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58926fbe-46c7-42f8-8417-90b2ea495c0c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1217 microversion: 2.1 time: 0.593808 Aug 23 10:51:39.221521 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1706/3489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:38 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1217 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:39.230039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e51e4c86-559c-46d5-a738-6553826cae46 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'create', calling method: .version_select at 0x7fdc9d154790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-727301852", "description": "tempest-description-1442965235"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:39.236348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:39.238740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:39.242736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7f85c743-604d-4f51-a1f3-5deeb9d9e9b5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1891 microversion: 2.42 time: 0.363212 Aug 23 10:51:39.243548 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1784/3490] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:38 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1891 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:39.648378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:39.649707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:39.657241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:39.658057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:39.658506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:39.659397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:39.660017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:39.660632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:39.807859 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e51e4c86-559c-46d5-a738-6553826cae46 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.575442 Aug 23 10:51:39.807859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1707/3491] 10.222.0.78 () {60 vars in 1180 bytes} [Tue Aug 23 10:51:39 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:39.819238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-727301852"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:39.821670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:39.830361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:39.831176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:39.831879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:39.832838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:39.833732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:39.834468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:39.852720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:39.867518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68ebd0c3-1a9d-4bff-aaaf-4dd72914101a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.223535 Aug 23 10:51:39.870372 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1785/3492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:39 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:40.233200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.security_group_api [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Adding security group 692a15ee-0bdd-404c-b060-51c47c544698 to port 2e92c754-0328-4dd5-90b4-7e47e051bd3c Aug 23 10:51:40.244629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:40.246005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:40.253766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:40.254288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:40.254731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:40.258616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:40.258616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:40.258616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:40.322564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:40.332253 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb5ec76a-9110-4cae-b7bd-001c8fde171b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1213 microversion: 2.1 time: 0.092283 Aug 23 10:51:40.333548 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1786/3493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:40 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:40.345640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:40.346556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:40.354072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:40.354757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:40.356096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:40.357152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:40.358044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:40.359585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:40.636373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:40.648655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:40.651465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:40.653755 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e111d54-366f-4e48-85ac-d7d2a681b154 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.319171 Aug 23 10:51:40.654629 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1787/3494] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:40 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:40.898481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:40.900439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:40.925667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:40.926981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:40.928536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:40.929582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:40.930963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:40.933171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.147644 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03821840-9235-4847-92ce-687ae8472c12 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action" status: 202 len: 0 microversion: 2.1 time: 1.332576 Aug 23 10:51:41.152912 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1708/3495] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:39 2022] POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action => generated 0 bytes in 1338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:51:41.161991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-727301852"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:41.162550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:41.178929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.179700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.180353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.181285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.182146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.182755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.452394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:41.468542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24150417-6b04-4c0c-9b00-3ab67169a0d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.582010 Aug 23 10:51:41.484319 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1788/3496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:40 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:41.489790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c92c39f3-525d-454b-9ee7-aec1fe660bd4 req-017aa9ab-74e0-460c-b4dc-ef6819684192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:41.501764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c92c39f3-525d-454b-9ee7-aec1fe660bd4 req-017aa9ab-74e0-460c-b4dc-ef6819684192 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.503187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c92c39f3-525d-454b-9ee7-aec1fe660bd4 req-017aa9ab-74e0-460c-b4dc-ef6819684192 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.503794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c92c39f3-525d-454b-9ee7-aec1fe660bd4 req-017aa9ab-74e0-460c-b4dc-ef6819684192 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.522151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c92c39f3-525d-454b-9ee7-aec1fe660bd4 req-017aa9ab-74e0-460c-b4dc-ef6819684192 service nova] Creating event network-changed:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:51:41.530593 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c92c39f3-525d-454b-9ee7-aec1fe660bd4 req-017aa9ab-74e0-460c-b4dc-ef6819684192 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044417 Aug 23 10:51:41.531456 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1789/3497] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:41.537298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:41.538311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:41.551611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.552357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.553016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.553889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.554517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.555340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.692309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:41.705321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-407f606c-21cd-4a84-8c49-f14f53a73239 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1269 microversion: 2.1 time: 0.172445 Aug 23 10:51:41.724353 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1790/3498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:41 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:41.730122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:41.731289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:41.738094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.738843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.739448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.740317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:41.741142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:41.741983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:41.815469 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.security_group_api [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Removing security group 692a15ee-0bdd-404c-b060-51c47c544698 from port 2e92c754-0328-4dd5-90b4-7e47e051bd3c Aug 23 10:51:42.145077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:42.158170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:42.160233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:42.161664 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a8e60bd-bc4a-4c05-8098-9e3e8e945360 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.435913 Aug 23 10:51:42.162448 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1791/3499] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:41 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:42.500504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:42.504810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:42.523526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:42.525136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:42.525936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:42.527912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:42.528878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:42.531232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:42.722450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:42.734506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efe633f4-9e14-4557-83c4-b4fb159ec81e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.246171 Aug 23 10:51:42.736124 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1792/3500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:42 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:42.749217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:42.749964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:42.757807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:42.758305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:42.758748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:42.759450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:42.759953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:42.760541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:42.848292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:42.863300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-843a960c-e213-4ebd-825a-d9006f5944c8 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1269 microversion: 2.1 time: 0.125694 Aug 23 10:51:42.864335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1793/3501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:42 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:42.968016 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a05c324-76b0-4ed3-a7c7-65ab55154157 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action" status: 202 len: 0 microversion: 2.1 time: 1.813424 Aug 23 10:51:42.971394 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1709/3502] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:41 2022] POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action => generated 0 bytes in 1817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:51:42.993693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de445135-e0be-402f-b1cd-63bbbef424ba tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'create', calling method: .version_select at 0x7fdc9cbb9040>, body: {"pool": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:43.187870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:43.189052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:43.206198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:43.207437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:43.210413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:43.212827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:43.215376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:43.217217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:43.941392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:43.982051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:43.985261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:43.988048 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b654f27-f88c-4e58-9751-2ee472bc283f tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.804475 Aug 23 10:51:43.989404 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1710/3503] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:43 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:51:43.994985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:43.995904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:44.004003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.004840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.005513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:44.006458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.008249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.008979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:44.063757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:51:44.203853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e6d7db6-28d6-4797-8892-a8876b99e089 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 204 len: 0 microversion: 2.1 time: 0.212826 Aug 23 10:51:44.209458 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1711/3504] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:51:43 2022] DELETE /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:51:44.217144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5b2b2206-a63a-4753-ade8-854bf8db24a6 req-0dd2731f-8b63-4aea-807f-8620742483bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:44.231747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5b2b2206-a63a-4753-ade8-854bf8db24a6 req-0dd2731f-8b63-4aea-807f-8620742483bd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.232769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5b2b2206-a63a-4753-ade8-854bf8db24a6 req-0dd2731f-8b63-4aea-807f-8620742483bd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.233793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5b2b2206-a63a-4753-ade8-854bf8db24a6 req-0dd2731f-8b63-4aea-807f-8620742483bd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:44.266818 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5b2b2206-a63a-4753-ade8-854bf8db24a6 req-0dd2731f-8b63-4aea-807f-8620742483bd service nova] Creating event network-changed:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:51:44.273229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5b2b2206-a63a-4753-ade8-854bf8db24a6 req-0dd2731f-8b63-4aea-807f-8620742483bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061656 Aug 23 10:51:44.274634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1712/3505] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:44.280418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:44.283659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:44.310224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.312531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.313269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:44.314252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.315033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.315729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:44.875263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:44.891181 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a05c51a8-2a28-45fe-a506-0a0e31935b1e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.614892 Aug 23 10:51:44.892200 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1713/3506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:44 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:44.928226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:44.929222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:44.936156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.937113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.937813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:44.938736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:44.939392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:44.940264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:45.067877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:45.079373 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a436224c-997a-43f3-a4a1-cf0bd96f6878 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1275 microversion: 2.1 time: 0.184815 Aug 23 10:51:45.082344 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1714/3507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:44 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:45.104322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:45.108454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:45.117731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:45.118473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:45.119859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:45.121028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:45.134981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:45.135774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:45.446417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:45.462539 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1657d8f8-81e3-418c-b686-26600a0c9448 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1553 microversion: 2.1 time: 0.378953 Aug 23 10:51:45.472540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1715/3508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:45 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1553 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:45.477752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:45.491294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:45.534424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:45.535239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:45.535848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:45.536829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:45.537454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:45.538473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:45.579589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:46.056015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:46.075087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:46.080021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:46.085365 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0b7b52b-d15f-493d-b4af-17714de05401 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.608443 Aug 23 10:51:46.096957 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1716/3509] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:45 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:46.098500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:46.099412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:46.115035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:46.115749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:46.116200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:46.122426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:46.123125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:46.123651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:46.900413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:46.909945 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e407780d-39b5-42da-8a69-09a018251969 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.822875 Aug 23 10:51:46.920942 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1717/3510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:46 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:46.926232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:46.927057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:46.940612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:46.942036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:46.943854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:46.945011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:46.948109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:46.952054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:47.197032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:47.213651 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7bedbc0-ced5-4907-9ebb-0ab6fcf70f19 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.291138 Aug 23 10:51:47.216048 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1718/3511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:46 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:47.223730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:47.225039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:47.237123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:47.237994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:47.238794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:47.239884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:47.240672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:47.241330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:47.578748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:47.588361 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc08472b-a74e-4a69-bf73-0d2540be95a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1553 microversion: 2.1 time: 0.370149 Aug 23 10:51:47.590633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1719/3512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:47 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1553 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:47.596242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:47.597216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:47.604002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:47.604842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:47.605628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:47.606611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:47.607293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:47.607943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.007235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:48.019853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:48.021773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:48.023330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2af2a263-a271-4462-836d-c709660ece48 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.431074 Aug 23 10:51:48.026797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1720/3513] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:47 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:48.039202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:48.040337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:48.055889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.059139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.059726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.062576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.063309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.063926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.099193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:48.164963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:48.524166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:48.546269 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ee73770-aa5d-48d5-8385-3399437ee0b6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.515563 Aug 23 10:51:48.550727 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1721/3514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:48 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:48.560358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:48.562141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:48.573630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.575125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.575938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.577256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.578098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.578892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.703330 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de445135-e0be-402f-b1cd-63bbbef424ba tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.724491 Aug 23 10:51:48.708774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1794/3515] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:51:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:48.725454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-801b07c8-e594-4685-958a-f0aacca7ca74 req-af9d08c0-3232-4c56-9fdf-c1ab5f54204c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc509db-c064-44dc-b367-860a2c51b016", "tag": "76dbff01-7595-4cbc-9d4e-f42bc7fb2f23"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:48.763383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-801b07c8-e594-4685-958a-f0aacca7ca74 req-af9d08c0-3232-4c56-9fdf-c1ab5f54204c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.763872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-801b07c8-e594-4685-958a-f0aacca7ca74 req-af9d08c0-3232-4c56-9fdf-c1ab5f54204c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.764373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-801b07c8-e594-4685-958a-f0aacca7ca74 req-af9d08c0-3232-4c56-9fdf-c1ab5f54204c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.776328 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-801b07c8-e594-4685-958a-f0aacca7ca74 req-af9d08c0-3232-4c56-9fdf-c1ab5f54204c service nova] Creating event network-changed:76dbff01-7595-4cbc-9d4e-f42bc7fb2f23 for instance 2fc509db-c064-44dc-b367-860a2c51b016 on n-h2-847009-13 Aug 23 10:51:48.787883 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-801b07c8-e594-4685-958a-f0aacca7ca74 req-af9d08c0-3232-4c56-9fdf-c1ab5f54204c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076897 Aug 23 10:51:48.790592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1795/3516] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:48.799567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:48.801029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:48.809016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.809513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.810009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:48.812225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:48.813540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:48.814073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:49.012128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:49.021010 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49bbc997-48c8-473d-a8d5-4395e949cef1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.468440 Aug 23 10:51:49.022821 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1722/3517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:48 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:49.028851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.68"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:49.032169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:49.047533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:49.049040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:49.049040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:49.050060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:49.050687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:49.051293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:49.104866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "refresh_cache-39350aa4-469c-448b-ab25-1da72fe77abf" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:51:49.106159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquired lock "refresh_cache-39350aa4-469c-448b-ab25-1da72fe77abf" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:51:49.218086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:49.531076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:49.546386 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-742be293-152b-4713-8a88-a998b6291e4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1553 microversion: 2.1 time: 0.751609 Aug 23 10:51:49.552866 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1796/3518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:48 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1553 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:49.562123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9200a512-1a57-4fd8-baa3-28781b73e206 req-f0da6341-1967-4bf8-8329-135567168a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f8abe5-3fa8-45c1-9539-535d43d6f1fb", "name": "network-vif-plugged", "status": "completed", "tag": "caeb0ad7-b381-49ab-a011-b73673a3db8c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:49.597505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9200a512-1a57-4fd8-baa3-28781b73e206 req-f0da6341-1967-4bf8-8329-135567168a83 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:49.598011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9200a512-1a57-4fd8-baa3-28781b73e206 req-f0da6341-1967-4bf8-8329-135567168a83 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:49.608316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9200a512-1a57-4fd8-baa3-28781b73e206 req-f0da6341-1967-4bf8-8329-135567168a83 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:49.644525 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9200a512-1a57-4fd8-baa3-28781b73e206 req-f0da6341-1967-4bf8-8329-135567168a83 service nova] Creating event network-vif-plugged:caeb0ad7-b381-49ab-a011-b73673a3db8c for instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb on n-h2-847009-13 Aug 23 10:51:49.669132 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9200a512-1a57-4fd8-baa3-28781b73e206 req-f0da6341-1967-4bf8-8329-135567168a83 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112602 Aug 23 10:51:49.669819 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1797/3519] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:49.684323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:49.687875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:49.702116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:49.702919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:49.704845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:49.706204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:49.706864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:49.707459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:50.406524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:50.421323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:50.423049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:50.424149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79a6e9de-e9ca-414d-8d14-5fae939b7c43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.751139 Aug 23 10:51:50.424730 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1798/3520] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:49 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:50.432963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:50.434404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:50.468332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:50.468996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:50.469451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:50.470376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:50.470724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:50.476073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:50.895009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:50.905147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9852d3b5-6020-42a4-8ccc-b81173de70ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.476052 Aug 23 10:51:50.921526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1799/3521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:50 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:50.936832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-51fce757-9457-4d72-8998-d946e1035743 req-c7b3299f-73ad-4c4d-b00b-9c44dd20a99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1", "name": "network-vif-deleted", "tag": "c7b4a576-d035-4d44-bdb3-269dd4ab3dc0"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:50.968555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-51fce757-9457-4d72-8998-d946e1035743 req-c7b3299f-73ad-4c4d-b00b-9c44dd20a99a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:50.969158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-51fce757-9457-4d72-8998-d946e1035743 req-c7b3299f-73ad-4c4d-b00b-9c44dd20a99a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:50.969678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-51fce757-9457-4d72-8998-d946e1035743 req-c7b3299f-73ad-4c4d-b00b-9c44dd20a99a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:50.991077 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-51fce757-9457-4d72-8998-d946e1035743 req-c7b3299f-73ad-4c4d-b00b-9c44dd20a99a service nova] Creating event network-vif-deleted:c7b4a576-d035-4d44-bdb3-269dd4ab3dc0 for instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 on n-h2-847009-13 Aug 23 10:51:51.005798 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-51fce757-9457-4d72-8998-d946e1035743 req-c7b3299f-73ad-4c4d-b00b-9c44dd20a99a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093736 Aug 23 10:51:51.017008 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1800/3522] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:51.032164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:51.033078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:51.051168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:51.051851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:51.057139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:51.058322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:51.059356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:51.059994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:51.860481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:51.878048 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6d7d29a-39ef-413f-80ca-b51a65fd2af9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.857790 Aug 23 10:51:51.879920 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1801/3523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:51 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:51.895717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:51.898002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:51.908398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:51.914639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:51.915445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:51.916119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:51.917156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:51.918378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:51.919050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:51.958421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:52.073560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:52.092113 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34496563-2d13-40ea-94b0-67994ccd60a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1346 microversion: 2.1 time: 0.209154 Aug 23 10:51:52.092646 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1802/3524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:51 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:52.115732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:52.116363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:52.137077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:52.137589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:52.138049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:52.138778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:52.139996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:52.140450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:52.266848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:51:52.928485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:52.946333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:52.948017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:52.952168 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d756bf35-4889-4eb2-8d14-5a1c7f835789 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.845962 Aug 23 10:51:52.954930 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1803/3525] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:52 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:52.977139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:52.978023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:52.986804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:52.987650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:52.988266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:52.989307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:52.989948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:52.990580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.225972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Updating instance_info_cache with network_info: [{"id": "2e92c754-0328-4dd5-90b4-7e47e051bd3c", "address": "fa:16:3e:27:11:79", "network": {"id": "efc6e76a-aa02-42d6-bc17-2e6f44b0a0c5", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1036451456-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be943232715d4de78de5bf47d056b11c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e92c754-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:51:53.258438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Releasing lock "refresh_cache-39350aa4-469c-448b-ab25-1da72fe77abf" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:51:53.259494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd9eabd4-bf3b-434d-8e9d-b12bfd677103 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action" status: 202 len: 0 microversion: 2.1 time: 4.235544 Aug 23 10:51:53.260340 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1723/3526] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:49 2022] POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action => generated 0 bytes in 4237 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:51:53.267897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0e389718-3ffd-4c8d-8afd-dd325ecea97f req-afd947d9-5e27-4496-a479-723c40294f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:53.294282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0e389718-3ffd-4c8d-8afd-dd325ecea97f req-afd947d9-5e27-4496-a479-723c40294f63 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:53.298385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0e389718-3ffd-4c8d-8afd-dd325ecea97f req-afd947d9-5e27-4496-a479-723c40294f63 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:53.299006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0e389718-3ffd-4c8d-8afd-dd325ecea97f req-afd947d9-5e27-4496-a479-723c40294f63 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.317402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0e389718-3ffd-4c8d-8afd-dd325ecea97f req-afd947d9-5e27-4496-a479-723c40294f63 service nova] Creating event network-changed:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:51:53.332855 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0e389718-3ffd-4c8d-8afd-dd325ecea97f req-afd947d9-5e27-4496-a479-723c40294f63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069777 Aug 23 10:51:53.336170 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1724/3527] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:53.348552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:53.351178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:53.363824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:53.366443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:53.369936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.372726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:53.389489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:53.392449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.541850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:53.560961 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c5b4c9d-389c-4e5a-b769-74a591b5b057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1317 microversion: 2.1 time: 0.593772 Aug 23 10:51:53.577852 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1804/3528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:52 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:53.583040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:53.583903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:53.592413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:53.593276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:53.593887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.594778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:53.595400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:53.596011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.700234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:53.712225 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f223eea1-2fe7-4e05-8941-80042a32b03e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.374493 Aug 23 10:51:53.713068 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1725/3529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:53 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:53.718618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.68"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:53.770427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:53.788034 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d43ae887-f76b-4ad5-8734-4d5fc1559023 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1346 microversion: 2.1 time: 0.208699 Aug 23 10:51:53.788657 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1805/3530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:53 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1346 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:53.980712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:53.982064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:53.994041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:53.994908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:53.995616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:53.996678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:54.015800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:54.029181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:54.255551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:54.262867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:54.263755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:54.264303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:54.266773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:54.267948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:54.269434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:54.481061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:54.492437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:54.493724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:54.495318 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-575ebb8d-12b4-4ad6-a0f0-12aeb41d7819 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.519709 Aug 23 10:51:54.496388 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1806/3531] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:53 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:54.582860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:54.584144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:54.592468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:54.593282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:54.594293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:54.595452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:54.597150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:54.597842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:54.707355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "refresh_cache-39350aa4-469c-448b-ab25-1da72fe77abf" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 10:51:54.707800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquired lock "refresh_cache-39350aa4-469c-448b-ab25-1da72fe77abf" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 10:51:55.002485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:55.010769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02c13a81-8806-4b0e-a88b-ee6ea9ba5157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1507 microversion: 2.1 time: 0.431708 Aug 23 10:51:55.025186 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1807/3532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:54 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:55.032366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:55.033416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:55.040382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:55.040633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:55.041292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:55.042169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:55.043668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:55.044303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:55.332760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:55.350815 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d900b6ad-5000-4647-9653-a1fca1078cd4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.322229 Aug 23 10:51:55.352419 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1808/3533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:55 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:55.370738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:55.373150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:55.401096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:55.402978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:55.410453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:55.413869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:55.420046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:55.423850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:56.019910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:56.031071 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1be8b9fc-83c5-4625-ae72-e677fc757db5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1346 microversion: 2.1 time: 0.676744 Aug 23 10:51:56.046707 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1809/3534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:55 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1346 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:56.053642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:56.054462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:56.074404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:56.074902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:56.075344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:56.080262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:56.080796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:56.081250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:56.146664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:51:56.286265 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22e88065-f75f-447d-a6b8-b72ab1b736a2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 204 len: 0 microversion: 2.1 time: 0.237144 Aug 23 10:51:56.290321 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1810/3535] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:51:56 2022] DELETE /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:51:56.303932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:56.304666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:56.312610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:56.313357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:56.313614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:56.314331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:56.314808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:56.315797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:56.455587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Building network info cache for instance {{(pid=128860) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 10:51:56.970793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:56.982865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:56.985250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:56.992978 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9cbb658-6664-47ae-9348-59e67c559f26 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.699164 Aug 23 10:51:56.993726 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1811/3536] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:56 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:56.998874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9a711530-ad10-419c-b4b7-b82433e602ed req-a82c7c9c-f326-4ab6-b9b7-81df48be7a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc509db-c064-44dc-b367-860a2c51b016", "name": "network-vif-plugged", "status": "completed", "tag": "76dbff01-7595-4cbc-9d4e-f42bc7fb2f23"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:57.008789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9a711530-ad10-419c-b4b7-b82433e602ed req-a82c7c9c-f326-4ab6-b9b7-81df48be7a8a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.009309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9a711530-ad10-419c-b4b7-b82433e602ed req-a82c7c9c-f326-4ab6-b9b7-81df48be7a8a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.009749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9a711530-ad10-419c-b4b7-b82433e602ed req-a82c7c9c-f326-4ab6-b9b7-81df48be7a8a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.023458 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9a711530-ad10-419c-b4b7-b82433e602ed req-a82c7c9c-f326-4ab6-b9b7-81df48be7a8a service nova] Creating event network-vif-plugged:76dbff01-7595-4cbc-9d4e-f42bc7fb2f23 for instance 2fc509db-c064-44dc-b367-860a2c51b016 on n-h2-847009-13 Aug 23 10:51:57.041907 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9a711530-ad10-419c-b4b7-b82433e602ed req-a82c7c9c-f326-4ab6-b9b7-81df48be7a8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045249 Aug 23 10:51:57.043545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1812/3537] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:57.055381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:57.060339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:57.068826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.070462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.071077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.072008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.072788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.073410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.384202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:57.399016 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99150b39-d87e-4dbd-9a7f-860591a9f241 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1513 microversion: 2.1 time: 0.350479 Aug 23 10:51:57.399633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1813/3538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:57 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:57.410907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:57.411601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:57.437956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.438851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.439478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.441908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.442607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.443232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.719210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Updating instance_info_cache with network_info: [{"id": "2e92c754-0328-4dd5-90b4-7e47e051bd3c", "address": "fa:16:3e:27:11:79", "network": {"id": "efc6e76a-aa02-42d6-bc17-2e6f44b0a0c5", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1036451456-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "be943232715d4de78de5bf47d056b11c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2e92c754-03", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:51:57.734894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Releasing lock "refresh_cache-39350aa4-469c-448b-ab25-1da72fe77abf" {{(pid=128860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 10:51:57.736503 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68195ae1-d9fd-4fe7-befc-ea36a5401b50 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action" status: 202 len: 0 microversion: 2.1 time: 4.021939 Aug 23 10:51:57.737040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1726/3539] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:51:53 2022] POST /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf/action => generated 0 bytes in 4023 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 10:51:57.746996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4738e898-132c-4eea-b87f-5d729cd69f5e req-3b3ae0aa-6e7b-481c-9ab2-d1e960e35665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:51:57.759385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4738e898-132c-4eea-b87f-5d729cd69f5e req-3b3ae0aa-6e7b-481c-9ab2-d1e960e35665 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.759885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4738e898-132c-4eea-b87f-5d729cd69f5e req-3b3ae0aa-6e7b-481c-9ab2-d1e960e35665 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.760328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4738e898-132c-4eea-b87f-5d729cd69f5e req-3b3ae0aa-6e7b-481c-9ab2-d1e960e35665 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.774255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4738e898-132c-4eea-b87f-5d729cd69f5e req-3b3ae0aa-6e7b-481c-9ab2-d1e960e35665 service nova] Creating event network-changed:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:51:57.779646 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4738e898-132c-4eea-b87f-5d729cd69f5e req-3b3ae0aa-6e7b-481c-9ab2-d1e960e35665 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038058 Aug 23 10:51:57.780616 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1727/3540] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:51:57.792846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:57.795944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:57.804649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.805440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.806066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.807002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.807642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.808910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.868465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:57.868992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:57.869527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:57.871071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:51:58.027289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:58.042863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:58.047761 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9507308-9ff1-44f9-9df9-cd56090786eb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.647032 Aug 23 10:51:58.063695 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1814/3541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:57 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:58.067654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7ca9177-9e47-415d-b8a5-13ffa2bc5aa3 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '.version_select at 0x7fdc9cc8c280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:58.069808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed86cf63-f5e1-4062-bec9-303b7c47d438 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1351 microversion: 2.1 time: 0.287053 Aug 23 10:51:58.077188 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1728/3542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:57 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1351 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:58.082491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:58.083174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:58.099513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:58.100184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:58.100778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:58.102152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:58.102804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:58.103624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:58.387742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:58.397867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:58.399532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:58.400718 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8640ecc1-c1cd-4c46-b652-f57cf4cf2300 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.322303 Aug 23 10:51:58.401444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1729/3543] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:58 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:51:58.420412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:58.421378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:58.427905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:58.428335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:58.428916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:58.429706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:58.430388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:58.431304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:58.728607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:58.741460 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-612bed97-7b39-4526-8b9a-4f4d516788d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1513 microversion: 2.1 time: 0.324637 Aug 23 10:51:58.742931 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1730/3544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:58 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:59.079503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:59.080478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:59.088666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.090052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.091114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:59.092111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.092806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.093817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:59.413480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:59.438272 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bdb3bdc-9484-4a25-9621-c00374218622 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1317 microversion: 2.1 time: 0.370058 Aug 23 10:51:59.447748 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1731/3545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:59 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:51:59.458763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:59.459648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:59.469781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.470466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.471074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:59.472070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.472711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.473335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:59.530049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:51:59.555013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.555511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.555969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:59.556475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:51:59.669086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:51:59.682488 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e019ef23-033f-4fe6-b590-259f23a46371 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 200 len: 1351 microversion: 2.1 time: 0.232128 Aug 23 10:51:59.696973 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1732/3546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:51:59 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 1351 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:51:59.696973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:51:59.696973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:51:59.697915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.699382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.700123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:51:59.701089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:51:59.701994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:51:59.702929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:00.496373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:00.516887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:00.518944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:00.520406 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2cd3870-3103-4bb3-851c-1cb1a413b470 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.835752 Aug 23 10:52:00.522002 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1733/3547] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:51:59 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:00.569206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:00.579557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:00.631488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:00.639048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:00.639660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:00.640532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:00.647138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:00.647545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:00.660265 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7ca9177-9e47-415d-b8a5-13ffa2bc5aa3 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/18d83fe6-9212-4ac2-973a-7e83105a8a51" status: 202 len: 0 microversion: 2.1 time: 2.607791 Aug 23 10:52:00.661044 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1815/3548] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:51:58 2022] DELETE /compute/v2.1/os-floating-ips/18d83fe6-9212-4ac2-973a-7e83105a8a51 => generated 0 bytes in 2609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:00.688982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:00.690960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:00.721787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:00.722438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:00.722999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:00.727999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:00.730575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:00.737402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:00.992549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:01.020594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62de92ae-b2ab-495f-a1b5-97b1df0bca88 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 200 len: 1471 microversion: 2.1 time: 0.465797 Aug 23 10:52:01.021690 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1734/3549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:00 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:01.028570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-598f093a-9959-47cd-a540-14b1614050c7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '.version_select at 0x7fdc9d69eee0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:01.033675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:01.049318 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-97dd3417-e962-4d36-af96-9c623925b66c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1466 microversion: 2.1 time: 0.382061 Aug 23 10:52:01.050238 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1816/3550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:00 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1466 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:01.057692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:01.059423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:01.071144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.071771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.072294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.073137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.074403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.075097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.116452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 HTTP/1.1 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1'} Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:01.123008 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.128052 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.132251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:01.133398 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af86cecb-70eb-40fc-ae65-efd91e16b8ac tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 404 len: 111 microversion: 2.1 time: 0.081897 Aug 23 10:52:01.135786 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1817/3551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:01 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:01.152931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-574817ae-293b-4bfb-aa27-050cddb4cf4c req-227facf9-b2b3-4e1b-a66a-7120474f4f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f8abe5-3fa8-45c1-9539-535d43d6f1fb", "name": "network-vif-deleted", "tag": "caeb0ad7-b381-49ab-a011-b73673a3db8c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:01.173996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-574817ae-293b-4bfb-aa27-050cddb4cf4c req-227facf9-b2b3-4e1b-a66a-7120474f4f6f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.181042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-574817ae-293b-4bfb-aa27-050cddb4cf4c req-227facf9-b2b3-4e1b-a66a-7120474f4f6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.181770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-574817ae-293b-4bfb-aa27-050cddb4cf4c req-227facf9-b2b3-4e1b-a66a-7120474f4f6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.220575 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-574817ae-293b-4bfb-aa27-050cddb4cf4c req-227facf9-b2b3-4e1b-a66a-7120474f4f6f service nova] Creating event network-vif-deleted:caeb0ad7-b381-49ab-a011-b73673a3db8c for instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb on n-h2-847009-13 Aug 23 10:52:01.225923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-574817ae-293b-4bfb-aa27-050cddb4cf4c req-227facf9-b2b3-4e1b-a66a-7120474f4f6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084865 Aug 23 10:52:01.226791 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1818/3552] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:01.236863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:01.237864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:01.250690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.251300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.251750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.252465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.252981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.253415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.555627 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24b9c56b-86f2-4234-aee0-18526f073708 tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1619 microversion: 2.1 time: 0.327374 Aug 23 10:52:01.569379 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1819/3553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:01 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1619 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:01.586703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:01.591098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:01.627197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.628333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.630447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.654828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.656798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.660032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.704632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1/os-volume_attachments HTTP/1.1 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1'} Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:01.709743 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0fa2e50b-d5cd-485c-9618-c38d1398a4f6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.140569 Aug 23 10:52:01.714106 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1820/3554] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:52:01 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1/os-volume_attachments => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:01.722238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:01.722870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:01.741097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.743552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.746619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.747627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:01.748311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:01.749206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:01.759127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:01.957334 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-598f093a-9959-47cd-a540-14b1614050c7 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/692a15ee-0bdd-404c-b060-51c47c544698" status: 202 len: 0 microversion: 2.1 time: 0.933438 Aug 23 10:52:01.960843 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1735/3555] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 10:52:01 2022] DELETE /compute/v2.1/os-security-groups/692a15ee-0bdd-404c-b060-51c47c544698 => generated 0 bytes in 935 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:01.968195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-205726513", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "c94cbffe-d053-422b-bacb-6ab8fd02d551"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:01.993452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:02.041462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:02.062373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:02.067869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:02.071766 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e3784c7-91c5-411c-a9a2-67305b51fe89 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.352160 Aug 23 10:52:02.073571 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1821/3556] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:01 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:02.074518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] validate_networks() for None {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:02.083223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:02.083734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:02.107149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.107946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.108563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.109495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.113197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.113929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.170851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:02.345273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-674ecfa9-df52-4bcc-aa8b-6a371da0076b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "DELETE /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 204 len: 0 microversion: 2.1 time: 0.268033 Aug 23 10:52:02.347368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1822/3557] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:02 2022] DELETE /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:02.354831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:02.356610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:02.366780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.368482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.369369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.370414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.371655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.372356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.444312 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb HTTP/1.1 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '64f8abe5-3fa8-45c1-9539-535d43d6f1fb'} Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:02.446895 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:02.452323 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:02.454197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:02.455302 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-27fe2fcb-365c-4842-853b-c24bb48d63df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 404 len: 111 microversion: 2.1 time: 0.106515 Aug 23 10:52:02.456487 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1823/3558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:02 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:02.462916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-106537214", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:02.566916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:02.568447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:02.570497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:02.571990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:02.574438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:02.579949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:02.586956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.587786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.588923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.590709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.591396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.592170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.619286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:02.628072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Getting quotas for user 1fc684cdb7f449f48bdd1bcb7d436afc and project 730a5bd640e2437cab0c302a1a03fb66. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:02.648279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:02.653306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:02.736103 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-201181b2-6cc6-4fdc-89ae-7a8fd67c660b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775267 Aug 23 10:52:02.737487 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1736/3559] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:52:02.748942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:02.752532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:02.770829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.772936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.774001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:02.776010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:02.778776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:02.779333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.327916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:03.328516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:03.328859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:03.329281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:03.329705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:03.344729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.345269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.345713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.346646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.347372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.347990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.375011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:03.394065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:03.430705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:03.436410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:03.518417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cbee56a0-5f67-42a0-8f81-f74285734e38 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059981 Aug 23 10:52:03.521849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1824/3560] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:52:03.537020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:03.538083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:03.553666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.556953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.558748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.561755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.562833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.564784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.712605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:03.735588 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9d2b145-fd92-441a-8208-f0c71be34126 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1510 microversion: 2.1 time: 0.994809 Aug 23 10:52:03.736203 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1737/3561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:02 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1510 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:03.743920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:03.746209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:03.779772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.780294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.780815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.782497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.784779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.785704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.901376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:03.913411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcabc578-6d4d-430b-8516-da2ea53cba7d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.388535 Aug 23 10:52:03.930509 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1825/3562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:03 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:03.952271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:03.955575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:03.981098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.981510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.982179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:03.983293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:03.984230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:03.985048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:04.136220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:04.148900 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95f42443-4fb6-4994-a30e-c36d91838b5f tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1220 microversion: 2.1 time: 0.411560 Aug 23 10:52:04.149818 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1738/3563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:03 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1220 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:04.160671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4db5eda8-2b16-413d-8d05-843d599dc8f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:04.163824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4db5eda8-2b16-413d-8d05-843d599dc8f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:04.330995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:04.332857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4db5eda8-2b16-413d-8d05-843d599dc8f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:04.348192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:04.348588 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4db5eda8-2b16-413d-8d05-843d599dc8f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1" status: 200 len: 1214 microversion: 2.1 time: 0.197675 Aug 23 10:52:04.349578 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1739/3564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:04 2022] GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:04.360566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fc62eda-7156-4e10-80b4-362bd5dd8cd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fc62eda-7156-4e10-80b4-362bd5dd8cd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 163 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": 12345, "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 12345 Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:04.367855 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 23 10:52:04.374579 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:04.376824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:04.376824 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e34ee33-6e90-4439-8c02-11454a508950 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.435750 Aug 23 10:52:04.376824 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1826/3565] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:03 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:04.378760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:04.382050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:04.389781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fc62eda-7156-4e10-80b4-362bd5dd8cd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:04.391390 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fc62eda-7156-4e10-80b4-362bd5dd8cd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.040541 Aug 23 10:52:04.392004 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1740/3566] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:04 2022] POST /compute/v2.1/servers => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:04.405809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:04.407590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:04.420557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:04.422481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:04.423242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:04.424607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:04.426500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:04.427935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:04.428591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:04.470175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:04.470976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:04.471536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:04.537852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'flavor' on Instance uuid ffe992c9-8e3f-4edb-a544-aadcc2d053e1 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:04.553318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'system_metadata' on Instance uuid ffe992c9-8e3f-4edb-a544-aadcc2d053e1 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:04.623993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'metadata' on Instance uuid ffe992c9-8e3f-4edb-a544-aadcc2d053e1 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:04.868078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:04.879670 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2856d69d-5fca-4323-8abb-4ceee2cfd9a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.483138 Aug 23 10:52:04.893049 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1741/3567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:04 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:04.893049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:04.893049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:04.895631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:04.896635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:04.897470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:04.898278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:04.898848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:04.899389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.020497 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.scheduler.client.report [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Deleted allocations for instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 Aug 23 10:52:05.041294 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ff61e46-00dd-445e-a564-e4452ea3fffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1" status: 204 len: 0 microversion: 2.1 time: 0.669089 Aug 23 10:52:05.046271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1827/3568] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:04 2022] DELETE /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:05.049221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:05.049958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:05.056133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.057114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.057688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.058527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.059122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.059672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.205071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:05.216600 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9d1a6031-3e4c-41c1-a141-f2dc280d7b82 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.171455 Aug 23 10:52:05.217209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1828/3569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:05 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:05.222541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:05.223206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:05.231187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.231952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.232626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.233730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.233930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.234373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.250744 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 HTTP/1.1 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ffe992c9-8e3f-4edb-a544-aadcc2d053e1'} Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:05.253036 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff230c32-e274-4a4e-9a48-bc7e11887815 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1" status: 404 len: 111 microversion: 2.1 time: 0.036131 Aug 23 10:52:05.257717 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1829/3570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:05 2022] GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:05.262926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:05.263558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:05.270321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.270943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.271404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.272120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.272585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.273190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.330925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:05.344775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f32a75ad-baf2-4266-8e5f-fbba9ca776a6 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1510 microversion: 2.1 time: 0.463266 Aug 23 10:52:05.358709 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1742/3571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:04 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:05.360718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:05.371632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11e9a275-cecd-47e9-8138-8459f35e82db tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1220 microversion: 2.1 time: 0.115160 Aug 23 10:52:05.372214 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1830/3572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:05 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:05.406012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1050014855", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:05.413788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:05.414455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:05.426079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.426857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.427455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.428959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:05.430736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:05.431400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:05.473195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:06.003495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:06.003924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:06.004412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:06.004960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:06.013242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:06.024640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:06.025443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:06.026078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:06.027870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:06.028600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:06.029061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:06.035536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:06.044627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:06.053118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:06.054791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:06.055960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:06.059824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63740c7e-faba-421f-8659-c343f25c45bb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.659034 Aug 23 10:52:06.061553 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1743/3573] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:05 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:06.061773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:06.098097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:06.100287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:06.219936 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82de4d19-5d8b-4406-b55b-e51aed5e4d2b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818836 Aug 23 10:52:06.228683 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1831/3574] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 10:52:06.233367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0513c001-4994-4473-bcd5-cc94a6b2043b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:06.234747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0513c001-4994-4473-bcd5-cc94a6b2043b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:06.371684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:06.371684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:06.386640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:06.387141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:06.387584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:06.394608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:06.395288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:06.395750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:06.724155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:06.734379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5481fb91-14ea-45db-84b5-7f25e821f360 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1510 microversion: 2.1 time: 0.370668 Aug 23 10:52:06.753277 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1832/3575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:06 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:06.761371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:06.761830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:06.770130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:06.770543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:06.771113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:06.772132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:06.772596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:06.773218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:06.913325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:06.940386 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e2be5201-1d75-4ca7-930a-d76f78b93688 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1212 microversion: 2.1 time: 0.175536 Aug 23 10:52:06.944900 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1833/3576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:06 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1212 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:06.968016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0513c001-4994-4473-bcd5-cc94a6b2043b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:06.983933 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0513c001-4994-4473-bcd5-cc94a6b2043b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1215 microversion: 2.1 time: 0.756227 Aug 23 10:52:06.984800 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1744/3577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:06 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1215 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:07.091290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:07.091992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:07.099564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:07.100059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:07.100501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:07.101255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:07.101812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:07.102331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:07.427830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:07.441366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:07.446629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:07.450216 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-97c0ea0b-b0cd-4c90-8311-a6433d9e2f45 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.366320 Aug 23 10:52:07.453789 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1834/3578] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:07 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:07.755572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:07.756133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:07.770280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:07.774769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:07.776616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:07.777766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:07.778443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:07.779097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:07.976901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:07.978729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:07.998490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.000676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.001275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.002137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.003958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.004615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.037924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:INSERT=1,nova_cell1:DELETE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:08.162568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:08.173401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d47f2c71-dc2b-4728-b80c-75a1a9d14517 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1268 microversion: 2.1 time: 0.211658 Aug 23 10:52:08.174499 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1835/3579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:07 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1268 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:08.181046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:08.182183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:08.195960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:08.203699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29896b1d-388c-4e49-9332-7d3c42947482 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1468 microversion: 2.1 time: 0.451852 Aug 23 10:52:08.204315 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1745/3580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:07 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:08.217762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.218270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.223225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.223225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.223225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.226650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.280892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5a6284e0-34af-4805-a1da-1b97b24de35f req-04006074-c29f-4ff9-9125-0ffb99d928b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39350aa4-469c-448b-ab25-1da72fe77abf", "name": "network-vif-deleted", "tag": "2e92c754-0328-4dd5-90b4-7e47e051bd3c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:08.295639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a6284e0-34af-4805-a1da-1b97b24de35f req-04006074-c29f-4ff9-9125-0ffb99d928b2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.297233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a6284e0-34af-4805-a1da-1b97b24de35f req-04006074-c29f-4ff9-9125-0ffb99d928b2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.297851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a6284e0-34af-4805-a1da-1b97b24de35f req-04006074-c29f-4ff9-9125-0ffb99d928b2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.318454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5a6284e0-34af-4805-a1da-1b97b24de35f req-04006074-c29f-4ff9-9125-0ffb99d928b2 service nova] Creating event network-vif-deleted:2e92c754-0328-4dd5-90b4-7e47e051bd3c for instance 39350aa4-469c-448b-ab25-1da72fe77abf on n-h1-847009-13 Aug 23 10:52:08.328051 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5a6284e0-34af-4805-a1da-1b97b24de35f req-04006074-c29f-4ff9-9125-0ffb99d928b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051942 Aug 23 10:52:08.329404 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1746/3581] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:52:08.336115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7221bfa-55f1-408f-8712-1b8548c320fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1605039474", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bcfe0918-c770-4fbd-9824-4757d8828a24", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:08.461138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e7221bfa-55f1-408f-8712-1b8548c320fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Block Device bcfe0918-c770-4fbd-9824-4757d8828a24 is not bootable. Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7221bfa-55f1-408f-8712-1b8548c320fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 358 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1605039474", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "bcfe0918-c770-4fbd-9824-4757d8828a24", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: exception: Block Device bcfe0918-c770-4fbd-9824-4757d8828a24 is not bootable. Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1605039474', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'bcfe0918-c770-4fbd-9824-4757d8828a24'}], 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1659, in _create_instance Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device bcfe0918-c770-4fbd-9824-4757d8828a24 is not bootable. Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:08.470713 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device bcfe0918-c770-4fbd-9824-4757d8828a24 is not bootable. Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device bcfe0918-c770-4fbd-9824-4757d8828a24 is not bootable. Aug 23 10:52:08.475293 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:08.476771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7221bfa-55f1-408f-8712-1b8548c320fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Block Device bcfe0918-c770-4fbd-9824-4757d8828a24 is not bootable. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:08.477104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7221bfa-55f1-408f-8712-1b8548c320fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.146384 Aug 23 10:52:08.481828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1747/3582] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:08 2022] POST /compute/v2.1/servers => generated 110 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:08.487970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:08.488750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:08.498515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.499020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.499467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.500268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.500769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.501714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.566219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:08.577054 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7edb5a3-6069-40f3-814c-5789fea856ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1267 microversion: 2.1 time: 0.400333 Aug 23 10:52:08.577054 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1836/3583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:08 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1267 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:08.587428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:08.589792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:08.607907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.608059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.608497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:08.610232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:08.619926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:08.621345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.052450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:09.078191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:09.083631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:09.099491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14af62e9-650a-41b1-bbba-12b3e3840e5e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.605152 Aug 23 10:52:09.103181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1748/3584] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:08 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:09.205867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:09.207717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:09.220619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.221368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.224603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.225618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.226642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.227441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.380590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:09.394448 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-775a771c-f35c-4a54-aa40-e3e8178d3608 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.814413 Aug 23 10:52:09.395104 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1837/3585] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:08 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:09.405792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:09.408242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:09.422743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.425356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.432972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.433798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.434272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.434915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.500317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.503641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.504292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.513103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lazy-loading 'fault' on Instance uuid 39350aa4-469c-448b-ab25-1da72fe77abf {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:09.528723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:09.547444 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34e2bad6-01a1-47e0-a553-b83965490da5 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1276 microversion: 2.1 time: 0.346250 Aug 23 10:52:09.556900 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1749/3586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:09 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1276 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:09.570622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f604e2ba-ff74-4994-91f1-5585321769f4 req-4b1df485-f0e4-4129-bc18-92028209aae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "ada32124-6a26-48d3-b44a-884b21329b6e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:09.599228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f604e2ba-ff74-4994-91f1-5585321769f4 req-4b1df485-f0e4-4129-bc18-92028209aae5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.599871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f604e2ba-ff74-4994-91f1-5585321769f4 req-4b1df485-f0e4-4129-bc18-92028209aae5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.600580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f604e2ba-ff74-4994-91f1-5585321769f4 req-4b1df485-f0e4-4129-bc18-92028209aae5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.631926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f604e2ba-ff74-4994-91f1-5585321769f4 req-4b1df485-f0e4-4129-bc18-92028209aae5 service nova] Creating event network-vif-plugged:ada32124-6a26-48d3-b44a-884b21329b6e for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:09.642420 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f604e2ba-ff74-4994-91f1-5585321769f4 req-4b1df485-f0e4-4129-bc18-92028209aae5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083471 Aug 23 10:52:09.644158 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1750/3587] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:09.661718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:09.663970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:09.680254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.680978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.681501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.682336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.699490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.699996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.722109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268524fb46ef417b839c2b3af9b4edd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be943232715d4de78de5bf47d056b11c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:09.730575 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-574cf47a-6635-4fb7-8cdd-fc7225088d0b tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 200 len: 1313 microversion: 2.1 time: 0.333916 Aug 23 10:52:09.731203 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1838/3588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:09 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:09.743021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:09.746172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:09.764405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.764933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.765375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:09.766083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:09.766544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:09.766968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:10.080705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:10.089884 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f72458cd-db45-4879-9a00-7bd908a47bc2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.443485 Aug 23 10:52:10.112822 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1751/3589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:09 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:10.126574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:10.127405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:10.138654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:10.145847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:10.146904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:10.147899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:10.148332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:10.148831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:10.182497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:10.191091 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bae81d62-e12e-4490-8f2b-e3794b8de7e1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1273 microversion: 2.1 time: 0.455351 Aug 23 10:52:10.201457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1839/3590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:09 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:10.581023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:10.581023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:10.587068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:10.587572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:10.588021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:10.588940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:10.589824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:10.590259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:10.906025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:10.921260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:10.925380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:10.927021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b28a6c4-2eb6-4682-9efa-9aa390d8f95e tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.804372 Aug 23 10:52:10.927860 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1752/3591] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:10 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:52:10.935600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:10.939024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] [instance: 39350aa4-469c-448b-ab25-1da72fe77abf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:10.957702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:10.958575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:10.960945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:10.966719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:10.967495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:10.968188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:11.038746 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] HTTP exception thrown: Instance 39350aa4-469c-448b-ab25-1da72fe77abf could not be found. Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Request method failure captured: Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf HTTP/1.1 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLD6cY55dSaLX-M0AsPSenz5lf_ukT2PHqufq3I2qeHg7m2_BdzrDu8HYW2a2pq_y9M3cxbNC0SHgu7mtSlHSLGTDAv4LpBTrXKhZcDsZxwowUkxS-w0J9lqlhdiowVv7o_RVDIQG7ROtlU6jzhN4bjR7inAf9pqO1bhcol7DWLQKx8 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: be943232715d4de78de5bf47d056b11c Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-119264805 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/be943232715d4de78de5bf47d056b11c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_be943232715d4de78de5bf47d056b11c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be943232715d4de78de5bf47d056b11c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/be943232715d4de78de5bf47d056b11c"}]}] Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-119264805 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: be943232715d4de78de5bf47d056b11c Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-119264805 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueTestJSONUnderV235-119264805-project Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 268524fb46ef417b839c2b3af9b4edd3 Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-119264805-project Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 39350aa4-469c-448b-ab25-1da72fe77abf could not be found. Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '39350aa4-469c-448b-ab25-1da72fe77abf'} Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39350aa4-469c-448b-ab25-1da72fe77abf could not be found. Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39350aa4-469c-448b-ab25-1da72fe77abf could not be found. Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:11.043498 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39350aa4-469c-448b-ab25-1da72fe77abf could not be found. Aug 23 10:52:11.047968 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:11.052316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] Returning 404 to user: Instance 39350aa4-469c-448b-ab25-1da72fe77abf could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:11.053580 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8de24e5-1667-4663-92d8-fad538ff6463 tempest-ServerRescueTestJSONUnderV235-119264805 tempest-ServerRescueTestJSONUnderV235-119264805-project] 10.222.0.78 "GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf" status: 404 len: 111 microversion: 2.1 time: 0.123474 Aug 23 10:52:11.054659 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1753/3592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:10 2022] GET /compute/v2.1/servers/39350aa4-469c-448b-ab25-1da72fe77abf => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:11.225705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:11.227498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:11.245909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:11.251845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:11.252752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:11.253678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:11.255827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:11.259369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:11.352102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:11.361174 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b996241b-d24c-4331-9fcd-1a1607a9723c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1274 microversion: 2.1 time: 0.794297 Aug 23 10:52:11.361758 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1840/3593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:10 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1274 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:11.674625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9eebf5c3-ae31-4b2a-9d6c-d818a325c4b3 req-939a6300-e37f-42eb-a811-98656b33e841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "e0790256-559e-4ed3-880d-a92da3742a25"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:11.744887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9eebf5c3-ae31-4b2a-9d6c-d818a325c4b3 req-939a6300-e37f-42eb-a811-98656b33e841 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:11.747465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9eebf5c3-ae31-4b2a-9d6c-d818a325c4b3 req-939a6300-e37f-42eb-a811-98656b33e841 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:11.753539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9eebf5c3-ae31-4b2a-9d6c-d818a325c4b3 req-939a6300-e37f-42eb-a811-98656b33e841 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:11.795270 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9eebf5c3-ae31-4b2a-9d6c-d818a325c4b3 req-939a6300-e37f-42eb-a811-98656b33e841 service nova] Creating event network-vif-plugged:e0790256-559e-4ed3-880d-a92da3742a25 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:11.809119 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9eebf5c3-ae31-4b2a-9d6c-d818a325c4b3 req-939a6300-e37f-42eb-a811-98656b33e841 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145223 Aug 23 10:52:11.815144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1841/3594] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:11.956041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:11.956772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:11.975194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:11.975939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:11.976535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:11.977680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:11.979306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:11.980971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:12.603004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:12.741920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:12.770315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62446bc1-7420-4eb7-a09d-85d40db7cff4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 1.550797 Aug 23 10:52:12.783568 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1754/3595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:11 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:12.788690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:12.789354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:12.802836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:12.814351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:12.815065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:12.815846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:12.816331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:12.816784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.006832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:13.016624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:13.019050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:13.020380 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6f56d62-1391-43dd-9b83-eacd68902bc5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 1.068778 Aug 23 10:52:13.020823 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1842/3596] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:11 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:52:13.041728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a28c5711-1231-4933-85ce-881ffdf8416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-117020484", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "destination_type": "local"}, {"source_type": "volume", "uuid": "8e9312e5-2386-4e11-81be-d1d47e49961d", "destination_type": "invalid"}], "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a28c5711-1231-4933-85ce-881ffdf8416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 494 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-117020484", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "destination_type": "local"}, {"source_type": "volume", "uuid": "8e9312e5-2386-4e11-81be-d1d47e49961d", "destination_type": "invalid"}], "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-117020484', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8e9312e5-2386-4e11-81be-d1d47e49961d', 'destination_type': 'invalid'}], 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:13.047666 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 23 10:52:13.051575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:13.065713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a28c5711-1231-4933-85ce-881ffdf8416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:13.066998 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a28c5711-1231-4933-85ce-881ffdf8416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.032976 Aug 23 10:52:13.068261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1843/3597] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:13 2022] POST /compute/v2.1/servers => generated 155 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:13.079666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:13.080636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:13.091033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:13.091880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:13.092541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.098056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:13.098858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:13.099524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.509162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:13.521315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7eef5620-c4ac-4895-8f1e-c31b4e8b7c07 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.444762 Aug 23 10:52:13.521868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:13.527428 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1844/3598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:13 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:13.549019 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c34cb30c-72c4-4d16-aebb-c5164ebdcfb0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.763168 Aug 23 10:52:13.560890 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1755/3599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:12 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:13.570732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:13.572163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:13.589814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:13.594617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:13.601489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.616581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:13.617423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:13.621468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.794945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:13.798261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:13.810369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:13.811248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:13.811925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.814079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:13.815952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:13.816838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:13.857403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:14.106214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:14.125181 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e794733f-7dd7-48d5-8a42-1485d136416b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.562068 Aug 23 10:52:14.138754 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1845/3600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:13 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:14.153331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:14.154231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:14.166052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:14.167382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:14.168187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:14.169667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:14.170537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:14.171392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:14.403182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:14.414390 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a49ce69c-8dff-438a-a90b-99e2c356390c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.626695 Aug 23 10:52:14.431821 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1756/3601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:13 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:14.438282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19a57a1a-90a7-4f68-b15c-0f46647fcb36 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118795543", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19a57a1a-90a7-4f68-b15c-0f46647fcb36 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 492 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118795543", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1118795543', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.445588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 10:52:14.449538 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:14.455351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-19a57a1a-90a7-4f68-b15c-0f46647fcb36 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:14.456533 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-19a57a1a-90a7-4f68-b15c-0f46647fcb36 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023039 Aug 23 10:52:14.457376 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1757/3602] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:14 2022] POST /compute/v2.1/servers => generated 624 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:14.471787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:14.472997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:14.485923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:14.487859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:14.488522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:14.490058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:14.490708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:14.491152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:14.632836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:14.655839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:14.658045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:14.664414 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc9b5590-807a-4509-853c-9c5445493432 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.523390 Aug 23 10:52:14.665601 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1846/3603] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:14 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:14.681477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:14.683342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:14.695479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:14.696336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:14.697048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:14.699118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:14.699961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:14.700860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:15.018285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:15.036660 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb2f287a-e161-43f2-a698-ef85fe6e1148 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.369515 Aug 23 10:52:15.038577 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1847/3604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:14 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:15.069220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b7562aa2-d6c9-4b3a-a0ab-1272aedeead5 req-b7eeea3d-7381-4d23-b4ae-224791fc0667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a5a23b-45c5-4fe6-82a8-e07cbc755931", "tag": "fba9e79b-dc56-4744-a830-50e5d36edc5c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:15.111595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b7562aa2-d6c9-4b3a-a0ab-1272aedeead5 req-b7eeea3d-7381-4d23-b4ae-224791fc0667 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:15.112170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b7562aa2-d6c9-4b3a-a0ab-1272aedeead5 req-b7eeea3d-7381-4d23-b4ae-224791fc0667 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:15.112518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b7562aa2-d6c9-4b3a-a0ab-1272aedeead5 req-b7eeea3d-7381-4d23-b4ae-224791fc0667 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:15.146594 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b7562aa2-d6c9-4b3a-a0ab-1272aedeead5 req-b7eeea3d-7381-4d23-b4ae-224791fc0667 service nova] Creating event network-changed:fba9e79b-dc56-4744-a830-50e5d36edc5c for instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 on n-h2-847009-13 Aug 23 10:52:15.166699 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b7562aa2-d6c9-4b3a-a0ab-1272aedeead5 req-b7eeea3d-7381-4d23-b4ae-224791fc0667 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126634 Aug 23 10:52:15.172905 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1848/3605] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:15.425516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:15.435503 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3254ec6-b417-41b0-9063-be7cd51ee23f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.972818 Aug 23 10:52:15.443276 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1758/3606] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:14 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:15.454077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:15.454344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:15.471050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:15.471652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:15.472021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:15.472664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:15.473841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:15.474298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:15.475934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:15.477649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:15.493417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:15.494028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:15.496764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:15.498883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:15.500291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:15.501729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:15.905283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:15.925657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a374568-38c0-4d49-bd58-09f00bdfba8f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.493365 Aug 23 10:52:15.944601 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1849/3607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:15 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:15.983362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b0282a49-7fd3-47ee-acfa-f6995d6e194e req-da6f90bf-5eff-464c-9a35-d1eaffab0871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "c9d2120a-58d0-4732-aaa7-95b54da7b465"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:15.996829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b0282a49-7fd3-47ee-acfa-f6995d6e194e req-da6f90bf-5eff-464c-9a35-d1eaffab0871 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:15.997710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b0282a49-7fd3-47ee-acfa-f6995d6e194e req-da6f90bf-5eff-464c-9a35-d1eaffab0871 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:15.998479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b0282a49-7fd3-47ee-acfa-f6995d6e194e req-da6f90bf-5eff-464c-9a35-d1eaffab0871 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.021596 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b0282a49-7fd3-47ee-acfa-f6995d6e194e req-da6f90bf-5eff-464c-9a35-d1eaffab0871 service nova] Creating event network-vif-plugged:c9d2120a-58d0-4732-aaa7-95b54da7b465 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:16.036998 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b0282a49-7fd3-47ee-acfa-f6995d6e194e req-da6f90bf-5eff-464c-9a35-d1eaffab0871 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084737 Aug 23 10:52:16.039164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1850/3608] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:16.050064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:16.051270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:16.061926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:16.066120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.072929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.076182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.077352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.078090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.078748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.087014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:16.129916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:16.191165 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adcbcc1f-4489-444b-9fc6-f121bfd89249 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.732021 Aug 23 10:52:16.191759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1759/3609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:15 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:16.210681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:16.227494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:16.257661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.259921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.262318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.265165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.268381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.272098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.514594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:16.529748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:16.531276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:16.532564 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68349c48-fc1a-46db-a6a3-e3dfab68a5a5 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.488205 Aug 23 10:52:16.533350 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1851/3610] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:16 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:16.538898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e9332f2-05f2-4941-a076-68f43d5c432e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e9332f2-05f2-4941-a076-68f43d5c432e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 416 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.543632 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:52:16.547401 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:16.550989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e9332f2-05f2-4941-a076-68f43d5c432e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:16.552047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e9332f2-05f2-4941-a076-68f43d5c432e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.017588 Aug 23 10:52:16.553120 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1852/3611] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:16.562109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:16.562720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:16.572376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.572996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.573637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.574389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.574856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.575288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.772565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:16.786473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b3b1d22-3179-45bb-9de2-1d32732f7019 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.229049 Aug 23 10:52:16.787060 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1853/3612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:16 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:16.809981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:16.817797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:16.818409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:16.832329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.832848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.836038 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c8076a1-2c01-4b6d-a9c5-dca8d8e83861 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.643037 Aug 23 10:52:16.836946 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1760/3613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:16 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:16.837234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.838215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:16.839530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:16.840255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:16.955651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:16.960028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:16.990225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:16.999427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:17.000014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:17.000415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:17.001165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:17.001637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:17.002140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:17.520119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:17.531778 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-075331ad-9fdb-410a-b9cf-e1ff632c3b5b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.717246 Aug 23 10:52:17.533000 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1854/3614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:16 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:17.537873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cd425dca-c41a-4936-a58f-b6c61839512e req-6a64d260-aad7-48e0-a34f-d988d337d19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e43c82a-2315-441b-97de-fd3ac6c6c2fc", "tag": "fe9cd896-95db-48e9-ab3e-d7d05107a894"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:17.550871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cd425dca-c41a-4936-a58f-b6c61839512e req-6a64d260-aad7-48e0-a34f-d988d337d19a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:17.552986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cd425dca-c41a-4936-a58f-b6c61839512e req-6a64d260-aad7-48e0-a34f-d988d337d19a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:17.553764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cd425dca-c41a-4936-a58f-b6c61839512e req-6a64d260-aad7-48e0-a34f-d988d337d19a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:17.577289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cd425dca-c41a-4936-a58f-b6c61839512e req-6a64d260-aad7-48e0-a34f-d988d337d19a service nova] Creating event network-changed:fe9cd896-95db-48e9-ab3e-d7d05107a894 for instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc on n-h1-847009-13 Aug 23 10:52:17.584774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cd425dca-c41a-4936-a58f-b6c61839512e req-6a64d260-aad7-48e0-a34f-d988d337d19a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049938 Aug 23 10:52:17.585902 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1855/3615] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:17.593180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:17.594377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:17.601943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:17.602440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:17.602880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:17.603610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:17.604922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:17.605522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:17.632774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:17.988116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:17.990729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:18.002511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96581a30-d184-4949-a843-0a744e585c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 1.051937 Aug 23 10:52:18.004784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1761/3616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:16 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:18.008029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:18.013230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:18.014676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1077c2bb-558c-4dd9-841b-b2ef0e789de0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.427418 Aug 23 10:52:18.015532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1856/3617] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:17 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:18.020551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:18.021128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a5b18c1-9358-4706-8d03-046e06046e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1434855053", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": -1, "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:18.021943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:18.036709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:18.037520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:18.038854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:18.039790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:18.040429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:18.041051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:18.058910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9a5b18c1-9358-4706-8d03-046e06046e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Flavor -1 could not be found. Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a5b18c1-9358-4706-8d03-046e06046e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 206 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1434855053", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": -1, "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: exception: Flavor -1 could not be found. Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1434855053', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': -1, 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:18.065998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 23 10:52:18.071091 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:18.075291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a5b18c1-9358-4706-8d03-046e06046e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:18.076733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a5b18c1-9358-4706-8d03-046e06046e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.070312 Aug 23 10:52:18.083906 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1762/3618] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:18 2022] POST /compute/v2.1/servers => generated 73 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:52:18.090978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:18.091604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:18.099779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:18.100901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:18.101352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:18.102065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:18.102523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:18.102951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:18.533080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:18.541330 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d0b9836d-714e-419c-a6be-35abf74019d6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.524571 Aug 23 10:52:18.541991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1857/3619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:18 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:18.553027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "c9bedf3a-d5d4-4fd2-bf39-515a26496926"}, {"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "d5c4df22-c16f-4712-83e2-870018b97e49"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:18.563431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:18.564178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:18.564813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:18.578548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] Creating event network-vif-plugged:c9bedf3a-d5d4-4fd2-bf39-515a26496926 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:18.579319 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] Creating event network-vif-plugged:d5c4df22-c16f-4712-83e2-870018b97e49 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:18.586585 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e646354c-b41b-4097-8ddc-823bf99f67c4 req-25950878-97f1-42da-9a2f-2ae989a8743a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042539 Aug 23 10:52:18.587857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1858/3620] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:19.003186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:19.027268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:19.029059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:19.033005 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb4d59f4-e4cb-429b-96bb-e1c2aaf40b4b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.947446 Aug 23 10:52:19.035253 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1763/3621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:18 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:19.053602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.058727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:19.060038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:19.060916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.063970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.064951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.065595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.067124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.102454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.103193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.106093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.108179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.110907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.112972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.478651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:19.487356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:19.494263 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d217e265-c5a6-493c-9abe-88e69e4f1edd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.471547 Aug 23 10:52:19.508504 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1859/3622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:19 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:19.508756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:19.508756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:19.508756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16d75308-8ad9-4f53-aff3-0ffc8a587829 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.467596 Aug 23 10:52:19.508756 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1764/3623] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:19 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:19.509151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:19.509151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:19.534093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.534939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.535478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.548436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.551118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.552178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.567537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:19.568256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:19.585722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.586473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.587111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.587645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.588130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.588700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.799326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:19.809328 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3bcf76d-89bf-4e40-a564-cff73455909f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.311088 Aug 23 10:52:19.810223 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1860/3624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:19 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:19.882164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ab32281-0708-4605-9399-4f2bbfdb5a63 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-133393122", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ab32281-0708-4605-9399-4f2bbfdb5a63 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 172 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-133393122", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-133393122', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi -1 Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:19.886839 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ab32281-0708-4605-9399-4f2bbfdb5a63 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:19.891646 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ab32281-0708-4605-9399-4f2bbfdb5a63 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.009942 Aug 23 10:52:19.892703 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1861/3625] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:19 2022] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:19.898205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:19.898813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:19.907470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.907977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.908415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:19.909175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:19.909633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:19.910053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:20.102062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:20.125351 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d9c15e9-096f-4d47-9fb0-5c8e5dc02db2 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.566776 Aug 23 10:52:20.128181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1765/3626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:19 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:20.184488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:20.195384 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7aaf6962-86d5-4b1a-8ff5-fa70ead9b2ff tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.302284 Aug 23 10:52:20.197611 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1862/3627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:19 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:20.228426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:20.229130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:20.240238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:20.240999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:20.241934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:20.242982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:20.243606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:20.244199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:20.537179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e10d0460-b710-42cc-b054-25ffc209fac7 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Calling method '.version_select at 0x7fdc9c5c6280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:20.544413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:20.556217 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-404f41ab-4cd2-44a5-a194-e9122bdf5991 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.337218 Aug 23 10:52:20.557103 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1766/3628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:20 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:20.567755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:20.568661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:20.580576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:20.583031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:20.583685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:20.585420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:20.586737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:20.587271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:20.625170 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e10d0460-b710-42cc-b054-25ffc209fac7 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.227654 Aug 23 10:52:20.633168 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1863/3629] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 10:52:20 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:52:20.642204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:20.643299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:20.674546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:20.675057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:20.675501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:20.680331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:20.681112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:20.681881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.025632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.027206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.040524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.042715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.044230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b228a736-f6d0-4b9e-a4f5-893f1c5a4aa2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.409578 Aug 23 10:52:21.044827 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1864/3630] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:20 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:21.051209 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-feb38763-bbcb-4547-a220-cfd7443d14db tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.489062 Aug 23 10:52:21.052652 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1767/3631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:20 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:21.059303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1afc430e-0c47-468b-b4f2-bae9eab5c155 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Action: 'create', calling method: .version_select at 0x7fdc9c42a280>, body: {"pool": "non_exist_pool"} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:21.065837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1fda7f3-7e57-4af9-8de6-b0e73f44634e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1704895661", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:21.074593 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c1fda7f3-7e57-4af9-8de6-b0e73f44634e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1fda7f3-7e57-4af9-8de6-b0e73f44634e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 216 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1704895661", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1704895661', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:21.078169 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.082947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1fda7f3-7e57-4af9-8de6-b0e73f44634e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:21.085514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c1fda7f3-7e57-4af9-8de6-b0e73f44634e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023566 Aug 23 10:52:21.086382 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1865/3632] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:21 2022] POST /compute/v2.1/servers => generated 123 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:21.100101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:21.102505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:21.111241 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1afc430e-0c47-468b-b4f2-bae9eab5c155 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] HTTP exception thrown: Floating IP pool not found. Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1afc430e-0c47-468b-b4f2-bae9eab5c155 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Request method failure captured: Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 26 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLFkvA5yDWOf3cOp3cxbVqmSqlpDDzfwdhFMWowRb9s4wwR8zoHCUzZRvjSbEiWF_5YO0IMs7psf4Hrj2IaGfO6Rp1_lio4aXxJOYhnXumeA1Tn3cHuSxlMfQN8loYkVZWIUIz79r749y89i7yI03G4pw0naZatGv0nQNPaF8Sco9Ok Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 65d288cb3fdb4293bf805bfb40ad41f3 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-761972705 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65d288cb3fdb4293bf805bfb40ad41f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65d288cb3fdb4293bf805bfb40ad41f3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65d288cb3fdb4293bf805bfb40ad41f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65d288cb3fdb4293bf805bfb40ad41f3"}]}] Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-761972705 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 65d288cb3fdb4293bf805bfb40ad41f3 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-761972705 Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsNegativeTestJSON-761972705-project Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c5c15c449b214ae7ad9fdc1675cbcefe Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-761972705-project Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: {"pool": "non_exist_pool"} Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: exception: Floating IP pool not found. Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:21.113417 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:21.120439 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 23 10:52:21.120439 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.120439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1afc430e-0c47-468b-b4f2-bae9eab5c155 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Returning 404 to user: Floating IP pool not found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:21.120439 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1afc430e-0c47-468b-b4f2-bae9eab5c155 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.061172 Aug 23 10:52:21.120439 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1768/3633] 10.222.0.78 () {60 vars in 1170 bytes} [Tue Aug 23 10:52:21 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:52:21.127582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0246be7-5ebf-4a6d-9200-cbf14eb06756 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Calling method '.version_select at 0x7fdc9c2d7ca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:21.133303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:21.134045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:21.134695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.135939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:21.137164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:21.137869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.299131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG neutronclient.v2_0.client [None req-b0246be7-5ebf-4a6d-9200-cbf14eb06756 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ad008381-35f3-42e8-af06-06af76a60866 could not be found", "detail": ""}} {{(pid=128860) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 10:52:21.299902 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b0246be7-5ebf-4a6d-9200-cbf14eb06756 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] HTTP exception thrown: Floating IP not found for ID ad008381-35f3-42e8-af06-06af76a60866 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0246be7-5ebf-4a6d-9200-cbf14eb06756 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Request method failure captured: Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-floating-ips/ad008381-35f3-42e8-af06-06af76a60866 HTTP/1.1 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLFkvA5yDWOf3cOp3cxbVqmSqlpDDzfwdhFMWowRb9s4wwR8zoHCUzZRvjSbEiWF_5YO0IMs7psf4Hrj2IaGfO6Rp1_lio4aXxJOYhnXumeA1Tn3cHuSxlMfQN8loYkVZWIUIz79r749y89i7yI03G4pw0naZatGv0nQNPaF8Sco9Ok Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 65d288cb3fdb4293bf805bfb40ad41f3 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-761972705 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/65d288cb3fdb4293bf805bfb40ad41f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_65d288cb3fdb4293bf805bfb40ad41f3", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65d288cb3fdb4293bf805bfb40ad41f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/65d288cb3fdb4293bf805bfb40ad41f3"}]}] Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-761972705 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 65d288cb3fdb4293bf805bfb40ad41f3 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-761972705 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-FloatingIPsNegativeTestJSON-761972705-project Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c5c15c449b214ae7ad9fdc1675cbcefe Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-761972705-project Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: exception: Floating IP not found for ID ad008381-35f3-42e8-af06-06af76a60866 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ad008381-35f3-42e8-af06-06af76a60866'} Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ad008381-35f3-42e8-af06-06af76a60866 could not be found Aug 23 10:52:21.301831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-826b3e52-c392-4f02-b8cf-94bf08456ffd'] Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ad008381-35f3-42e8-af06-06af76a60866. Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ad008381-35f3-42e8-af06-06af76a60866 Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ad008381-35f3-42e8-af06-06af76a60866 Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0246be7-5ebf-4a6d-9200-cbf14eb06756 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] Returning 404 to user: Floating IP not found for ID ad008381-35f3-42e8-af06-06af76a60866 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:21.306560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0246be7-5ebf-4a6d-9200-cbf14eb06756 tempest-FloatingIPsNegativeTestJSON-761972705 tempest-FloatingIPsNegativeTestJSON-761972705-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/ad008381-35f3-42e8-af06-06af76a60866" status: 404 len: 111 microversion: 2.1 time: 0.182115 Aug 23 10:52:21.316129 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1769/3634] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:52:21 2022] DELETE /compute/v2.1/os-floating-ips/ad008381-35f3-42e8-af06-06af76a60866 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:52:21.316129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:21.316129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:21.326645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:21.327153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:21.327594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.328320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:21.330337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:21.330777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.496509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.517336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6fc15e99-bdb7-4b9e-9c9c-2f9ac5264902 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.425996 Aug 23 10:52:21.533614 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1866/3635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:21 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:21.547172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:21.547847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:21.554500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:21.556428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:21.557191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.558172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:21.559110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:21.559789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:21.648182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.665788 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8567a97f-2f1e-4036-b6ea-8034dbd90b37 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.354864 Aug 23 10:52:21.668066 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1770/3636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:21 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:21.943101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:21.956044 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1323f45b-186e-4186-a952-499178a9b22a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.414324 Aug 23 10:52:21.973134 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1867/3637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:21 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:22.022232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c29d369b-6acc-45e8-b896-d1ab1ffc9d6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-288712289", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-key-1481057718", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:22.083004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:22.086328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:22.106264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:22.108271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:22.109007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:22.111449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:22.113244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:22.113955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:22.154515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-c29d369b-6acc-45e8-b896-d1ab1ffc9d6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] validate_networks() for [('70891eb3-d931-4d2c-bee7-d99486f88b11', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:22.775499 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c29d369b-6acc-45e8-b896-d1ab1ffc9d6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Invalid key_name provided. Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c29d369b-6acc-45e8-b896-d1ab1ffc9d6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 246 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-288712289", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-key-1481057718", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid key_name provided. Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-288712289', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'key_name': 'tempest-key-1481057718', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1076, in _validate_and_build_base_options Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1481057718 not found for user e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:22.779952 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 23 10:52:22.787597 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:22.791046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c29d369b-6acc-45e8-b896-d1ab1ffc9d6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid key_name provided. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:22.791046 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c29d369b-6acc-45e8-b896-d1ab1ffc9d6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.773294 Aug 23 10:52:22.792209 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1771/3638] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:22 2022] POST /compute/v2.1/servers => generated 70 bytes in 775 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 10:52:22.799542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:22.800292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:22.807725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:22.808353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:22.808968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:22.809806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:22.810379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:22.811184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.011366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.029971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.031494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.033863 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5a9347e-d059-4d3f-810e-447336ac4abe tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.966653 Aug 23 10:52:23.036410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1868/3639] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:22 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:23.042278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d4186f6c-36a9-47d0-86ec-29c83d9c47b9 req-908e58a5-0304-4c4a-b15b-9c14873e7e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "a864d661-858f-474f-ad0a-fcc083ec2074"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:23.069898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.077955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4186f6c-36a9-47d0-86ec-29c83d9c47b9 req-908e58a5-0304-4c4a-b15b-9c14873e7e34 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.084413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4186f6c-36a9-47d0-86ec-29c83d9c47b9 req-908e58a5-0304-4c4a-b15b-9c14873e7e34 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.085174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4186f6c-36a9-47d0-86ec-29c83d9c47b9 req-908e58a5-0304-4c4a-b15b-9c14873e7e34 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.085484 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aadf5e1f-7e4f-4ee9-8364-4421bb2a0fae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.290726 Aug 23 10:52:23.086871 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1772/3640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:22 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:23.099429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:23.102043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:23.114107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.114305 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d4186f6c-36a9-47d0-86ec-29c83d9c47b9 req-908e58a5-0304-4c4a-b15b-9c14873e7e34 service nova] Creating event network-vif-plugged:a864d661-858f-474f-ad0a-fcc083ec2074 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:23.114811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.115258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.115976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.116922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.117359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.128168 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d4186f6c-36a9-47d0-86ec-29c83d9c47b9 req-908e58a5-0304-4c4a-b15b-9c14873e7e34 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090277 Aug 23 10:52:23.129006 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1869/3641] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:23.150305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:23.152056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:23.176269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.176808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.177234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.177948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.178411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.178840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.381380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.397983 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63ce28b9-c17d-46f0-8b1c-ba85a3636c6a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.305784 Aug 23 10:52:23.399436 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1773/3642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:23 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:23.489253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.503905 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77e08ced-ee6b-45f3-ab71-98989d87c80d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.366134 Aug 23 10:52:23.504942 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1870/3643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:23 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:23.527004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:23.528127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:23.544304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.545173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.546349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.547365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:23.548057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:23.548686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:23.887397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:23.898053 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba3a6186-ab5e-4085-9a08-fce494ef8ca4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.375968 Aug 23 10:52:23.900614 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1774/3644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:23 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:24.060573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:24.062876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:24.070868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.074129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.075103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.078152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.078932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.081207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.117468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:24.122221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:24.148663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.149693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.150579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.151657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.152398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.153390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.464414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:24.480894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e649a08a-e260-4e2d-b4ca-a5aaf54a538c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.376749 Aug 23 10:52:24.482365 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1775/3645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:24 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:24.507935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca87840f-742b-48c5-90ad-0472f0b9c507 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-979200665", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:24.647683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.security_group_api [None req-ca87840f-742b-48c5-90ad-0472f0b9c507 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Neutron security group does_not_exist not found {{(pid=128860) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 23 10:52:24.648279 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ca87840f-742b-48c5-90ad-0472f0b9c507 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca87840f-742b-48c5-90ad-0472f0b9c507 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 257 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-979200665", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-979200665', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 23 10:52:24.663500 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1061, in _validate_and_build_base_options Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 508, in _check_requested_secgroups Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:24.668839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca87840f-742b-48c5-90ad-0472f0b9c507 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:24.673850 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca87840f-742b-48c5-90ad-0472f0b9c507 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.182513 Aug 23 10:52:24.673850 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1776/3646] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:24 2022] POST /compute/v2.1/servers => generated 106 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:24.676172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:24.676172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:24.694499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.695085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.696182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.698614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.703543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.705273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.836486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:24.851954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:24.853519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:24.862893 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9cb7e13-256d-4378-a431-48a6889b428c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.803500 Aug 23 10:52:24.863529 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1871/3647] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:24 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:24.873404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:24.874366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:24.904038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:24.913599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.915106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.916087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5819f2ac-7372-41a4-9e57-dea63ae496e4 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.242095 Aug 23 10:52:24.918390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:24.919490 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1777/3648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:24 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:24.921940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:24.922710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:24.924396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.033423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:25.036568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:25.044310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.053421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.054131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.055479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.059556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.060189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.143073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:25.166362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:25.180098 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddfe399e-0ad4-4f4d-97e6-5161755bb489 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.313508 Aug 23 10:52:25.180711 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1872/3649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:24 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:25.194119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a5a23b-45c5-4fe6-82a8-e07cbc755931", "name": "network-vif-plugged", "status": "completed", "tag": "fba9e79b-dc56-4744-a830-50e5d36edc5c"}, {"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-plugged", "status": "completed", "tag": "45b4a255-749d-4e2a-b1d9-2962413c0338"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:25.203699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0fd66087-33d8-4006-8d21-729cb72d6c90 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.179610 Aug 23 10:52:25.208938 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1778/3650] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:25 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:25.217687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:25.219955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:25.232576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.233506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.234145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.235198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.236885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.237578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.249511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.252110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.252587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.296692 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] Creating event network-vif-plugged:fba9e79b-dc56-4744-a830-50e5d36edc5c for instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 on n-h2-847009-13 Aug 23 10:52:25.297240 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] Creating event network-vif-plugged:45b4a255-749d-4e2a-b1d9-2962413c0338 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:25.316289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7b27039a-e09c-44b1-b3bc-7c85c2580e95 req-6b08b745-08f5-47bd-bf3f-2130b6b4356b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134320 Aug 23 10:52:25.316932 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1873/3651] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:25.333383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:25.335095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:25.356232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.357139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.357857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.358845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.359537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.360192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.696937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:25.705537 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e590b7c0-b3b7-4120-b6b3-c05b55ae216d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.494848 Aug 23 10:52:25.706119 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1779/3652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:25 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:25.720817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:25.721759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:25.723981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:25.739274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.740074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.743172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.744120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:25.745328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:25.749042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:25.994297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.006116 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2af731d8-4884-4557-b979-37e541904856 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1672 microversion: 2.1 time: 0.687649 Aug 23 10:52:26.007078 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1874/3653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:25 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1672 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:26.014180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb857571-5f67-41f9-ac13-7e7c8d6fe8b5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:26.014750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb857571-5f67-41f9-ac13-7e7c8d6fe8b5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 62eceb55-f497-4e21-8ce6-2e61f1fed6c9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:26.021998 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-fb857571-5f67-41f9-ac13-7e7c8d6fe8b5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 62eceb55-f497-4e21-8ce6-2e61f1fed6c9 could not be found. Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb857571-5f67-41f9-ac13-7e7c8d6fe8b5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/62eceb55-f497-4e21-8ce6-2e61f1fed6c9 HTTP/1.1 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 62eceb55-f497-4e21-8ce6-2e61f1fed6c9 could not be found. Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '62eceb55-f497-4e21-8ce6-2e61f1fed6c9'} Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62eceb55-f497-4e21-8ce6-2e61f1fed6c9 could not be found. Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62eceb55-f497-4e21-8ce6-2e61f1fed6c9 could not be found. Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:26.024188 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62eceb55-f497-4e21-8ce6-2e61f1fed6c9 could not be found. Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb857571-5f67-41f9-ac13-7e7c8d6fe8b5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 62eceb55-f497-4e21-8ce6-2e61f1fed6c9 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb857571-5f67-41f9-ac13-7e7c8d6fe8b5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62eceb55-f497-4e21-8ce6-2e61f1fed6c9" status: 404 len: 111 microversion: 2.1 time: 0.019314 Aug 23 10:52:26.029529 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1875/3654] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:26 2022] DELETE /compute/v2.1/servers/62eceb55-f497-4e21-8ce6-2e61f1fed6c9 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:26.037725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:26.038599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:26.049391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.049825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.050912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.052469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.053207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.054309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.165165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.181894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4dc0b68c-3b15-4135-bfd1-3d8e45ff82e5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.468222 Aug 23 10:52:26.183063 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1780/3655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:25 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:26.189306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:26.190598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:26.199469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.200325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.201048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.202237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.203036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.203697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.433052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.446727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.448297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.449491 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3cfd16bd-5719-4875-9617-0dddb4fa7411 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.418841 Aug 23 10:52:26.454760 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1876/3656] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:26 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:26.465370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:26.466393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:26.475197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.476182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.477055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.478472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.481919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.483273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.574143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.582928 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da7ef066-b7f6-4321-8b49-1ea8e4b377fe tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.397798 Aug 23 10:52:26.583806 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1781/3657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:26 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:26.810177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:26.818731 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41d473dd-f20f-46cc-84e5-4ffe0da5ea91 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.360378 Aug 23 10:52:26.818985 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1877/3658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:26 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:26.844873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:26.848681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:26.867317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.871248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.871823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:26.872700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:26.874094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:26.875259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.033612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:27.035199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:27.046294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.047143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.048093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.049520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.050320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.051060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.142958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:27.155485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fc95870-d6d8-4c3d-89a5-18013c629be6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.317910 Aug 23 10:52:27.158436 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1782/3659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:26 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:27.178157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24a10dbb-1083-47a3-bb13-c226b50a014e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:27.178833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24a10dbb-1083-47a3-bb13-c226b50a014e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:52:27.179360 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-24a10dbb-1083-47a3-bb13-c226b50a014e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24a10dbb-1083-47a3-bb13-c226b50a014e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9223372036854775808 could not be found. Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9223372036854775808'} Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:27.187141 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:27.192981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:27.192981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:27.192981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:27.192981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 23 10:52:27.192981 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:27.195140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24a10dbb-1083-47a3-bb13-c226b50a014e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:27.196024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24a10dbb-1083-47a3-bb13-c226b50a014e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023272 Aug 23 10:52:27.205173 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1783/3660] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Aug 23 10:52:27 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:52:27.213835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:27.215238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:27.225689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.226606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.227725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.229084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.229787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.230648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.508432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:27.519760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2788422-8165-4eac-a154-76fa98c60764 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1315 microversion: 2.1 time: 0.315605 Aug 23 10:52:27.534049 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1784/3661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:27 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:27.541496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:27.541812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:27.549101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.549881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.550515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.551434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.552070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.552684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.807094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:27.819635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0cb69b29-4cf5-4bfd-9608-877e78b7d2b1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.283889 Aug 23 10:52:27.820999 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1785/3662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:27 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:27.830361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-549f6749-ba94-416f-8cfa-c9b02bcf855d req-4138db26-eb19-4448-8016-96c16d7c5c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e43c82a-2315-441b-97de-fd3ac6c6c2fc", "name": "network-vif-plugged", "status": "completed", "tag": "fe9cd896-95db-48e9-ab3e-d7d05107a894"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:27.846069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-549f6749-ba94-416f-8cfa-c9b02bcf855d req-4138db26-eb19-4448-8016-96c16d7c5c1f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.847320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-549f6749-ba94-416f-8cfa-c9b02bcf855d req-4138db26-eb19-4448-8016-96c16d7c5c1f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.847806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-549f6749-ba94-416f-8cfa-c9b02bcf855d req-4138db26-eb19-4448-8016-96c16d7c5c1f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.862969 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-549f6749-ba94-416f-8cfa-c9b02bcf855d req-4138db26-eb19-4448-8016-96c16d7c5c1f service nova] Creating event network-vif-plugged:fe9cd896-95db-48e9-ab3e-d7d05107a894 for instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc on n-h1-847009-13 Aug 23 10:52:27.870452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-549f6749-ba94-416f-8cfa-c9b02bcf855d req-4138db26-eb19-4448-8016-96c16d7c5c1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046799 Aug 23 10:52:27.870842 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1786/3663] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:27.886505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:27.887549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:27.894421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.894923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.895366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.896074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:27.899625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:27.900300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:27.966552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:27.976564 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-574624f2-42a9-4f50-b2ee-9652c8507c11 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1672 microversion: 2.1 time: 0.952834 Aug 23 10:52:27.977927 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1878/3664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:27 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1672 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:27.996343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:27.997166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:28.017738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:28.019379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:28.020077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:28.021136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:28.022057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:28.023229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:28.029303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:28.321470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:28.334281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:28.336386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:28.337928 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e3186a2-11bc-4051-8218-9a0904d6f3bc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1879 microversion: 2.42 time: 0.465911 Aug 23 10:52:28.340265 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1787/3665] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:27 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1879 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:28.350755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:28.374750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:28.374750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:28.382221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52c5b20b-a1cc-4201-8e7b-56e24e666049 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.402873 Aug 23 10:52:28.387004 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1879/3666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:27 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:28.407612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:28.409398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:28.410027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:28.414847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:28.415727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:28.417395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:28.542702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:28.543874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:28.554411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:28.558091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:28.559400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:28.560436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:28.561501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:28.563127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:28.563955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:28.940904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:28.953824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef130737-ee3e-4d30-bee1-2e6293eab00c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.612010 Aug 23 10:52:28.954612 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1788/3667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:28 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:28.986296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e296af7-ab44-4602-b9f3-78d343e3ca43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:28.987508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e296af7-ab44-4602-b9f3-78d343e3ca43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Failed to fetch instance by id -1 {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 10:52:28.987875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:28.988778 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3e296af7-ab44-4602-b9f3-78d343e3ca43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance -1 could not be found. Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e296af7-ab44-4602-b9f3-78d343e3ca43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance -1 could not be found. Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '-1'} Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:28.990705 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:28.995984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:28.995984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:28.995984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 23 10:52:28.995984 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:29.004232 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec15133b-0cd6-4b27-946b-da5d935b5f47 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1502 microversion: 2.1 time: 0.465638 Aug 23 10:52:29.006249 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1880/3668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:28 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1502 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:29.008075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e296af7-ab44-4602-b9f3-78d343e3ca43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:29.014284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e296af7-ab44-4602-b9f3-78d343e3ca43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.038499 Aug 23 10:52:29.015362 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1789/3669] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:52:28 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:52:29.019976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:29.020604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:29.032669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.033026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:29.033849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:29.034631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.035885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.041483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.042318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.042985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.049686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.050222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.052924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.054500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.056314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.057113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.337715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:29.348298 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfa8d499-d373-4a9d-9f2e-dace41211421 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.319328 Aug 23 10:52:29.349137 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1790/3670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:29 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:29.378877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:29.379438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:29.387529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.388382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.389145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.390109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.390795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.391450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.424031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:29.438156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ae9847b-20a3-48dc-8086-12f4141ab813 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1677 microversion: 2.1 time: 0.430588 Aug 23 10:52:29.438944 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1881/3671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:29 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1677 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:29.450132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:29.453444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:29.476272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.476988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.481836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.482707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.485732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.486207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.556722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59c81007-e757-4219-9ac0-45475a98a3f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931/action" status: 202 len: 0 microversion: 2.1 time: 0.193825 Aug 23 10:52:29.558115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1791/3672] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:29 2022] POST /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:29.585855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:29.586952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:29.596209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.597157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.597803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:29.599614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:29.600255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:29.601033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.061909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.073416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.077091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-461af836-6c4d-43ea-bcfa-b1de1953c73d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.515979 Aug 23 10:52:30.078421 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1792/3673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:29 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:30.086440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.087593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:30.088106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.088452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.090270 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-abf29254-949e-418e-9dae-4f50624f1af3 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2836 microversion: 2.42 time: 0.649761 Aug 23 10:52:30.097353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.097854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.098624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.099348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.100039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.100481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.102313 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1882/3674] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:52:29 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2836 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:30.117218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:30.118851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.128289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.129110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.129816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.134782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.136418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.137200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.337131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.348163 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d70849d-63c1-4979-9306-ce9f9fea9988 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1316 microversion: 2.1 time: 0.268653 Aug 23 10:52:30.349150 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1793/3675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:30 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:30.355591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e18d1960-c7af-4eae-aef1-8d4027cd551d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:30.356518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e18d1960-c7af-4eae-aef1-8d4027cd551d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 735a0705-2315-42e7-b901-7bfcd9b9a695] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.381118 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e18d1960-c7af-4eae-aef1-8d4027cd551d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 735a0705-2315-42e7-b901-7bfcd9b9a695 could not be found. Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e18d1960-c7af-4eae-aef1-8d4027cd551d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/735a0705-2315-42e7-b901-7bfcd9b9a695/action HTTP/1.1 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 19 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: {"forceDelete": {}} Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 735a0705-2315-42e7-b901-7bfcd9b9a695 could not be found. Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '735a0705-2315-42e7-b901-7bfcd9b9a695', 'body': {'forceDelete': {}}} Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 735a0705-2315-42e7-b901-7bfcd9b9a695 could not be found. Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 735a0705-2315-42e7-b901-7bfcd9b9a695 could not be found. Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:30.392784 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 735a0705-2315-42e7-b901-7bfcd9b9a695 could not be found. Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e18d1960-c7af-4eae-aef1-8d4027cd551d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 735a0705-2315-42e7-b901-7bfcd9b9a695 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e18d1960-c7af-4eae-aef1-8d4027cd551d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/735a0705-2315-42e7-b901-7bfcd9b9a695/action" status: 404 len: 111 microversion: 2.1 time: 0.043957 Aug 23 10:52:30.397578 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1794/3676] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:30 2022] POST /compute/v2.1/servers/735a0705-2315-42e7-b901-7bfcd9b9a695/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:30.403952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:30.404877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.414022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.414528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.414964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.415879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.419348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.419939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.488439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.505888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-448c9116-0315-486c-8bd8-fced38ce7eb0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1487 microversion: 2.1 time: 0.402138 Aug 23 10:52:30.506486 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1883/3677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:30 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1487 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:30.512569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:30.522965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.529735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.530234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.530673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.531388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.531851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.532287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.635879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-699fa21a-044f-4286-97e0-abe1adc4c7cd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.238526 Aug 23 10:52:30.636528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1795/3678] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 10:52:30 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7/os-interface => generated 1830 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:52:30.645302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:30.646217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.677252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.680338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.683956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.686198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.688333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.693208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.896602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:30.912921 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c1a3c4e-234f-4438-82d4-539b4e9eaa52 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.404876 Aug 23 10:52:30.914740 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1884/3679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:30 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:30.922001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:30.923162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:30.945695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.946940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.948400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:30.949740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:30.951530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:30.952304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.012626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:31.103625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:31.116517 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee35f85a-35e2-4aae-addb-4a9a54f66b24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.478343 Aug 23 10:52:31.120156 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1796/3680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:30 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:31.127787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:31.131481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:31.144150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.144658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.145137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.145870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.146318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.153378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.220642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44dc2d24-a565-496d-b14a-6ddd6d453d1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 204 len: 0 microversion: 2.1 time: 0.303928 Aug 23 10:52:31.221254 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1885/3681] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:30 2022] DELETE /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:31.230787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:31.231511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:31.245559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.246437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.246892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.247628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.248096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.248528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.447030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:31.459856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:31.462745 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a68373eb-1a77-49b5-adbe-b844c74a9b60 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.344289 Aug 23 10:52:31.463979 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1797/3682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:31 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:31.484529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:31.485357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:31.493956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.495851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.496871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.498476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.504831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.505478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.641051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:31.651560 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c8cf09de-5a30-4786-8a53-a9f35e4c7ffd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1493 microversion: 2.1 time: 0.424658 Aug 23 10:52:31.652844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1886/3683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:31 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1493 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:31.680990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b217151-d055-4b5c-89f9-07eff9a47456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:31.695516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b217151-d055-4b5c-89f9-07eff9a47456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: fae36cc1-0f58-403e-8224-b5bb9970306f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:31.717480 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0b217151-d055-4b5c-89f9-07eff9a47456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance fae36cc1-0f58-403e-8224-b5bb9970306f could not be found. Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b217151-d055-4b5c-89f9-07eff9a47456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/fae36cc1-0f58-403e-8224-b5bb9970306f/action HTTP/1.1 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 39 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: {"os-getConsoleOutput": {"length": 10}} Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fae36cc1-0f58-403e-8224-b5bb9970306f could not be found. Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fae36cc1-0f58-403e-8224-b5bb9970306f', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae36cc1-0f58-403e-8224-b5bb9970306f could not be found. Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae36cc1-0f58-403e-8224-b5bb9970306f could not be found. Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:31.732073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae36cc1-0f58-403e-8224-b5bb9970306f could not be found. Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b217151-d055-4b5c-89f9-07eff9a47456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance fae36cc1-0f58-403e-8224-b5bb9970306f could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b217151-d055-4b5c-89f9-07eff9a47456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/fae36cc1-0f58-403e-8224-b5bb9970306f/action" status: 404 len: 111 microversion: 2.1 time: 0.081569 Aug 23 10:52:31.737964 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1887/3684] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:31 2022] POST /compute/v2.1/servers/fae36cc1-0f58-403e-8224-b5bb9970306f/action => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:31.753038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:31.753879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:31.769925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.770429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.770877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:31.771609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:31.777860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:31.778518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.098749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:32.107418 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-455de018-31c7-4752-a435-431deba74e2e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.364913 Aug 23 10:52:32.108252 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1888/3685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:31 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:32.130401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:32.140398 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f2f61c7b-9a54-4286-a6ae-a0f70de4dcfb tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1466 microversion: 2.1 time: 0.675344 Aug 23 10:52:32.144986 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1798/3686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:31 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1466 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:32.146835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:32.147661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:32.155984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.156488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.156965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.157679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.158143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.158573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.174753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:32.175383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:32.191771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.192277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.192956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.194613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.195248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.195964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.758829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b68ef9f-edea-412d-a258-a7ac665d659e tempest-ServersOnMultiNodesTest-848064780 tempest-ServersOnMultiNodesTest-848064780-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1619 microversion: 2.1 time: 0.588175 Aug 23 10:52:32.761631 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1799/3687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:32 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1619 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:32.772119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:32.773511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:32.791289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.793172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.803241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:32.811608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.819062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.821094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.824870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.827037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-979339fe-4afd-46fd-b9dc-efcda9cb1211 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.682924 Aug 23 10:52:32.827912 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1889/3688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:32 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:32.854862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:32.855801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:32.876268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.879920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.880607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.882905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:32.889343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:32.890060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:32.957356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:33.137866 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c13a1b3f-535e-4b7f-85c6-8a533976996a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 204 len: 0 microversion: 2.1 time: 0.306191 Aug 23 10:52:33.142851 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1890/3689] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:32 2022] DELETE /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:33.154271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18490368-8f8b-4034-af33-bc8356704822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:33.155004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-18490368-8f8b-4034-af33-bc8356704822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: cf0ee477-1e84-4464-9af1-628174ae85d4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:33.180881 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-18490368-8f8b-4034-af33-bc8356704822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance cf0ee477-1e84-4464-9af1-628174ae85d4 could not be found. Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18490368-8f8b-4034-af33-bc8356704822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/cf0ee477-1e84-4464-9af1-628174ae85d4 HTTP/1.1 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance cf0ee477-1e84-4464-9af1-628174ae85d4 could not be found. Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'cf0ee477-1e84-4464-9af1-628174ae85d4'} Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf0ee477-1e84-4464-9af1-628174ae85d4 could not be found. Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf0ee477-1e84-4464-9af1-628174ae85d4 could not be found. Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:33.184058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf0ee477-1e84-4464-9af1-628174ae85d4 could not be found. Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18490368-8f8b-4034-af33-bc8356704822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance cf0ee477-1e84-4464-9af1-628174ae85d4 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:33.188599 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-18490368-8f8b-4034-af33-bc8356704822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/cf0ee477-1e84-4464-9af1-628174ae85d4" status: 404 len: 111 microversion: 2.1 time: 0.042072 Aug 23 10:52:33.192406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1891/3690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:33 2022] GET /compute/v2.1/servers/cf0ee477-1e84-4464-9af1-628174ae85d4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:33.206376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:33.208670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:33.210972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:33.220984 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0abcdf06-57a6-4ac7-99be-a85480ba7109 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1493 microversion: 2.1 time: 0.457603 Aug 23 10:52:33.221595 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1800/3691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:32 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1493 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:33.228046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.230494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.231257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.232973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.236638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.237242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.239940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:33.240567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:33.258197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.261638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.262319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.265541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.266223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.267032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.503998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:33.516543 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b252e1b7-a661-4ba0-9328-9aa23b48cc17 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.280364 Aug 23 10:52:33.517398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1801/3692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:33 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:33.529661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d2a653fb-7f7c-49ad-bf3d-7496f0b365e0 req-2d62fc8f-7ab0-4853-9246-bdbe17a40303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "tag": "ada32124-6a26-48d3-b44a-884b21329b6e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:33.553129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d2a653fb-7f7c-49ad-bf3d-7496f0b365e0 req-2d62fc8f-7ab0-4853-9246-bdbe17a40303 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.553567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d2a653fb-7f7c-49ad-bf3d-7496f0b365e0 req-2d62fc8f-7ab0-4853-9246-bdbe17a40303 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.554010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d2a653fb-7f7c-49ad-bf3d-7496f0b365e0 req-2d62fc8f-7ab0-4853-9246-bdbe17a40303 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.581875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d2a653fb-7f7c-49ad-bf3d-7496f0b365e0 req-2d62fc8f-7ab0-4853-9246-bdbe17a40303 service nova] Creating event network-changed:ada32124-6a26-48d3-b44a-884b21329b6e for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:52:33.592531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d2a653fb-7f7c-49ad-bf3d-7496f0b365e0 req-2d62fc8f-7ab0-4853-9246-bdbe17a40303 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067446 Aug 23 10:52:33.597541 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1802/3693] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:33.608585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:33.609610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:33.625321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.626058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.626305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.626973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:33.627620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:33.628057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:33.845471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:33.860804 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-262c5222-9faf-494a-ab91-ab029efda79b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1472 microversion: 2.1 time: 0.661283 Aug 23 10:52:33.860804 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1892/3694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:33 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1472 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:34.072280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:34.085569 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8845f91b-2ac3-40d4-b09c-1f10ca298b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.486709 Aug 23 10:52:34.086167 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1803/3695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:33 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:34.242622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:34.248875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:34.257554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-772387f7-b818-45f8-a7aa-fbe7a36a4820 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1434699748", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:34.279006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.279508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.279953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-772387f7-b818-45f8-a7aa-fbe7a36a4820 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 238 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1434699748", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1434699748', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.283297 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 23 10:52:34.288641 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.292771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.292907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.293235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-772387f7-b818-45f8-a7aa-fbe7a36a4820 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:34.294257 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-772387f7-b818-45f8-a7aa-fbe7a36a4820 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045310 Aug 23 10:52:34.295385 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1804/3696] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:52:34.304667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.305693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:34.306530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:34.315037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.315545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.316203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.317117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.317741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.318377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.574002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:34.587396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56750097-0d65-4909-bc25-cf59a9802020 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.287362 Aug 23 10:52:34.589097 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1805/3697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:34 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:34.615322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:34.616930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:34.629910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.631137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.632083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.633097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.633936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.634618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.804909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:34.814871 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a13173f-369b-4212-b7ab-69e6fd520cdc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.205727 Aug 23 10:52:34.815847 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1806/3698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:34 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:34.862785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:34.875695 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28547432-e46b-457a-9582-03e9faea3a19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1493 microversion: 2.1 time: 0.637153 Aug 23 10:52:34.891895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1893/3699] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:34 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1493 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:34.908911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:34.913226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:34.928078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b7bf8d9-1857-45d7-b7f4-89986b5a521b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-241171926", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b7bf8d9-1857-45d7-b7f4-89986b5a521b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 234 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-241171926", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-241171926', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.934427 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 23 10:52:34.939117 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:34.944083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.944083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.944083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.944083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.944083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.944997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.946350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b7bf8d9-1857-45d7-b7f4-89986b5a521b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:34.947551 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8b7bf8d9-1857-45d7-b7f4-89986b5a521b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.026002 Aug 23 10:52:34.948779 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1894/3700] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:34 2022] POST /compute/v2.1/servers => generated 133 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:34.961741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:34.962708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:34.974294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.975494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.976631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:34.978420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:34.979798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:34.982474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:35.011150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:35.319109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:35.329983 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7abc6c5e-0bc0-4afb-b23e-f8d6e9d88cc6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1472 microversion: 2.1 time: 0.434341 Aug 23 10:52:35.333186 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1807/3701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:34 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:35.511605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:35.534862 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0c9c8776-3849-4be0-9e14-64412773d259 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.579936 Aug 23 10:52:35.537020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1895/3702] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:34 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:35.565593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:35.566414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:35.574662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:35.575426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:35.576115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:35.577014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:35.578787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:35.580377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:35.794318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7a5e1354-0bf0-4e2e-9f09-4b96b5d1fb3a req-54cb2735-64c4-42ac-a298-62ec78d456c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a5a23b-45c5-4fe6-82a8-e07cbc755931", "name": "network-vif-deleted", "tag": "fba9e79b-dc56-4744-a830-50e5d36edc5c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:35.814358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7a5e1354-0bf0-4e2e-9f09-4b96b5d1fb3a req-54cb2735-64c4-42ac-a298-62ec78d456c1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:35.814861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7a5e1354-0bf0-4e2e-9f09-4b96b5d1fb3a req-54cb2735-64c4-42ac-a298-62ec78d456c1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:35.817505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7a5e1354-0bf0-4e2e-9f09-4b96b5d1fb3a req-54cb2735-64c4-42ac-a298-62ec78d456c1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:35.862200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7a5e1354-0bf0-4e2e-9f09-4b96b5d1fb3a req-54cb2735-64c4-42ac-a298-62ec78d456c1 service nova] Creating event network-vif-deleted:fba9e79b-dc56-4744-a830-50e5d36edc5c for instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 on n-h2-847009-13 Aug 23 10:52:35.874320 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7a5e1354-0bf0-4e2e-9f09-4b96b5d1fb3a req-54cb2735-64c4-42ac-a298-62ec78d456c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390110 Aug 23 10:52:35.877294 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1808/3703] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:52:35.910834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:35.911554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:35.923401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:35.925502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:35.926855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:35.929157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:35.932178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:35.933617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.017978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.019121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.020970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.022222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid b8a5a23b-45c5-4fe6-82a8-e07cbc755931 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:36.107898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:36.121278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4164f4cd-7d0a-4025-8ccc-8d31f7973e87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 200 len: 1305 microversion: 2.1 time: 0.215422 Aug 23 10:52:36.140774 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1809/3704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:35 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:36.215121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:36.226511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15e9a9c1-d521-484a-b0fb-321766f864e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.670843 Aug 23 10:52:36.227404 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1896/3705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:35 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:36.252505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b22bd273-9f6a-4e9d-983c-701def185d2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:36.257888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b22bd273-9f6a-4e9d-983c-701def185d2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 0e66e914-0f88-4f26-9da9-8d9d6c5e2333] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:36.265275 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b22bd273-9f6a-4e9d-983c-701def185d2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 0e66e914-0f88-4f26-9da9-8d9d6c5e2333 could not be found. Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b22bd273-9f6a-4e9d-983c-701def185d2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/0e66e914-0f88-4f26-9da9-8d9d6c5e2333/action HTTP/1.1 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 13 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: {"pause": {}} Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 0e66e914-0f88-4f26-9da9-8d9d6c5e2333 could not be found. Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0e66e914-0f88-4f26-9da9-8d9d6c5e2333', 'body': {'pause': {}}} Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e66e914-0f88-4f26-9da9-8d9d6c5e2333 could not be found. Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e66e914-0f88-4f26-9da9-8d9d6c5e2333 could not be found. Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:36.279428 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:36.285258 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:36.285258 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:36.285258 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e66e914-0f88-4f26-9da9-8d9d6c5e2333 could not be found. Aug 23 10:52:36.285258 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:36.287130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b22bd273-9f6a-4e9d-983c-701def185d2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 0e66e914-0f88-4f26-9da9-8d9d6c5e2333 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:36.288904 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b22bd273-9f6a-4e9d-983c-701def185d2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/0e66e914-0f88-4f26-9da9-8d9d6c5e2333/action" status: 404 len: 111 microversion: 2.1 time: 0.040695 Aug 23 10:52:36.290309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1810/3706] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:36 2022] POST /compute/v2.1/servers/0e66e914-0f88-4f26-9da9-8d9d6c5e2333/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:36.298884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:36.299624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:36.311938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.313957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.321624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.324687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.325376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.329134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.358838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:36.359458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:36.388895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.390121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.391582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.392627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.393349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.394635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.777114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:36.790892 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de7fab4c-711a-4145-9016-830db272b5a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1472 microversion: 2.1 time: 0.437859 Aug 23 10:52:36.792567 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1811/3707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:36 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1472 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:36.856644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:36.878670 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7e77af31-74b1-4d79-bf61-f1d8a47aea43 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.581418 Aug 23 10:52:36.880257 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1897/3708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:36 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:36.907061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:36.911517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:36.925208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.925815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.926914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:36.927720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:36.929244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:36.931492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:37.158156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:37.158874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:37.172206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:37.172776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:37.175040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:37.175979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:37.177469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:37.179680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:37.197022 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 HTTP/1.1 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b8a5a23b-45c5-4fe6-82a8-e07cbc755931'} Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:37.216347 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:52:37.221448 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:37.223615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:37.224721 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35756e21-aebb-40b0-b2a2-6949afec05bd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 404 len: 111 microversion: 2.1 time: 0.070401 Aug 23 10:52:37.243612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1898/3709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:37 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:37.333929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:37.344013 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34dff552-ce2c-4886-acd1-472e4728738a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.446101 Aug 23 10:52:37.347849 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1812/3710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:36 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:37.369920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:37.371654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:37.384416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:37.389611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:37.390458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:37.391719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:37.392827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:37.395267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:37.412571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-776574919", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:37.519549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:37.577976 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4e0e99b-17d9-4c87-b327-c528ef31ecf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.211644 Aug 23 10:52:37.582850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1899/3711] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:37 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:37.612596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:37.613550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:37.627872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:37.628422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:37.628914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:37.629665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:37.630137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:37.633699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.330865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:38.331233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:38.331409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:38.331857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:38.332115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:38.332535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:38.342508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:38.343007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:38.346402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.347202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:38.347754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:38.348199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.348326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f165e458-7926-42a7-860f-1f5434d2d414 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1511 microversion: 2.1 time: 0.746382 Aug 23 10:52:38.350021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1900/3712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:37 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1511 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:38.387542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:38.390823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:38.393311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:38.395758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:38.414101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:38.417637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:38.419388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.422139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:38.422656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:38.425253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.443335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:38.445858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:38.514537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:38.516014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:38.517744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.518852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid 8e43c82a-2315-441b-97de-fd3ac6c6c2fc {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:38.557399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84899088-8643-425b-8d10-2ce6fe3196f5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147919 Aug 23 10:52:38.559161 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1813/3713] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:52:38.564495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-dda85d2e-bdf4-40d8-ba94-a61659008cd0 req-5fdf1e1e-aa3e-468b-b26d-31cacc6153f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e43c82a-2315-441b-97de-fd3ac6c6c2fc", "name": "network-vif-deleted", "tag": "fe9cd896-95db-48e9-ab3e-d7d05107a894"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:38.579084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dda85d2e-bdf4-40d8-ba94-a61659008cd0 req-5fdf1e1e-aa3e-468b-b26d-31cacc6153f9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:38.579949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dda85d2e-bdf4-40d8-ba94-a61659008cd0 req-5fdf1e1e-aa3e-468b-b26d-31cacc6153f9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:38.580561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dda85d2e-bdf4-40d8-ba94-a61659008cd0 req-5fdf1e1e-aa3e-468b-b26d-31cacc6153f9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:38.599138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-dda85d2e-bdf4-40d8-ba94-a61659008cd0 req-5fdf1e1e-aa3e-468b-b26d-31cacc6153f9 service nova] Creating event network-vif-deleted:fe9cd896-95db-48e9-ab3e-d7d05107a894 for instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc on n-h1-847009-13 Aug 23 10:52:38.611470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-dda85d2e-bdf4-40d8-ba94-a61659008cd0 req-5fdf1e1e-aa3e-468b-b26d-31cacc6153f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050667 Aug 23 10:52:38.612681 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1814/3714] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:38.623625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14da04fa-2499-42cb-9459-3054044a04ca tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:38.625110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14da04fa-2499-42cb-9459-3054044a04ca tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:38.718274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:38.732335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ceb67ff5-b5f0-4b10-99d0-a9da6e6bc2d0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 200 len: 1306 microversion: 2.1 time: 0.379062 Aug 23 10:52:38.734922 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1901/3715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:38 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 1306 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:38.763241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14da04fa-2499-42cb-9459-3054044a04ca tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:38.774321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14da04fa-2499-42cb-9459-3054044a04ca tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1214 microversion: 2.1 time: 0.159286 Aug 23 10:52:38.776274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1815/3716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:38 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:39.374568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:39.375823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:39.393892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:39.394426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:39.394884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:39.395641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:39.396112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:39.396547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:39.423236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1745377278", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:39.543663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] validate_networks() for [('15655082-1d8f-460f-9281-cf049945d69c', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:40.436700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:40.453440 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc2095d3-1943-4c7c-b0ee-22126eb1d977 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1491 microversion: 2.1 time: 1.079929 Aug 23 10:52:40.456606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:40.458163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:40.458875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:40.459296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:40.459715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:40.466064 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1816/3717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:39 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1491 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:40.481631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.482207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.483027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.483842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.484359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.485136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.485815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:40.486726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 8e43c82a-2315-441b-97de-fd3ac6c6c2fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:40.500415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.500962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.501419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.502145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.506736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.509473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.514378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for project e8e517070ce248b08c60a477f1e40f00. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:40.523105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for user 661fb95cf8664a7a8eb9322155164792 and project e8e517070ce248b08c60a477f1e40f00. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:40.544286 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc could not be found. Aug 23 10:52:40.546468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc HTTP/1.1 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc could not be found. Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8e43c82a-2315-441b-97de-fd3ac6c6c2fc'} Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc could not be found. Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc could not be found. Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:40.548353 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc could not be found. Aug 23 10:52:40.553703 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.554801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance 8e43c82a-2315-441b-97de-fd3ac6c6c2fc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:40.556158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:40.557809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c708ce9d-722e-48c0-a3ea-6e9357aeb28d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc" status: 404 len: 111 microversion: 2.1 time: 0.089355 Aug 23 10:52:40.562016 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1817/3718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:40 2022] GET /compute/v2.1/servers/8e43c82a-2315-441b-97de-fd3ac6c6c2fc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:40.572150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:40.579432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:40.585771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.586275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.586906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.587628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.588380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.588905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.682664 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a343da9b-e50a-4169-8df3-2afaf84a7098 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.372223 Aug 23 10:52:40.684573 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1902/3719] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:52:40.689779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:40.690616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:40.698027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.698988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.699727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.700676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.703100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.703800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.740855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'pause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state paused Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 13 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: {"pause": {}} Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'pause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state paused Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'pause': {}}} Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state paused. Cannot pause while the instance is in this state. Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state paused Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:40.743362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:40.750420 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:40.750420 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:40.750420 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:40.750420 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state paused Aug 23 10:52:40.750420 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:40.752879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'pause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state paused {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:40.754080 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91d9de03-3dd9-4479-8e3f-ab780a7035d5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 143 microversion: 2.1 time: 0.068227 Aug 23 10:52:40.755237 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1903/3720] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:40 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 143 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:52:40.761887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:40.762802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:40.769580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.770401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.771073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.772194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:40.772938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:40.773641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:40.801611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:40.809622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:40.819958 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-574bac63-ff1d-43c4-b77b-21b75cb02416 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1266 microversion: 2.1 time: 0.251588 Aug 23 10:52:40.821394 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1818/3721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:40 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:40.833740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8433473d-a6f1-4754-9db3-6448c332881e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:40.834617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8433473d-a6f1-4754-9db3-6448c332881e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:40.980890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8433473d-a6f1-4754-9db3-6448c332881e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:40.992555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8433473d-a6f1-4754-9db3-6448c332881e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1222 microversion: 2.1 time: 0.169717 Aug 23 10:52:41.020321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1819/3722] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:40 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:41.027495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:41.028204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:41.030105 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a40512d7-8304-4825-89c0-708bd59bb26e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 204 len: 0 microversion: 2.1 time: 0.272797 Aug 23 10:52:41.031390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1904/3723] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:40 2022] DELETE /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:41.038531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:41.040118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:41.040875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:41.042009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:41.042760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:41.043650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:41.049514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:41.050932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:41.074956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:41.075436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:41.075892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:41.081169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:41.083625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:41.084096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:41.144133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:41.178182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48d276e8-8e68-447b-890d-eb89efb41b78 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.156069 Aug 23 10:52:41.179827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1820/3724] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:41 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:41.209157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-146097724", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:41.327253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] validate_networks() for [('15655082-1d8f-460f-9281-cf049945d69c', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:41.459192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:41.470542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a324710-744b-488d-907a-b92dde954aa6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1472 microversion: 2.1 time: 0.434426 Aug 23 10:52:41.475434 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1905/3725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:41 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:41.489182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:41.490213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:41.506976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:41.511133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:41.511726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:41.512687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:41.513282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:41.514541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:41.950331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:41.968948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-502f188c-2a0b-44a9-b0f6-166975ed3431 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1498 microversion: 2.1 time: 0.491970 Aug 23 10:52:41.969922 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1906/3726] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:41 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1498 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:41.980240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:41.990400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:42.004295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:42.007635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:42.008399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:42.010598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:42.014093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:42.014884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:42.219909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:42.249402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e40c2b11-379d-4b9e-8be0-81adffbd80fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1274 microversion: 2.1 time: 0.274747 Aug 23 10:52:42.260594 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1907/3727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:41 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1274 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:42.505207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:42.505902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:42.534468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:42.535011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:42.535468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:42.538989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:42.539802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:42.539987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.108569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:43.109848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:43.112238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:43.113028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:43.113767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:43.156677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.162137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.162978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.178031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.180222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.180780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.235440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:43.258487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for project e8e517070ce248b08c60a477f1e40f00. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:43.272024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for user 661fb95cf8664a7a8eb9322155164792 and project e8e517070ce248b08c60a477f1e40f00. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:43.303382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:43.313062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:43.399239 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-357d8ea4-e1c7-4b27-9099-ccae538981e1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.217387 Aug 23 10:52:43.401619 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1821/3728] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:52:43.409887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:43.410797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:43.420417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.421368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.422604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.423525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.425722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.426391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.445943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:43.457815 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-71e0b31c-3695-4c9e-916a-bf9b38e76360 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1472 microversion: 2.1 time: 0.960446 Aug 23 10:52:43.473346 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1908/3729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:42 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:43.493501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:43.495406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:43.516062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.518077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.518840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.519999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.520856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.523318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.761950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:43.774549 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e74b8567-40ef-4e0d-a9d8-28e1b5e16a5b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1272 microversion: 2.1 time: 0.299038 Aug 23 10:52:43.775132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1909/3730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:43 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:43.795084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b54bf22e-4380-430b-87f5-0bff3a3a7d10 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:43.801767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b54bf22e-4380-430b-87f5-0bff3a3a7d10 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:43.905581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:43.921117 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f425123-d18d-466a-b80c-54661f1d9cc9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.518137 Aug 23 10:52:43.922760 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1822/3731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:43 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:43.948786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:43.949636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:43.981757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.984121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.985017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:43.987940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:43.990783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:43.993982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.102148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b54bf22e-4380-430b-87f5-0bff3a3a7d10 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:44.111715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b54bf22e-4380-430b-87f5-0bff3a3a7d10 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1221 microversion: 2.1 time: 0.334884 Aug 23 10:52:44.112212 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1910/3732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:43 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1221 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:44.490206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:44.491556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:44.504222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.506052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.507013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.508525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.509574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.510597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.531351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:44.545176 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9432da41-27a6-437d-8f48-a5ed7e5892d8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.602120 Aug 23 10:52:44.557719 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1823/3733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:43 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:44.569749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:44.572088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:44.593953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.594760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.598531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.601077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.601798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.602476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.625315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb/action HTTP/1.1 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 28 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: {"reboot": {"type": "SOFT"}} Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '64f8abe5-3fa8-45c1-9539-535d43d6f1fb', 'body': {'reboot': {'type': 'SOFT'}}} Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:44.628733 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:44.634037 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:44.635916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:44.638831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:44.639869 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35a881db-a1b0-4427-985d-dd4939eb6dea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb/action" status: 404 len: 111 microversion: 2.1 time: 0.075023 Aug 23 10:52:44.640540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1824/3734] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:44 2022] POST /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:44.644545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:44.657567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:44.658307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:44.683998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.684580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.685016 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fa0002a5-1f39-4c1c-8a35-96b088f1f870 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1430 microversion: 2.1 time: 0.186081 Aug 23 10:52:44.685315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.686291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.687298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.687939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.701522 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1911/3735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:44 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1430 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:44.796098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:44.797787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:44.806715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.808230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.809137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.810722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:44.813355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:44.814175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:44.986125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:45.000039 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfe223be-4a41-4339-9d21-79846d0a8c31 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1272 microversion: 2.1 time: 0.207071 Aug 23 10:52:45.015061 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1912/3736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:44 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:45.023286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7ff0a0d7-ce11-4303-a279-d4c3ef99a896 req-24f3893d-8805-4f5f-bb4a-69d2e44b52e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc509db-c064-44dc-b367-860a2c51b016", "name": "network-vif-deleted", "tag": "76dbff01-7595-4cbc-9d4e-f42bc7fb2f23"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:45.031387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:45.040423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7ff0a0d7-ce11-4303-a279-d4c3ef99a896 req-24f3893d-8805-4f5f-bb4a-69d2e44b52e3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.041943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7ff0a0d7-ce11-4303-a279-d4c3ef99a896 req-24f3893d-8805-4f5f-bb4a-69d2e44b52e3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.042716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7ff0a0d7-ce11-4303-a279-d4c3ef99a896 req-24f3893d-8805-4f5f-bb4a-69d2e44b52e3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.067502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7ff0a0d7-ce11-4303-a279-d4c3ef99a896 req-24f3893d-8805-4f5f-bb4a-69d2e44b52e3 service nova] Creating event network-vif-deleted:76dbff01-7595-4cbc-9d4e-f42bc7fb2f23 for instance 2fc509db-c064-44dc-b367-860a2c51b016 on n-h2-847009-13 Aug 23 10:52:45.076156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7ff0a0d7-ce11-4303-a279-d4c3ef99a896 req-24f3893d-8805-4f5f-bb4a-69d2e44b52e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059266 Aug 23 10:52:45.077219 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1913/3737] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:45.139089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:45.139960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:45.161793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.164490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.165018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.168072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.168551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.173825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.466265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:45.489202 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-96faf4a2-cd37-4593-b319-45135b1f6349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1273 microversion: 2.1 time: 0.354442 Aug 23 10:52:45.496123 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1914/3738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:45 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:45.719388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:45.720073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:45.730568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.731072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.731515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.732256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.732764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.755531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:45.766954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.777074 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be17cbb0-e4e6-4e24-ac4e-2b33b775f638 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 1.122152 Aug 23 10:52:45.778452 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1825/3739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:44 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:45.803267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:45.803900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:45.819041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.819552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.819993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.820119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.820583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.820773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:45.821180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:45.821577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:45.822809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid 2fc509db-c064-44dc-b367-860a2c51b016 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:45.837544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:46.004101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:46.012931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6378dbd-f75b-4fdc-86e8-5a9f3ffa2d7e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 200 len: 1307 microversion: 2.1 time: 0.302521 Aug 23 10:52:46.029058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1915/3740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:45 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:46.035124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:46.037429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:46.051950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:46.054476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:46.054938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:46.055681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:46.056154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:46.058023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:46.644886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:46.661823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:46.734714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6e1d230-788d-4642-b779-f6106acb311c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.700844 Aug 23 10:52:46.740733 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1916/3741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:46 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:46.742429 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c3a0bfa-bff3-45f8-9269-e397e91616ef tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.939712 Aug 23 10:52:46.756558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1826/3742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:45 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:46.759497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:46.766841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:46.777606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f45e5bb-2301-44ef-aafc-b9171b9fb9d4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:46.781326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:46.781834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:46.783034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:46.783973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:46.784156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f45e5bb-2301-44ef-aafc-b9171b9fb9d4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 1654c6f7-57fa-4a58-9318-afd2c7f71f0b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:46.784610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:46.785090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:46.798888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5f45e5bb-2301-44ef-aafc-b9171b9fb9d4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 1654c6f7-57fa-4a58-9318-afd2c7f71f0b could not be found. Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f45e5bb-2301-44ef-aafc-b9171b9fb9d4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/1654c6f7-57fa-4a58-9318-afd2c7f71f0b/action HTTP/1.1 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 28 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: {"reboot": {"type": "SOFT"}} Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1654c6f7-57fa-4a58-9318-afd2c7f71f0b could not be found. Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1654c6f7-57fa-4a58-9318-afd2c7f71f0b', 'body': {'reboot': {'type': 'SOFT'}}} Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1654c6f7-57fa-4a58-9318-afd2c7f71f0b could not be found. Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1654c6f7-57fa-4a58-9318-afd2c7f71f0b could not be found. Aug 23 10:52:46.800514 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1654c6f7-57fa-4a58-9318-afd2c7f71f0b could not be found. Aug 23 10:52:46.805279 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:46.809355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f45e5bb-2301-44ef-aafc-b9171b9fb9d4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 1654c6f7-57fa-4a58-9318-afd2c7f71f0b could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:46.810374 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f45e5bb-2301-44ef-aafc-b9171b9fb9d4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/1654c6f7-57fa-4a58-9318-afd2c7f71f0b/action" status: 404 len: 111 microversion: 2.1 time: 0.048057 Aug 23 10:52:46.811213 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1827/3743] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:46 2022] POST /compute/v2.1/servers/1654c6f7-57fa-4a58-9318-afd2c7f71f0b/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:52:46.818820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:46.819442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:46.832043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:46.832625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:46.833011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:46.833731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:46.841987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:46.842790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.007258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:47.020988 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a881f47b-928c-4d3c-9903-7b67625dd874 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1279 microversion: 2.1 time: 0.271351 Aug 23 10:52:47.024814 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1917/3744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:46 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:47.057199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:47.058270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2fc509db-c064-44dc-b367-860a2c51b016] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:47.070459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.070971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.071469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.073229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.073804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.074243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.107775 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance 2fc509db-c064-44dc-b367-860a2c51b016 could not be found. Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 HTTP/1.1 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 2fc509db-c064-44dc-b367-860a2c51b016 could not be found. Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2fc509db-c064-44dc-b367-860a2c51b016'} Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc509db-c064-44dc-b367-860a2c51b016 could not be found. Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc509db-c064-44dc-b367-860a2c51b016 could not be found. Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:47.110578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc509db-c064-44dc-b367-860a2c51b016 could not be found. Aug 23 10:52:47.116204 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:47.117783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance 2fc509db-c064-44dc-b367-860a2c51b016 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:47.122260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eab77c26-d4f1-4d0a-ae43-69ec05d3f81b tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016" status: 404 len: 111 microversion: 2.1 time: 0.088002 Aug 23 10:52:47.123576 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1918/3745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:47 2022] GET /compute/v2.1/servers/2fc509db-c064-44dc-b367-860a2c51b016 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:52:47.133787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:47.136296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:47.144845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.145588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.146229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.147609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.148259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.149064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.185100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:47.201023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:47.209342 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cf503dc-52fd-4dc7-be1f-e0c5e147e822 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.394156 Aug 23 10:52:47.213765 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1828/3746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:46 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:47.302980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87ea0f16-6903-48ba-9099-81e392abde6f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Action: 'create', calling method: .version_select at 0x7fdc9c0400d0>, body: {"keypair": {"name": "tempest-keypair-802449961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK42NAGOBOJVCArcpK0BVrKeZauvipSVJzQU6ESLRl758ufV2JqHoZgiqk/oMIULUGv50jV2rNPqYDVy7wgE1gckY9FKzVKSPlCKsJd4aINa4kKVIeCaM8Bik9E/S5iCZQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:47.322794 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-39d874ff-2fc1-41b6-bf7b-4dc5bac06259 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 204 len: 0 microversion: 2.1 time: 0.194831 Aug 23 10:52:47.326589 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1919/3747] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:47 2022] DELETE /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:47.332338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:47.333665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:47.340846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-87ea0f16-6903-48ba-9099-81e392abde6f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Getting quotas for project 40f8ed91bafc4261b673d721fd244647. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:47.344712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.345284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.345910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.346916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-87ea0f16-6903-48ba-9099-81e392abde6f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Getting quotas for user 41b1ccd5b45247beb31d3e70b16a10dc and project 40f8ed91bafc4261b673d721fd244647. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:47.348658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.349364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.350027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.391288 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87ea0f16-6903-48ba-9099-81e392abde6f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.176280 Aug 23 10:52:47.392702 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1829/3748] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:52:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:47.398987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:47.399740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:47.408699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.409667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.410554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.411714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.412684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.413591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.826683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:47.835998 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b38db7f-0f23-41f5-97e3-e5157576ba7d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1471 microversion: 2.1 time: 0.442058 Aug 23 10:52:47.841411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1830/3749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:47 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1471 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:47.846595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:47.853271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:47.870919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.871633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.872239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:47.874468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:47.875744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:47.878803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.358735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:48.386747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:48.394339 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-25a9d372-776e-4996-b435-30e20b0bad21 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 1.066557 Aug 23 10:52:48.396945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1920/3750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:47 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:48.410224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f6c1441-ffc2-4037-9732-c013bf285082 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.567507 Aug 23 10:52:48.423868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:48.424417 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1831/3751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:47 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:48.424520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:48.424610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0f777181-2e58-4d3b-9842-6d7f74c0f1e7 req-e3cdf088-b625-41dd-a5a8-123a897430aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5213bf0f-b9d3-4cd8-88e4-530a4f430820", "tag": "5dc6fa06-4536-42d8-9b80-4893f6db4973"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:48.430961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.432248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.433373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.433932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.434333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.434867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.450467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0f777181-2e58-4d3b-9842-6d7f74c0f1e7 req-e3cdf088-b625-41dd-a5a8-123a897430aa service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.451085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0f777181-2e58-4d3b-9842-6d7f74c0f1e7 req-e3cdf088-b625-41dd-a5a8-123a897430aa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.451549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0f777181-2e58-4d3b-9842-6d7f74c0f1e7 req-e3cdf088-b625-41dd-a5a8-123a897430aa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.471068 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0f777181-2e58-4d3b-9842-6d7f74c0f1e7 req-e3cdf088-b625-41dd-a5a8-123a897430aa service nova] Creating event network-changed:5dc6fa06-4536-42d8-9b80-4893f6db4973 for instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 on n-h2-847009-13 Aug 23 10:52:48.478996 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0f777181-2e58-4d3b-9842-6d7f74c0f1e7 req-e3cdf088-b625-41dd-a5a8-123a897430aa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062607 Aug 23 10:52:48.484230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1832/3752] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:48.495697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:48.503055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:48.524658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.525371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.527233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.528200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.529099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.529709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.554814 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb/action HTTP/1.1 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 65 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '64f8abe5-3fa8-45c1-9539-535d43d6f1fb', 'body': {'rebuild': {'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8'}}} Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 23 10:52:48.559413 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:52:48.564883 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:48.566992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:48.567911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:48.569072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dcc63cd-aae1-4648-ab0f-5fdc086b6544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb/action" status: 404 len: 111 microversion: 2.1 time: 0.083546 Aug 23 10:52:48.570599 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1833/3753] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:48 2022] POST /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:48.576968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1aee7c2-a0a0-4a82-b055-99a4ea17ad34 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1279 microversion: 2.1 time: 0.178882 Aug 23 10:52:48.580449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:48.581213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1921/3754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:48 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:48.581402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:48.602782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.604878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.605673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.607412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.608234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.609071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.868714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:48.870835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:48.904671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.905767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.906445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.907835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:48.908654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:48.909340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:48.966243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:48.977380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f1df5b3-6588-43d7-9887-a3c73d9ad15b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.401196 Aug 23 10:52:48.979120 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1834/3755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:48 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:49.003197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:49.004144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:49.021023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.021778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.022862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.023769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.024504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.025802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.324410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:49.342639 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03ccdb00-45cc-46f4-9e19-c7d658ddff62 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.340435 Aug 23 10:52:49.343292 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1835/3756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:48 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:49.373195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd312995-3e58-4df6-bedb-e2a2f3ddbc01 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:49.376133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd312995-3e58-4df6-bedb-e2a2f3ddbc01 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: dd5c65bc-4ed7-4da1-938f-47a0cf95f848] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:49.382830 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-fd312995-3e58-4df6-bedb-e2a2f3ddbc01 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance dd5c65bc-4ed7-4da1-938f-47a0cf95f848 could not be found. Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd312995-3e58-4df6-bedb-e2a2f3ddbc01 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/dd5c65bc-4ed7-4da1-938f-47a0cf95f848/action HTTP/1.1 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 65 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance dd5c65bc-4ed7-4da1-938f-47a0cf95f848 could not be found. Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'dd5c65bc-4ed7-4da1-938f-47a0cf95f848', 'body': {'rebuild': {'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8'}}} Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd5c65bc-4ed7-4da1-938f-47a0cf95f848 could not be found. Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 10:52:49.385146 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd5c65bc-4ed7-4da1-938f-47a0cf95f848 could not be found. Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd5c65bc-4ed7-4da1-938f-47a0cf95f848 could not be found. Aug 23 10:52:49.390249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:49.393514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd312995-3e58-4df6-bedb-e2a2f3ddbc01 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance dd5c65bc-4ed7-4da1-938f-47a0cf95f848 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:49.394596 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd312995-3e58-4df6-bedb-e2a2f3ddbc01 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/dd5c65bc-4ed7-4da1-938f-47a0cf95f848/action" status: 404 len: 111 microversion: 2.1 time: 0.033813 Aug 23 10:52:49.398915 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1836/3757] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:49 2022] POST /compute/v2.1/servers/dd5c65bc-4ed7-4da1-938f-47a0cf95f848/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:52:49.405353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:49.405982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:49.414745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.415475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.416453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.417634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.418119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.418557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.712452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:49.726614 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0c709ec9-ed75-411d-b448-5f36a129977e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1471 microversion: 2.1 time: 0.864116 Aug 23 10:52:49.736440 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1922/3758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:48 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1471 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:49.753426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:49.756204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:49.778181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.780274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.781641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.783407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.784416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.785518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.843332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:49.852278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44dc71ec-91fc-41af-9fa3-2b01699c9aa3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.452048 Aug 23 10:52:49.861898 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1837/3759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:49 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:49.880354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:49.882012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:49.888953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.889709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.890327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:49.891408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:49.892041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:49.892638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.296066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:50.304595 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dabad2f0-5b81-46a1-bd26-78cb63be1d15 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.566465 Aug 23 10:52:50.305485 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1923/3760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:49 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:50.324689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:50.325687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:50.333036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.333822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.334638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.335591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.336279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.336978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.500393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:50.528148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:50.539753 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a05a2442-0ec0-461f-9c73-97bc3ff8b8db tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.676249 Aug 23 10:52:50.541776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1838/3761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:49 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:50.547100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-561230d6-3043-4b60-a2ce-03d87d112f92 req-f0859447-2e4c-4ae0-aafb-8a1ba0410617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69836824-35ef-49e2-9b18-8ea94744cc8e", "tag": "149d5707-d13d-45d7-b809-ba896ae8aaf7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:50.566006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-561230d6-3043-4b60-a2ce-03d87d112f92 req-f0859447-2e4c-4ae0-aafb-8a1ba0410617 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.566639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-561230d6-3043-4b60-a2ce-03d87d112f92 req-f0859447-2e4c-4ae0-aafb-8a1ba0410617 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.567075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-561230d6-3043-4b60-a2ce-03d87d112f92 req-f0859447-2e4c-4ae0-aafb-8a1ba0410617 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.582782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-561230d6-3043-4b60-a2ce-03d87d112f92 req-f0859447-2e4c-4ae0-aafb-8a1ba0410617 service nova] Creating event network-changed:149d5707-d13d-45d7-b809-ba896ae8aaf7 for instance 69836824-35ef-49e2-9b18-8ea94744cc8e on n-h1-847009-13 Aug 23 10:52:50.588985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-561230d6-3043-4b60-a2ce-03d87d112f92 req-f0859447-2e4c-4ae0-aafb-8a1ba0410617 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045582 Aug 23 10:52:50.590526 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1839/3762] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:50.732907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:50.741988 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5839fa4f-13ae-4133-bc56-2eb209006667 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.422781 Aug 23 10:52:50.742836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1924/3763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:50 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:50.759235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:50.760849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:50.763976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07d1f5e6-6c00-4092-9e0f-e93e02c83992 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:50.764469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-07d1f5e6-6c00-4092-9e0f-e93e02c83992 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 87e57519-ff98-472e-838f-4509de714dc9] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:50.774114 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-07d1f5e6-6c00-4092-9e0f-e93e02c83992 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 87e57519-ff98-472e-838f-4509de714dc9 could not be found. Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07d1f5e6-6c00-4092-9e0f-e93e02c83992 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/87e57519-ff98-472e-838f-4509de714dc9/action HTTP/1.1 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 15 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: {"restore": {}} Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 87e57519-ff98-472e-838f-4509de714dc9 could not be found. Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '87e57519-ff98-472e-838f-4509de714dc9', 'body': {'restore': {}}} Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e57519-ff98-472e-838f-4509de714dc9 could not be found. Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e57519-ff98-472e-838f-4509de714dc9 could not be found. Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:50.776151 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e57519-ff98-472e-838f-4509de714dc9 could not be found. Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07d1f5e6-6c00-4092-9e0f-e93e02c83992 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 87e57519-ff98-472e-838f-4509de714dc9 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07d1f5e6-6c00-4092-9e0f-e93e02c83992 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/87e57519-ff98-472e-838f-4509de714dc9/action" status: 404 len: 111 microversion: 2.1 time: 0.020720 Aug 23 10:52:50.788829 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1925/3764] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:50 2022] POST /compute/v2.1/servers/87e57519-ff98-472e-838f-4509de714dc9/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:50.794423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:50.795051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:50.795898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.797064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.798292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.799353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.800290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.801269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.809039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.809549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.809993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:50.810720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:50.811177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:50.811610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.249612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:51.259055 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6be552ba-73b4-47cb-9c18-733b8d9baf66 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.472689 Aug 23 10:52:51.276868 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1926/3765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:50 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:51.297429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:51.313355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d0d6fa53-a84c-4762-9325-db59716b72af req-ce5066ae-b1ee-4812-999f-69add753c4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa94ba5-70c5-4ab2-af55-5704a28c7527", "tag": "eac5f959-8938-4b8f-b84f-3963d2b9c619"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:51.346564 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7742ef50-ba83-406b-abda-9260a04d0ccc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1471 microversion: 2.1 time: 0.591397 Aug 23 10:52:51.351652 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1840/3766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:50 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:51.390957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:51.391332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d0d6fa53-a84c-4762-9325-db59716b72af req-ce5066ae-b1ee-4812-999f-69add753c4e2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.393306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:51.393552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d0d6fa53-a84c-4762-9325-db59716b72af req-ce5066ae-b1ee-4812-999f-69add753c4e2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.397731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d0d6fa53-a84c-4762-9325-db59716b72af req-ce5066ae-b1ee-4812-999f-69add753c4e2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.414714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.421043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.422218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.423101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.427108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.427706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.435553 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d0d6fa53-a84c-4762-9325-db59716b72af req-ce5066ae-b1ee-4812-999f-69add753c4e2 service nova] Creating event network-changed:eac5f959-8938-4b8f-b84f-3963d2b9c619 for instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 on n-h2-847009-13 Aug 23 10:52:51.451860 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d0d6fa53-a84c-4762-9325-db59716b72af req-ce5066ae-b1ee-4812-999f-69add753c4e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180929 Aug 23 10:52:51.458058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1927/3767] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:51.474642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:51.475788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:51.498467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.499895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.500575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.502217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.503058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.504331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.819660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:51.829984 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5f7e607-97e3-445b-bb05-a245d4a6e6e3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.370067 Aug 23 10:52:51.849290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1928/3768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:51 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:51.856529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:51.857378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:51.860255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:51.868040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.870201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.870897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.871857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:51.872518 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1261696d-bdcf-4849-b691-567a992d51b3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.515161 Aug 23 10:52:51.872654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:51.873264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:51.874149 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1841/3769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:51 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:51.880614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-460014986", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "81549a55-13a3-4573-92a4-a586c2f7242d"}], "security_groups": [{"name": "tempest-securitygroup--1162859693"}], "key_name": "tempest-keypair-802449961", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:51.895924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:52.049571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] validate_networks() for [('81549a55-13a3-4573-92a4-a586c2f7242d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:52:52.149298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:52.160623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9e366c1-8fb2-4ff6-b5b3-192ca556817b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.310086 Aug 23 10:52:52.174727 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1929/3770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:51 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:52.179917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:52.180455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:52.186532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.187017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.187637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.188765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.189223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.189653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.213945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'restore' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 15 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: {"restore": {}} Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'restore' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'restore': {}}} Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state active. Cannot restore while the instance is in this state. Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:52.216149 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'restore' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb9c5cfe-882c-492c-8e88-ccbc81359544 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 145 microversion: 2.1 time: 0.043202 Aug 23 10:52:52.222260 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1930/3771] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:52 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 145 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:52:52.227932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:52.229182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:52.235248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.235746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.236196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.236990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.237445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.237870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.395099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:52.404781 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0c694c2-3d46-4a07-aef5-bb12a6c7d1e0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.180444 Aug 23 10:52:52.405464 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1931/3772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:52 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:52.417194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:52.418082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:52.428139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.428713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.429247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.430782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.431249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.432305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.467582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.468073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.468510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.469109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid 7f8b647c-8ac8-4d88-ad72-8723d3537613 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:52.528431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:52.537612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7244fb30-60cb-40cd-bcde-f126caa69096 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1306 microversion: 2.1 time: 0.131009 Aug 23 10:52:52.539120 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1932/3773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:52 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:52.547969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:52.549144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:52.557540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.558210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.558758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.561773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.562738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.563411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.734493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:52.743735 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93b21caa-2a9d-4a82-bd0e-87896ea14733 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.203276 Aug 23 10:52:52.745533 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1933/3774] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:52 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:52.750374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-98678783-696b-4fdb-ae39-9ee23553f785 req-aa42c5e4-59b0-4c56-a39f-8bf1aa09d925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8b647c-8ac8-4d88-ad72-8723d3537613", "name": "network-vif-deleted", "tag": "00498f2e-8ed2-404b-8fa7-79d6bcdb0c6b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:52.761345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-98678783-696b-4fdb-ae39-9ee23553f785 req-aa42c5e4-59b0-4c56-a39f-8bf1aa09d925 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.761838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-98678783-696b-4fdb-ae39-9ee23553f785 req-aa42c5e4-59b0-4c56-a39f-8bf1aa09d925 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.762281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-98678783-696b-4fdb-ae39-9ee23553f785 req-aa42c5e4-59b0-4c56-a39f-8bf1aa09d925 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.777122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-98678783-696b-4fdb-ae39-9ee23553f785 req-aa42c5e4-59b0-4c56-a39f-8bf1aa09d925 service nova] Creating event network-vif-deleted:00498f2e-8ed2-404b-8fa7-79d6bcdb0c6b for instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 on n-h2-847009-13 Aug 23 10:52:52.787145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-98678783-696b-4fdb-ae39-9ee23553f785 req-aa42c5e4-59b0-4c56-a39f-8bf1aa09d925 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039764 Aug 23 10:52:52.787145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1934/3775] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:52.793047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-901cf60f-3f4a-4a18-81f5-4b645ac0fc10 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:52.793434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-901cf60f-3f4a-4a18-81f5-4b645ac0fc10 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:52.802347 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-901cf60f-3f4a-4a18-81f5-4b645ac0fc10 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29 could not be found. Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-901cf60f-3f4a-4a18-81f5-4b645ac0fc10 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29/action HTTP/1.1 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 14 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: {"resume": {}} Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29 could not be found. Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29', 'body': {'resume': {}}} Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29 could not be found. Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29 could not be found. Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:52.813080 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29 could not be found. Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-901cf60f-3f4a-4a18-81f5-4b645ac0fc10 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-901cf60f-3f4a-4a18-81f5-4b645ac0fc10 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29/action" status: 404 len: 111 microversion: 2.1 time: 0.026556 Aug 23 10:52:52.822539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1935/3776] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:52 2022] POST /compute/v2.1/servers/fdf11f14-9c7b-4f70-9cb2-d6dc0585cb29/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:52.825041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:52.825696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:52.843884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.845023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.846177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.847243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.848434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.849372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.895039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Getting quotas for project 40f8ed91bafc4261b673d721fd244647. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:52.911559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Getting quotas for user 41b1ccd5b45247beb31d3e70b16a10dc and project 40f8ed91bafc4261b673d721fd244647. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:52.950256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:52:52.950733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:52:52.951214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:52:52.951629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:52:52.952080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:52:52.961993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.962534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.964138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.964993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:52.965764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:52.966372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:52.989825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Getting quotas for project 40f8ed91bafc4261b673d721fd244647. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:52:52.996644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Getting quotas for user 41b1ccd5b45247beb31d3e70b16a10dc and project 40f8ed91bafc4261b673d721fd244647. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:52:53.012010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:52:53.015047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:52:53.084787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.095772 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65c994ea-211c-4df1-a4ef-08e5dd8ed3a3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.275164 Aug 23 10:52:53.101237 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1936/3777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:52 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.110167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.111171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.122344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.123034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.123736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.124255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c344c4ea-c479-4811-9f27-3052aae65981 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.248926 Aug 23 10:52:53.124943 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1842/3778] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:51 2022] POST /compute/v2.1/servers => generated 407 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:52:53.125330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.127387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.128114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.130507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.131426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.141362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.142122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.142816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.144064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.144833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.145523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.358364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.375220 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d982bf7-3fde-4af8-8090-e4d4c5c44631 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.246608 Aug 23 10:52:53.375885 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1843/3779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.382091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8941cae9-d9b8-4238-99c8-32d5c46ce967 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.382724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8941cae9-d9b8-4238-99c8-32d5c46ce967 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.469961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8941cae9-d9b8-4238-99c8-32d5c46ce967 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.477957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8941cae9-d9b8-4238-99c8-32d5c46ce967 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1268 microversion: 2.1 time: 0.100923 Aug 23 10:52:53.493751 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1844/3780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1268 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.500532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.501769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.508790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.509741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.510427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.511374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.512173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.512889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.518748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:53.534635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.549436 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77a720b0-4a7e-4174-91e4-1220c307c0b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.446376 Aug 23 10:52:53.550654 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1937/3781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.564267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:53.565580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.578991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.579587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.583939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.584716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.585301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.585881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.639996 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'resume' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 14 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: {"resume": {}} Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'resume' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'resume': {}}} Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state active. Cannot resume while the instance is in this state. Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:53.645195 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:53.652935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:53.652935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:53.652935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:53.652935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:52:53.652935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:52:53.655364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'resume' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:53.656493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f745bc35-dc6e-463a-aa67-995a27e4da79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 144 microversion: 2.1 time: 0.104543 Aug 23 10:52:53.657409 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1938/3782] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:53 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 144 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:52:53.668150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.669123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.681466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.682711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.683626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.684905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.685577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.686215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.691545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.700561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67def61a-4204-45fb-b231-e3a2f88ea653 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.205139 Aug 23 10:52:53.701189 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1845/3783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.707998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.726728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.741486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.742271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.743343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.744979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.746068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.747712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.792025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.792594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.793180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.793678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid 7f8b647c-8ac8-4d88-ad72-8723d3537613 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:53.864088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.874812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07461fbf-c2dc-429d-bb77-6256514f10c0 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 200 len: 1306 microversion: 2.1 time: 0.211441 Aug 23 10:52:53.881246 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1939/3784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.926421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:53.935462 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08907504-d714-4143-9b89-1c82cbbcd73c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.233267 Aug 23 10:52:53.936040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1846/3785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:53.958797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:53.959660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:53.967854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.968533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.969255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:53.970211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:53.970987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:53.971857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.108136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:54.187883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:54.195756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4ed68b3-bc8d-4891-ad75-f655dddc362d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.240754 Aug 23 10:52:54.196329 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1940/3786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:53 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:54.313798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-050a7d31-6ef6-4997-a9ea-e8dc8f8d39e9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-050a7d31-6ef6-4997-a9ea-e8dc8f8d39e9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 160 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70891eb3-d931-4d2c-bee7-d99486f88b11"}]}} Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'networks': [{'uuid': '70891eb3-d931-4d2c-bee7-d99486f88b11'}]}}} Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi '' Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:52:54.317638 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-050a7d31-6ef6-4997-a9ea-e8dc8f8d39e9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-050a7d31-6ef6-4997-a9ea-e8dc8f8d39e9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010080 Aug 23 10:52:54.324291 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1847/3787] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:52:54 2022] POST /compute/v2.1/servers => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:52:54.328121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:54.328762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:54.335193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.335685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.336131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.336859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.337332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.338291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.490181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:54.501899 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d7c26d2-d881-441e-aec5-87ff23f716df tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.177402 Aug 23 10:52:54.502968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:54.503137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1941/3788] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:54 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:54.503888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:54.526917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.528106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.528911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.529963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.530674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.531286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.537708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:54.538329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:54.545249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.546052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.546505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.547227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.547696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.548131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.676641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:54.690485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dda608f-6840-432e-846c-3f0574899c06 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1272 microversion: 2.1 time: 0.192036 Aug 23 10:52:54.705661 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1848/3789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:54 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:54.712460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:54.714098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:54.716459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:54.722368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.723149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.723843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.724835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.725523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.726816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.751988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:54.767561 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8db2e4bc-8996-4e66-b11f-c02edca4a086 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.232362 Aug 23 10:52:54.768592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1942/3790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:54 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:54.779660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:54.781770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:54.797457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.809361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.811724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:54.812528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:54.815507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:54.816003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.046744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:55.057375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1fd6807-e6a2-43e1-acd4-c2cec2219f5e tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.350175 Aug 23 10:52:55.057971 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1849/3791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:54 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:55.069566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8de2d096-1f63-44f1-8744-13e5a3201199 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:55.069566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8de2d096-1f63-44f1-8744-13e5a3201199 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: af7fb042-7b34-4e6d-bd2f-4be915047cc6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.072072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8de2d096-1f63-44f1-8744-13e5a3201199 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance af7fb042-7b34-4e6d-bd2f-4be915047cc6 could not be found. Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8de2d096-1f63-44f1-8744-13e5a3201199 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/af7fb042-7b34-4e6d-bd2f-4be915047cc6/action HTTP/1.1 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 14 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: {"shelve": {}} Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance af7fb042-7b34-4e6d-bd2f-4be915047cc6 could not be found. Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'af7fb042-7b34-4e6d-bd2f-4be915047cc6', 'body': {'shelve': {}}} Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7fb042-7b34-4e6d-bd2f-4be915047cc6 could not be found. Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7fb042-7b34-4e6d-bd2f-4be915047cc6 could not be found. Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:55.076365 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7fb042-7b34-4e6d-bd2f-4be915047cc6 could not be found. Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8de2d096-1f63-44f1-8744-13e5a3201199 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance af7fb042-7b34-4e6d-bd2f-4be915047cc6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8de2d096-1f63-44f1-8744-13e5a3201199 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/af7fb042-7b34-4e6d-bd2f-4be915047cc6/action" status: 404 len: 111 microversion: 2.1 time: 0.018231 Aug 23 10:52:55.083192 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1850/3792] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:55 2022] POST /compute/v2.1/servers/af7fb042-7b34-4e6d-bd2f-4be915047cc6/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:55.084161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.085294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 7f8b647c-8ac8-4d88-ad72-8723d3537613] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.109406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.111222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.112528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.113534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.114134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.114584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.127225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:55.141151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c417f14-d011-4075-80c6-0a78676f9368 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.370566 Aug 23 10:52:55.142209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1943/3793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:54 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:55.149498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.151332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.154059 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 could not be found. Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 HTTP/1.1 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 could not be found. Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7f8b647c-8ac8-4d88-ad72-8723d3537613'} Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 could not be found. Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 could not be found. Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:52:55.158712 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 could not be found. Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance 7f8b647c-8ac8-4d88-ad72-8723d3537613 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:52:55.166496 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dfb829bd-7caa-4fbe-9e1f-500c2ed8034c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613" status: 404 len: 111 microversion: 2.1 time: 0.085078 Aug 23 10:52:55.170531 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1851/3794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:55 2022] GET /compute/v2.1/servers/7f8b647c-8ac8-4d88-ad72-8723d3537613 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:52:55.180219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.181147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.185925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.186477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.187020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.187711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.188432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.190269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.194494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.194974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.195592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.196313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.197018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.198102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.229320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:55.394115 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-47e877cf-f363-4e4c-8491-d96ae0e63d99 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 204 len: 0 microversion: 2.1 time: 0.220819 Aug 23 10:52:55.395630 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1852/3795] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:55 2022] DELETE /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:55.410602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.412241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.422313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.423824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.425003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.425913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.426130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:55.426727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.427533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.439003 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-976c7984-5be0-4d99-a309-4962d7053396 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.291625 Aug 23 10:52:55.439003 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1944/3796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:55 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:55.467503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.468290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.482922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:52:55.494995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.495677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.496665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.497439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.497966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.498412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.608031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-899f10e3-38f7-4baf-a4fc-0deeb4ce5d3c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 204 len: 0 microversion: 2.1 time: 0.207705 Aug 23 10:52:55.609031 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1853/3797] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:52:55 2022] DELETE /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:52:55.618713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.620548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.627889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.628460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.629011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.630258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.630932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.631586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.711658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:55.729008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-39af8251-f08b-479c-91cf-93e176fd6b04 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.271126 Aug 23 10:52:55.743436 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1945/3798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:55 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:55.753957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:55.754857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.763114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.763885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.764379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.765202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.765675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.766121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.841706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:55.850018 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5157ed92-fbba-47c6-96f2-7af1f82f3798 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1320 microversion: 2.1 time: 0.104481 Aug 23 10:52:55.851580 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1946/3799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:55 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1320 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:55.857090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:55.857862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:55.864247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.864772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.865251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.866956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:55.867431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:55.867864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:55.894694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lazy-loading 'flavor' on Instance uuid 057c7307-04cc-43f0-8c9d-1233486e4b9e {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:52:55.898432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:55.983188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:55.991844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70b7f76e-e679-4429-bf0c-4f74d020bd9a tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1473 microversion: 2.1 time: 0.378629 Aug 23 10:52:55.992422 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1854/3800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:55 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:56.080375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:56.081648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:56.090123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.092508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.093724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.096348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.097597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.099005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.148392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0527177-efe6-4da3-83e4-5f8055f031a4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.295498 Aug 23 10:52:56.149788 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1947/3801] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:52:55 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:52:56.163209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:56.164593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:56.179680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.180194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.180640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.182272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.182744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.183243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.295118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:56.307138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a416430-1d47-4921-9b24-37e21db4f7fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.231196 Aug 23 10:52:56.307961 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1855/3802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:56 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:56.321572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:56.322734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:56.329416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.329911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.330396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.331114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.331512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.331945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.340812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:56.350178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-382e9ef0-25b6-4444-9e6f-223c0bdd95be tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.195400 Aug 23 10:52:56.350847 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1948/3803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:56 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:56.473935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:56.481610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afde8bf4-1d2e-4294-af22-580c69106411 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.171544 Aug 23 10:52:56.482191 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1856/3804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:56 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:56.873858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:56.874637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:56.880840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.881580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.882611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.883698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:56.884348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:56.885530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:56.956482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:56.966997 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52238a2e-ba4d-40d6-a89b-dc8349e9d344 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1328 microversion: 2.1 time: 0.097795 Aug 23 10:52:56.967130 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1949/3805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:56 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:57.016099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:57.016981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:57.024404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.025030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.026223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.027155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.027630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.028225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.288905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:57.314391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f617100b-3bd0-42fb-97b8-ae2d48af79cc tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1473 microversion: 2.1 time: 0.301915 Aug 23 10:52:57.315711 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1857/3806] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:57 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:57.335700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:57.341549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:57.357498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.358236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.358771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.359569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.360079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.360678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.379111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:57.379737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:57.397306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.397827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.399855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.403666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.405051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.405694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.716493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:57.729260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2eec0290-635c-4c82-94ba-2c8f94c558fe tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.361290 Aug 23 10:52:57.740686 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1858/3807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:57 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:57.758230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:57.760149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:57.769314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.775652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.777211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.779047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:57.779862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:57.780963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:57.940352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:57.953631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24273a58-eb69-4619-bb85-f1f474b40143 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.626794 Aug 23 10:52:57.962202 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1950/3808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:57 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:58.121362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:58.131052 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-382e2464-9e09-4f7d-849f-a094278dd289 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.384028 Aug 23 10:52:58.135904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1859/3809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:57 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:58.141829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:58.143905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:58.167344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.171539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.172996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.174852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.176047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.185350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.216054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-70157479-6332-47f4-b386-577e09bb1191 req-255f7591-fb40-4830-89db-014361cfc927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5213bf0f-b9d3-4cd8-88e4-530a4f430820", "name": "network-vif-plugged", "status": "completed", "tag": "5dc6fa06-4536-42d8-9b80-4893f6db4973"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:58.242860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-70157479-6332-47f4-b386-577e09bb1191 req-255f7591-fb40-4830-89db-014361cfc927 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.243380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-70157479-6332-47f4-b386-577e09bb1191 req-255f7591-fb40-4830-89db-014361cfc927 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.244501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-70157479-6332-47f4-b386-577e09bb1191 req-255f7591-fb40-4830-89db-014361cfc927 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.259343 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-70157479-6332-47f4-b386-577e09bb1191 req-255f7591-fb40-4830-89db-014361cfc927 service nova] Creating event network-vif-plugged:5dc6fa06-4536-42d8-9b80-4893f6db4973 for instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 on n-h2-847009-13 Aug 23 10:52:58.266706 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-70157479-6332-47f4-b386-577e09bb1191 req-255f7591-fb40-4830-89db-014361cfc927 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302291 Aug 23 10:52:58.268242 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1951/3810] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:58.287247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:58.303841 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ed1dfaa-f83d-4424-b35c-e40e927e9bd5 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1326 microversion: 2.1 time: 0.165294 Aug 23 10:52:58.316632 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1860/3811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:58 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:58.355333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:58.356055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:58.380001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.381092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.381783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.382740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.383387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.384001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.756558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:58.757210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:58.765171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.765680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.766164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.766889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:58.767357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:58.767797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:58.772335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:52:59.039564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:59.051242 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-368f1954-29fa-4050-8903-5a8f86a9325c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.297848 Aug 23 10:52:59.053485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1861/3812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:58 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:59.055090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:59.060389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:59.061379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:59.070060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.071003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.071399 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a623b7d7-bf4d-43e6-a95c-bc35a43cf86d tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1473 microversion: 2.1 time: 0.730196 Aug 23 10:52:59.071986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.077259 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1952/3813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:58 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1473 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:59.081267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.081948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.082918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.157837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:59.158831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:59.165422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.166434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.167101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.168117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.168615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.169137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.335835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:59.351531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de6262ab-dfa6-4753-b156-9fcb522b4c81 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.296646 Aug 23 10:52:59.352303 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1862/3814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:59 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:52:59.375581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:52:59.377013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:52:59.384171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.386186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.387383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.388309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.389509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.390140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.629240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:59.642666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54b4ee0d-0042-492b-8aac-f171dffd7a2f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.489591 Aug 23 10:52:59.646851 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1953/3815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:59 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:52:59.723447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ed55b67e-5c33-4a20-8c93-daf3a5149be3 req-942eebc9-174e-4616-934b-110781a00d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bd0133b-7a00-487c-9ea4-77c3d3a4771e", "name": "network-vif-deleted", "tag": "7d70e389-7680-4da2-9e6e-41d17c1ecd30"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:52:59.744702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed55b67e-5c33-4a20-8c93-daf3a5149be3 req-942eebc9-174e-4616-934b-110781a00d7a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:52:59.747202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed55b67e-5c33-4a20-8c93-daf3a5149be3 req-942eebc9-174e-4616-934b-110781a00d7a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:52:59.748673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed55b67e-5c33-4a20-8c93-daf3a5149be3 req-942eebc9-174e-4616-934b-110781a00d7a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:52:59.792390 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ed55b67e-5c33-4a20-8c93-daf3a5149be3 req-942eebc9-174e-4616-934b-110781a00d7a service nova] Creating event network-vif-deleted:7d70e389-7680-4da2-9e6e-41d17c1ecd30 for instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e on n-h1-847009-13 Aug 23 10:52:59.799731 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ed55b67e-5c33-4a20-8c93-daf3a5149be3 req-942eebc9-174e-4616-934b-110781a00d7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080938 Aug 23 10:52:59.801136 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1954/3816] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:52:59.852330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:52:59.862013 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b24319fd-c4ed-4620-ad12-8385dc7ff5d9 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.494470 Aug 23 10:52:59.864600 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1863/3817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:52:59 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:00.080951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:00.081838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:00.094397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:00.095261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:00.106693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.108729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.111495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.112720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.114018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.116600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.117011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.117649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.118340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.119872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.123713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.125325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.201245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.202639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.203945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.205218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid 2bd0133b-7a00-487c-9ea4-77c3d3a4771e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:00.402087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:00.413424 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff78efda-6460-4c9c-b209-963ee79634a7 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 200 len: 1309 microversion: 2.1 time: 0.323227 Aug 23 10:53:00.414547 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1864/3818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:00 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 1309 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:00.420667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ab4efb3d-2f3c-4d3d-94c4-58bbabf98946 req-5aecf9ee-e14c-4f9f-a258-2c29c75b0532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b", "tag": "5af23ff6-6fbd-44a8-b25f-f286912be0b2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:00.430882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab4efb3d-2f3c-4d3d-94c4-58bbabf98946 req-5aecf9ee-e14c-4f9f-a258-2c29c75b0532 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.431675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab4efb3d-2f3c-4d3d-94c4-58bbabf98946 req-5aecf9ee-e14c-4f9f-a258-2c29c75b0532 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.432297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab4efb3d-2f3c-4d3d-94c4-58bbabf98946 req-5aecf9ee-e14c-4f9f-a258-2c29c75b0532 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.447519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ab4efb3d-2f3c-4d3d-94c4-58bbabf98946 req-5aecf9ee-e14c-4f9f-a258-2c29c75b0532 service nova] Creating event network-changed:5af23ff6-6fbd-44a8-b25f-f286912be0b2 for instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b on n-h2-847009-13 Aug 23 10:53:00.456633 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ab4efb3d-2f3c-4d3d-94c4-58bbabf98946 req-5aecf9ee-e14c-4f9f-a258-2c29c75b0532 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040427 Aug 23 10:53:00.458312 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1865/3819] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:00.469816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69836824-35ef-49e2-9b18-8ea94744cc8e", "name": "network-vif-plugged", "status": "completed", "tag": "149d5707-d13d-45d7-b809-ba896ae8aaf7"}, {"server_uuid": "aaa94ba5-70c5-4ab2-af55-5704a28c7527", "name": "network-vif-plugged", "status": "completed", "tag": "eac5f959-8938-4b8f-b84f-3963d2b9c619"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:00.487863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.488661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.489765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.491885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:00.503554 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ecb892ad-6418-4bda-817e-8d2f8dec80bb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.428821 Aug 23 10:53:00.504733 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1955/3820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:00 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:00.513126 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] Creating event network-vif-plugged:149d5707-d13d-45d7-b809-ba896ae8aaf7 for instance 69836824-35ef-49e2-9b18-8ea94744cc8e on n-h1-847009-13 Aug 23 10:53:00.514620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] Creating event network-vif-plugged:eac5f959-8938-4b8f-b84f-3963d2b9c619 for instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 on n-h2-847009-13 Aug 23 10:53:00.521947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:00.522814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:00.527213 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a883f6c8-8a25-40f8-a7ab-b18116928763 req-a2e12cdf-049a-4d76-a3d5-d39414f1529c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064395 Aug 23 10:53:00.529621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1866/3821] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:00.531002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.531550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.532169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.533721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.534183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.535405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.673439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:00.674901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:00.694203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.697621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.698176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.699154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.700401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.700939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.815540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:00.828168 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-481560d1-eb01-44ec-9f26-4176ee36ee30 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1314 microversion: 2.1 time: 0.322054 Aug 23 10:53:00.829456 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1956/3822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:00 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:00.885974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:00.889485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:00.901046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:00.921447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.922632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.923318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:00.924074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:00.924538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:00.927816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.282385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:01.284715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:01.293658 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8277029-01a6-4aba-b4ef-39b53febe798 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.629696 Aug 23 10:53:01.294711 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1867/3823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:00 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:01.296790 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9d520c84-92e9-49c3-801c-85d99e08cc34 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.415229 Aug 23 10:53:01.298289 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1957/3824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:00 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:01.437504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:01.438385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 2bd0133b-7a00-487c-9ea4-77c3d3a4771e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:01.445420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.446120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.446680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.447791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.448202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.448673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.464695 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e could not be found. Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e HTTP/1.1 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e could not be found. Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '2bd0133b-7a00-487c-9ea4-77c3d3a4771e'} Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e could not be found. Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e could not be found. Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:01.466574 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e could not be found. Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance 2bd0133b-7a00-487c-9ea4-77c3d3a4771e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b07fbe5-59fc-427b-aeff-5045c5732960 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e" status: 404 len: 111 microversion: 2.1 time: 0.035287 Aug 23 10:53:01.472233 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1868/3825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:01 2022] GET /compute/v2.1/servers/2bd0133b-7a00-487c-9ea4-77c3d3a4771e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:53:01.477765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:01.478908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:01.487945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.488714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.489492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.490427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.491324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.491792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.525940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:01.526600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:01.533156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.533555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.533694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.534059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.534344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.535092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.535461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.535664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:01.536954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.537395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.602825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:01.625285 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9ebd9b2-ba79-4e42-a8e2-4eb8b0b39ad3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 200 len: 1309 microversion: 2.1 time: 0.151655 Aug 23 10:53:01.626230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1958/3826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:01 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 1309 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:01.738642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:01.748509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64d0e50b-f450-4653-9937-31bbbf776ff5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.226866 Aug 23 10:53:01.749435 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1869/3827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:01 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:01.850698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6887743e-5ad9-4c6f-ab1b-71988844ef02 req-f80f6fcd-ce45-4df2-a9f2-48993027c03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd9db75-5081-47ca-9f3e-d73cdcfe1acd", "name": "network-vif-deleted", "tag": "7d355080-2421-4394-93ef-99cf1fc6045f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:01.851291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:01.851626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:01.861092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.861980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.862702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.863848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.864551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.865171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.872382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6887743e-5ad9-4c6f-ab1b-71988844ef02 req-f80f6fcd-ce45-4df2-a9f2-48993027c03e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:01.873566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6887743e-5ad9-4c6f-ab1b-71988844ef02 req-f80f6fcd-ce45-4df2-a9f2-48993027c03e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:01.874309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6887743e-5ad9-4c6f-ab1b-71988844ef02 req-f80f6fcd-ce45-4df2-a9f2-48993027c03e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:01.890493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6887743e-5ad9-4c6f-ab1b-71988844ef02 req-f80f6fcd-ce45-4df2-a9f2-48993027c03e service nova] Creating event network-vif-deleted:7d355080-2421-4394-93ef-99cf1fc6045f for instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd on n-h2-847009-13 Aug 23 10:53:01.895919 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6887743e-5ad9-4c6f-ab1b-71988844ef02 req-f80f6fcd-ce45-4df2-a9f2-48993027c03e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052397 Aug 23 10:53:01.897245 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1959/3828] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:02.152592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:02.165402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c108084-aeec-41ec-8ea9-f68f93f55d7d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1500 microversion: 2.1 time: 0.318704 Aug 23 10:53:02.166176 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1870/3829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:01 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1500 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:02.188208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:02.189174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.196195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.197374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.198222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.198997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.199502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.200009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.228664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'flavor' on Instance uuid 5213bf0f-b9d3-4cd8-88e4-530a4f430820 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:02.319124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.320436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.330751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.331977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.332690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.335148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.335964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.336730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.434554 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38ddbb7b-83b8-4c7e-ba43-248cda3e31be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820/action" status: 202 len: 0 microversion: 2.1 time: 0.250892 Aug 23 10:53:02.435884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1960/3830] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:02 2022] POST /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:53:02.443289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.444122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.453646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.454522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.455541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.456704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.457452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.458273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.591916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:02.607560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8042adba-7d38-412a-952f-a0d9850c3d84 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1321 microversion: 2.1 time: 0.293683 Aug 23 10:53:02.608152 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1871/3831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:02 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:02.623433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.624055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.631778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.632400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.632932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.633648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.634111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.635338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.747714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:02.758371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7cddbd2b-1c26-4d05-a385-8ce77df0ce7f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.320019 Aug 23 10:53:02.761190 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1961/3832] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:02 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:02.766470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.767416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.773706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.774343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.774970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.776593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.777227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.777749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.784676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:02.797217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd could not be found. Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd HTTP/1.1 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd could not be found. Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5fd9db75-5081-47ca-9f3e-d73cdcfe1acd'} Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd could not be found. Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd could not be found. Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:02.799020 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd could not be found. Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance 5fd9db75-5081-47ca-9f3e-d73cdcfe1acd could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:02.804350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68579487-3de7-435f-bb01-3ec2d97dbada tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd" status: 404 len: 111 microversion: 2.1 time: 0.039072 Aug 23 10:53:02.806158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1962/3833] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:02 2022] GET /compute/v2.1/servers/5fd9db75-5081-47ca-9f3e-d73cdcfe1acd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:53:02.811039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.811893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.819236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.820001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.820449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.821631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.821631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.823128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.846285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:02.858651 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e115af5-f596-4d37-90ca-b272a21575b9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.249154 Aug 23 10:53:02.874653 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1872/3834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:02 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:02.880151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee491f9e-fcba-4189-aaa9-817a66c5e3fd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.924260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee491f9e-fcba-4189-aaa9-817a66c5e3fd tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/c735150d-f266-4cf7-b2de-0084fdaf3da2" status: 204 len: 0 microversion: 2.1 time: 0.046686 Aug 23 10:53:02.927399 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1873/3835] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:53:02 2022] DELETE /compute/v2.1/os-server-groups/c735150d-f266-4cf7-b2de-0084fdaf3da2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:53:02.935267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:02.936850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:02.947197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.948712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.949398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.950291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:02.951915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:02.953070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:02.982635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:02.996916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:53:03.035870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:03.047346 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1693d270-3c95-4983-a767-950544b178aa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.240738 Aug 23 10:53:03.048296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1963/3836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:02 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:03.102120 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d76f2842-a7f9-45df-b7d5-a07e755f03ac tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 204 len: 0 microversion: 2.1 time: 0.171024 Aug 23 10:53:03.102776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1874/3837] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:53:02 2022] DELETE /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:53:03.111325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:03.111818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:03.118030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.118516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.119510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.120222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.120683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.121153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.148355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:53:03.235556 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c76c7330-9070-4e53-90de-56359a5647fa tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 204 len: 0 microversion: 2.1 time: 0.127780 Aug 23 10:53:03.236144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1964/3838] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:53:03 2022] DELETE /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:53:03.245866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:03.246587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:03.253657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.254097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.254529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.255314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.255671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.256319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.396871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:03.407422 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c45e37d-01ab-4cb6-a1fc-4b049503c051 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1474 microversion: 2.1 time: 0.167080 Aug 23 10:53:03.412789 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1875/3839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:03 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1474 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:03.631101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:03.631804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:03.640191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.640714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.641223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.641969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.642435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.642867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.781753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:03.782607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:03.785373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=32 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:03.790000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.790495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.791101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.791913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.792449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.792900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.830190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:03.850438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59c7142c-9ce1-4cf0-9562-c42f176758a7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1515 microversion: 2.1 time: 0.222997 Aug 23 10:53:03.850438 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1965/3840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:03 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:03.873226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:03.877098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:03.883637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.884172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.885887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.886615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.887086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.887527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.915371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lazy-loading 'flavor' on Instance uuid aaa94ba5-70c5-4ab2-af55-5704a28c7527 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:03.951173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:03.960296 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba92a380-5a6c-405f-b80a-2ae53faa440f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.182441 Aug 23 10:53:03.964920 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1876/3841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:03 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:03.969211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:03.970003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:03.977047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.977859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.979033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:03.979883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:03.980575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:03.981084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.011499 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cca15a41-99e7-449d-ac3f-7b15861111a6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action" status: 200 len: 32 microversion: 2.1 time: 0.143689 Aug 23 10:53:04.017200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1966/3842] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:03 2022] POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:53:04.023242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:04.024328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:04.031932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.032571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.033170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.033988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.034530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.035160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.140917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:04.149261 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-155ea52c-384b-41b1-9196-849137a87e19 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.186876 Aug 23 10:53:04.150696 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1877/3843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:03 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:04.155433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:04.156163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:04.162090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.162689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.163231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.164028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.164591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.165162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.197556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:04.206829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b239b695-89a4-480f-946b-ba6bfa0e8ee6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.188301 Aug 23 10:53:04.207539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1967/3844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:04 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:04.316596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:04.320390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:04.327131 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96819d37-b43b-4866-aadc-d7de4503f97b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.175452 Aug 23 10:53:04.327815 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1878/3845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:04 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:04.429286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:04.430062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:04.438752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.439485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.439925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.441478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.441478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.447617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.591545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:04.599943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92dbc072-06ae-47f7-ba1b-11613d195ec6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1474 microversion: 2.1 time: 0.174398 Aug 23 10:53:04.600518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1968/3846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:04 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:04.985216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:04.986074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:04.993152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.994330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.994842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:04.995639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:04.996101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:04.996536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.135626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:05.143328 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d0d9384-2eeb-402b-ad22-51859ac42ee6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.162995 Aug 23 10:53:05.143899 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1879/3847] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:04 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:05.171471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:05.172092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:05.179485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.180522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.181030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.183121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.183640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.184086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.228868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:05.229779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:05.236512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.237113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.237726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.238475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.238968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.239394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.332498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:05.342980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac3988f5-78ae-4790-a703-c65a65f23f50 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.175324 Aug 23 10:53:05.343880 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1969/3848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:05 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:05.360769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:05.361387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:05.370604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.371201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.371779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.372606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.373221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.373700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.529883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:05.538967 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0ec67b95-800e-4d37-9240-feb63a9c10c0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.193611 Aug 23 10:53:05.546341 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1970/3849] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:05 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:05.623579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:05.624525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:05.631576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.632177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.632633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.633481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:05.634827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:05.635364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:05.724710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:05.737319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5343f791-9bf2-4e20-b33e-aa6ece8b8589 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.513635 Aug 23 10:53:05.741193 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1880/3850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:05 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:05.792879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:05.800667 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8bfc48e5-8533-4275-bbd9-a0dea2b086a9 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1474 microversion: 2.1 time: 0.182146 Aug 23 10:53:05.801363 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1971/3851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:05 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1474 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:06.164400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:06.164993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:06.174092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.174897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.175548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.176593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.177634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.178631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.353288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:06.367204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:06.367829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:06.368041 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87c2ed9e-35f6-4522-a257-57e4d2f5c215 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.207702 Aug 23 10:53:06.369170 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1881/3852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:06 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:06.389538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.391653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.392111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.392915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.393342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.393775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.536781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:06.545586 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de75538b-509a-49dc-96f1-8ce4928a85f9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.183885 Aug 23 10:53:06.546166 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1972/3853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:06 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:06.560299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:06.561330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:06.567560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.568136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.570177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.571265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.572996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.573438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.745166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:06.752841 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34d9df2f-f645-4be7-9e44-fabbee28bba0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.197140 Aug 23 10:53:06.753510 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1882/3854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:06 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:06.759904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:06.760605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:06.766842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.767336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.767784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.768494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.769000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.769438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.823486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:06.824118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:06.831113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.831610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.832048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.832764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:06.833239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:06.833660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:06.918625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:06.927090 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4f536c4-d4ad-4b8b-b700-1f6ecebe7f46 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.171451 Aug 23 10:53:06.927682 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1973/3855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:06 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:06.979062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:06.986915 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30761f9a-12ee-4cdc-86dc-11cb9c1b8d95 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1474 microversion: 2.1 time: 0.168406 Aug 23 10:53:06.987539 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1883/3856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:06 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1474 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:07.390200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:07.390735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:07.397552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.398037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.398474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.399194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.400354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.401035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.541848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:07.549741 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46c2ddfd-0fcd-4347-9331-6d573bfc54fc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.163591 Aug 23 10:53:07.550319 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1974/3857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:07 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:07.566309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:07.567013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:07.574491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.574984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.575427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.576127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.576788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.577224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.723559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:07.731829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5798ba79-99f2-4700-b81e-43ce85b82903 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.169276 Aug 23 10:53:07.732338 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1884/3858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:07 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:07.775705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:07.776877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:07.783214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.783770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.784308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.785108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.785638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.786125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.929725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:07.933116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:07.940522 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8264757-9276-4414-bae5-96e82b99db73 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.170081 Aug 23 10:53:07.941152 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1975/3859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:07 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:07.949693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:07.950638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:07.957738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.958227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.958666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:07.959364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:07.959822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:07.960246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.010665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:08.011472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:08.019635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.020304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.021029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.021830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.022509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.023011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.111475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:08.121122 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edd01f1a-d0ab-41c2-8a92-c9fdd1285b75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.176054 Aug 23 10:53:08.122280 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1885/3860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:07 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:08.171493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:08.179581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-014afec0-145e-45c5-8109-4c823a703068 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1474 microversion: 2.1 time: 0.174911 Aug 23 10:53:08.180801 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1976/3861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:08 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:08.314204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-80bcdd81-4823-4cec-ad1a-ed9d95770d31 req-17672e4d-589c-4184-a46e-f70d34526010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b", "name": "network-vif-plugged", "status": "completed", "tag": "5af23ff6-6fbd-44a8-b25f-f286912be0b2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:08.320498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:08.326253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-80bcdd81-4823-4cec-ad1a-ed9d95770d31 req-17672e4d-589c-4184-a46e-f70d34526010 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.326861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-80bcdd81-4823-4cec-ad1a-ed9d95770d31 req-17672e4d-589c-4184-a46e-f70d34526010 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.327387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-80bcdd81-4823-4cec-ad1a-ed9d95770d31 req-17672e4d-589c-4184-a46e-f70d34526010 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.342368 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-80bcdd81-4823-4cec-ad1a-ed9d95770d31 req-17672e4d-589c-4184-a46e-f70d34526010 service nova] Creating event network-vif-plugged:5af23ff6-6fbd-44a8-b25f-f286912be0b2 for instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b on n-h2-847009-13 Aug 23 10:53:08.347557 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-80bcdd81-4823-4cec-ad1a-ed9d95770d31 req-17672e4d-589c-4184-a46e-f70d34526010 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037131 Aug 23 10:53:08.348392 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1886/3862] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:08.569844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:08.570475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:08.578490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.578864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.579317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.580034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.580503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.580968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.730639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:08.738744 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f381dcc1-c24e-451c-a75b-676b371df5af tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.172892 Aug 23 10:53:08.739652 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1977/3863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:08 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:08.754728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:08.755489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:08.762320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.762804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.763248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.763946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.764410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.764897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.962598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:08.963527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:08.973038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.973580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.974229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:08.975151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:08.975791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:08.976402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:09.001843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:09.017927 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f9633c2-2716-4d07-a8b3-9c11cbe39847 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.268183 Aug 23 10:53:09.018844 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1887/3864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:08 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:09.120242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:09.128561 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e9df65d-92e7-4471-9a15-e702e3d47067 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.169910 Aug 23 10:53:09.129365 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1978/3865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:08 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:09.145469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:09.146087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:09.152868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:09.153371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:09.153817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:09.154547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:09.155015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:09.155633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:09.202114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:09.203150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:09.214914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:09.214914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:09.217114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:09.223737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:09.224313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:09.224852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:09.621114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:09.638612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5bef55b7-6d5e-469f-942b-c6d9e246ba51 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1474 microversion: 2.1 time: 0.440317 Aug 23 10:53:09.640215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1979/3866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:09 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1474 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:09.671758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:09.710590 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14bc0e87-33ce-48c6-aae2-19447a7092f0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.570649 Aug 23 10:53:09.714643 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1888/3867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:09 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:09.761145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:09.762394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:09.769869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:09.770716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:09.772092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:09.773464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:09.774311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:09.775706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.041244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:10.041899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:10.053874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:10.069614 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2af9472b-cc44-48aa-85ae-a1f9aab65a7a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.313585 Aug 23 10:53:10.070230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1980/3868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:09 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:10.086417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.089323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.090268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.095198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.098200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.098721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.148947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:10.151013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:10.163610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.164405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.165051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.166564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.167193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.168606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.401302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:10.413016 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4630ccf4-3316-4d9d-a802-d2d3633978a6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.377885 Aug 23 10:53:10.413603 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1889/3869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:10 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:10.605213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5e8224c6-fc1c-4110-94aa-ed1d314060bf req-cbdc58ed-e16a-4123-91e7-f2984d0a6b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f2b476b-849f-46ab-bc9a-78df551c80fc", "name": "network-vif-deleted", "tag": "5ddc0565-0b27-457a-a0ba-1bfc35e5cd34"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:10.626697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e8224c6-fc1c-4110-94aa-ed1d314060bf req-cbdc58ed-e16a-4123-91e7-f2984d0a6b82 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.627444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e8224c6-fc1c-4110-94aa-ed1d314060bf req-cbdc58ed-e16a-4123-91e7-f2984d0a6b82 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.628074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5e8224c6-fc1c-4110-94aa-ed1d314060bf req-cbdc58ed-e16a-4123-91e7-f2984d0a6b82 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.640534 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5e8224c6-fc1c-4110-94aa-ed1d314060bf req-cbdc58ed-e16a-4123-91e7-f2984d0a6b82 service nova] Creating event network-vif-deleted:5ddc0565-0b27-457a-a0ba-1bfc35e5cd34 for instance 9f2b476b-849f-46ab-bc9a-78df551c80fc on n-h2-847009-13 Aug 23 10:53:10.647494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5e8224c6-fc1c-4110-94aa-ed1d314060bf req-cbdc58ed-e16a-4123-91e7-f2984d0a6b82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232189 Aug 23 10:53:10.653329 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1890/3870] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:10.679334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:10.682270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:10.705278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.706395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.707095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.708175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.708914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.709622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.837765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:10.849722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-137401c6-a7ca-4362-9027-b588d4f1e543 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1432 microversion: 2.1 time: 0.189623 Aug 23 10:53:10.850639 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1891/3871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:10 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1432 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:10.856089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:10.857028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:10.864142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.864989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.865611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:10.866572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:10.867031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:10.867456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.141177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:11.154232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c68eac12-adbb-4d17-818a-ff06d7ab2439 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.302349 Aug 23 10:53:11.155363 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1892/3872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:10 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:11.160684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:11.161911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:11.170590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.171753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.172370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.173454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.174102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.174798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.370021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:11.394100 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4a6afad-9676-48a6-8181-a1b93a181636 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1394 microversion: 2.1 time: 0.235520 Aug 23 10:53:11.396890 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1893/3873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:11 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1394 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:11.426856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0c3733ec-e7fe-450a-b32d-495ca29e2cec req-537603e6-0bb9-47b0-978c-83ef9e16fd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7b1c36-2332-4704-9e10-abe75922884c", "name": "network-vif-deleted", "tag": "c711af0e-e47e-47db-b55d-ac9c9f211c42"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:11.452545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c3733ec-e7fe-450a-b32d-495ca29e2cec req-537603e6-0bb9-47b0-978c-83ef9e16fd22 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.453429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c3733ec-e7fe-450a-b32d-495ca29e2cec req-537603e6-0bb9-47b0-978c-83ef9e16fd22 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.454119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c3733ec-e7fe-450a-b32d-495ca29e2cec req-537603e6-0bb9-47b0-978c-83ef9e16fd22 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.472896 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0c3733ec-e7fe-450a-b32d-495ca29e2cec req-537603e6-0bb9-47b0-978c-83ef9e16fd22 service nova] Creating event network-vif-deleted:c711af0e-e47e-47db-b55d-ac9c9f211c42 for instance fe7b1c36-2332-4704-9e10-abe75922884c on n-h2-847009-13 Aug 23 10:53:11.476081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:11.481520 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0c3733ec-e7fe-450a-b32d-495ca29e2cec req-537603e6-0bb9-47b0-978c-83ef9e16fd22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065576 Aug 23 10:53:11.483032 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1894/3874] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:11.489069 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1270901b-ea81-4101-8061-34c88c36b574 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 1.343910 Aug 23 10:53:11.489668 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1981/3875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:10 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:11.492560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:11.494891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:11.502920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.506549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.507252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.508203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.511271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.511922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.746526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:11.755393 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e16800bf-e545-4e1e-8f5c-d91a88a12278 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.270608 Aug 23 10:53:11.756111 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1895/3876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:11 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:11.873522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:11.874455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:11.881541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.882034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.882460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.883490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.884477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.885763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.921050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:11.921580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:11.921978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:11.922525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid fe7b1c36-2332-4704-9e10-abe75922884c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:11.993516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:12.003086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-532086fe-4365-4179-a178-01ea773e6ae1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1308 microversion: 2.1 time: 0.133678 Aug 23 10:53:12.014635 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1982/3877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:11 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:12.183218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:12.183902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:12.190931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.191411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.191932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.192653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.193318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.193918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.347390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:12.357380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5729e131-37fe-4edd-8b4d-470d5efae040 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.180197 Aug 23 10:53:12.358016 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1896/3878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:12 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:12.416131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:12.416856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:12.423652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.424242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.424808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.425691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.426312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.426803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.511720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:12.512511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:12.527313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.528280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.530591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.532037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.533398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.537633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.607805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:12.687241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:12.697011 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8dce1bff-0246-4538-a81f-77f2bbb4f407 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1575 microversion: 2.1 time: 0.284724 Aug 23 10:53:12.698441 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1983/3879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:12 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1575 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:12.720419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:12.721700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:12.738230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.741226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.741838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.743146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.744933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.745414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.809030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:12.818879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6897e93d-5750-4c63-a577-a3982fe164ea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.312015 Aug 23 10:53:12.819677 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1897/3880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:12 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:12.827061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:12.828093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:12.835956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.836964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.837789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.838689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:12.839483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:12.840106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:12.861579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26e3dd54-5e68-4351-8aa9-9d8866465b7c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145512 Aug 23 10:53:12.862907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1984/3881] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:53:12 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:53:13.031794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:13.032824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:13.049303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.049594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:13.052322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.053258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:13.057552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.058308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.059008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:13.061706 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e07cb16-13f3-4fce-bf06-6fbbb9971297 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.240556 Aug 23 10:53:13.062588 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1898/3882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:12 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:13.118688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.119552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.121204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:13.122070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid fe7b1c36-2332-4704-9e10-abe75922884c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:13.250643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:13.263443 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7297da9-e39d-4d35-ab91-d3d908db9fe6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 200 len: 1308 microversion: 2.1 time: 0.239417 Aug 23 10:53:13.264793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1985/3883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:13 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:13.380442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:13.381162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:13.392547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.393232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.394060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:13.394785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.395280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.395719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:13.573794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:13.582431 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b3bc7b3-611a-4fc5-aab7-0e40dcfdcdef tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.205855 Aug 23 10:53:13.592891 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1899/3884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:13 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:13.840659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:13.841592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:13.849200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.849947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.850376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:13.851418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:13.851884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:13.852311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.083920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.086948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.099581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.101061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.104251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.105584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.106325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.107191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.148254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:14.181603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ed170764-2c00-4ef8-8a56-638c311fbcfb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1533 microversion: 2.1 time: 0.343659 Aug 23 10:53:14.193308 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1986/3885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:13 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1533 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:14.271249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:14.287179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.288073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: fe7b1c36-2332-4704-9e10-abe75922884c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.304933 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89a5a863-d804-4483-9830-44e822f949c8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.224940 Aug 23 10:53:14.311391 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1900/3886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:14 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:14.312776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.313536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.314169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.315233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.316030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.316707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.336175 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance fe7b1c36-2332-4704-9e10-abe75922884c could not be found. Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c HTTP/1.1 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fe7b1c36-2332-4704-9e10-abe75922884c could not be found. Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fe7b1c36-2332-4704-9e10-abe75922884c'} Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7b1c36-2332-4704-9e10-abe75922884c could not be found. Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7b1c36-2332-4704-9e10-abe75922884c could not be found. Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:14.338437 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7b1c36-2332-4704-9e10-abe75922884c could not be found. Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance fe7b1c36-2332-4704-9e10-abe75922884c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:14.344098 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db90dc86-f846-4d8b-9c6f-e5c00174c388 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c" status: 404 len: 111 microversion: 2.1 time: 0.058079 Aug 23 10:53:14.350521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.351141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: 9f2b476b-849f-46ab-bc9a-78df551c80fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.354887 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1987/3887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:14 2022] GET /compute/v2.1/servers/fe7b1c36-2332-4704-9e10-abe75922884c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:53:14.357990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.358483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.359220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.359934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.360392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.360905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.382212 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance 9f2b476b-849f-46ab-bc9a-78df551c80fc could not be found. Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc HTTP/1.1 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9f2b476b-849f-46ab-bc9a-78df551c80fc could not be found. Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9f2b476b-849f-46ab-bc9a-78df551c80fc'} Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f2b476b-849f-46ab-bc9a-78df551c80fc could not be found. Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f2b476b-849f-46ab-bc9a-78df551c80fc could not be found. Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:14.385299 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f2b476b-849f-46ab-bc9a-78df551c80fc could not be found. Aug 23 10:53:14.391550 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:14.394163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance 9f2b476b-849f-46ab-bc9a-78df551c80fc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:14.395219 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a74e675-c888-46fb-b13a-42d7fdaed94e tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc" status: 404 len: 111 microversion: 2.1 time: 0.050374 Aug 23 10:53:14.396294 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1901/3888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:14 2022] GET /compute/v2.1/servers/9f2b476b-849f-46ab-bc9a-78df551c80fc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:53:14.406418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a650442-4bf7-4c5a-8535-64f58554e5f6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.444245 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a650442-4bf7-4c5a-8535-64f58554e5f6 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/a0c9895c-1c7c-41aa-ad89-4eca55effd24" status: 204 len: 0 microversion: 2.1 time: 0.042072 Aug 23 10:53:14.444995 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1988/3889] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:53:14 2022] DELETE /compute/v2.1/os-server-groups/a0c9895c-1c7c-41aa-ad89-4eca55effd24 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:53:14.453578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.454472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.461790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.463446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.464505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.465710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.466234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.466741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.499370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:53:14.606924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.609640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.617645 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f7a61d5-75d0-40ba-b1da-2889cb1b0969 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 204 len: 0 microversion: 2.1 time: 0.167727 Aug 23 10:53:14.618188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.622173 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1902/3890] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:53:14 2022] DELETE /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:53:14.623398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.624235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.625462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.626560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.627473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.627897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.628621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.642846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.643461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.643925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.644673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.645179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.646511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.810528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:14.813378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:14.818919 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54f09f40-8bce-4db0-902d-d7d7423585e3 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1472 microversion: 2.1 time: 0.195365 Aug 23 10:53:14.820161 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1903/3891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:14 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:14.826049 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a81d91e4-d188-40e2-997e-642d497f2c92 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.224786 Aug 23 10:53:14.827727 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1989/3892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:14 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:14.836722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:14.837609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:14.848372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.849321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.850122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.851144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.851819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.852429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.852575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1f34b5a0-2526-4b19-b51a-1f9bf5d0e337 req-62c32b28-28c7-4cfe-aa04-8b418e78786e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b", "tag": "5af23ff6-6fbd-44a8-b25f-f286912be0b2"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:14.870754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1f34b5a0-2526-4b19-b51a-1f9bf5d0e337 req-62c32b28-28c7-4cfe-aa04-8b418e78786e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:14.871357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1f34b5a0-2526-4b19-b51a-1f9bf5d0e337 req-62c32b28-28c7-4cfe-aa04-8b418e78786e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:14.871841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1f34b5a0-2526-4b19-b51a-1f9bf5d0e337 req-62c32b28-28c7-4cfe-aa04-8b418e78786e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:14.889415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1f34b5a0-2526-4b19-b51a-1f9bf5d0e337 req-62c32b28-28c7-4cfe-aa04-8b418e78786e service nova] Creating event network-changed:5af23ff6-6fbd-44a8-b25f-f286912be0b2 for instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b on n-h2-847009-13 Aug 23 10:53:14.894368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1f34b5a0-2526-4b19-b51a-1f9bf5d0e337 req-62c32b28-28c7-4cfe-aa04-8b418e78786e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063601 Aug 23 10:53:14.895454 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1990/3893] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:15.024486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:15.035312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b717e2be-2609-4269-82a2-359847efa605 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1575 microversion: 2.1 time: 0.213802 Aug 23 10:53:15.036498 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1904/3894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:14 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:15.205648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:15.206371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:15.213774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.214536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.215156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.216151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.216816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.217407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.331979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:15.331979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:15.338938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.339438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.339887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.340781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.341089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.341520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.443519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:15.459589 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-70b4ab3c-1f1b-4599-96a9-cb4b083646c1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1533 microversion: 2.1 time: 0.257209 Aug 23 10:53:15.461495 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1991/3895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:15 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:15.536224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:15.545303 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c8f2c9e-284b-42eb-8b20-d72377af8c5a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.217759 Aug 23 10:53:15.546151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1905/3896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:15 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:15.842397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:15.843228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:15.850789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:15.851991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:15.864722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.869633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.870413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.871107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.872152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.872804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.874002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.874409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:15.875043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.875631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:15.876014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:15.877549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:16.095699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:16.107297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0933af55-f34c-4005-b73d-e63130dae257 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.261246 Aug 23 10:53:16.108595 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1906/3897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:15 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:16.163144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:16.174084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b9ecd2d-f653-416e-af6a-68378129f0c1 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1472 microversion: 2.1 time: 0.337688 Aug 23 10:53:16.176833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1992/3898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:15 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:16.483564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:16.484300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:16.491142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:16.491628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:16.492066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:16.492783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:16.493988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:16.494539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:16.566418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:16.567031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:16.574598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:16.575093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:16.575751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:16.576866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:16.577495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:16.578096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:16.649373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:16.664954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d6910c3-9062-495d-bb1a-3df4a95eeb8a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1533 microversion: 2.1 time: 0.184924 Aug 23 10:53:16.672826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1907/3899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:16 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1533 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:16.730662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:16.738752 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4308e424-0bee-46c5-8ffc-d2b0b5f90efc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.176196 Aug 23 10:53:16.739562 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1993/3900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:16 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:17.135922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:17.136910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:17.144229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.145486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.146183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.147075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.147850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.148564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.195458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:17.196850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:17.211925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.212285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.213364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.213364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.214519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.214519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.243976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:17.312766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:17.323441 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e944a02-7482-459f-b002-ea42d30adf05 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.191998 Aug 23 10:53:17.336957 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1908/3901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:17 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:17.667066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:17.679107 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17de9500-6e1f-4f99-b915-d951283575be tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1472 microversion: 2.1 time: 0.487403 Aug 23 10:53:17.699383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:17.700015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:17.703988 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1994/3902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:17 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1472 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:17.715837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.716489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.716976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.718034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.718997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.719611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.762286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:17.763239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:17.774427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.778282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.778282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.781945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:17.781945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:17.781945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:17.980830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:17.991189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-66351479-3b3a-415e-b968-3a972c02dccb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1533 microversion: 2.1 time: 0.295996 Aug 23 10:53:18.007976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1909/3903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:17 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1533 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:18.016934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-47496803-0258-4cf5-b72b-79c52d782d3a req-f0cd795c-65d6-448d-b8ed-0193e29da079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057c7307-04cc-43f0-8c9d-1233486e4b9e", "name": "network-vif-plugged", "status": "completed", "tag": "d4b89f90-900a-49c6-8ae6-8d854e7c5ffd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:18.035995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-47496803-0258-4cf5-b72b-79c52d782d3a req-f0cd795c-65d6-448d-b8ed-0193e29da079 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.037128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-47496803-0258-4cf5-b72b-79c52d782d3a req-f0cd795c-65d6-448d-b8ed-0193e29da079 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.043444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-47496803-0258-4cf5-b72b-79c52d782d3a req-f0cd795c-65d6-448d-b8ed-0193e29da079 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.061588 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-47496803-0258-4cf5-b72b-79c52d782d3a req-f0cd795c-65d6-448d-b8ed-0193e29da079 service nova] Creating event network-vif-plugged:d4b89f90-900a-49c6-8ae6-8d854e7c5ffd for instance 057c7307-04cc-43f0-8c9d-1233486e4b9e on n-h1-847009-13 Aug 23 10:53:18.067781 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-47496803-0258-4cf5-b72b-79c52d782d3a req-f0cd795c-65d6-448d-b8ed-0193e29da079 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057579 Aug 23 10:53:18.068887 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1910/3904] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:18.135404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0baf668f-4f85-49d0-8474-eb9b3281f937 req-b4604896-65c6-4380-b119-77f28c4dfb68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94cbffe-d053-422b-bacb-6ab8fd02d551", "name": "network-vif-deleted", "tag": "78817fdd-ea68-4303-b30e-22df6a4b0769"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:18.147880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0baf668f-4f85-49d0-8474-eb9b3281f937 req-b4604896-65c6-4380-b119-77f28c4dfb68 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.148392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0baf668f-4f85-49d0-8474-eb9b3281f937 req-b4604896-65c6-4380-b119-77f28c4dfb68 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.148884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0baf668f-4f85-49d0-8474-eb9b3281f937 req-b4604896-65c6-4380-b119-77f28c4dfb68 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.162412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0baf668f-4f85-49d0-8474-eb9b3281f937 req-b4604896-65c6-4380-b119-77f28c4dfb68 service nova] Creating event network-vif-deleted:78817fdd-ea68-4303-b30e-22df6a4b0769 for instance c94cbffe-d053-422b-bacb-6ab8fd02d551 on n-h1-847009-13 Aug 23 10:53:18.171416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0baf668f-4f85-49d0-8474-eb9b3281f937 req-b4604896-65c6-4380-b119-77f28c4dfb68 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041676 Aug 23 10:53:18.172214 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1911/3905] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:18.183052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:18.191632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-afa29350-08d8-4dcc-b913-2d74e33abc9a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.434231 Aug 23 10:53:18.192479 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1995/3906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:17 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:18.344938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:18.345884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:18.352601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.353944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.354636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.355557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.356175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.356905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.539640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:18.548810 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efe4c861-9ee1-41cf-9dac-2faaa0783f87 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.208888 Aug 23 10:53:18.549478 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1912/3907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:18 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:18.701559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:18.702479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:18.710007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.710720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.711338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.713077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.713720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.714348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.755764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:18.756395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:18.757059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:18.757717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lazy-loading 'fault' on Instance uuid c94cbffe-d053-422b-bacb-6ab8fd02d551 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:18.800563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc684cdb7f449f48bdd1bcb7d436afc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '730a5bd640e2437cab0c302a1a03fb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:18.809391 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3297b554-298e-420e-b43d-57d5541b5f5c tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 200 len: 1306 microversion: 2.1 time: 0.111945 Aug 23 10:53:18.810469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1996/3908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:18 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:19.037254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:19.037943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:19.044934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.045541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.045990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.047039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.049084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.049084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.214568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:19.215616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:19.217452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:19.219049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:19.223798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.224250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.224771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.225643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.226136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.226580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.228456 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b97046ea-2193-4d57-ba90-9b74daaf6fc3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1533 microversion: 2.1 time: 0.195135 Aug 23 10:53:19.229180 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1913/3909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:19 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1533 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:19.383102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:19.391777 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-05feaed6-9ee4-41b3-a394-163adce48f67 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.181274 Aug 23 10:53:19.392783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1997/3910] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:19 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:19.577252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:19.577947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:19.584665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.585189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.585629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.586353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.586810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.587267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.606696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:19.729700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:19.737821 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d264c64a-ebbb-4747-818b-1484772a0865 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.165772 Aug 23 10:53:19.738517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1914/3911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:19 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:19.831414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:19.832151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] [instance: c94cbffe-d053-422b-bacb-6ab8fd02d551] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:19.842539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.843673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.844792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.846244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:19.847305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:19.848079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:19.877636 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] HTTP exception thrown: Instance c94cbffe-d053-422b-bacb-6ab8fd02d551 could not be found. Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Request method failure captured: Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 HTTP/1.1 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLCmiVszFgue0PN_guQBhEdo0m72nRsjHowu7QbdGzmECAwP7bxLtjcNufaGjN0ApKMAPaGZZ-k39IoL1KjHobJN0qLfJZQ4sMf68BmbUp8-CxmUsetGf3viM77vOaCdOkdJ_5Wlg7oCveYb1Ep4AfyOZIRDln1YccvaQ9nCWlHUHyA Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_730a5bd640e2437cab0c302a1a03fb66", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/730a5bd640e2437cab0c302a1a03fb66"}]}] Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 730a5bd640e2437cab0c302a1a03fb66 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1025305635 Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1fc684cdb7f449f48bdd1bcb7d436afc Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersOnMultiNodesTest-1025305635-project Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c94cbffe-d053-422b-bacb-6ab8fd02d551 could not be found. Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c94cbffe-d053-422b-bacb-6ab8fd02d551'} Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94cbffe-d053-422b-bacb-6ab8fd02d551 could not be found. Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94cbffe-d053-422b-bacb-6ab8fd02d551 could not be found. Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:19.880969 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94cbffe-d053-422b-bacb-6ab8fd02d551 could not be found. Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] Returning 404 to user: Instance c94cbffe-d053-422b-bacb-6ab8fd02d551 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:19.887358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e32c3fe2-53e2-4ecc-8ab8-c607afa50032 tempest-ServersOnMultiNodesTest-1025305635 tempest-ServersOnMultiNodesTest-1025305635-project] 10.222.0.78 "GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551" status: 404 len: 111 microversion: 2.1 time: 0.055930 Aug 23 10:53:19.889341 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1998/3912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:19 2022] GET /compute/v2.1/servers/c94cbffe-d053-422b-bacb-6ab8fd02d551 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:53:20.249957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:20.253324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:20.258634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:20.259838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:20.262911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:20.262911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:20.262911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:20.262911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:20.414203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:20.416470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:20.424078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:20.424229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:20.424667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:20.425424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:20.425889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:20.426318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:20.462400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:20.472323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff82250c-b3c4-4669-96b3-b5e202f76e1b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1533 microversion: 2.1 time: 0.226246 Aug 23 10:53:20.473344 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1915/3913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:20 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1533 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:20.631828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:20.641382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9e05f3b-57e8-40ee-ac31-99a9962c4446 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.231266 Aug 23 10:53:20.642234 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 1999/3914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:20 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:20.763008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:20.764177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:20.771607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:20.772509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:20.773059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:20.774151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:20.775389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:20.775991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:20.934384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:20.943796 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34b0b98b-fdf9-4ec4-a486-c4a7d616670e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.185677 Aug 23 10:53:20.958182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1916/3915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:20 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:21.496357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:21.499857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:21.509343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:21.510160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:21.510864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:21.512714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:21.513196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:21.513695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:21.665919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:21.666523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:21.667902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:21.674311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:21.674809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:21.675248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:21.675950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:21.676407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:21.676943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:21.678417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-240df1aa-bb92-4d6e-9b83-0d38c8bfded4 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.187449 Aug 23 10:53:21.679322 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2000/3916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:21 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:21.856943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:21.867249 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddc3dbe7-f650-4e61-9334-662d3b8b5fdd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.205212 Aug 23 10:53:21.868805 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1917/3917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:21 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:21.966669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:21.967384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:21.973698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:21.974203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:21.974649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:21.975783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:21.976423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:21.977465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:22.127160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:22.138393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e60bc1f-cd65-4236-8554-5ff90e1a800b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.176379 Aug 23 10:53:22.146364 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2001/3918] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:21 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:22.699990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:22.700622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:22.708618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:22.709163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:22.709730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:22.710515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:22.710974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:22.711411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:22.894228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:22.895045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:22.897288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:22.910184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:22.911498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e6d1b69-89ab-4a6d-bede-3f1986b78707 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.215419 Aug 23 10:53:22.911940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:22.913520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:22.913819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1918/3919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:22 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:22.917189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:22.917955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:22.918650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:23.164057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:23.164057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:23.178998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:23.179495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:23.179941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:23.181458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:23.181966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:23.182499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:23.205044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:23.226302 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92d780e7-6d80-4ca7-85c7-58fb05529ab2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.335832 Aug 23 10:53:23.229427 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2002/3920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:22 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:23.444409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:23.460603 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e796205-616d-42e1-8d94-165f37b4d769 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.302058 Aug 23 10:53:23.461252 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1919/3921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:23 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:23.938367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:23.939424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:23.964167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:23.964775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:23.973704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:23.974692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:23.975198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:23.975651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:24.255092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:24.256938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:24.262331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:24.269103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:24.269663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:24.270117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:24.270884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:24.271049 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-401a61a0-446b-4762-8c22-a07150cbce98 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.336888 Aug 23 10:53:24.285336 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2003/3922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:23 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:24.289808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:24.291221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:24.495064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:24.495696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:24.522292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:24.528352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:24.530333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:24.531126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:24.531612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:24.532044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:24.611340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:24.646344 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b74db69a-9e17-4bee-82ce-3b1024d7aafb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.394852 Aug 23 10:53:24.671005 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1920/3923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:24 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:24.822929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:24.836005 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb83645c-cb5c-486e-ac78-248aca90df1d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.349388 Aug 23 10:53:24.844772 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2004/3924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:24 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:25.296308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:25.297178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:25.314435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:25.316506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:25.318848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:25.319664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:25.322479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:25.323000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:25.677350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:25.678622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:25.687246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:25.687750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:25.688204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:25.694658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:25.717137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:25.717801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:25.986070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:25.996847 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-921b45b6-f59c-4c11-83ad-a5efb21b0443 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.704833 Aug 23 10:53:26.025067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1921/3925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:25 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:26.030924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:26.032276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:26.039174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:26.040108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:26.040877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:26.041914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:26.042606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:26.043306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:26.053393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:26.062355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-990d1610-f660-45cd-ba97-694596706bc0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.388882 Aug 23 10:53:26.069115 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2005/3926] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:25 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:26.328837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:26.344436 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9de4d6d5-2dc2-4725-ac20-8f4a6d569e70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.317509 Aug 23 10:53:26.346282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1922/3927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:26 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:27.033608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:27.034457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:27.044903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:27.048573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:27.052889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:27.053916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:27.054588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:27.056135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:27.098457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:27.099374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:27.113666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:27.116679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:27.120133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:27.130261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:27.131068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:27.131812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:27.435648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:27.453510 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8a28d8b-5e15-4e7c-bdd7-da539f9b45f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.425584 Aug 23 10:53:27.471461 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2006/3928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:27 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:27.480343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:27.481907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:27.491259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:27.493833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:27.494742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:27.496082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:27.497760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:27.499994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:27.982599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:28.002963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:28.007964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:28.012161 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-caa4f72a-d52f-4279-b656-6726296475c6 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2954 microversion: 2.42 time: 0.930100 Aug 23 10:53:28.037404 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1923/3929] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:53:27 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2954 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:53:28.051281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:28.055522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:28.063938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:28.065022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:28.065898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:28.067198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:28.068134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:28.068818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:28.157382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:28.165993 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00fd431d-5afe-4fb1-9302-9a56b53cc656 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1506 microversion: 2.1 time: 0.692555 Aug 23 10:53:28.170240 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2007/3930] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:27 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1506 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:28.175185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:28.175691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:28.189870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:28.190395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:28.190857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:28.191603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:28.192078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:28.192516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:28.340216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:28.354419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7871e91-f266-40c8-a87b-ac7928952978 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.314434 Aug 23 10:53:28.371252 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1924/3931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:28 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:28.476259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:28.476935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:28.488192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:28.493503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:28.494412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:28.495428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:28.497528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:28.498252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:28.579483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e6dbf2b-fc1c-4e71-aea0-b15af668c7a4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.407930 Aug 23 10:53:28.585386 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2008/3932] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 10:53:28 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7/os-interface => generated 1830 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:53:28.894506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:28.909335 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d63063f-ecba-4f3a-8954-db6275b3c04a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.436046 Aug 23 10:53:28.914863 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1925/3933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:28 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:29.188890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:29.189517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:29.214221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:29.214734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:29.221308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:29.223037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:29.224316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:29.226718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:29.378672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:29.379297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:29.391735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:29.392852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:29.394768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:29.397921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:29.398731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:29.402291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:29.639835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:29.648704 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d5410d62-90fc-4de0-aafd-bb2fe6d786f7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1527 microversion: 2.1 time: 0.465103 Aug 23 10:53:29.658105 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2009/3934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:29 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1527 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:29.723997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:29.739957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb570529-bb19-488d-9f8f-04fd19807ddb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.364913 Aug 23 10:53:29.741470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1926/3935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:29 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:29.932471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:29.933480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:29.950910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:29.952041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:29.952714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:29.953676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:29.954340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:29.955137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:30.383501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:30.395013 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2c92d40-e8d6-40f0-9f60-aed4e57192bc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.467982 Aug 23 10:53:30.397876 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2010/3936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:29 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:30.686064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:30.687393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:30.701171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:30.701677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:30.702128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:30.702849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:30.703311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:30.703742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:30.771310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:30.771990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:30.788686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:30.795198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:30.795666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:30.796428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:30.796933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:30.801983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:30.965271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:30.975998 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2742c642-fc9c-486a-96ce-567c52e358d2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1527 microversion: 2.1 time: 0.294070 Aug 23 10:53:30.977224 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1927/3937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:30 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:31.093397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:31.107149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:31.116262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f48af94-ff11-4a7d-bad3-f7d443cde98a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.355263 Aug 23 10:53:31.117565 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2011/3938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:30 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:31.208080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1427094455", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "d26b4e4e-92d2-42da-96e8-fce80f3d1152"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:31.310085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] validate_networks() for [('d26b4e4e-92d2-42da-96e8-fce80f3d1152', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:53:31.425327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:31.426561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:31.450329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:31.451105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:31.452277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:31.457013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:31.458945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:31.459851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:31.759457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:31.771519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68613a3a-d6b0-4149-a9b7-3cfee3a2467e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.354833 Aug 23 10:53:31.773828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2012/3939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:31 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:31.999133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:32.000133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:32.009968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.015865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.016523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.018366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.019025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.019659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.089095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:53:32.089887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:53:32.090232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:53:32.090753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:53:32.091278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:53:32.113156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.117281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.119981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.125232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.125841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.126395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.172346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:53:32.182863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for user e0ff1121d80f493aa4d6d0b62a583d32 and project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:53:32.202900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:32.204592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:53:32.208970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:53:32.236132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:32.265142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91452005-3c08-4904-8781-bbe15fde9750 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1527 microversion: 2.1 time: 0.259863 Aug 23 10:53:32.275294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2013/3940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:31 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1527 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:32.288397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:32.289052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:32.295402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.295900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.298324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.300030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.305368 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-942c28c5-745d-4ed6-b896-c4f4bc94ff13 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.326081 Aug 23 10:53:32.311528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1928/3941] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:53:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:53:32.312383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.313161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.320511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ca2e593-4153-43fc-a1f3-89e71f2c8ddb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:32.322037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ca2e593-4153-43fc-a1f3-89e71f2c8ddb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:32.441552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ca2e593-4153-43fc-a1f3-89e71f2c8ddb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:32.453134 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ca2e593-4153-43fc-a1f3-89e71f2c8ddb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1225 microversion: 2.1 time: 0.138827 Aug 23 10:53:32.457919 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1929/3942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:32 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:32.662276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:32.677335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-283338f2-d871-4a54-a969-6ad21319984f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.408053 Aug 23 10:53:32.679855 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2014/3943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:32 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:32.742172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5272bea1-d44b-41c5-8556-5e744619fa2d req-4610d615-5f43-41b4-8499-fc79643f3331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5213bf0f-b9d3-4cd8-88e4-530a4f430820", "name": "network-vif-plugged", "status": "completed", "tag": "5dc6fa06-4536-42d8-9b80-4893f6db4973"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:32.761538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5272bea1-d44b-41c5-8556-5e744619fa2d req-4610d615-5f43-41b4-8499-fc79643f3331 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.762043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5272bea1-d44b-41c5-8556-5e744619fa2d req-4610d615-5f43-41b4-8499-fc79643f3331 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.762485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5272bea1-d44b-41c5-8556-5e744619fa2d req-4610d615-5f43-41b4-8499-fc79643f3331 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.795411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:32.796056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:32.801105 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5272bea1-d44b-41c5-8556-5e744619fa2d req-4610d615-5f43-41b4-8499-fc79643f3331 service nova] Creating event network-vif-plugged:5dc6fa06-4536-42d8-9b80-4893f6db4973 for instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 on n-h2-847009-13 Aug 23 10:53:32.806414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.817638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.818379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.821919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:32.822598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:32.823227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:32.824018 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5272bea1-d44b-41c5-8556-5e744619fa2d req-4610d615-5f43-41b4-8499-fc79643f3331 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086408 Aug 23 10:53:32.829138 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1930/3944] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:33.179470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:33.196570 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb842d23-2e69-42b9-b870-5159625567ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.406194 Aug 23 10:53:33.198240 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2015/3945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:32 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:33.291846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:33.292572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:33.312837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:33.313368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:33.313830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:33.314577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:33.315043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:33.315480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:33.482457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:33.483662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:33.499702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:33.505305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:33.506006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:33.507321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:33.507925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:33.509708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:33.650814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:33.666148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0cfdb341-e6b0-46e0-b61c-a2c7e8dd2efb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1229 microversion: 2.1 time: 0.189605 Aug 23 10:53:33.670500 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2016/3946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:33 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1229 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:33.703420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:33.716799 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-421d827e-8600-4d51-b733-892632b5bd97 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.427390 Aug 23 10:53:33.717457 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1931/3947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:33 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:33.725826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:33.728610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:33.740196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:33.741373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:33.744237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:33.746197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:33.746878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:33.747707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:33.995050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:34.006982 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f57ae53-bdf7-4b14-81a1-9d1b8b790349 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.294101 Aug 23 10:53:34.009246 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2017/3948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:33 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:34.220604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:34.221259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:34.242850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:34.243682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:34.244298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:34.245282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:34.245914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:34.246510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:34.605513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:34.622642 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcf2a4eb-293e-42a0-9bde-91359c9fccce tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.406032 Aug 23 10:53:34.624545 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1932/3949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:34 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:34.691392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:34.692774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:34.711720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:34.712629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:34.713800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:34.722031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:34.722779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:34.724203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:34.746510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:34.747757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:34.762872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:34.771402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:34.772335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:34.773330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:34.774212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:34.774852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:34.817297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:34.959760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:34.972246 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-471c1f3d-dcb5-4ce8-a3ce-e19a90ff18fe tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1285 microversion: 2.1 time: 0.285128 Aug 23 10:53:34.997195 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2018/3950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:34 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1285 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:35.030796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:35.031715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:35.043577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:35.047481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:35.048239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:35.050746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:35.051464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:35.053324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:35.065890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:35.077720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03e861a3-667a-484a-8421-c93a9a888544 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.336086 Aug 23 10:53:35.082443 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1933/3951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:34 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:35.646594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:35.647233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:35.658739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:35.666007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:35.669379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:35.670408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:35.673910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:35.674573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:35.950806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:35.966853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15dfa181-9696-4a91-a93d-ffc659f3d8f2 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.324796 Aug 23 10:53:35.980535 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1934/3952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:35 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:35.996244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:35.999612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:36.015438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:36.018173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:36.022373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:36.023351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:36.025312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:36.025933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:36.137733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:36.153983 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3a0be3c-eb1d-4964-aa14-3a14c4406442 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1283 microversion: 2.1 time: 0.157205 Aug 23 10:53:36.155093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1935/3953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:35 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:36.175847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:36.177556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:36.187805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:36.194479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:36.196679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:36.197425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:36.200578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:36.202795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:36.203509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:36.212142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f489e41a-6dbd-430a-bfd1-cc431ea0c43d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 1.186862 Aug 23 10:53:36.212909 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2019/3954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:35 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:36.521409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:36.538642 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c12a8018-7b4c-427a-b536-d2ce95cf6a5f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.381343 Aug 23 10:53:36.540360 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1936/3955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:36 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:37.006932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:37.009019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:37.018319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.025353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.029562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.031824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.037167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.038530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.182153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:37.182941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:37.200826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.201669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.204796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.205775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.209744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.212929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.588710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:37.606861 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b344f94c-dbc4-4925-85c5-acd97fdc7322 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.427660 Aug 23 10:53:37.632282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1937/3956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:37 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:37.637705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:37.643217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:37.655780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.661785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.665565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.666557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.667161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.667710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.698555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:37.709777 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1988504c-f664-49ce-83a1-ba5aa584001e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.706782 Aug 23 10:53:37.714309 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2020/3957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:37 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:37.725031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:37.736374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:37.752416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.754594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.757282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:37.758859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:37.767408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:37.768440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:38.083950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:38.096897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e54ae09-2a19-4d30-9329-b5f7910ef75b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.462925 Aug 23 10:53:38.118705 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1938/3958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:37 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:38.351149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:38.371233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-16a0d60d-96db-4f8a-a963-461da3792dbd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.654713 Aug 23 10:53:38.374536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2021/3959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:37 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:38.403056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c6c36d35-e7c1-4dfe-816c-4dbb70f87f69 req-e321373d-0960-4d72-9434-88b6e86dca6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b8db994-e1c8-44a1-9e86-add937250758", "tag": "6ff1c4f0-e2da-46ba-9371-aa39e8a84f44"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:38.433643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c6c36d35-e7c1-4dfe-816c-4dbb70f87f69 req-e321373d-0960-4d72-9434-88b6e86dca6f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:38.442142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c6c36d35-e7c1-4dfe-816c-4dbb70f87f69 req-e321373d-0960-4d72-9434-88b6e86dca6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:38.442832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c6c36d35-e7c1-4dfe-816c-4dbb70f87f69 req-e321373d-0960-4d72-9434-88b6e86dca6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:38.489500 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c6c36d35-e7c1-4dfe-816c-4dbb70f87f69 req-e321373d-0960-4d72-9434-88b6e86dca6f service nova] Creating event network-changed:6ff1c4f0-e2da-46ba-9371-aa39e8a84f44 for instance 1b8db994-e1c8-44a1-9e86-add937250758 on n-h1-847009-13 Aug 23 10:53:38.506223 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c6c36d35-e7c1-4dfe-816c-4dbb70f87f69 req-e321373d-0960-4d72-9434-88b6e86dca6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109027 Aug 23 10:53:38.519960 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1939/3960] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:38.646054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:38.646859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:38.676468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:38.685451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:38.703544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:38.704874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:38.705458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:38.709177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:38.741466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:38.742309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:38.779720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:38.780478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:38.781153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:38.781990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:38.786452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:38.787361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:39.154719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:39.163485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a1520e7-c5b1-4f3c-ab56-5f420face434 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.429932 Aug 23 10:53:39.181610 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1940/3961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:38 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:39.190327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:39.190968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:39.215842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:39.235301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:39.235906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:39.239414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:39.239901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:39.240336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:39.396166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:39.410096 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04928089-049f-4975-b2f0-d348bc033d8f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.777409 Aug 23 10:53:39.417031 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2022/3962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:38 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:39.433878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:39.434773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:39.458498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:39.460917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:39.461638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:39.467452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:39.468222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:39.470833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:39.621140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:39.635801 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-780f0ef9-05df-4460-b452-113c6273adcb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.452970 Aug 23 10:53:39.637169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1941/3963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:39 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:39.971030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:39.984033 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8be657c7-cc5b-4559-a2e1-c1b39e3676bb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.563108 Aug 23 10:53:39.986334 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2023/3964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:39 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:40.184612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:40.185913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:40.206893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:40.207391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:40.216423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:40.221514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:40.222333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:40.222951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:40.445753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:40.446517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:40.461788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:40.463238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:40.463705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:40.467750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:40.468801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:40.469853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:40.575805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:40.585990 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ab0c4cc-1c24-41c6-ba80-938b4213b415 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.405863 Aug 23 10:53:40.614687 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1942/3965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:40 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:40.686486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:40.689384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:40.754192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:40.754713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:40.755170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:40.755909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:40.756382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:40.760444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:40.966318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:40.980347 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6764083-027d-4172-b3be-b146765c24c2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.542058 Aug 23 10:53:40.981359 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2024/3966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:40 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:41.010238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:41.012014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:41.024551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:41.025519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:41.031468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:41.032474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:41.033155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:41.033805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:41.099534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:41.112545 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d5ce3a4-bf0f-4c6b-a8b2-e70d1e20c883 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.458192 Aug 23 10:53:41.132811 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1943/3967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:40 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:41.347639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:41.362953 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19af52b4-f234-4030-b541-1ebc06aeb218 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.357258 Aug 23 10:53:41.373603 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2025/3968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:41 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:41.612101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:41.612729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:41.626685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:41.627455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:41.628055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:41.628979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:41.629627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:41.630207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:41.982213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:42.003574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:42.008057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:42.025644 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf13e8b9-285f-43bc-9844-9e268ce1f4e1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.418161 Aug 23 10:53:42.026195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:42.026566 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1944/3969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:41 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:42.028355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:42.028916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:42.030061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:42.030797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:42.031426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:42.149713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:42.150496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:42.161104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:42.166330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:42.187154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:42.198453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:42.199238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:42.199726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:42.200182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:42.381634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:42.390655 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d2252a0-f6d4-438b-bd47-a89ce4bef08c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.392186 Aug 23 10:53:42.408725 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2026/3970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:41 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:42.413878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:42.414941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:42.421810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:42.422580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:42.423190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:42.424087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:42.424763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:42.428117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:42.452258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:42.552088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:42.569056 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e4bf05a-46b1-4476-8275-a0887b22a0c0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.423576 Aug 23 10:53:42.574572 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1945/3971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:42 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:42.711366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:42.720000 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8aa24ce8-fac0-47e2-8e99-dce8adf5dcae tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.309823 Aug 23 10:53:42.725067 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2027/3972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:42 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:43.047746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:43.049348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:43.062632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.065072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.067097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.068987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.069936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.072800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.420267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:43.421984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:43.460475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:43.465091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.469702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-257f498e-23e0-4be0-ba54-910470748e6d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1528 microversion: 2.1 time: 0.426439 Aug 23 10:53:43.470311 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1946/3973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:43 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1528 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:43.471449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.475255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.480674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.485116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:43.487082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:43.489097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.490198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.507022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.507809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.511025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.512007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.512656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.513404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.582592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:43.742136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:43.766935 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-911912d4-fe5c-47d2-9012-353d20337356 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.295547 Aug 23 10:53:43.768240 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1947/3974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:43 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:43.775083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:43.776152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:43.783909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.784704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.785418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:43.786448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:43.787166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:43.787828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.033095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.053947 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-269ae54a-5592-43ea-9b34-d0b30c84cff5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.284317 Aug 23 10:53:44.055702 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1948/3975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:43 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:44.064088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:44.065964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.066676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:44.076294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.077134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.077597 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0aadf27-7fb7-4ca0-b667-067bd19b9d8d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.664590 Aug 23 10:53:44.078188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.080784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.081222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2028/3976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:43 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:44.083322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.091463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.092298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:44.095585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:44.104603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.105165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.105610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.106366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.106829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.107261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.261031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.276094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8892d878-6a4c-4bec-b1e4-6d3c301b7ff9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.218924 Aug 23 10:53:44.278087 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1949/3977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:44 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:44.416546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.425253 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24f84203-cea4-4c38-9651-1ec1894d521b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.342908 Aug 23 10:53:44.426877 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2029/3978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:44.459055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:44.459686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:44.470822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.471340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.471805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.473055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.473532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.473974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.493117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:44.493757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:44.506803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.507314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.507765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.508534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.509024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.517183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.730594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.734965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:44.747382 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c3a0382-70c5-4e15-bab3-9a295713e2aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.304458 Aug 23 10:53:44.748454 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1950/3979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:44.769986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:44.770609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:44.777310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.777815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.778244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.778949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:44.779406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:44.779835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:44.844717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.861882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-25f95ed8-3d4c-4a9a-9842-ba3a2ac69f8e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1510 microversion: 2.1 time: 0.372785 Aug 23 10:53:44.863004 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2030/3980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:44 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:44.954721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:44.969670 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb5f1b6f-2241-41e6-9f2e-5e540cef40dc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.203582 Aug 23 10:53:44.970270 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1951/3981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:45.081751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:45.082522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:45.095578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.098875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.099826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.100674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.101200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.101628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.105318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:45.106642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:45.114832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.115963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.116688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.118386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.119729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.120444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.316357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:45.318493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:45.325615 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0917b7da-bdce-4eac-a59b-33fa5c5a0f63 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1521 microversion: 2.1 time: 0.249536 Aug 23 10:53:45.326198 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2031/3982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:45 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:45.327073 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07b923f3-b567-43a4-8fb4-abd97271d0cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.226817 Aug 23 10:53:45.337135 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1952/3983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:45 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:45.338859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1121100379", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "1c5fdc6a-1777-4c61-b011-ad5f4ef33812"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:45.359822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:45.360488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:45.373281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.373780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.374596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.374942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.375404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.375840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.417435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] validate_networks() for [('1c5fdc6a-1777-4c61-b011-ad5f4ef33812', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:53:45.589558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:45.602290 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2200a30-45cb-4a97-b19d-7b8ec1b66c92 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.272201 Aug 23 10:53:45.603236 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1953/3984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:45 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:45.886258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:45.887454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:45.903227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.905236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.905950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:45.908091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:45.909281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:45.913871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.138389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:46.150355 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f39ed9bd-9847-4db9-a5a1-db3615f80bfd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1510 microversion: 2.1 time: 0.268327 Aug 23 10:53:46.151610 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1954/3985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:45 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:46.156640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:53:46.157793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:53:46.158454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:53:46.159084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:53:46.159690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:53:46.171748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.172455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.173102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.174013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.174673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.175284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.199561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:53:46.207369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for user ca80ea2c8904468d9e6944fc274afdb8 and project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:53:46.228700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:53:46.231174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:53:46.306051 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3827956-1515-402b-8271-8985ba4f9d1c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977905 Aug 23 10:53:46.307001 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2032/3986] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:53:46.321306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28c1359f-0632-4acc-9988-afd7a017e94d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:46.322568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28c1359f-0632-4acc-9988-afd7a017e94d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:46.348637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:46.349394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:46.361102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.361595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.362206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.363347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.363815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.364258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.387313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28c1359f-0632-4acc-9988-afd7a017e94d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:46.395617 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28c1359f-0632-4acc-9988-afd7a017e94d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1215 microversion: 2.1 time: 0.081969 Aug 23 10:53:46.412415 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1955/3987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:46 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:46.417915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:46.418541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:46.426098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.426697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.427145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.427856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.428373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.428835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.609378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:46.623797 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6429df3-a890-4323-9ff7-fb16d08d26e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1501 microversion: 2.1 time: 0.279225 Aug 23 10:53:46.624412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2033/3988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:46 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1501 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:46.634193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:46.635050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:46.642229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.642728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.643222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.644196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.644667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.645131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.654951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:46.673792 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9be7da44-d6be-4453-a4eb-a47388d79dca tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.259714 Aug 23 10:53:46.692425 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1956/3989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:46 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:46.699740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:46.700782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:46.711734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.721753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.722413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.723248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:46.724049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:46.724559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:46.829448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:46.838893 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61a4ed23-f396-482e-8fbe-52be75af42a3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.213413 Aug 23 10:53:46.861194 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2034/3990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:46 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:46.935053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:46.946497 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10e0167b-bcf1-48f2-9a19-ea9621538876 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1516 microversion: 2.1 time: 0.252237 Aug 23 10:53:46.947332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1957/3991] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:46 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:46.968727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9959e5fc-3f3e-40d4-bb73-d1ebaf1fb614 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:46.972780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9959e5fc-3f3e-40d4-bb73-d1ebaf1fb614 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 869e82f5-c594-4475-8316-38fc3f77f7bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:46.978388 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-9959e5fc-3f3e-40d4-bb73-d1ebaf1fb614 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Instance 869e82f5-c594-4475-8316-38fc3f77f7bb could not be found. Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9959e5fc-3f3e-40d4-bb73-d1ebaf1fb614 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/869e82f5-c594-4475-8316-38fc3f77f7bb/action HTTP/1.1 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 14 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: {"rescue": {}} Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 869e82f5-c594-4475-8316-38fc3f77f7bb could not be found. Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '869e82f5-c594-4475-8316-38fc3f77f7bb', 'body': {'rescue': {}}} Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869e82f5-c594-4475-8316-38fc3f77f7bb could not be found. Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869e82f5-c594-4475-8316-38fc3f77f7bb could not be found. Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:46.984357 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869e82f5-c594-4475-8316-38fc3f77f7bb could not be found. Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9959e5fc-3f3e-40d4-bb73-d1ebaf1fb614 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 404 to user: Instance 869e82f5-c594-4475-8316-38fc3f77f7bb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9959e5fc-3f3e-40d4-bb73-d1ebaf1fb614 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/869e82f5-c594-4475-8316-38fc3f77f7bb/action" status: 404 len: 111 microversion: 2.1 time: 0.021126 Aug 23 10:53:46.990922 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2035/3992] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:46 2022] POST /compute/v2.1/servers/869e82f5-c594-4475-8316-38fc3f77f7bb/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:53:46.997802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:46.998348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:47.005673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.006178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.006631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.008892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.009039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.009453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.107195 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f0d0ee3-4a69-402c-9a42-f2e730944d1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action" status: 202 len: 0 microversion: 2.1 time: 0.112873 Aug 23 10:53:47.113866 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1958/3993] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:46 2022] POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:53:47.124800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:47.128535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:47.151289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.152111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.153820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.154861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.156088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.156770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.177363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:47.178097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:47.197177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.197878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.198339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.203162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.203660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.204987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.458872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:47.474446 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21612c59-ec83-4a20-9521-ddbcf27e8e1e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1521 microversion: 2.1 time: 0.360045 Aug 23 10:53:47.475981 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2036/3994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:47 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:47.482532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:47.483658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:47.492072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.493551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.494540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.501866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:47.505720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.508784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.511636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.517538 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5f7b84b-e198-479d-986d-81aafb5a428a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1510 microversion: 2.1 time: 0.349646 Aug 23 10:53:47.533905 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1959/3995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:47 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:47.624654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:47.636968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56ac6e1f-dd23-4c18-bb72-3bda288d06df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1267 microversion: 2.1 time: 0.159470 Aug 23 10:53:47.637719 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2037/3996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:47 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:47.702577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:47.704139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:47.717627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.718175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.718992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.719866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.720415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.720987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.864044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:47.864617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:47.871851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.876026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.877249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.878285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:47.879002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:47.880080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:47.902283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:47.913265 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23525417-9809-425e-8bb3-920bcb9a9086 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.216296 Aug 23 10:53:47.914346 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1960/3997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:47 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:48.074206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:48.084828 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f0103ac-8414-49c7-ae0c-1ef8ca2ac361 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.226923 Aug 23 10:53:48.085667 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2038/3998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:47 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:48.487684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1d84b79f-0cf1-41b9-b467-d60b1d2c5e6e req-a797a0ef-b0e7-4aae-9930-633669b1b320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8db994-e1c8-44a1-9e86-add937250758", "name": "network-vif-plugged", "status": "completed", "tag": "6ff1c4f0-e2da-46ba-9371-aa39e8a84f44"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:48.500830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:48.502076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:48.522873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.526398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.526849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:48.529959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d84b79f-0cf1-41b9-b467-d60b1d2c5e6e req-a797a0ef-b0e7-4aae-9930-633669b1b320 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.530758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.531759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.534451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d84b79f-0cf1-41b9-b467-d60b1d2c5e6e req-a797a0ef-b0e7-4aae-9930-633669b1b320 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.535173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d84b79f-0cf1-41b9-b467-d60b1d2c5e6e req-a797a0ef-b0e7-4aae-9930-633669b1b320 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:48.535882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:48.562857 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1d84b79f-0cf1-41b9-b467-d60b1d2c5e6e req-a797a0ef-b0e7-4aae-9930-633669b1b320 service nova] Creating event network-vif-plugged:6ff1c4f0-e2da-46ba-9371-aa39e8a84f44 for instance 1b8db994-e1c8-44a1-9e86-add937250758 on n-h1-847009-13 Aug 23 10:53:48.595880 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1d84b79f-0cf1-41b9-b467-d60b1d2c5e6e req-a797a0ef-b0e7-4aae-9930-633669b1b320 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109621 Aug 23 10:53:48.605575 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1961/3999] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:48.635641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:48.641104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:48.663651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.665648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.667772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:48.668604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.670174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.670481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:48.922486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:48.931089 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f905e70c-21d1-493c-9179-36a8b9f93bb7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1453 microversion: 2.1 time: 0.321014 Aug 23 10:53:48.931679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1962/4000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:48 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1453 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:48.936309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:48.937004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:48.954826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.955332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.955780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:48.956607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:48.957120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:48.957554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.060143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:49.069994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dbf32f06-67d4-4949-9abd-eaba923085f0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1273 microversion: 2.1 time: 0.137149 Aug 23 10:53:49.083922 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1963/4001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:48 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:49.083922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:49.083922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.083922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.084459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.084835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.085522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.085992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.087507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.122550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:49.140473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41f4c118-2472-443c-bb3e-9db6e00f2050 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1501 microversion: 2.1 time: 0.643535 Aug 23 10:53:49.154078 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2039/4002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:48 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1501 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:49.154078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:49.154078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.168800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:49.179246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.181023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.181854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.182806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.183463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.191051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.296754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:49.304675 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4add9958-8d8b-40fc-9916-f1035d2979cf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.232307 Aug 23 10:53:49.305334 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1964/4003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:49 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:49.310102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:49.310779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.316672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.317197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.317641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.318342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.318798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.319225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.485932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:49.501758 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2b07ae7-fd13-46f9-af16-bf7c5c277415 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.195075 Aug 23 10:53:49.502354 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1965/4004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:49 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:49.507034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:49.510559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.516806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.517314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.517761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.518546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.519013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.519497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.544318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:49.556332 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-002a57ba-b5d1-4454-b374-2e89baea7c95 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1453 microversion: 2.1 time: 0.413519 Aug 23 10:53:49.558000 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2040/4005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:49 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1453 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:49.562611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lazy-loading 'flavor' on Instance uuid 69836824-35ef-49e2-9b18-8ea94744cc8e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:49.639202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Cannot 'rescue' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state paused Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action HTTP/1.1 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 14 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: {"rescue": {}} Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'rescue' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state paused Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '69836824-35ef-49e2-9b18-8ea94744cc8e', 'body': {'rescue': {}}} Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e in vm_state paused. Cannot rescue while the instance is in this state. Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state paused Aug 23 10:53:49.641459 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state paused Aug 23 10:53:49.647148 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.649466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 409 to user: Cannot 'rescue' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state paused {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:49.650600 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59a3d030-a0c1-449b-840b-bec9e12e5c7b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action" status: 409 len: 144 microversion: 2.1 time: 0.147329 Aug 23 10:53:49.655054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1966/4006] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:49 2022] POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action => generated 144 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:53:49.660459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:49.661248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.672296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:49.672861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.676133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.676670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.677152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.678641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.678956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.679453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.680533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.681506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.681974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.682405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.685028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.685782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.750508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lazy-loading 'flavor' on Instance uuid 057c7307-04cc-43f0-8c9d-1233486e4b9e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:49.781677 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'shelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state shelved_offloaded Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 14 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: {"shelve": {}} Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'shelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state shelved_offloaded Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'shelve': {}}} Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:53:49.784278 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state shelved_offloaded Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state shelved_offloaded Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:49.791267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'shelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state shelved_offloaded {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:49.794129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2874e8f3-f2dd-431b-942f-eea027b62925 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 155 microversion: 2.1 time: 0.125252 Aug 23 10:53:49.795618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1967/4007] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:49 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 155 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:53:49.808526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:49.811261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.824794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.825275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.826920 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fd765c86-ad90-4fa1-8e52-477ea32a8569 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action" status: 202 len: 0 microversion: 2.1 time: 0.170497 Aug 23 10:53:49.830531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.830700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2041/4008] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:49 2022] POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:53:49.830808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.830808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.830808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.841614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:49.842403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:49.845090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:49.854528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.855045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.855496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.864583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:49.865208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:49.867046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:49.945150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128860) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 10:53:50.147605 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffe2bc21-9884-4583-a816-6c6e6442505e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.347921 Aug 23 10:53:50.149244 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1968/4009] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:49 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:53:50.166743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:50.169427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:50.181747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.183290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.184283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.185428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.186131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.186271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:50.186896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.235454 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65aaf7f3-2159-42fd-9f56-bf6324cc026c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1508 microversion: 2.1 time: 0.402371 Aug 23 10:53:50.256991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2042/4010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:49 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:50.301655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:50.302311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:50.324782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.325979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.326432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.327171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.328859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.332625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.440848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:50.472161 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-197fab3c-7f78-4a64-95e1-f9454f549520 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.321252 Aug 23 10:53:50.473051 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1969/4011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:50 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:50.483980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:50.494724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:50.517139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.517762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.520042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.520835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.521319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.521755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.833798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:50.855337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5a09dc2-8308-4386-9b42-7ba3f0a19d41 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1461 microversion: 2.1 time: 0.572423 Aug 23 10:53:50.856720 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2043/4012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:50 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1461 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:50.863092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:50.864559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:50.881929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.882737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.884228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:50.885470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:50.886108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:50.886712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.127739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:51.138511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c1eaeeb-f780-4226-a6af-28aeb4d552e9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1325 microversion: 2.1 time: 0.658193 Aug 23 10:53:51.139578 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1970/4013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:50 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1325 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:51.144150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0ea2d0a7-6bda-4b13-9640-bf778a9323a2 req-29fd5b57-a01d-443d-8d56-960c0bfe4da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057c7307-04cc-43f0-8c9d-1233486e4b9e", "name": "network-vif-unplugged", "status": "completed", "tag": "d4b89f90-900a-49c6-8ae6-8d854e7c5ffd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:51.156516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:51.162677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0ea2d0a7-6bda-4b13-9640-bf778a9323a2 req-29fd5b57-a01d-443d-8d56-960c0bfe4da6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.163403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0ea2d0a7-6bda-4b13-9640-bf778a9323a2 req-29fd5b57-a01d-443d-8d56-960c0bfe4da6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.165061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0ea2d0a7-6bda-4b13-9640-bf778a9323a2 req-29fd5b57-a01d-443d-8d56-960c0bfe4da6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.182274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.compute.server_external_events [req-0ea2d0a7-6bda-4b13-9640-bf778a9323a2 req-29fd5b57-a01d-443d-8d56-960c0bfe4da6 service nova] Unable to find a host for instance 057c7307-04cc-43f0-8c9d-1233486e4b9e. Dropping event network-vif-unplugged {{(pid=128860) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 10:53:51.183269 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0ea2d0a7-6bda-4b13-9640-bf778a9323a2 req-29fd5b57-a01d-443d-8d56-960c0bfe4da6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.042672 Aug 23 10:53:51.184134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1971/4014] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 10:53:51.214920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:51.224323 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6bf9b3ab-880f-4dd2-8fa7-8f169e13952d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1522 microversion: 2.1 time: 0.365829 Aug 23 10:53:51.225111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2044/4015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:50 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:51.280385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:51.281333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:51.287720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.288364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.289156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.290293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.290976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.291415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.494379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:51.496456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:51.497399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:51.505244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.506057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.506753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.508402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.509724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.510405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.520935 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a0980cd-7b2c-4c11-b7a2-8029cf8336e8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1516 microversion: 2.1 time: 0.244368 Aug 23 10:53:51.521973 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1972/4016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:51 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:51.723552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9f9c1cbc-73ec-4461-b9e5-ff4341a8aef0 req-9450fd6e-ed5c-45e9-9233-aa85a0f5be2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9233d2d2-c13f-4c49-ac96-0784d4022b4f", "tag": "abe64a62-3f3c-4b3c-b567-cc16fa541b16"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:51.743682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9f9c1cbc-73ec-4461-b9e5-ff4341a8aef0 req-9450fd6e-ed5c-45e9-9233-aa85a0f5be2f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.744615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9f9c1cbc-73ec-4461-b9e5-ff4341a8aef0 req-9450fd6e-ed5c-45e9-9233-aa85a0f5be2f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.745422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9f9c1cbc-73ec-4461-b9e5-ff4341a8aef0 req-9450fd6e-ed5c-45e9-9233-aa85a0f5be2f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.783285 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9f9c1cbc-73ec-4461-b9e5-ff4341a8aef0 req-9450fd6e-ed5c-45e9-9233-aa85a0f5be2f service nova] Creating event network-changed:abe64a62-3f3c-4b3c-b567-cc16fa541b16 for instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f on n-h2-847009-13 Aug 23 10:53:51.800023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9f9c1cbc-73ec-4461-b9e5-ff4341a8aef0 req-9450fd6e-ed5c-45e9-9233-aa85a0f5be2f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087157 Aug 23 10:53:51.804646 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1973/4017] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:51.887771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:51.889613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:51.894425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:51.897342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:51.909383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-530ccab7-ceae-4135-9ec6-d3814fd081a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.415760 Aug 23 10:53:51.909937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.910468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.913237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:51.919027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:51.920379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:51.921145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2045/4018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:51 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:51.926087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:52.160606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:52.161190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:52.201183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:52.221476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:52.228348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:52.234053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:52.234822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:52.236648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:52.299165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:52.313914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bf4001e-fa2e-4e8a-b2b6-0a9f5b758a2b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.433226 Aug 23 10:53:52.315546 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1974/4019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:51 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:52.320591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:52.321956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:52.330125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:52.330904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:52.331467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:52.332257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:52.332719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:52.333905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:52.535613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:52.552383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2eb20318-a735-4bfc-a31d-8d9910c5888a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1504 microversion: 2.1 time: 0.235462 Aug 23 10:53:52.553014 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1975/4020] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:52 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:52.941081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:52.943192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:52.954906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:52.957905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:52.958667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:52.964725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:52.966195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:52.970201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.133523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:53.153499 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01e2cde6-caa8-4699-a6bc-7683301447f8 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.997142 Aug 23 10:53:53.154367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2046/4021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:52 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:53.168983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:53.169207 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2138a66d-cdda-43cf-ada4-9317549a425e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.236745 Aug 23 10:53:53.169781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1976/4022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:52 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:53.183955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:53.184637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:53.192826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.193335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.193794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.194594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.195178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.196947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.336723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:53.337391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:53.354229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.354739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.355148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:53.355312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.355903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.356372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.356836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.371677 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45b59292-50fe-4fa0-8ea2-3e88b5d4104d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.195515 Aug 23 10:53:53.373038 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1977/4023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:53 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:53.394219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01a986fe-36e4-4d2d-b7f3-0ffedf2eb389 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-898698226", "metadata": {"": ""}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01a986fe-36e4-4d2d-b7f3-0ffedf2eb389 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action HTTP/1.1 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 106 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-898698226", "metadata": {"": ""}}} Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-898698226', 'metadata': {'': ''}}}} Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'': ''} Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:53.400645 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01a986fe-36e4-4d2d-b7f3-0ffedf2eb389 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-01a986fe-36e4-4d2d-b7f3-0ffedf2eb389 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action" status: 400 len: 170 microversion: 2.1 time: 0.013227 Aug 23 10:53:53.406396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1978/4024] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Aug 23 10:53:53 2022] POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action => generated 170 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:53:53.412601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:53.413379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:53.421336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.422051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.423254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.424077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.424797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.425342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.573233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:53.583285 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88f9cb1a-6bc4-448f-8dd4-8ad88a9adf80 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.174582 Aug 23 10:53:53.584488 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1979/4025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:53 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:53.591017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:53.591932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:53.599480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.600388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.601089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.602637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.603308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.603949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.737213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:53.745634 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6140294d-09a1-4711-8fc4-41a4bac41eb3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.413396 Aug 23 10:53:53.746223 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2047/4026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:53 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:53.765270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:53.766101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:53.768709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:53.775179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.775679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.776129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.777059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:53.777618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:53.777968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:53.779966 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90f90766-2547-496e-941b-76c635a0bca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1504 microversion: 2.1 time: 0.194118 Aug 23 10:53:53.780655 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1980/4027] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:53 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:54.075190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:54.083591 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b0d5edd9-7b3f-421d-9a97-1640eaf4c632 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.322230 Aug 23 10:53:54.085774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2048/4028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:53 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:54.106479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73e46ae1-b8f6-4ed6-a574-433673db5390 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1229857833", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73e46ae1-b8f6-4ed6-a574-433673db5390 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action HTTP/1.1 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 619 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1229857833", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1229857833', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:53:54.111393 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 10:53:54.114895 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:54.119423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73e46ae1-b8f6-4ed6-a574-433673db5390 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:54.119423 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73e46ae1-b8f6-4ed6-a574-433673db5390 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action" status: 400 len: 938 microversion: 2.1 time: 0.011794 Aug 23 10:53:54.124965 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1981/4029] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Aug 23 10:53:54 2022] POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action => generated 938 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:53:54.130230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:54.131162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.138352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.139771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.140583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.141661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.142302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.142909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.188349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:54.191318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.198445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.198946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.199386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.200091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.201035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.201297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.227620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lazy-loading 'flavor' on Instance uuid 69836824-35ef-49e2-9b18-8ea94744cc8e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:53:54.319522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:54.319995 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae423335-5c5a-4fee-a874-0a9543ca20b8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action" status: 200 len: 32 microversion: 2.1 time: 0.136719 Aug 23 10:53:54.321182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1982/4030] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:54 2022] POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:53:54.327043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:54.327687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.334344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.334567 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9cb3849a-7417-4dca-82de-dbd63c8553e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.208251 Aug 23 10:53:54.334845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.335167 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2049/4031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:54 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:54.335307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.336511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.337256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.338077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.357775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:54.358500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.364847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.365809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.366190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.366908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.367407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.367848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.498399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:54.506391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5dbce118-a53e-4162-9ef4-98e9aec4ebb2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.183833 Aug 23 10:53:54.506976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1983/4032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:54 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:54.512408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:54.513036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.527647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.528396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.530440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.531420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.532089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.532724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.627545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:54.638499 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07139f9c-fce9-435c-ac13-a1bdb2e39d70 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.297618 Aug 23 10:53:54.640586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2050/4033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:54 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:54.769975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:54.770666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.784456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:54.786047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.786562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.787210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.788108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.789846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.790453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.798371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f8ed83a-7c28-4685-89a0-92652f045413 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.288178 Aug 23 10:53:54.806861 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1984/4034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:54 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:54.811902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:54.812693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:54.819722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.820559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.821486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.822613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:54.823281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:54.823907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:54.829075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:55.139996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:55.149069 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18b9b1ed-c06b-48ce-9489-606ff7ee2a66 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1504 microversion: 2.1 time: 0.339971 Aug 23 10:53:55.158650 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1985/4035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:54 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:55.163878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50e69fe3-f8a6-464c-aeb9-79ec1d3b70eb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50e69fe3-f8a6-464c-aeb9-79ec1d3b70eb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action HTTP/1.1 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 285 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:55.173711 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:53:55.178556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50e69fe3-f8a6-464c-aeb9-79ec1d3b70eb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:55.181376 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50e69fe3-f8a6-464c-aeb9-79ec1d3b70eb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action" status: 400 len: 619 microversion: 2.1 time: 0.019178 Aug 23 10:53:55.188469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1986/4036] 10.222.0.78 () {60 vars in 1279 bytes} [Tue Aug 23 10:53:55 2022] POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:53:55.198891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:55.210724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:55.211758 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8666f3ab-a858-4655-972d-37954084d97c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.446731 Aug 23 10:53:55.213468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:55.221039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2051/4037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:54 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:55.226099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c61ce9c9-277d-4687-9357-0916938babba req-71da7e51-cc4a-4379-bc1b-61522dd3ecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5213bf0f-b9d3-4cd8-88e4-530a4f430820", "name": "network-vif-unplugged", "status": "completed", "tag": "5dc6fa06-4536-42d8-9b80-4893f6db4973"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:55.246387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.252238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.254989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.256337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.260270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.262287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.267547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c61ce9c9-277d-4687-9357-0916938babba req-71da7e51-cc4a-4379-bc1b-61522dd3ecc5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.277372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c61ce9c9-277d-4687-9357-0916938babba req-71da7e51-cc4a-4379-bc1b-61522dd3ecc5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.279633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c61ce9c9-277d-4687-9357-0916938babba req-71da7e51-cc4a-4379-bc1b-61522dd3ecc5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.317540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c61ce9c9-277d-4687-9357-0916938babba req-71da7e51-cc4a-4379-bc1b-61522dd3ecc5 service nova] Creating event network-vif-unplugged:5dc6fa06-4536-42d8-9b80-4893f6db4973 for instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 on n-h2-847009-13 Aug 23 10:53:55.360691 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c61ce9c9-277d-4687-9357-0916938babba req-71da7e51-cc4a-4379-bc1b-61522dd3ecc5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132861 Aug 23 10:53:55.361404 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2052/4038] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:55.531431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:55.532609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:55.549776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:55.552801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.554662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.558694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.559842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.560652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.561395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.567021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bced0571-dff5-4ae6-967a-fa8363adae3f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.375967 Aug 23 10:53:55.569364 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1987/4039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:55 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:55.597920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:55.598650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:55.607031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.607541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.608027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.608765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.609286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.609719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.894179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:55.904866 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c7aa573-8484-43d2-b466-08405c5ebfaf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.380190 Aug 23 10:53:55.906207 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2053/4040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:55 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:55.912043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:55.913913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:55.921896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.923003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.923692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.927316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:55.933028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.937912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9306f3c0-7e62-480e-930c-b8c3c315798e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 0.345026 Aug 23 10:53:55.938778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.939510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.941200 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1988/4041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:55 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:55.983822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-611571843"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:55.987323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:55.994961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.995816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.996506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:55.997565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:55.998107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:55.998640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.186951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:56.215496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:56.226421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:56.237431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a43ee8e-afe1-4744-ab47-1ee94d0aa2f9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.329699 Aug 23 10:53:56.238245 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2054/4042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:55 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:56.259720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:56.261053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:56.267884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.268606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.269385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.270661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.271306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.271911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.352623 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8c6c03a-0171-4dd1-89b2-371b318171a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action" status: 202 len: 0 microversion: 2.1 time: 0.383291 Aug 23 10:53:56.356905 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1989/4043] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:55 2022] POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:53:56.371963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:56.372697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:56.391579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.392928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.393706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.394683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.395327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.395987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.396778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:56.546133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:56.573155 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-289cc070-e6f5-4b86-858c-4eb7c0920679 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1504 microversion: 2.1 time: 0.321645 Aug 23 10:53:56.582129 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2055/4044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:56 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:56.588085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-151135242"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:56.599463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:56.599683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:56.608013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.608013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.608404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.609391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.610562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.611019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.619775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e7a9893-087a-4e75-8694-07314ae35c59 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.261384 Aug 23 10:53:56.634177 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1990/4045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:56 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:56.673271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Cannot 'createImage' instance 1b8db994-e1c8-44a1-9e86-add937250758 while it is in task_state image_snapshot_pending Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action HTTP/1.1 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 84 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-151135242"}} Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'createImage' instance 1b8db994-e1c8-44a1-9e86-add937250758 while it is in task_state image_snapshot_pending Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-151135242'}}} Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b8db994-e1c8-44a1-9e86-add937250758 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:53:56.676393 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 1b8db994-e1c8-44a1-9e86-add937250758 while it is in task_state image_snapshot_pending Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 1b8db994-e1c8-44a1-9e86-add937250758 while it is in task_state image_snapshot_pending Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 409 to user: Cannot 'createImage' instance 1b8db994-e1c8-44a1-9e86-add937250758 while it is in task_state image_snapshot_pending {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5e60c02-956b-4f42-8e50-89b44853206f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action" status: 409 len: 167 microversion: 2.1 time: 0.095345 Aug 23 10:53:56.682671 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2056/4046] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:53:56 2022] POST /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758/action => generated 167 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:53:56.699406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-410303c8-92fa-4d88-899f-1d255eafc011 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '.version_select at 0x7fdc8fe3bf70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:56.907993 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-410303c8-92fa-4d88-899f-1d255eafc011 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/images/f5d2a974-183b-4716-9fc2-1ba743fc0aa7" status: 204 len: 0 microversion: 2.1 time: 0.215125 Aug 23 10:53:56.908666 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1991/4047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:56 2022] DELETE /compute/v2.1/images/f5d2a974-183b-4716-9fc2-1ba743fc0aa7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:53:56.930080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:56.932357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:56.932817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:56.935628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:56.952647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.953281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.955661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.956173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.957956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.958676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.959675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.960448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:56.961882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.962678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:56.963357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:56.967440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.236142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:57.246374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f518e81-2256-4d88-848e-3bdd30585ee6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1542 microversion: 2.1 time: 0.331288 Aug 23 10:53:57.260786 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2057/4048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:56 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1542 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:57.262831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:57.265263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:57.274548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:57.279948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.280462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.280940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.281672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.282853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84b12f6f-867a-435f-a787-1d91dce7b0fc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.358580 Aug 23 10:53:57.282989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.283505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.283949 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1992/4049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:56 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:57.604461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:57.605457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:57.618172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.618715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.619448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.621827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.622559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.623244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.655399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:57.673365 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2926fe02-aac0-4d0e-8a3f-11aff6e4d8ec tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.405414 Aug 23 10:53:57.674159 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2058/4050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:57 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:57.683238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:57.683900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:57.713026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.713533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.713985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.714723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.715196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.715632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.881503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:57.893647 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-867d74c5-96db-4289-839e-3dfcb269663c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 200 len: 1507 microversion: 2.1 time: 0.293852 Aug 23 10:53:57.894734 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1993/4051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:57 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:57.921971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:57.925346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:57.936721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.937486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.938061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.939013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:57.939981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:57.940723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:57.993571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:53:58.017197 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Working on deleting snapshot 339e928f-aefb-4d70-97a2-9016be169df7 from shelved instance... Aug 23 10:53:58.184392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:58.201299 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6dd81805-bae5-468e-9c7d-575a67a4a583 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.525859 Aug 23 10:53:58.221462 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2059/4052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:57 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:58.280234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:58.281820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:58.290447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:58.291286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:58.291949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:58.292909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:58.293659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:58.294334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:58.628809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:58.643963 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81182d9a-e981-4238-b6b1-2faa79c2be60 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1542 microversion: 2.1 time: 0.374427 Aug 23 10:53:58.644647 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2060/4053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:58 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1542 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:53:58.657192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:58.657192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:58.672781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:58.673418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:58.673989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:58.675053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:58.677075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:58.677797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:58.922977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:58.938545 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4090d495-8f44-4edc-800e-08c1b3b78b9b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.292747 Aug 23 10:53:58.939293 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2061/4054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:58 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:58.956427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:58.957982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:58.988473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:58.989327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:58.990019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:58.991229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:58.991897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:58.993249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.298278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:59.311978 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee36492b-74ee-40c7-9a8b-a9420e0bc13b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.371306 Aug 23 10:53:59.313219 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2062/4055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:58 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:59.323211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:59.326584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:59.343070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.343919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.344627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.347268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.350743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.351617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.360128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:53:59.631972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:59.632469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Doing local delete in cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=128860) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 23 10:53:59.634704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.635533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.636212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.638853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 23 10:53:59.644369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] deallocate_for_instance() {{(pid=128860) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 23 10:53:59.656602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51aa8404-0a2c-40d1-89ba-ea58a051fdb8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.342090 Aug 23 10:53:59.657508 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2063/4056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:59 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:53:59.668594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7202acd1-e3c4-4411-9307-077c9ed24882 req-9ffb9e27-e37e-436f-be96-043d2f6c349c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9233d2d2-c13f-4c49-ac96-0784d4022b4f", "name": "network-vif-plugged", "status": "completed", "tag": "abe64a62-3f3c-4b3c-b567-cc16fa541b16"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:53:59.700255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7202acd1-e3c4-4411-9307-077c9ed24882 req-9ffb9e27-e37e-436f-be96-043d2f6c349c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.701874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7202acd1-e3c4-4411-9307-077c9ed24882 req-9ffb9e27-e37e-436f-be96-043d2f6c349c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.702430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7202acd1-e3c4-4411-9307-077c9ed24882 req-9ffb9e27-e37e-436f-be96-043d2f6c349c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.740392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7202acd1-e3c4-4411-9307-077c9ed24882 req-9ffb9e27-e37e-436f-be96-043d2f6c349c service nova] Creating event network-vif-plugged:abe64a62-3f3c-4b3c-b567-cc16fa541b16 for instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f on n-h2-847009-13 Aug 23 10:53:59.769370 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7202acd1-e3c4-4411-9307-077c9ed24882 req-9ffb9e27-e37e-436f-be96-043d2f6c349c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105776 Aug 23 10:53:59.772617 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2064/4057] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:59.786228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:59.791527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:53:59.800236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Searching by: {'deleted': False, 'project_id': '40f8ed91bafc4261b673d721fd244647'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:53:59.810766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.811411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.812271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.813222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.813903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.814537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.876544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:53:59.941974 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a7b83a8b-2eb1-4296-9a81-54d638a6e96f tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.163867 Aug 23 10:53:59.947836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2065/4058] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:53:59 2022] GET /compute/v2.1/servers => generated 333 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:53:59.967493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:53:59.969830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:53:59.986364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.988056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.989248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:53:59.994741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:53:59.995576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:53:59.996291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:00.441448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:00.450551 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a5b103a-c105-46d5-8219-f5a8ffe72f40 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1542 microversion: 2.1 time: 0.491369 Aug 23 10:54:00.451153 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2066/4059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:53:59 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1542 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:00.465230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:00.465230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:00.465230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:00.465230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:00.465230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:00.465748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:00.465920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:00.466364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:00.673048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:00.682410 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1520a827-d8d8-40c2-88f5-05272620c90d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.230112 Aug 23 10:54:00.683005 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2067/4060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:00 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:00.688534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:00.695019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:00.698405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Searching by: {'deleted': False, 'project_id': '40f8ed91bafc4261b673d721fd244647'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:54:00.705224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:00.706211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:00.707162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:00.709372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:00.710103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:00.710728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:00.713271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Updating instance_info_cache with network_info: [] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:54:00.757245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:54:00.969483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:00.996361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:00.997126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:00.997727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.225496 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60bd7bd1-e2e6-4396-8914-b2585dfee1f7 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.541079 Aug 23 10:54:01.226226 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2068/4061] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:54:00 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:01.232336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:01.232983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:01.249731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.250238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.250686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.251406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.251868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.252298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.426336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b88fe4d-40d1-4d87-8528-fbaa56c00d09 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 204 len: 0 microversion: 2.1 time: 3.509934 Aug 23 10:54:01.427517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1994/4062] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:53:57 2022] DELETE /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 0 bytes in 3512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:54:01.434466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:01.439097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:01.460060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.460568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.461088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.462140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.462611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.471795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.513227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:01.526280 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca3db2b8-9b39-41a6-b881-fda771c08a93 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.297535 Aug 23 10:54:01.527371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2069/4063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:01 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:01.532551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3ef3cc02-4cb5-49e8-9e2b-a02b9c1ac171 req-724d79f4-d345-4365-a51b-a1fb006c58c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5213bf0f-b9d3-4cd8-88e4-530a4f430820", "name": "network-vif-deleted", "tag": "5dc6fa06-4536-42d8-9b80-4893f6db4973"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:01.544258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ef3cc02-4cb5-49e8-9e2b-a02b9c1ac171 req-724d79f4-d345-4365-a51b-a1fb006c58c8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.545473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ef3cc02-4cb5-49e8-9e2b-a02b9c1ac171 req-724d79f4-d345-4365-a51b-a1fb006c58c8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.546171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ef3cc02-4cb5-49e8-9e2b-a02b9c1ac171 req-724d79f4-d345-4365-a51b-a1fb006c58c8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.580540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.server_external_events [req-3ef3cc02-4cb5-49e8-9e2b-a02b9c1ac171 req-724d79f4-d345-4365-a51b-a1fb006c58c8 service nova] Unable to find a host for instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820. Dropping event network-vif-deleted {{(pid=128859) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 10:54:01.582476 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3ef3cc02-4cb5-49e8-9e2b-a02b9c1ac171 req-724d79f4-d345-4365-a51b-a1fb006c58c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053293 Aug 23 10:54:01.587582 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2070/4064] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 10:54:01.598604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7699201a-e21d-4562-93c9-8ff9664a170b tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:01.620908 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7699201a-e21d-4562-93c9-8ff9664a170b tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031364 Aug 23 10:54:01.624130 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2071/4065] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:54:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:01.639366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:01.641123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:01.657057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.658624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.659925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.662160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.663469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.666803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.687250 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 HTTP/1.1 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5213bf0f-b9d3-4cd8-88e4-530a4f430820'} Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:01.689410 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:54:01.696575 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:01.698939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:01.700069 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f8b1a7c3-4a82-48b5-b9ef-00eba4bcff08 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 404 len: 111 microversion: 2.1 time: 0.073757 Aug 23 10:54:01.700830 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2072/4066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:01 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:01.705786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:01.706600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:01.714790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.715643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.716369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.717296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.718775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.719790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.857080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:01.874231 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fb93bdd-04b6-4b58-b804-47805dc2d31c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.436261 Aug 23 10:54:01.874231 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1995/4067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:01 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:01.894823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:01.902592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:01.924633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.925326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.927392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.931216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:01.932585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:01.936046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:01.962665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:02.083256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:02.115768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29544c2f-1794-4d9e-a207-6953fdbfc84a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1534 microversion: 2.1 time: 0.413438 Aug 23 10:54:02.117040 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2073/4068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:01 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1534 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:02.120688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:02.122970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-753918853", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:02.133920 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5226a2d-d2a1-4401-b8b7-bf7c4b2159c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1315 microversion: 2.1 time: 0.242905 Aug 23 10:54:02.134625 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1996/4069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:01 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:02.152082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:02.152592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:02.169321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.169914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.170382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.171141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.171616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.182422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.234158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:54:02.243449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:54:02.374416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4b62a4f-2488-46d8-a202-8e1c40175c14 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 204 len: 0 microversion: 2.1 time: 0.238441 Aug 23 10:54:02.375608 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1997/4070] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:54:02 2022] DELETE /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:54:02.387568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:02.388965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:02.397508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.399285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.400469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.401718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.402438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.403264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.669519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:02.680147 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dea2065d-e18b-48ff-8c78-efd1e113df8a tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1700 microversion: 2.1 time: 0.298476 Aug 23 10:54:02.681101 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1998/4071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:02 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1700 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:02.685892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:02.686567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:02.692993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.693482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.693919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.694615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.695147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.696127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.846873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:54:02.848178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:54:02.848956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:54:02.849634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:54:02.850268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:54:02.871230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.871887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.872445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.873458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:02.874041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:02.874685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:02.915859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:02.923284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:02.952932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:54:02.955751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:54:02.983325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:03.000516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5014da2e-436c-4a6e-a65f-0661989c0676 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.318028 Aug 23 10:54:03.001739 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 1999/4072] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:02 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:03.006660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:03.007502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:03.014445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.015317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.016086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.016908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.017492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.017931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.021459 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be09e78d-470c-4da6-80b0-fa1d0ac224a8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902569 Aug 23 10:54:03.024727 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2074/4073] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:54:03.035547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b869f19b-377c-4eba-bb87-18191655ec2a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:03.036187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b869f19b-377c-4eba-bb87-18191655ec2a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:03.106665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b869f19b-377c-4eba-bb87-18191655ec2a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:03.115041 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b869f19b-377c-4eba-bb87-18191655ec2a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1214 microversion: 2.1 time: 0.083555 Aug 23 10:54:03.131886 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2075/4074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:03 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:03.146137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:03.146769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:03.156289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.156756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.157231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.157998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.158420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.158859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.278147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:03.297954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0aefcda1-abc0-4474-a0df-2db530970c16 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.290078 Aug 23 10:54:03.308812 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2000/4075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:03 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:03.308812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:03.308812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:03.320681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.322682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.324650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.326023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.326666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.327544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.454067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:03.462745 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fd14f45d-97da-4d21-a71d-c89f1d4fc6e2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1534 microversion: 2.1 time: 0.321924 Aug 23 10:54:03.463772 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2076/4076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:03 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1534 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:03.608172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:03.626469 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df1c8b14-ac8b-4f67-8681-1259e472147c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1502 microversion: 2.1 time: 0.325661 Aug 23 10:54:03.644474 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2001/4077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:03 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:03.648985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:03.650153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:03.688241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.688901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.689247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.689979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.690440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.690927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.702963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:03.703976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:03.716391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.717469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.718129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.719422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:03.720202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:03.720954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:03.995191 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.network.security_group_api [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Removing security group 37d10921-eccc-4160-8c13-a9ccaf44a505 from port abe64a62-3f3c-4b3c-b567-cc16fa541b16 Aug 23 10:54:03.996765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:04.008589 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5078dca-2e1f-4fb2-ae07-55e757d07fdc tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1700 microversion: 2.1 time: 0.310429 Aug 23 10:54:04.024668 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2002/4078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:03 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1700 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:04.048721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:04.050189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:04.068143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.068731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.069287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.070227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.072099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.072579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.300129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:04.319765 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5501a5e8-e1a1-47ef-a4b9-217722493692 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.283061 Aug 23 10:54:04.332818 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2003/4079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:04 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:04.332818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:04.332818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:04.352369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.352893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.353345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.354064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.354530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.355000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.438727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:04.455527 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2301468c-1d2b-4e8e-93b8-87b5065cb8d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1218 microversion: 2.1 time: 0.131938 Aug 23 10:54:04.455710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa8163e9-f140-4dbb-b7db-b505105646a5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f/action" status: 202 len: 0 microversion: 2.1 time: 0.811520 Aug 23 10:54:04.455823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2004/4080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:04 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:04.459272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2077/4081] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:03 2022] POST /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:54:04.460222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:04.461120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:04.466676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:04.467581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:04.478112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.479182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.480022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.480363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.480967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.481326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.482049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.482565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.482877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.483381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.483527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.484081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.692494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:04.706409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:04.713485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dd4a152-0570-4791-9697-71c533c4ddbc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.246801 Aug 23 10:54:04.719603 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2005/4082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:04 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:04.722301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99db72be-6131-4344-9740-60f6c03fd1e4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1460 microversion: 2.1 time: 0.260949 Aug 23 10:54:04.738378 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2078/4083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:04 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1460 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:04.749958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:04.750662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:04.753391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6ffbd200-4bae-429e-b637-658182e9fe58 req-fd0ac257-bf4e-4085-a4c2-5090913ff7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9233d2d2-c13f-4c49-ac96-0784d4022b4f", "tag": "abe64a62-3f3c-4b3c-b567-cc16fa541b16"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:04.770253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.770765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.771215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.776954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.777713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.777915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.788410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ffbd200-4bae-429e-b637-658182e9fe58 req-fd0ac257-bf4e-4085-a4c2-5090913ff7f0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.789577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ffbd200-4bae-429e-b637-658182e9fe58 req-fd0ac257-bf4e-4085-a4c2-5090913ff7f0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.796957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6ffbd200-4bae-429e-b637-658182e9fe58 req-fd0ac257-bf4e-4085-a4c2-5090913ff7f0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.827525 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6ffbd200-4bae-429e-b637-658182e9fe58 req-fd0ac257-bf4e-4085-a4c2-5090913ff7f0 service nova] Creating event network-changed:abe64a62-3f3c-4b3c-b567-cc16fa541b16 for instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f on n-h2-847009-13 Aug 23 10:54:04.842142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6ffbd200-4bae-429e-b637-658182e9fe58 req-fd0ac257-bf4e-4085-a4c2-5090913ff7f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102365 Aug 23 10:54:04.843089 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2079/4084] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:04.850345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:04.861653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:04.877504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.881782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.882637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.885081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:04.887963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:04.890871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:04.997389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:05.008509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88a8d39c-3bda-475c-a278-c09f4d815b4f tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1534 microversion: 2.1 time: 0.286900 Aug 23 10:54:05.009727 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2006/4085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:04 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1534 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:05.032087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:05.032726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:05.040850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.041356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.041814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.042542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.043015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.043451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.204083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:05.214714 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-860aea82-e3cd-471f-8946-df8400316657 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1700 microversion: 2.1 time: 0.187073 Aug 23 10:54:05.215405 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2007/4086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:05 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1700 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:05.343752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:05.344337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:05.351883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.352374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.352847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.353580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.354050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.354504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.503136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:05.512325 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63356e68-a177-4d0f-9a56-6327a116cc41 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.172638 Aug 23 10:54:05.513192 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2008/4087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:05 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:05.527687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:05.528765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:05.535855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.536046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.536633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.537302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.537914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.538465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.605217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:05.613523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-550105cd-ce58-4cbe-b721-17418d91cecf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1218 microversion: 2.1 time: 0.091025 Aug 23 10:54:05.616783 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2009/4088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:05 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:05.722961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:05.739359 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b85355f1-2899-4bb7-81c3-c961c4a235bf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.894005 Aug 23 10:54:05.744088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2080/4089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:04 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:05.749423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:05.750330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:05.762299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.766495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.767711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:05.768055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.768331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:05.769772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.770471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.771141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.774417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:05.776060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.776841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.777907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.778377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:05.779217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:05.779217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:05.945725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:05.955416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cd991c0-004f-4277-b33b-ee8f39ae72c7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.209775 Aug 23 10:54:05.956279 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2010/4090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:05 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.031170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.032017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.038722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.040355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.041167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.041958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.042494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.043010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.048683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:06.161526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:06.174434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f200b32-7bb6-45b3-bd56-5d2e5dcb360c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.410479 Aug 23 10:54:06.175971 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2081/4091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:05 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.198582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.199476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.208222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.209152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.209793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.211572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.212400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.213044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.218971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:06.227824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-663cc24d-a66d-40ac-b273-82501af81561 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1534 microversion: 2.1 time: 0.200598 Aug 23 10:54:06.228420 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2011/4092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1534 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.245263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.246946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.254991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.255707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.256334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.257250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.258587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.259210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.337048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:06.345299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6470e6f-7a60-4050-9793-36cedaa4709c tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1632 microversion: 2.1 time: 0.108723 Aug 23 10:54:06.346050 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2012/4093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1632 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.536136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.537378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.547112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.547644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.548111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.549046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.549689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.550299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.611687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:06.620810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d76964d9-45c4-441f-9d8f-e03fc33106d8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.428271 Aug 23 10:54:06.622788 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2082/4094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.628130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f1aff2f4-1f40-40d9-9f0e-cf9747a9f5ba req-83c97a44-a0de-4369-94c1-51b90cb7e7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8db994-e1c8-44a1-9e86-add937250758", "name": "network-vif-plugged", "status": "completed", "tag": "6ff1c4f0-e2da-46ba-9371-aa39e8a84f44"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:06.642442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f1aff2f4-1f40-40d9-9f0e-cf9747a9f5ba req-83c97a44-a0de-4369-94c1-51b90cb7e7a4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.643238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f1aff2f4-1f40-40d9-9f0e-cf9747a9f5ba req-83c97a44-a0de-4369-94c1-51b90cb7e7a4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.644048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f1aff2f4-1f40-40d9-9f0e-cf9747a9f5ba req-83c97a44-a0de-4369-94c1-51b90cb7e7a4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.662331 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f1aff2f4-1f40-40d9-9f0e-cf9747a9f5ba req-83c97a44-a0de-4369-94c1-51b90cb7e7a4 service nova] Creating event network-vif-plugged:6ff1c4f0-e2da-46ba-9371-aa39e8a84f44 for instance 1b8db994-e1c8-44a1-9e86-add937250758 on n-h1-847009-13 Aug 23 10:54:06.671348 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f1aff2f4-1f40-40d9-9f0e-cf9747a9f5ba req-83c97a44-a0de-4369-94c1-51b90cb7e7a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046262 Aug 23 10:54:06.672270 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2083/4095] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:06.684197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.686213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.693439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.694229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.694863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.696569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.697450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.698118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.769176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:06.779987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98bf2d04-b564-443c-b016-f70fe1aece85 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.249197 Aug 23 10:54:06.780880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:06.781654 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2013/4096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.787270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.787901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.798689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.799499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.800126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.802052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.803642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-954698ad-e3dd-4980-8923-c50034899fd6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1218 microversion: 2.1 time: 0.124637 Aug 23 10:54:06.803937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.804451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.818534 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2084/4097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:06.980470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:06.981770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:06.991835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.992497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.997289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:06.998439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:06.998975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:06.999530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.010168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:07.025365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:07.037886 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-932e64e1-3171-4d14-88f3-3da6c70d4153 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.254963 Aug 23 10:54:07.040444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2014/4098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:07.046032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a6ff18a0-7d5f-41d5-a5e6-f092a1a8e199 req-533efc49-9cd6-410c-87ba-834244f4d771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b", "name": "network-vif-deleted", "tag": "5af23ff6-6fbd-44a8-b25f-f286912be0b2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:07.057820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a6ff18a0-7d5f-41d5-a5e6-f092a1a8e199 req-533efc49-9cd6-410c-87ba-834244f4d771 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.058333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a6ff18a0-7d5f-41d5-a5e6-f092a1a8e199 req-533efc49-9cd6-410c-87ba-834244f4d771 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.058778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a6ff18a0-7d5f-41d5-a5e6-f092a1a8e199 req-533efc49-9cd6-410c-87ba-834244f4d771 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.091655 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a6ff18a0-7d5f-41d5-a5e6-f092a1a8e199 req-533efc49-9cd6-410c-87ba-834244f4d771 service nova] Creating event network-vif-deleted:5af23ff6-6fbd-44a8-b25f-f286912be0b2 for instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b on n-h2-847009-13 Aug 23 10:54:07.105273 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a6ff18a0-7d5f-41d5-a5e6-f092a1a8e199 req-533efc49-9cd6-410c-87ba-834244f4d771 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063838 Aug 23 10:54:07.106722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2015/4099] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:07.120200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-224075798", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "1c5fdc6a-1777-4c61-b011-ad5f4ef33812"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:07.241670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] validate_networks() for [('1c5fdc6a-1777-4c61-b011-ad5f4ef33812', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:54:07.351010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:07.363771 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-871ad2c4-2633-45d0-881e-200134c5d9f3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.388419 Aug 23 10:54:07.364621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2085/4100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:06 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:07.385884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:07.386827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:07.396241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.397140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.399266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.400558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.401280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.401878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.599242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:07.607926 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d932693b-f4d1-4f30-b97a-8b39e7ce4717 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1534 microversion: 2.1 time: 0.227524 Aug 23 10:54:07.608193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2086/4101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:07 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1534 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:07.613283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:07.613889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:07.621178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.621676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.622254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.623217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.623460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.623892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.665580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.666085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.666527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.666982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lazy-loading 'fault' on Instance uuid fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:54:07.723529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b1ccd5b45247beb31d3e70b16a10dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f8ed91bafc4261b673d721fd244647', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:07.733091 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20016555-1041-43c3-9396-ccaa677a67f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 200 len: 1358 microversion: 2.1 time: 0.122844 Aug 23 10:54:07.735675 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2087/4102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:07 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 1358 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:07.803600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:07.803600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:07.810846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.811515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.812061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.813089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.813583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.814125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.955049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:54:07.955920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:54:07.956414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:54:07.956868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:54:07.966406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:54:07.991921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.992326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.992790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:07.993563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:07.994034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:07.994471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.010353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:08.025748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:08.026609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:08.032972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Getting quotas for user ca80ea2c8904468d9e6944fc274afdb8 and project 8c7fefe975214d6a8482557904472914. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:08.038244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e10c2044-85d6-446e-b0dc-1ed1a8b9c152 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.238636 Aug 23 10:54:08.051800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2088/4103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:07 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:08.051800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:08.051800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:08.052271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:54:08.052760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:54:08.053699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.054904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.055812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.056809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.057711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.058257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.117843 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-132b2e12-c978-432f-8943-1b4f4939b92d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009832 Aug 23 10:54:08.124034 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2016/4104] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:54:08.129309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e28fd9b-572e-49e4-a37e-84071f55b624 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:08.130184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e28fd9b-572e-49e4-a37e-84071f55b624 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:08.142019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:08.152187 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f44001f-06d8-411a-89fd-712b24269da9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1218 microversion: 2.1 time: 0.111378 Aug 23 10:54:08.152770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2089/4105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:08 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:08.277808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e28fd9b-572e-49e4-a37e-84071f55b624 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:08.287332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e28fd9b-572e-49e4-a37e-84071f55b624 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1214 microversion: 2.1 time: 0.161595 Aug 23 10:54:08.289857 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2017/4106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:08 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:08.391358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:08.391983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:08.407355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.407867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.408319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.413614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.414904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.416382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.629236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:08.629872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:08.642369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.642878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.643329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.644052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.644520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.645016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.656153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:08.671298 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ca95046-0faa-4c43-be82-16ad2a2dddd7 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.283896 Aug 23 10:54:08.673563 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2090/4107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:08 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:08.757313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:08.758880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] [instance: fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:08.777202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.779899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.781869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.782833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:08.783315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:08.783756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:08.820949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] HTTP exception thrown: Instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b could not be found. Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Request method failure captured: Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b HTTP/1.1 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLF-rzN29y8KByqpSPkYmGN-clzVeMxmW4rQiHtSGpHKwY5Rvf26Q4v5LDAeR22KTOh1ETBHIrQ_lOt7JauLkDQZaRSrMZ4gtJg_ibu4igA3Cn8kjZtCA0p_-4IS1G6d4wYJ2oLkGch3unNS0FhwbrmB7VlhQIzoC0DUk8sOS0cvSjk Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 40f8ed91bafc4261b673d721fd244647 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-245646247 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/40f8ed91bafc4261b673d721fd244647"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_40f8ed91bafc4261b673d721fd244647", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/40f8ed91bafc4261b673d721fd244647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/40f8ed91bafc4261b673d721fd244647"}]}] Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-245646247 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 40f8ed91bafc4261b673d721fd244647 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-245646247 Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-245646247-project Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 41b1ccd5b45247beb31d3e70b16a10dc Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-245646247-project Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b could not be found. Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b'} Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b could not be found. Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b could not be found. Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:08.822741 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:08.828510 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:08.828510 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:08.828510 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:08.828510 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:08.828510 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b could not be found. Aug 23 10:54:08.828510 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:08.829778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Returning 404 to user: Instance fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:08.831235 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b35ba4c9-8db7-4b43-b06a-20101198f8f6 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b" status: 404 len: 111 microversion: 2.1 time: 0.079754 Aug 23 10:54:08.832336 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2091/4108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:08 2022] GET /compute/v2.1/servers/fdb0e5b5-7712-40c8-8202-1d7c1ec7c20b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:54:08.842590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8597e65d-6b14-424a-b8da-5d420adc8880 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] Calling method '.version_select at 0x7fdc9cb41700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:08.871981 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8597e65d-6b14-424a-b8da-5d420adc8880 tempest-ServersTestJSON-245646247 tempest-ServersTestJSON-245646247-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802449961" status: 202 len: 0 microversion: 2.1 time: 0.034168 Aug 23 10:54:08.875688 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2092/4109] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:54:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802449961 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:54:08.882940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:08.891379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69750804-9e4c-4be5-96bc-2f3f965c04f9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.266186 Aug 23 10:54:08.891973 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2018/4110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:08 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:09.060499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:09.061112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:09.074409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.075161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.075839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.076576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.077100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.077732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.174428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:09.175113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:09.182166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.182662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.183112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.184647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.185171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.185609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.271290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:09.281422 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ae9d7e6-a094-441b-93d2-e15a5223ccb1 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1210 microversion: 2.1 time: 0.111165 Aug 23 10:54:09.282852 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2019/4111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:09 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:09.308459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:09.309650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:09.316876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.317410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.317852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.318565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.319179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.319990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.324696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:09.335329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b2e6ce7-0d65-4241-ba47-87a52bf9b407 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.279270 Aug 23 10:54:09.352144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2093/4112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:09 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:09.395681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:09.406433 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-600d4db1-52fc-455c-826d-3a8588ec6180 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1218 microversion: 2.1 time: 0.101787 Aug 23 10:54:09.407098 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2020/4113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:09 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:09.694113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:09.694736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:09.703048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.704177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.704630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.706017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.706486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.706921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.913590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:09.914578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:09.922197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.923030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.923565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.924360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:09.924931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:09.925432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:09.942902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:09.954773 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-442f5d79-449f-4e69-b474-72e98e51e353 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.264398 Aug 23 10:54:09.955900 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2094/4114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:09 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:10.083224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:10.092312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c3493c2-ea35-42a0-9b2a-ab9f7e294832 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.182952 Aug 23 10:54:10.092921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2021/4115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:09 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:10.306329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:10.307065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:10.313421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.313999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.314537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.315572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.316071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.316537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.358184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:10.358979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:10.365854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.366802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.367449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.368427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.369035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.369700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.412161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:10.436382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc4641f3-1ad2-4229-a770-7d1642c1e999 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1210 microversion: 2.1 time: 0.134705 Aug 23 10:54:10.438483 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2095/4116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:10 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:10.457330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:10.458218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:10.465848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.466339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.467140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.467921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.468578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.469192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.558004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:10.565164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:10.566592 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94c80f48-5c18-419e-b4e4-7f0a04ec851a tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.212546 Aug 23 10:54:10.575406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cefc340e-5a7f-4d9b-a7e8-154264738860 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1218 microversion: 2.1 time: 0.132085 Aug 23 10:54:10.576359 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2096/4117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:10 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:10.585077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2022/4118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:10 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:10.978098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:10.978898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:10.985985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.986602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.987146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:10.987972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:10.988695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:10.989246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.114657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:11.116027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:11.124407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.125274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.126445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.127377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.128127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.128732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.134053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:11.142129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7bae85b-d352-4e13-afcd-5e4f1e927632 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.170411 Aug 23 10:54:11.143078 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2023/4119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:10 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:11.461923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:11.462602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:11.471865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.472771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.473733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.475032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.475729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.477749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.555823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:11.564904 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de96d6a2-4614-480b-9de3-ee3306bd454b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1210 microversion: 2.1 time: 0.109000 Aug 23 10:54:11.566151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2024/4120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:11 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:11.589613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:11.590540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:11.597263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.598053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.598678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.599597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.600230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.604994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.849629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:11.864392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f2d03de-b2fc-4e2f-b422-aaaa60cb3e37 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.279232 Aug 23 10:54:11.876234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:11.883615 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2025/4121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:11 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:11.893101 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-479f750f-608c-41c4-8bb9-451fde96670c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.779331 Aug 23 10:54:11.893732 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2097/4122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:11 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:11.897525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:11.899255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:11.917735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.918210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.918616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:11.919364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:11.919840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:11.920288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.166238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:12.167478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:12.181598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.182103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.182551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.183262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.189387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.190374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.196549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:12.209561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-baa6c05e-e316-4678-b43a-f12ef7ba641b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1210 microversion: 2.1 time: 0.323467 Aug 23 10:54:12.210872 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2026/4123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:11 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1210 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:12.497371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:12.512276 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4eb1e06-6e7b-4d63-86aa-905046287adc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.349699 Aug 23 10:54:12.512276 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2098/4124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:12 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:12.605302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:12.623526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:12.642134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.647009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.648579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.649949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.650799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.651593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.738980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:12.750545 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fa58fb0-e1c3-437d-b008-026ff55e9421 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1210 microversion: 2.1 time: 0.161255 Aug 23 10:54:12.751976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2027/4125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:12 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1210 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:12.889472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:12.890233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:12.893539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:12.909345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.915543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.917248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.918319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:12.919050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.919526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.919704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:12.920335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.939603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.940268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.940775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:12.968942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:12.972130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:12.973575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.114544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:13.306185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:13.319487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86f6564-ba40-470e-bac8-5249c862ea73 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.407270 Aug 23 10:54:13.321639 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2028/4126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:12 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:13.330232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:13.334111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:13.355556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:13.356516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:13.357198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.358178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:13.358890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:13.359948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.462317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:13.469395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1cf37c4-3832-43ee-b3fa-ffe6f58ebd24 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1210 microversion: 2.1 time: 0.146262 Aug 23 10:54:13.469988 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2029/4127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:13 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:13.498560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:13.510371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eeb6cbee-e3b2-4657-8e1b-0c3eb7639fff tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.625592 Aug 23 10:54:13.516482 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2099/4128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:12 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:13.536119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:13.537297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:13.544209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:13.544721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:13.545196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.546067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:13.546579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:13.547151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.553161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:13.767685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:13.772789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:13.774349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:13.782204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-755a1173-b70e-457a-a829-ceda1d7ac0ed tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.252289 Aug 23 10:54:13.785737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2030/4129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:13 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:13.794608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:13.795063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:13.795731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.796245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:13.796714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:13.797185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:13.927886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:13.949406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8902d857-479f-48eb-8399-13c93b001acf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1266 microversion: 2.1 time: 0.181470 Aug 23 10:54:13.952055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2100/4130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:13 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:14.345460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:14.346122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:14.360350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.368487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.368487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.368487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.368487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.368487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.494622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:14.495261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:14.518714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.522280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.523792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.528128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.528980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.529432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.664548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:14.676846 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a083a003-9f4d-4605-ae66-933356525397 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1210 microversion: 2.1 time: 0.188486 Aug 23 10:54:14.683743 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2101/4131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:14 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1210 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:14.694197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:14.695854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:14.697459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:14.712308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.712605 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e2961ac-8bd9-454a-96c2-d9305c4539e6 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.369493 Aug 23 10:54:14.719522 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2031/4132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:14 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:14.724482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.725174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.726825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.727616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.728073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.810964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:14.811838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:14.824011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.824933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.827107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.828391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.830177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.830897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.924244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:14.933727 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db2beae0-8ce1-4ea1-9257-27f9b09cb9d1 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.248594 Aug 23 10:54:14.934662 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2102/4133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:14 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:14.981294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:14.982552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:14.990523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.991082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.991651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:14.992767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:14.993328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:14.994218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:15.001290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:15.089002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:15.092524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:15.103252 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3cd28a8-9c1b-4550-aebe-b5690f887fd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.300600 Aug 23 10:54:15.104768 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2032/4134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:14 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:15.111506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b3270b6b-7080-4f17-a5e4-9539bc2988fe tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1266 microversion: 2.1 time: 0.135812 Aug 23 10:54:15.112163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2103/4135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:14 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:15.704729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:15.706083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:15.722506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:15.723316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:15.724080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:15.725018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:15.727651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:15.728197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:15.738733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:15.739352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:15.747547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:15.748049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:15.748497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:15.749697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:15.749697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:15.750120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:15.830717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:15.839730 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75249562-2306-4764-8e84-7c5b4598e332 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1210 microversion: 2.1 time: 0.143450 Aug 23 10:54:15.840684 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2033/4136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:15 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1210 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:15.933532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:15.943121 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49b87a9b-226f-4e22-90c1-6616b13cdb23 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.208013 Aug 23 10:54:15.944582 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2104/4137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:15 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:15.957072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:15.966254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:15.973918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:15.974523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:15.975423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:15.977186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:15.978506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:15.979093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.126380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:16.127004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:16.137722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.138230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.138684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.139413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.139993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.140472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.141070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:16.150746 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f961c06e-e7c2-4d76-b9fd-ac9283f123cd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.197637 Aug 23 10:54:16.165696 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2034/4138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:15 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:16.165696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:16.165696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:16.165696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.165696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.166222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.167816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.167816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.167816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.247875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:16.257733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-644a8f14-bc46-4a8e-a323-2815f43166e2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1266 microversion: 2.1 time: 0.104182 Aug 23 10:54:16.258732 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2035/4139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:16 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:16.323672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:16.339631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ff71c97-7037-4755-9a58-ff599af6751d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.217056 Aug 23 10:54:16.340477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2105/4140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:16 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:16.520592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7981cea7-5d33-457b-a73c-ceaa716d76ff req-bcd89d86-525e-4200-b01c-d09361ec28f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057c7307-04cc-43f0-8c9d-1233486e4b9e", "name": "network-vif-plugged", "status": "completed", "tag": "d4b89f90-900a-49c6-8ae6-8d854e7c5ffd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:16.543365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7981cea7-5d33-457b-a73c-ceaa716d76ff req-bcd89d86-525e-4200-b01c-d09361ec28f3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.544051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7981cea7-5d33-457b-a73c-ceaa716d76ff req-bcd89d86-525e-4200-b01c-d09361ec28f3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.545700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7981cea7-5d33-457b-a73c-ceaa716d76ff req-bcd89d86-525e-4200-b01c-d09361ec28f3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.581117 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7981cea7-5d33-457b-a73c-ceaa716d76ff req-bcd89d86-525e-4200-b01c-d09361ec28f3 service nova] Creating event network-vif-plugged:d4b89f90-900a-49c6-8ae6-8d854e7c5ffd for instance 057c7307-04cc-43f0-8c9d-1233486e4b9e on n-h1-847009-13 Aug 23 10:54:16.586967 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7981cea7-5d33-457b-a73c-ceaa716d76ff req-bcd89d86-525e-4200-b01c-d09361ec28f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071201 Aug 23 10:54:16.588187 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2036/4141] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:16.862252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:16.862867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:16.887222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.894005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.894563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.895348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.895823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.896669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.970094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:16.971460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:16.990475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.994134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.994268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:16.996522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:16.998934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:16.999614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.047672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:17.060579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edcf1f9b-5d49-42a1-aa2a-35f57ebfd037 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1266 microversion: 2.1 time: 0.201112 Aug 23 10:54:17.061792 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2106/4142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:16 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:17.179254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:17.181232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:17.189626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:17.190126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:17.190615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.191476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:17.191941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:17.192398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.224937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:17.236184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c75e843-efb2-4854-8dc0-8e9c5af45d59 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.271826 Aug 23 10:54:17.237280 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2037/4143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:16 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:17.282067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:17.282992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:17.295666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:17.297066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:17.297717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.299122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:17.299777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:17.301425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.425509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:17.430358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:17.441868 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-618339db-ebe6-406b-b05f-25ecdc95c2d5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.268873 Aug 23 10:54:17.442099 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e6d4370-43ab-45f0-a312-6c2fd678f4fd tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1272 microversion: 2.1 time: 0.166108 Aug 23 10:54:17.444542 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2038/4144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:17 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:17.445877 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2107/4145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:17 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:17.466322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:17.467264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:17.474934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:17.475707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:17.477041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.477962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:17.478607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:17.479258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:17.722600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:17.750394 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b56f85c2-4517-4d40-9087-1084cda5a82c tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.299073 Aug 23 10:54:17.767847 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2039/4146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:17 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:18.092102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:18.094147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:18.109556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.110087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.110538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.111258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.120112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.120869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.264140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:18.265391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:18.269435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:18.284488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.285016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.290801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.292571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.293017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.293466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.293964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:18.365631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:18.388331 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-57462154-6802-438a-8491-24b07ff04e82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1266 microversion: 2.1 time: 0.300636 Aug 23 10:54:18.403470 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2108/4147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:18 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:18.467851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:18.468754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:18.480212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.480711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.481210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.487942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.488646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.492802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.777866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:18.786997 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4c56733-57b4-48fa-ae68-bde6698e2c15 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.323575 Aug 23 10:54:18.791739 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2109/4148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:18 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:18.813785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:18.814406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:18.821097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.824334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.824829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:18.825566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:18.826039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:18.826466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.014974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:19.031040 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1bad873e-58f9-4cf1-ba60-ef5a250b0761 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1540 microversion: 2.1 time: 0.771350 Aug 23 10:54:19.032254 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2040/4149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:18 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1540 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:19.049913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:19.050929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:19.065142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.065664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.068064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.071121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.072311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.072834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.231175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:19.254581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cba7da82-4984-40fe-8cf5-890d59e439ef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.461636 Aug 23 10:54:19.255073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2110/4150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:18 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:19.411171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:19.411786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:19.423691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.425027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.425889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.426813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.428295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.429175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.438951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:19.450512 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64246eed-ee15-4f8a-8525-467f455a2c8d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.416602 Aug 23 10:54:19.451411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2041/4151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:19 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:19.510134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-48ba79d0-72ef-456c-bb17-2b51695db705 req-dcd0ff85-70d9-408e-8e96-52fe063e3c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da", "tag": "dbd8e543-e8fc-4ad5-9e5f-1b9c96222b38"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:19.526656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48ba79d0-72ef-456c-bb17-2b51695db705 req-dcd0ff85-70d9-408e-8e96-52fe063e3c72 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.533795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48ba79d0-72ef-456c-bb17-2b51695db705 req-dcd0ff85-70d9-408e-8e96-52fe063e3c72 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.534444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48ba79d0-72ef-456c-bb17-2b51695db705 req-dcd0ff85-70d9-408e-8e96-52fe063e3c72 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.568046 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-48ba79d0-72ef-456c-bb17-2b51695db705 req-dcd0ff85-70d9-408e-8e96-52fe063e3c72 service nova] Creating event network-changed:dbd8e543-e8fc-4ad5-9e5f-1b9c96222b38 for instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da on n-h1-847009-13 Aug 23 10:54:19.576084 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-48ba79d0-72ef-456c-bb17-2b51695db705 req-dcd0ff85-70d9-408e-8e96-52fe063e3c72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070783 Aug 23 10:54:19.589911 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2042/4152] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:19.669349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:19.687451 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24188159-3c78-4ac8-b2d0-d70846c5dbb0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1266 microversion: 2.1 time: 0.280093 Aug 23 10:54:19.689472 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2111/4153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:19 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:19.818593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:19.819336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:19.834569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.835231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.836189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:19.836973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:19.837602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:19.838096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.039177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:20.048600 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3308fe1f-262d-424a-be6a-99dc4aa2b07f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1502 microversion: 2.1 time: 0.234374 Aug 23 10:54:20.060763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2043/4154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:19 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:20.061008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:20.061008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.071579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afd74992-9b39-4829-befe-67c0c53e8a11"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:20.074208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.089103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.089655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.090116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.090838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.091300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.091776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.097295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.097937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.098573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.099546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.100330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.101216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.134190 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Cannot 'attach_volume' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state rescued Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/os-volume_attachments HTTP/1.1 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 74 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: {"volumeAttachment": {"volumeId": "afd74992-9b39-4829-befe-67c0c53e8a11"}} Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'attach_volume' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state rescued Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'server_id': '69836824-35ef-49e2-9b18-8ea94744cc8e', 'body': {'volumeAttachment': {'volumeId': 'afd74992-9b39-4829-befe-67c0c53e8a11'}}} Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 10:54:20.136588 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state rescued Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state rescued Aug 23 10:54:20.142165 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:20.145898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 409 to user: Cannot 'attach_volume' instance 69836824-35ef-49e2-9b18-8ea94744cc8e while it is in vm_state rescued {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:20.147105 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b97011d-c314-4668-84ab-a1883cf8200f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080725 Aug 23 10:54:20.152726 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2044/4155] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:54:20 2022] POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:54:20.159092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:20.160023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.170119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.170920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.171621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.173268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.173946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.174489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.306705 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5379c4b-5a46-41fb-b43d-274db12897b5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action" status: 202 len: 0 microversion: 2.1 time: 0.152179 Aug 23 10:54:20.308236 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2045/4156] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:20 2022] POST /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:54:20.315295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:20.316379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.330553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.333079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.333845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.334892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.337100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.337836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.428208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:20.442233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfe82587-4a60-4c08-bb90-9cdfc8271e2a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1535 microversion: 2.1 time: 0.387434 Aug 23 10:54:20.456875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2112/4157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:20 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1535 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:20.463145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:20.464046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.473205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.474156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.474827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.475751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.479784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.480064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.700674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:20.722643 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7498279-c575-4366-814d-a45283a1d502 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.412842 Aug 23 10:54:20.731723 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2046/4158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:20 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:20.746518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:20.747161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.759278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.759789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.760241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.760980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.761491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.761873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.800201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:20.886378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:20.900600 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddb990f4-410a-465d-b71f-ef91ae3710b9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.442206 Aug 23 10:54:20.901234 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2113/4159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:20 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:20.912980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:20.917202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:20.928203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.928698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.933034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:20.933735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:20.934216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:20.934655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:21.040464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:21.051757 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7557eff9-6bc0-4169-8676-70cc3b03ee82 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1284 microversion: 2.1 time: 0.148836 Aug 23 10:54:21.053060 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2114/4160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:20 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:21.214486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:21.223705 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4dda1d30-22ee-404a-9129-07af95e3f4d3 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1519 microversion: 2.1 time: 0.490597 Aug 23 10:54:21.228029 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2047/4161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:20 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1519 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:21.465701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:21.467083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:21.480267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:21.483864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:21.484551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:21.485596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:21.487251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:21.489770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:21.756480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:21.758218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:21.777327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:21.777815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:21.778261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:21.778987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:21.780329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:21.780815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.182839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:22.192827 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b1a716f-f5f6-4dcf-8b77-30c5f21d7152 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.442726 Aug 23 10:54:22.193421 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2048/4162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:21 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:22.212980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:22.219153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:22.243309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.245293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.248292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.249163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.252995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.255446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.516867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:22.530272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ee98f04-3c2c-47b1-8797-a39a478f8223 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1522 microversion: 2.1 time: 1.067970 Aug 23 10:54:22.531465 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2115/4163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:21 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:22.536495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:22.537497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:22.547669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.548375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.548977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.549762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.551535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.552110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.698561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:22.713764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6be778b-b7d7-4e8c-8eaf-33a0c5d2c50c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.518260 Aug 23 10:54:22.728904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2049/4164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:22 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:22.737407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:22.740237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:22.755367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.758013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.758688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.762891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.765041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.766478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.902240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:22.920485 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13dd0e69-270d-4e5c-87e7-6776c1d4f4d7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1272 microversion: 2.1 time: 0.387689 Aug 23 10:54:22.922292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2116/4165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:22 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1272 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:22.928124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:22.929448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:22.943698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.944969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.945817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:22.947589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:22.948436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:22.949172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.006469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:54:23.126045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d27ce41-5bd8-4704-88e7-53992205ddbb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 204 len: 0 microversion: 2.1 time: 0.201302 Aug 23 10:54:23.126847 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2117/4166] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:54:22 2022] DELETE /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:54:23.141147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:23.142307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:23.152302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.153305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.153985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.154889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.155540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.185798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.274960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:23.505787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:23.523277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0913fe99-fc53-4b20-aa56-0057e24780fd tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.790187 Aug 23 10:54:23.525368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2050/4167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:22 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:23.540970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:23.541820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:23.562664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.563181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.563650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.580360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.584267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.584826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.613243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:23.625845 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24ed4d06-76da-4267-921c-227fa0d31e27 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1528 microversion: 2.1 time: 0.493966 Aug 23 10:54:23.626612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2118/4168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:23 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1528 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:23.641076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:23.643061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:23.660970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.661720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.662299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.663162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.669326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.670060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.945550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:23.966835 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64632625-dcfd-4d59-a945-287abb78c456 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.338717 Aug 23 10:54:23.968145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2119/4169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:23 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:23.973566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:23.974604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:23.981835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.982653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.983282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:23.984342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:23.985038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:23.985768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.208645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:24.220146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d21a2e48-dca5-477b-bdad-8f27043c612c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.250246 Aug 23 10:54:24.233303 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2120/4170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:23 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:24.240494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:24.241983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:24.251284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.252222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.253540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.255076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.255878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.256517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.322864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:24.332269 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-680122d1-0b3a-4b73-9628-e2d393c1583c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.805556 Aug 23 10:54:24.333134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2051/4171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:23 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:24.354146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:24.355156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:24.362509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.363349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.364337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.365939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.366764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.367472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.469232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:24.478565 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a8c9034-94d9-4b84-ad38-1b19aff194c4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.243882 Aug 23 10:54:24.479414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2121/4172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:24 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:24.639021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:24.650562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:24.651532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:24.657858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c4f0a67-6e6f-4c69-9152-3a453c214bcc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.310954 Aug 23 10:54:24.664358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.664983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.665573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.666777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.667307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.667804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.673777 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2052/4173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:24 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:24.681412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44944123-cc44-4d4e-ad41-fc1e0144a96d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:24.687351 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-44944123-cc44-4d4e-ad41-fc1e0144a96d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 101f08df-2baa-44a4-9ac2-542dba9ab603 has no mapping to a cell. Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44944123-cc44-4d4e-ad41-fc1e0144a96d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/101f08df-2baa-44a4-9ac2-542dba9ab603/action HTTP/1.1 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 15 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: {"os-stop": {}} Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 101f08df-2baa-44a4-9ac2-542dba9ab603 has no mapping to a cell. Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '101f08df-2baa-44a4-9ac2-542dba9ab603', 'body': {'os-stop': {}}} Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 101f08df-2baa-44a4-9ac2-542dba9ab603 has no mapping to a cell. Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:24.714421 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 101f08df-2baa-44a4-9ac2-542dba9ab603 has no mapping to a cell. Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 101f08df-2baa-44a4-9ac2-542dba9ab603 has no mapping to a cell. Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-44944123-cc44-4d4e-ad41-fc1e0144a96d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 101f08df-2baa-44a4-9ac2-542dba9ab603 has no mapping to a cell. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-44944123-cc44-4d4e-ad41-fc1e0144a96d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/101f08df-2baa-44a4-9ac2-542dba9ab603/action" status: 404 len: 117 microversion: 2.1 time: 0.039412 Aug 23 10:54:24.722395 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2053/4174] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:24 2022] POST /compute/v2.1/servers/101f08df-2baa-44a4-9ac2-542dba9ab603/action => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:54:24.731508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:24.732548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:24.754015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.754893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.755523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:24.758745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:24.759603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:24.760287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.120620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:25.133576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8697975-e2cb-47b4-a271-bb27bbfc153e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.408598 Aug 23 10:54:25.134829 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2054/4175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:24 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:25.163006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:25.165225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:25.178656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:25.186059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:25.186560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.190569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:25.191537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:25.196260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.326544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:25.335731 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78e054a6-7e54-4d1a-8e68-074fddc04794 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1528 microversion: 2.1 time: 0.691544 Aug 23 10:54:25.337072 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2122/4176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:24 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1528 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:25.343135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:25.343956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:25.357675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:25.358337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:25.358975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.359965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:25.360607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:25.361222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.513562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:25.525080 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b3047be-8433-4cf3-88a9-ca661d877057 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.370452 Aug 23 10:54:25.526639 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2055/4177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:25 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:25.533592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:25.534479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:25.541383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:25.542559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:25.543178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.544077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:25.544763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:25.545365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:25.573144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:25.584484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddb116cf-21fb-461f-97dc-de96e5870141 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.246147 Aug 23 10:54:25.585231 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2123/4178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:25 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:25.790098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:25.802871 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5932425-3403-469f-bf7b-d712b90d1338 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.273222 Aug 23 10:54:25.804440 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2056/4179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:25 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:25.816585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93ebb50c-2f3d-4c78-ae75-3d90577c9fea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:25.817470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93ebb50c-2f3d-4c78-ae75-3d90577c9fea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: e17825d0-0ab5-4ea9-b8c6-743877391d2e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:25.827708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-93ebb50c-2f3d-4c78-ae75-3d90577c9fea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance e17825d0-0ab5-4ea9-b8c6-743877391d2e could not be found. Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93ebb50c-2f3d-4c78-ae75-3d90577c9fea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/e17825d0-0ab5-4ea9-b8c6-743877391d2e/action HTTP/1.1 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 15 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: {"suspend": {}} Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance e17825d0-0ab5-4ea9-b8c6-743877391d2e could not be found. Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'e17825d0-0ab5-4ea9-b8c6-743877391d2e', 'body': {'suspend': {}}} Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e17825d0-0ab5-4ea9-b8c6-743877391d2e could not be found. Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e17825d0-0ab5-4ea9-b8c6-743877391d2e could not be found. Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:25.838532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:25.844474 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:25.844474 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:25.844474 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e17825d0-0ab5-4ea9-b8c6-743877391d2e could not be found. Aug 23 10:54:25.844474 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:25.844474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93ebb50c-2f3d-4c78-ae75-3d90577c9fea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance e17825d0-0ab5-4ea9-b8c6-743877391d2e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:25.844474 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93ebb50c-2f3d-4c78-ae75-3d90577c9fea tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/e17825d0-0ab5-4ea9-b8c6-743877391d2e/action" status: 404 len: 111 microversion: 2.1 time: 0.032582 Aug 23 10:54:25.849839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2057/4180] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:25 2022] POST /compute/v2.1/servers/e17825d0-0ab5-4ea9-b8c6-743877391d2e/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:26.021618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:26.023869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:26.031982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.032823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.033719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.034652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.035939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.036532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.146536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45a050ae-9922-4762-9ddb-278adb58fc32 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Action: 'create', calling method: .version_select at 0x7fdc9c463310>, body: {"keypair": {"name": "tempest-keypair-1135365970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYjiOiV/U21NbNb0swDJ0cfNXbM4dtIh7gTqq0VeMQb1OsVTnLCshVQ5qJK7nJWPfhPZXMjwO3jNV1ze88iyZygYx+BW0Q3tWKsmWLvo6UeU03llkX6on6GPLGlAinOsw=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:26.172132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-45a050ae-9922-4762-9ddb-278adb58fc32 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Getting quotas for project ced522a415c24aff94350cdbd8ad197a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:26.178830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:26.180933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-45a050ae-9922-4762-9ddb-278adb58fc32 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Getting quotas for user 01a83a44e1ea47d2be803e63351c2aad and project ced522a415c24aff94350cdbd8ad197a. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:26.195209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:26.205591 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28911d30-bb39-4bcc-8819-51f921f57cf8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.617095 Aug 23 10:54:26.206432 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2124/4181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:25 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:26.213588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:26.215337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:26.222965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.224150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.224785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.226021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.226960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.227581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.232197 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45a050ae-9922-4762-9ddb-278adb58fc32 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.376081 Aug 23 10:54:26.234853 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2058/4182] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:54:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:26.240355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8ac71b65-6922-4cea-93b2-73aa869350bb req-14f4c64e-e9f2-4888-ba6e-901c53052560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79148d86-86de-46ef-8097-55b671c0c24e", "tag": "947d9885-5b8f-4c8d-b8c7-7493796bd94c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:26.250982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8ac71b65-6922-4cea-93b2-73aa869350bb req-14f4c64e-e9f2-4888-ba6e-901c53052560 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.251705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8ac71b65-6922-4cea-93b2-73aa869350bb req-14f4c64e-e9f2-4888-ba6e-901c53052560 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.252494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8ac71b65-6922-4cea-93b2-73aa869350bb req-14f4c64e-e9f2-4888-ba6e-901c53052560 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.268774 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8ac71b65-6922-4cea-93b2-73aa869350bb req-14f4c64e-e9f2-4888-ba6e-901c53052560 service nova] Creating event network-changed:947d9885-5b8f-4c8d-b8c7-7493796bd94c for instance 79148d86-86de-46ef-8097-55b671c0c24e on n-h1-847009-13 Aug 23 10:54:26.274452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8ac71b65-6922-4cea-93b2-73aa869350bb req-14f4c64e-e9f2-4888-ba6e-901c53052560 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038032 Aug 23 10:54:26.275513 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2059/4183] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:26.361700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:26.362616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:26.384571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.388007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.388646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.389774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.390051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.390494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.502558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:26.511448 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47d54041-263c-45d5-ade1-60ace22db5b8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.303461 Aug 23 10:54:26.515705 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2125/4184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:26 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:26.550002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:26.556634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:26.572959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:26.579261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.580035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.580493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.581269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.583018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.583473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.662342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:26.678774 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e6cef68-2976-4d05-9c9e-3fe90a1d4a7c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1528 microversion: 2.1 time: 0.322788 Aug 23 10:54:26.681035 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2060/4185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:26 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1528 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:26.687905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a7be10ec-8e06-4654-8665-c933c263d31e req-92eb0224-d31e-4422-b424-ed23349f8e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8db994-e1c8-44a1-9e86-add937250758", "name": "network-vif-unplugged", "status": "completed", "tag": "6ff1c4f0-e2da-46ba-9371-aa39e8a84f44"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:26.700976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a7be10ec-8e06-4654-8665-c933c263d31e req-92eb0224-d31e-4422-b424-ed23349f8e0f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.702343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a7be10ec-8e06-4654-8665-c933c263d31e req-92eb0224-d31e-4422-b424-ed23349f8e0f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.703581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a7be10ec-8e06-4654-8665-c933c263d31e req-92eb0224-d31e-4422-b424-ed23349f8e0f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.726781 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a7be10ec-8e06-4654-8665-c933c263d31e req-92eb0224-d31e-4422-b424-ed23349f8e0f service nova] Creating event network-vif-unplugged:6ff1c4f0-e2da-46ba-9371-aa39e8a84f44 for instance 1b8db994-e1c8-44a1-9e86-add937250758 on n-h1-847009-13 Aug 23 10:54:26.736351 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a7be10ec-8e06-4654-8665-c933c263d31e req-92eb0224-d31e-4422-b424-ed23349f8e0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053077 Aug 23 10:54:26.737780 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2061/4186] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:26.747401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:26.749296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:26.757930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.759013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.759863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.761172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.761810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.762606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.911914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:26.921483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-052d85f7-0845-45b1-90ff-33e11ee3f478 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.387554 Aug 23 10:54:26.923458 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2126/4187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:26 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:26.929633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:26.930585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:26.946883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.947642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.948182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.950160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:26.951320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:26.953526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:26.980008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:26.997048 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ceba236d-db57-4daf-b90d-efec56b0b7e4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.257045 Aug 23 10:54:27.008944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2062/4188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:26 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:27.013969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:27.014525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:27.021040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.021646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.022301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.023571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.024039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.024656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.054495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lazy-loading 'flavor' on Instance uuid 057c7307-04cc-43f0-8c9d-1233486e4b9e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:54:27.140916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0eb4bd74-f98c-4bfb-8893-ab01703f308e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.136851 Aug 23 10:54:27.141893 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2063/4189] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:27 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:54:27.151587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:27.152609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:27.160275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.161134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.161754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.162675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.163392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.164261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.197239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:27.205834 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4663d06-33b1-4f2f-b6a2-34b98b846d87 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.281053 Aug 23 10:54:27.220180 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2127/4190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:26 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:27.229383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:27.233622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:27.241007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.242396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.243210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.244301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.244958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.245545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.367130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:27.378890 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26f36f71-af80-4d85-b48f-d6f6fb332a7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1514 microversion: 2.1 time: 0.232424 Aug 23 10:54:27.381149 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2064/4191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:27 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:27.503774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:27.513461 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85c8ec64-3f87-410d-bf43-10bc7fd58c67 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.289622 Aug 23 10:54:27.528137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2128/4192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:27 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:27.704974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:27.705604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:27.712838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.713597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.713781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.714492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:27.714947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:27.715386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:27.916323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:27.927512 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b43033ab-77dd-4a92-b549-3e10c6a981fb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1528 microversion: 2.1 time: 0.226624 Aug 23 10:54:27.928364 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2065/4193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:27 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1528 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:28.023676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:28.024308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:28.038915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.039878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.040515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.041445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.042076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.042686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.226766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:28.227596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:28.248645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.250631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.251828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.252782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.255462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.256028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.475046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:28.482589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:28.497536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7d67135-6bbc-4c29-9e57-1786f782f106 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.275225 Aug 23 10:54:28.498748 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2066/4194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:28 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:28.504011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:28.504624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:28.515234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.516290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.517047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.517952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.518709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.519318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.743541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:28.757842 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51a21758-eec7-4a03-9755-b4a0396e2c77 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.736381 Aug 23 10:54:28.763531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2129/4195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:28 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:28.769198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:28.778354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:28.779853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:28.786856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.787560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.788272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.789897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4309ab84-96f3-48bf-a975-853718d43dab tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1514 microversion: 2.1 time: 0.289958 Aug 23 10:54:28.790812 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2067/4196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:28 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:28.791046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.791629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.792077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.954206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:28.955004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:28.964699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.965827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.966323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:28.967379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:28.968039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:28.968585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.195803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:29.205934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-700a88aa-af4c-445a-815d-08e5d01f791e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1528 microversion: 2.1 time: 0.257717 Aug 23 10:54:29.215259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:29.218858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2068/4197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:28 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1528 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:29.246003 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-422eee94-37fd-4ed4-af20-7c3674a89d01 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.481296 Aug 23 10:54:29.249196 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2130/4198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:28 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:29.296018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-815627100", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "448f2ab5-f8eb-4914-9c81-0661491ffb41"}], "security_groups": [{"name": "tempest-securitygroup--1297644813"}], "key_name": "tempest-keypair-1135365970", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:29.445373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cc7f13d2-3ccb-49b1-aa11-9cf196e564d5 req-871f5c39-fa21-4175-9b93-a640e6e6fa76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b8db994-e1c8-44a1-9e86-add937250758", "name": "network-vif-deleted", "tag": "6ff1c4f0-e2da-46ba-9371-aa39e8a84f44"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:29.459372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cc7f13d2-3ccb-49b1-aa11-9cf196e564d5 req-871f5c39-fa21-4175-9b93-a640e6e6fa76 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.460576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cc7f13d2-3ccb-49b1-aa11-9cf196e564d5 req-871f5c39-fa21-4175-9b93-a640e6e6fa76 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.461317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cc7f13d2-3ccb-49b1-aa11-9cf196e564d5 req-871f5c39-fa21-4175-9b93-a640e6e6fa76 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.476807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] validate_networks() for [('448f2ab5-f8eb-4914-9c81-0661491ffb41', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:54:29.480901 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cc7f13d2-3ccb-49b1-aa11-9cf196e564d5 req-871f5c39-fa21-4175-9b93-a640e6e6fa76 service nova] Creating event network-vif-deleted:6ff1c4f0-e2da-46ba-9371-aa39e8a84f44 for instance 1b8db994-e1c8-44a1-9e86-add937250758 on n-h1-847009-13 Aug 23 10:54:29.494368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cc7f13d2-3ccb-49b1-aa11-9cf196e564d5 req-871f5c39-fa21-4175-9b93-a640e6e6fa76 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054588 Aug 23 10:54:29.498545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2131/4199] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:29.525269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:29.531353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:29.538599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.539352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.539878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.541711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.545033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.545744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.749150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:29.758606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c07f84d-1c8f-452e-b2e0-26745f1afc1b tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.243979 Aug 23 10:54:29.760791 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2132/4200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:29 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:29.790805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:29.792190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:29.799906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.800521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.801007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.802324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.802805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.803245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.958645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:29.969503 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1988550-4fa4-40c0-b627-61b36ce8968b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1510 microversion: 2.1 time: 0.185622 Aug 23 10:54:29.977167 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2133/4201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:29 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:29.977167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:29.977167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:29.984254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.984904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.985474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:29.986430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:29.986992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:29.987512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.042842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Getting quotas for project ced522a415c24aff94350cdbd8ad197a. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:30.050015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Getting quotas for user 01a83a44e1ea47d2be803e63351c2aad and project ced522a415c24aff94350cdbd8ad197a. Resources: dict_keys(['metadata_items']) {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:30.068545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:54:30.069269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:54:30.070684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:54:30.071214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:54:30.071741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:54:30.080668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.081415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.081931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.082964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.083528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.084056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.103847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Getting quotas for project ced522a415c24aff94350cdbd8ad197a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:30.109505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Getting quotas for user 01a83a44e1ea47d2be803e63351c2aad and project ced522a415c24aff94350cdbd8ad197a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:30.124983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:54:30.127660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:54:30.139929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:30.149952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e47a8162-9faa-465e-a2fe-157e74d058c6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1514 microversion: 2.1 time: 0.177684 Aug 23 10:54:30.150463 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2134/4202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:29 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:30.180796 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b64ea52a-ee66-403e-988d-fbb4cb3651ae tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.889511 Aug 23 10:54:30.181624 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2069/4203] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:54:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:54:30.192078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d0d40da-ea86-4182-bfa7-e00de89aa1e4 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:30.192691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d0d40da-ea86-4182-bfa7-e00de89aa1e4 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:30.243535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:30.245943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:30.268111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.268786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.269279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.270216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.273159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.273950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.275211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d0d40da-ea86-4182-bfa7-e00de89aa1e4 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:30.283964 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d0d40da-ea86-4182-bfa7-e00de89aa1e4 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1277 microversion: 2.1 time: 0.095114 Aug 23 10:54:30.284559 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2135/4204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:30 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:30.293925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:30.295022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:30.304999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.305934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.306802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.307885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.308626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.309373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.345417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:30.404934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:30.419642 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-507072d9-27ea-44fe-91f7-38030c0aa8fc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1486 microversion: 2.1 time: 0.186402 Aug 23 10:54:30.421286 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2070/4205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:30 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1486 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:30.782489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:30.782807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:30.803104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.818545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.819108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:30.827288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:30.829409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:30.835048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.055290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:31.071299 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58fbf533-b308-4be3-bf59-f014df9b7d5e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.783084 Aug 23 10:54:31.073365 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2136/4206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:30 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:31.092189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:31.098008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:31.102454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:31.116821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.117764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.118465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.119555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.120317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.120576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e9d4098-e021-4340-a173-3c4dc7bc2c00 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.343126 Aug 23 10:54:31.121512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.146788 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2071/4207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:30 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:31.170859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:31.171822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:31.179357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.179865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.180304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.181113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.181577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.182007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.449300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:31.449823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:31.462425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9447131b-a486-4121-a250-0eef7baf16a2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1516 microversion: 2.1 time: 0.383690 Aug 23 10:54:31.463038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2137/4208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:31 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1516 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:31.471037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:31.471657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:31.478775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de32bb6e-cfd9-4012-90e0-8847cb634f6b tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1497 microversion: 2.1 time: 0.311749 Aug 23 10:54:31.479573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.480275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.480457 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2072/4209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:31 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1497 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:31.497152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:31.497485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.497765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:31.498481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.499035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.499466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.518209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.519275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.520241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.523082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.524526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.525382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.603488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.605687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.609692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.610714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lazy-loading 'fault' on Instance uuid 1b8db994-e1c8-44a1-9e86-add937250758 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:54:31.669756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:31.681389 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebd919d9-fd8a-473c-8c27-ff9f2495e113 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 200 len: 1315 microversion: 2.1 time: 0.199603 Aug 23 10:54:31.682680 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2073/4210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:31 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:31.689305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c8dd7d46-8a60-4551-83c0-1c5e7fac7a93 req-8fd50bdf-47fb-4568-ab63-d0a3117648fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da", "name": "network-vif-plugged", "status": "completed", "tag": "dbd8e543-e8fc-4ad5-9e5f-1b9c96222b38"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:31.703078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8dd7d46-8a60-4551-83c0-1c5e7fac7a93 req-8fd50bdf-47fb-4568-ab63-d0a3117648fc service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.703760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8dd7d46-8a60-4551-83c0-1c5e7fac7a93 req-8fd50bdf-47fb-4568-ab63-d0a3117648fc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.704195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8dd7d46-8a60-4551-83c0-1c5e7fac7a93 req-8fd50bdf-47fb-4568-ab63-d0a3117648fc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.723424 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c8dd7d46-8a60-4551-83c0-1c5e7fac7a93 req-8fd50bdf-47fb-4568-ab63-d0a3117648fc service nova] Creating event network-vif-plugged:dbd8e543-e8fc-4ad5-9e5f-1b9c96222b38 for instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da on n-h1-847009-13 Aug 23 10:54:31.729666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c8dd7d46-8a60-4551-83c0-1c5e7fac7a93 req-8fd50bdf-47fb-4568-ab63-d0a3117648fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045676 Aug 23 10:54:31.733716 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2074/4211] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:31.739420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:31.740604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:31.748919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.749718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.750325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.751387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.752045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.752639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.785476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lazy-loading 'flavor' on Instance uuid 057c7307-04cc-43f0-8c9d-1233486e4b9e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:54:31.803155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:31.817702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f9c441f-dec6-498d-8c33-fb35eb20254e tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1273 microversion: 2.1 time: 0.352433 Aug 23 10:54:31.819899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2138/4212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:31 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:31.824232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'suspend' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state suspended Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 15 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: {"suspend": {}} Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'suspend' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state suspended Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'suspend': {}}} Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state suspended. Cannot suspend while the instance is in this state. Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 23 10:54:31.825822 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state suspended Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state suspended Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'suspend' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state suspended {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-77c581c8-2333-4f17-b44e-b354c8b40407 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 148 microversion: 2.1 time: 0.092485 Aug 23 10:54:31.831002 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2075/4213] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:31 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 148 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:54:31.843316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:31.843868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:31.865579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.867951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.870086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:31.871346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:31.873882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:31.875004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.066321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf664937-3db0-494e-947c-aa90ba849030 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 202 len: 0 microversion: 2.1 time: 0.231847 Aug 23 10:54:32.067231 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2139/4214] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:31 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:54:32.078592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:32.080978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:32.095022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:32.096190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:32.103570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.104885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.107063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.109804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.110651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.111204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.116602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.117467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.118012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.120275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.121906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.123731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.314132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:32.318851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:32.322824 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08f9c867-aad7-454b-968d-f13052bd8756 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.233903 Aug 23 10:54:32.324218 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2140/4215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:32 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:32.330974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:32.331975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:32.332858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb218821-eaa4-401a-9131-80334b9ef751 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1503 microversion: 2.1 time: 0.260488 Aug 23 10:54:32.334320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2076/4216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:32 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:32.352848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.353403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.353847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.354560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.355022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.355444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.623193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:32.635948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e85f6f1-a7b4-49ac-84bc-9eca3aa86a78 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.309456 Aug 23 10:54:32.653263 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2141/4217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:32 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:32.707754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:32.709106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:32.717699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.718256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.718802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.719543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.720078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.720664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.738929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 HTTP/1.1 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758'} Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:32.741963 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:54:32.748098 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:32.749716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:32.750803 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45cb5fdb-4997-42e2-99fd-ef84d9d5cfd0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 404 len: 111 microversion: 2.1 time: 0.049131 Aug 23 10:54:32.751977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2077/4218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:32 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:32.765714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85f70947-9483-4111-9e3d-fdd288da897a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'create', calling method: .version_select at 0x7fdc9c258430>, body: {"keypair": {"name": "tempest-keypair-553864871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4l4adCSibJjet/pj7rdS5GiWC0ZDtw6qJBVmiO2d37uobnoyzYMhF9adh3vqUrP/YLwoikW7MWll0FW9ObDytcbZhSlMXxVJhMVmy2lG7MF1crN65OH1Kf09a4UK3sDQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:32.785157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-85f70947-9483-4111-9e3d-fdd288da897a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:32.791790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-85f70947-9483-4111-9e3d-fdd288da897a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for user e0ff1121d80f493aa4d6d0b62a583d32 and project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:32.822474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85f70947-9483-4111-9e3d-fdd288da897a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061581 Aug 23 10:54:32.823767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2142/4219] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:54:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:54:32.844431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:32.845241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:32.864699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.865908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.866574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.867992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:32.868846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:32.869769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:32.990115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:33.010444 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-926b637a-4e20-4f85-94ed-645aba2909df tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1335 microversion: 2.1 time: 0.170391 Aug 23 10:54:33.017539 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2078/4220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:32 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:33.346146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:33.347383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:33.359557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:33.360134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:33.360601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:33.361267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:33.361631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:33.362364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:33.363005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:33.363624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:33.372645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:33.373841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:33.374392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:33.375229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:33.375793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:33.376362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:33.572579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:33.589992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:33.590486 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59bf56b1-db49-49d4-aea8-a2912ba890bc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.248140 Aug 23 10:54:33.592200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2143/4221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:33 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:33.601720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-975bb81b-5243-4ec6-99b8-00b0c35cc19d tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1503 microversion: 2.1 time: 0.247323 Aug 23 10:54:33.603268 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2079/4222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:33 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:33.661408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:33.662462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:33.670126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:33.670886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:33.671328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:33.672147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:33.672611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:33.673197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.014239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:34.036514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d317376c-d5b1-43f7-ac5e-7666644a8b72 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.378432 Aug 23 10:54:34.037532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2144/4223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:33 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:34.043896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:34.046273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:34.058295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:34.059513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:34.059513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.059979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:34.060433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:34.060911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.267628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e34245bb-2a7d-4ca1-a816-35e4a3aba293 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'create', calling method: .version_select at 0x7fdca1d5ce50>, body: {"keypair": {"name": "tempest-keypair-804367118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2CmPXrnlC9i1NO043ulJWFSRbVpWOJEIjD5WO+g/Tq5XnQrtRhwnWDccpDNuSTjfRcCHqek4NnS4l/X/bjAnB/kvYwBQbRzz9jl5+31XcCinwAsDXO3bPS1jcNwLuugw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:34.307456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e34245bb-2a7d-4ca1-a816-35e4a3aba293 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for project e8e517070ce248b08c60a477f1e40f00. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:34.318643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e34245bb-2a7d-4ca1-a816-35e4a3aba293 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for user 661fb95cf8664a7a8eb9322155164792 and project e8e517070ce248b08c60a477f1e40f00. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:34.325982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:34.341526 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d7ac0eb-13ff-48f6-ad8c-5d76f475e0e0 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.306946 Aug 23 10:54:34.356966 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2080/4224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:34 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:34.395327 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e34245bb-2a7d-4ca1-a816-35e4a3aba293 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131782 Aug 23 10:54:34.396981 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2145/4225] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:54:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:54:34.614201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:34.615155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:34.624679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:34.625611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:34.626403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.627639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:34.628848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:34.629468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:34.629624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:34.630295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.637942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:34.638830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:34.639650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.640676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:34.641457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:34.642180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:34.802636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:34.811293 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25682708-6702-441d-b102-880af9e05a22 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.201157 Aug 23 10:54:34.812413 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2081/4226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:34 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:35.058739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:35.060016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:35.066323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.066817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.067250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:35.068230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.069960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.070756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:35.080901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:35.089943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a74a0ab2-bc1e-4b2d-8c1b-1fe08119bcd8 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1503 microversion: 2.1 time: 0.470015 Aug 23 10:54:35.100860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2146/4227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:34 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:35.309342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:35.323756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a31f88a-45b3-4ed0-97fc-0c2086a93116 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1314 microversion: 2.1 time: 0.269491 Aug 23 10:54:35.325222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2082/4228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:35 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:35.373948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:35.374560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:35.383514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.384006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.384447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:35.397766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.400220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.401372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:35.798293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fb52d3a7-99f8-4e28-b589-73aa2ebce841 req-f1538f6e-24be-4644-aeca-273abaa60040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cf52c2-0122-4173-8324-e7e3cccc60f1", "tag": "b7e7104c-d4e3-46f7-91be-098c41efd681"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:35.813247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:35.821295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fb52d3a7-99f8-4e28-b589-73aa2ebce841 req-f1538f6e-24be-4644-aeca-273abaa60040 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.821777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fb52d3a7-99f8-4e28-b589-73aa2ebce841 req-f1538f6e-24be-4644-aeca-273abaa60040 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.822208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fb52d3a7-99f8-4e28-b589-73aa2ebce841 req-f1538f6e-24be-4644-aeca-273abaa60040 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:35.839602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9bb2ab6-c277-438a-a9af-4b6a8e2d61f2 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.465018 Aug 23 10:54:35.855580 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2147/4229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:35 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:35.860585 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fb52d3a7-99f8-4e28-b589-73aa2ebce841 req-f1538f6e-24be-4644-aeca-273abaa60040 service nova] Creating event network-changed:b7e7104c-d4e3-46f7-91be-098c41efd681 for instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 on n-h2-847009-13 Aug 23 10:54:35.873696 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fb52d3a7-99f8-4e28-b589-73aa2ebce841 req-f1538f6e-24be-4644-aeca-273abaa60040 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079021 Aug 23 10:54:35.875015 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2083/4230] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:35.879219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:35.884096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:35.912051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.912693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.914910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:35.917481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:35.918093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:35.919831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:36.113997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2130886441", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:36.195853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] validate_networks() for [('d26b4e4e-92d2-42da-96e8-fce80f3d1152', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:54:36.284068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:36.293744 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c9c8a879-9f4b-45e9-8585-302c7820c2af tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.433839 Aug 23 10:54:36.299800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2148/4231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:35 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:36.310346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:36.311458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:36.327711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:36.328618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:36.329343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:36.330290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:36.330980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:36.338862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.059446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:54:37.060041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:54:37.060616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:54:37.061359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:54:37.062050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:54:37.072640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:37.075742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.076646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.077396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.078475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.079218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.079931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.082852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36826099-c9c5-4a39-9c4b-be95c70e3ec0 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1503 microversion: 2.1 time: 0.781657 Aug 23 10:54:37.083613 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2149/4232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:36 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1503 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:37.099853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:37.101108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:37.107253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:37.128352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for user e0ff1121d80f493aa4d6d0b62a583d32 and project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:37.131177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.134837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.136040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.139218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.140584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.143652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.169331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:54:37.175136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:54:37.266949 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3338d59d-63d9-408e-a9d1-78393cbc40b1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.157564 Aug 23 10:54:37.277995 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2084/4233] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:54:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:54:37.309270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:37.310011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:37.313552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:37.334351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.335579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.336176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.336960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.337456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.338092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.446191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:37.463767 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efc905d2-586a-45f9-a1ee-21c34c4640be tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1500 microversion: 2.1 time: 0.377176 Aug 23 10:54:37.466123 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2150/4234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:37 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:37.489195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1328729178", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15655082-1d8f-460f-9281-cf049945d69c"}], "security_groups": [{"name": "tempest-securitygroup--1551356691"}], "key_name": "tempest-keypair-804367118", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:37.662759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:37.681300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] validate_networks() for [('15655082-1d8f-460f-9281-cf049945d69c', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:54:37.691209 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de9a2e65-7f02-4d9b-aee6-b75b0a735801 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.411373 Aug 23 10:54:37.693561 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2085/4235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:37 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:37.699264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fd03454-282a-4673-8964-19e619d22033 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:37.700280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fd03454-282a-4673-8964-19e619d22033 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:37.785138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fd03454-282a-4673-8964-19e619d22033 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:37.794411 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fd03454-282a-4673-8964-19e619d22033 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1225 microversion: 2.1 time: 0.099476 Aug 23 10:54:37.795008 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2086/4236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:37 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:37.800461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:37.801108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:37.829267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.830033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.830654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.831587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:37.832218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:37.832838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:37.856677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:37.998744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:38.008402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20643144-3f77-425e-abae-8d3db3955f51 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.211317 Aug 23 10:54:38.009222 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2087/4237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:37 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:38.021271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04744a8b-16b7-4f2a-9ac2-4fe4078ab0ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:38.028018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04744a8b-16b7-4f2a-9ac2-4fe4078ab0ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.028539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04744a8b-16b7-4f2a-9ac2-4fe4078ab0ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.029003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04744a8b-16b7-4f2a-9ac2-4fe4078ab0ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.052381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04744a8b-16b7-4f2a-9ac2-4fe4078ab0ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 10:54:38.095037 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04744a8b-16b7-4f2a-9ac2-4fe4078ab0ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da/action" status: 202 len: 0 microversion: 2.1 time: 0.078675 Aug 23 10:54:38.095743 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2088/4238] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:38 2022] POST /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:54:38.105694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:38.106435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:38.113853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.115319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.115319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.115782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.116301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.116763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.127357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:54:38.127858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:54:38.128254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:54:38.128667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:54:38.129146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:54:38.139470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.139892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.140332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.141114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.141576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.142009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.159371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for project e8e517070ce248b08c60a477f1e40f00. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:54:38.165524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Getting quotas for user 661fb95cf8664a7a8eb9322155164792 and project e8e517070ce248b08c60a477f1e40f00. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:54:38.179691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:54:38.182048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:54:38.229246 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c3006f5-23a9-4ee2-9a8d-3a4e2048ee1c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.761706 Aug 23 10:54:38.236047 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2151/4239] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:54:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:54:38.241252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:38.242151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:38.258943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.259842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.260523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.261483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.263002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.263644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.271175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:38.282782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5916ad92-bc3f-4b7a-b03c-2d78f4c3cbef tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.182727 Aug 23 10:54:38.283986 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2089/4240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:38 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:38.288421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb12c153-c750-44e3-84cf-551b00e185cc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:38.289095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb12c153-c750-44e3-84cf-551b00e185cc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:38.351250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb12c153-c750-44e3-84cf-551b00e185cc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:38.358906 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb12c153-c750-44e3-84cf-551b00e185cc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1245 microversion: 2.1 time: 0.074328 Aug 23 10:54:38.359883 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2090/4241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:38 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:38.466088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:38.474781 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8589bf30-63a9-4b53-a070-17fd887fd9fb tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1503 microversion: 2.1 time: 0.237609 Aug 23 10:54:38.480367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2152/4242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:38 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:38.713084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:38.714227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:38.721680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.723146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.724019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.726406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.727231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.728180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.818227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:38.820602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:38.858609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.861977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.862930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.864240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:38.865448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:38.865896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:38.952850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:38.968827 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38a20284-9268-445f-9d13-90df14fe65c5 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.255170 Aug 23 10:54:38.969986 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2091/4243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:38 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:39.031857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:39.032863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.041365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.041865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.042352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.046469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:39.053183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.056011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.056998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.058132 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6cf44371-910d-4942-8b75-fa242aaf18b5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1277 microversion: 2.1 time: 0.245363 Aug 23 10:54:39.060708 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2153/4244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:38 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:39.249551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:39.259892 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74900fb6-dce5-4955-ad99-e59daffd1590 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.232582 Aug 23 10:54:39.261017 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2092/4245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:39 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:39.304154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:39.304788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.311494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.311975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.312413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.313126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.313582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.314003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.382473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:39.383106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.389682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.390191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.390868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.391588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.392053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.392607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.458380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:39.461420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:39.469250 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b09a5c88-447e-4199-9f23-1a633f7a3194 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.169094 Aug 23 10:54:39.470144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2154/4246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:39 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:39.479051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:39.487855 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db8e9e73-cf29-45e8-997b-48a9ccd19a81 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1297 microversion: 2.1 time: 0.110280 Aug 23 10:54:39.488450 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2093/4247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:39 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:39.509979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:39.510714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.518102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.518601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.519042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.519753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.520242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.520679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.714396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:39.734160 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1275f419-3d81-4176-b660-c61e2e4c9154 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.230131 Aug 23 10:54:39.737530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2155/4248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:39 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:39.768892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:39.770469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.780056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.782818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.784198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.785169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:39.785808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:39.786418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:39.953499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:39.966558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bda5d4b3-5929-4551-a785-64a7eadd30e5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.204275 Aug 23 10:54:39.968493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2094/4249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:39 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:39.989281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c83b102b-dc3f-47d4-85c0-95a42937c0ca tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:39.990311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c83b102b-dc3f-47d4-85c0-95a42937c0ca tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 4cbc33a0-5990-4256-b968-c97f6ba9a78d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.995028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:39.995764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:39.997340 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c83b102b-dc3f-47d4-85c0-95a42937c0ca tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 4cbc33a0-5990-4256-b968-c97f6ba9a78d could not be found. Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c83b102b-dc3f-47d4-85c0-95a42937c0ca tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/4cbc33a0-5990-4256-b968-c97f6ba9a78d/action HTTP/1.1 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 15 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: {"unpause": {}} Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 4cbc33a0-5990-4256-b968-c97f6ba9a78d could not be found. Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '4cbc33a0-5990-4256-b968-c97f6ba9a78d', 'body': {'unpause': {}}} Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbc33a0-5990-4256-b968-c97f6ba9a78d could not be found. Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbc33a0-5990-4256-b968-c97f6ba9a78d could not be found. Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:39.999397 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:40.007126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:40.007126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:40.007126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbc33a0-5990-4256-b968-c97f6ba9a78d could not be found. Aug 23 10:54:40.007126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:40.008268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.008268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.008627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c83b102b-dc3f-47d4-85c0-95a42937c0ca tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 4cbc33a0-5990-4256-b968-c97f6ba9a78d could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:40.008818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.008818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.008818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.008818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.009562 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c83b102b-dc3f-47d4-85c0-95a42937c0ca tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/4cbc33a0-5990-4256-b968-c97f6ba9a78d/action" status: 404 len: 111 microversion: 2.1 time: 0.019821 Aug 23 10:54:40.014567 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2156/4250] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:39 2022] POST /compute/v2.1/servers/4cbc33a0-5990-4256-b968-c97f6ba9a78d/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:40.024959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:40.026280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.029636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:40.035081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.035610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.036049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.036984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.037618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.038782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.197627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.214443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-802f1f7c-e81a-4b2c-b70b-880f4f0804c3 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.227933 Aug 23 10:54:40.215332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2095/4251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:39 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:40.222351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:40.228607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.234894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.235821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.236286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.237094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.237570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.238004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.309196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.317031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.320470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5e94752-1882-459b-a21f-e957efeaf54a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1283 microversion: 2.1 time: 0.104070 Aug 23 10:54:40.321425 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2096/4252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:40 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:40.326465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:40.327416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.339825 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ecb3aede-164e-4067-8570-dd0e2a0ed1a1 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.321010 Aug 23 10:54:40.340770 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2157/4253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:40 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:40.343991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.344494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.345007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.347299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-24e2f79a-8b74-4299-8832-1e681b8d871b req-afdbd4e3-d126-4af9-a785-5acff4a28beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79148d86-86de-46ef-8097-55b671c0c24e", "name": "network-vif-plugged", "status": "completed", "tag": "947d9885-5b8f-4c8d-b8c7-7493796bd94c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:40.348532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.349087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.349536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.369215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-24e2f79a-8b74-4299-8832-1e681b8d871b req-afdbd4e3-d126-4af9-a785-5acff4a28beb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.370273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-24e2f79a-8b74-4299-8832-1e681b8d871b req-afdbd4e3-d126-4af9-a785-5acff4a28beb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.371338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-24e2f79a-8b74-4299-8832-1e681b8d871b req-afdbd4e3-d126-4af9-a785-5acff4a28beb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.385658 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-24e2f79a-8b74-4299-8832-1e681b8d871b req-afdbd4e3-d126-4af9-a785-5acff4a28beb service nova] Creating event network-vif-plugged:947d9885-5b8f-4c8d-b8c7-7493796bd94c for instance 79148d86-86de-46ef-8097-55b671c0c24e on n-h1-847009-13 Aug 23 10:54:40.391692 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-24e2f79a-8b74-4299-8832-1e681b8d871b req-afdbd4e3-d126-4af9-a785-5acff4a28beb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049390 Aug 23 10:54:40.393192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2158/4254] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:40.398913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:40.401009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.409325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.410523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.411328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.412481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.413786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.414690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.556510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.571064 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10aef44d-6489-48d0-af05-0236d910d6da tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.245363 Aug 23 10:54:40.573228 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2097/4255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:40 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:40.578100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:40.578996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.586717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.588044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.588940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.590408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.591077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.591684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.768626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.779055 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87a1c088-bd7f-4b4f-a239-230b3b8e1537 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.204678 Aug 23 10:54:40.779919 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2098/4256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:40 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:40.785664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:40.786288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.815336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.815843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.816288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.817048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.817486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.818129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.917454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.922619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:40.931900 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f434109b-3ce9-4b87-b0d9-6ea9ac136bee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1303 microversion: 2.1 time: 0.150328 Aug 23 10:54:40.933750 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2cd49ea5-91fe-4a1d-aef3-f94992c4fdfc tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.539111 Aug 23 10:54:40.934343 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2159/4257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:40 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:40.938744 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2099/4258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:40 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:40.959110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:40.960766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:40.977436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.981428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.982184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:40.984234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:40.986741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:40.987479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.034361 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'unpause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 15 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: {"unpause": {}} Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'unpause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'unpause': {}}} Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state active. Cannot unpause while the instance is in this state. Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:41.036245 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:41.041947 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:41.041947 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:41.041947 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:41.041947 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:41.041947 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.041947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'unpause' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:41.042945 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fe1d440-3f83-4d3a-83fd-6bd10b26c993 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 145 microversion: 2.1 time: 0.088666 Aug 23 10:54:41.046779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2100/4259] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:40 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 145 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:54:41.052352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:41.053107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.060043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.061060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.062762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.064266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.065810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.067956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.237318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:41.238092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.251186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.252811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.253500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.254673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.255351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.257442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.406193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:41.415734 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e7c43b3-5e93-4b12-b0a8-ec540c3e8cfa tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.367430 Aug 23 10:54:41.420184 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2160/4260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:41 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:41.432317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:41.433265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.449365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.449943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.450395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.451178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.451644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.452216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.471514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:41.482131 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68417599-8df4-47b2-b063-e6cc5873a648 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.250084 Aug 23 10:54:41.483784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2101/4261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:41 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:41.490075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:41.491944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.499321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.500112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.500801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.501755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.502438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.503314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.685541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:41.698297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14737520-219a-493c-b9d0-cce321fc558e tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.212163 Aug 23 10:54:41.699398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2102/4262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:41 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:41.704452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:41.705325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.718677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.719339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.719798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.727595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.728664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.729423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.772142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:41.790031 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ea2ed28-04fd-46f1-b337-23a7dc8e3ab7 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.368121 Aug 23 10:54:41.791229 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2161/4263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:41 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:41.796026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f309914-e3f2-4459-83a5-eae51568da6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:41.796842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f309914-e3f2-4459-83a5-eae51568da6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 468420a6-9150-41b8-a36f-275c06f87f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.808733 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1f309914-e3f2-4459-83a5-eae51568da6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 468420a6-9150-41b8-a36f-275c06f87f5c could not be found. Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f309914-e3f2-4459-83a5-eae51568da6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/468420a6-9150-41b8-a36f-275c06f87f5c/action HTTP/1.1 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 18 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: {"unshelve": null} Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 468420a6-9150-41b8-a36f-275c06f87f5c could not be found. Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '468420a6-9150-41b8-a36f-275c06f87f5c', 'body': {'unshelve': None}} Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468420a6-9150-41b8-a36f-275c06f87f5c could not be found. Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468420a6-9150-41b8-a36f-275c06f87f5c could not be found. Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.815668 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468420a6-9150-41b8-a36f-275c06f87f5c could not be found. Aug 23 10:54:41.823343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:41.832689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f309914-e3f2-4459-83a5-eae51568da6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 468420a6-9150-41b8-a36f-275c06f87f5c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:41.835483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f309914-e3f2-4459-83a5-eae51568da6f tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/468420a6-9150-41b8-a36f-275c06f87f5c/action" status: 404 len: 111 microversion: 2.1 time: 0.041647 Aug 23 10:54:41.842993 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2162/4264] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:41 2022] POST /compute/v2.1/servers/468420a6-9150-41b8-a36f-275c06f87f5c/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:41.850153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:41.852780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:41.865297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.866309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.867719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:41.869323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:41.870604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:41.871359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.261756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:42.270880 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d706c9aa-d8c1-4bdf-92d4-494ffd7160ba tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.426291 Aug 23 10:54:42.285336 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2163/4265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:41 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:42.288261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:42.291139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:42.291761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:42.296946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9059ed0e-cd25-4b3f-b43d-ed13a566c260 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1314 microversion: 2.1 time: 0.596128 Aug 23 10:54:42.297781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2103/4266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:41 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:42.310594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.310594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.310594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.310594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.310594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.310594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.316186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:42.316837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:42.323533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.324035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.324482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.325240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.325706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.326139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.345494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:42.391589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:42.399760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-126142c7-d3a2-4307-93c5-3936ba02f371 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1303 microversion: 2.1 time: 0.087380 Aug 23 10:54:42.400338 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2104/4267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:42 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:42.510142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:42.510784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:42.517483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.518189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.518817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.519743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.520373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.521205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.650132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:42.667763 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2bf312bf-60e2-4e74-bc86-3665f38bb792 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.379877 Aug 23 10:54:42.670736 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2164/4268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:42 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:42.675290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:42.691872 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e4af6c2-4c1d-4d46-b135-d561a8406214 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.187964 Aug 23 10:54:42.693267 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2105/4269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:42 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:42.696719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:42.697391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:42.705123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.706042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.706661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.708269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.709001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.709594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.812761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:42.813575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:42.820857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.821704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.822273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:42.822978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:42.823556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:42.823994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.011967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:43.021355 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d2f9766-d8c1-4609-9e63-99952fe30485 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.214293 Aug 23 10:54:43.037219 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2106/4270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:42 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:43.055406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:43.066254 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7fbd12f-0cc4-4582-bd18-cff2b1fef157 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.376912 Aug 23 10:54:43.067620 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2165/4271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:42 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:43.090249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:43.091220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.098868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.099506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.100054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.101069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.102115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.102644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.134135 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Cannot 'unshelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action HTTP/1.1 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 18 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: {"unshelve": null} Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'unshelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'unshelve': None}} Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e in vm_state active. Cannot unshelve while the instance is in this state. Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:54:43.135824 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 409 to user: Cannot 'unshelve' instance 057c7307-04cc-43f0-8c9d-1233486e4b9e while it is in vm_state active {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-152c7831-d528-454b-b2b5-b0da3b4c9536 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action" status: 409 len: 146 microversion: 2.1 time: 0.052499 Aug 23 10:54:43.142916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2107/4272] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:43 2022] POST /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e/action => generated 146 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:54:43.153852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:43.156229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.169651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.173371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.173843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.175832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.176314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.177811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fb26569d-89c2-4388-8412-87f262c3fadc req-617793b3-cdd7-44ba-b0f5-2192e1eb9cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cf52c2-0122-4173-8324-e7e3cccc60f1", "name": "network-vif-plugged", "status": "completed", "tag": "b7e7104c-d4e3-46f7-91be-098c41efd681"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:43.181055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.208419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fb26569d-89c2-4388-8412-87f262c3fadc req-617793b3-cdd7-44ba-b0f5-2192e1eb9cc0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.209230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fb26569d-89c2-4388-8412-87f262c3fadc req-617793b3-cdd7-44ba-b0f5-2192e1eb9cc0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.210255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fb26569d-89c2-4388-8412-87f262c3fadc req-617793b3-cdd7-44ba-b0f5-2192e1eb9cc0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.234217 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fb26569d-89c2-4388-8412-87f262c3fadc req-617793b3-cdd7-44ba-b0f5-2192e1eb9cc0 service nova] Creating event network-vif-plugged:b7e7104c-d4e3-46f7-91be-098c41efd681 for instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 on n-h2-847009-13 Aug 23 10:54:43.241507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fb26569d-89c2-4388-8412-87f262c3fadc req-617793b3-cdd7-44ba-b0f5-2192e1eb9cc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071613 Aug 23 10:54:43.244908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2108/4273] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:43.252272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-77581bfd-6b8e-4a04-a812-44dcba5f03b4 req-01fccaea-c46e-4e7a-ae76-e5594e375d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc9a6e14-fd55-466b-9038-e89536ab0cd8", "tag": "e7ddc072-e999-45dc-b2cb-29a3df769345"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:43.269905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-77581bfd-6b8e-4a04-a812-44dcba5f03b4 req-01fccaea-c46e-4e7a-ae76-e5594e375d2b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.270680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-77581bfd-6b8e-4a04-a812-44dcba5f03b4 req-01fccaea-c46e-4e7a-ae76-e5594e375d2b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.271370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-77581bfd-6b8e-4a04-a812-44dcba5f03b4 req-01fccaea-c46e-4e7a-ae76-e5594e375d2b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.285247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-77581bfd-6b8e-4a04-a812-44dcba5f03b4 req-01fccaea-c46e-4e7a-ae76-e5594e375d2b service nova] Creating event network-changed:e7ddc072-e999-45dc-b2cb-29a3df769345 for instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 on n-h2-847009-13 Aug 23 10:54:43.291954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-77581bfd-6b8e-4a04-a812-44dcba5f03b4 req-01fccaea-c46e-4e7a-ae76-e5594e375d2b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045068 Aug 23 10:54:43.293126 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2109/4274] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:43.301396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:43.302334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.316884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.317396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.317845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.320581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.321106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.321556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.551112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:43.559519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85a7dc75-c438-4072-8201-f235a37435c4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.265070 Aug 23 10:54:43.560107 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2110/4275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:43 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:43.564668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:43.565312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.572451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.573252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.573694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.574609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.575065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.575494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.720560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:43.729106 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-362c0ed4-3f3b-448b-957a-a819793fc389 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1500 microversion: 2.1 time: 0.167935 Aug 23 10:54:43.729701 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2111/4276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:43 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:43.734436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:43.735058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.742152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.742569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.743225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.743946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.744415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.744879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.893018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:43.902184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9cb268f-83b4-479a-90c1-427ddea5eb01 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.171371 Aug 23 10:54:43.902771 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2112/4277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:43 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:43.907576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:43.908475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.915423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.916107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.916690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.917259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:43.917754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.918038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.918632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.925032 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85ca139e-38d6-45fe-9a50-173713c1da51 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.782149 Aug 23 10:54:43.926268 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2166/4278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:43 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:43.932573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:43.939992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:43.951613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.956521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.956521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:43.956521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:43.956521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:43.956521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.083374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6041ec1a-efdb-4120-8818-c26a630d3d91 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e/action" status: 202 len: 0 microversion: 2.1 time: 0.155575 Aug 23 10:54:44.085647 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2167/4279] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:43 2022] POST /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:54:44.091648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.092367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.099117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.099795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.100697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.101872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.102368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.102917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.118711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.127101 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0735eac9-176b-4527-bf1e-f589b8ec7fa1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1403 microversion: 2.1 time: 0.222974 Aug 23 10:54:44.127689 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2113/4280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:43 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1403 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:44.134055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.134678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.148998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.149500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.149950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.150700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.151170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.151600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.282578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.285960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.291964 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c57903b-fb38-41ad-b139-0729f6fcaefa tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.163177 Aug 23 10:54:44.307102 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2114/4281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:44.307909 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f27baf32-2dce-47b8-87c6-917e9878796a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.209696 Aug 23 10:54:44.307982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.307982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.307982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.307982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.307982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.307982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.308301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.308794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.321417 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2168/4282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:44.326733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d848dde-c1a9-4e18-b65a-3a139aa17427 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18828091_updated"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:44.330266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d848dde-c1a9-4e18-b65a-3a139aa17427 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: ec176c24-021b-4bc1-808e-9ad131b9a50a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.336658 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5d848dde-c1a9-4e18-b65a-3a139aa17427 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance ec176c24-021b-4bc1-808e-9ad131b9a50a could not be found. Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d848dde-c1a9-4e18-b65a-3a139aa17427 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/servers/ec176c24-021b-4bc1-808e-9ad131b9a50a HTTP/1.1 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 79 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-18828091_updated"}} Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ec176c24-021b-4bc1-808e-9ad131b9a50a could not be found. Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ec176c24-021b-4bc1-808e-9ad131b9a50a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-18828091_updated'}}} Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec176c24-021b-4bc1-808e-9ad131b9a50a could not be found. Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 23 10:54:44.338474 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec176c24-021b-4bc1-808e-9ad131b9a50a could not be found. Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec176c24-021b-4bc1-808e-9ad131b9a50a could not be found. Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d848dde-c1a9-4e18-b65a-3a139aa17427 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance ec176c24-021b-4bc1-808e-9ad131b9a50a could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d848dde-c1a9-4e18-b65a-3a139aa17427 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "PUT /compute/v2.1/servers/ec176c24-021b-4bc1-808e-9ad131b9a50a" status: 404 len: 111 microversion: 2.1 time: 0.017397 Aug 23 10:54:44.341490 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2169/4283] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 10:54:44 2022] PUT /compute/v2.1/servers/ec176c24-021b-4bc1-808e-9ad131b9a50a => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:44.348551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.349207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.356766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.357269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.357717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.358438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.360959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.362539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.514648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.526804 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1772394-60e2-4a20-9e7d-9d10e6fd52c9 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1505 microversion: 2.1 time: 0.233145 Aug 23 10:54:44.527390 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2115/4284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:44.581437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.582064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.588728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.589351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.590323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.591176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.591715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.592223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.745617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.757058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e56da4da-d51d-44b7-8477-127454142027 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.411505 Aug 23 10:54:44.758156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2170/4285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:44.759818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.769374 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-361d44cf-69c6-4d4d-9087-bd7b177ff204 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.192218 Aug 23 10:54:44.779324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.780681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.781590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2116/4286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:44.789347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.789754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.790194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.790900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.791363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.791787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.923884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:44.924693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:44.934406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.935096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.935675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.936653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:44.937266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:44.937793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:44.959408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:44.971459 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8133c850-5614-4a7e-abdb-bbf9b234b005 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.195407 Aug 23 10:54:44.972221 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2171/4287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:44.997256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3bec680-4246-4af7-b114-bd39c78d733a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3bec680-4246-4af7-b114-bd39c78d733a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e HTTP/1.1 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 280 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.001193 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 10:54:45.004326 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.007635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3bec680-4246-4af7-b114-bd39c78d733a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:45.008699 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3bec680-4246-4af7-b114-bd39c78d733a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "PUT /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 400 len: 619 microversion: 2.1 time: 0.015560 Aug 23 10:54:45.010613 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2172/4288] 10.222.0.78 () {60 vars in 1257 bytes} [Tue Aug 23 10:54:44 2022] PUT /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:54:45.019675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.020456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.031048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.031629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.032305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.033185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.033733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.034280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.098449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.107223 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e4eaafe-e6b7-42ca-837c-8ac56819fefb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.187439 Aug 23 10:54:45.107822 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2117/4289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:44 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:45.150288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.150923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.157031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.157554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.158009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.158755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.159224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.159661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.306986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.308864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.315681 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-236f8840-6f50-4e4a-9bdf-e413688ced79 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.301785 Aug 23 10:54:45.328857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2173/4290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:45.329015 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93582d0a-ad1a-4904-b8a8-84383d35a902 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1590 microversion: 2.1 time: 0.172869 Aug 23 10:54:45.329015 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2118/4291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1590 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:45.329160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.329160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.329278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-efd984bb-7fb3-4b27-a04b-cf01ee428fd3 req-4fa0d24d-6ae5-4428-9958-5bc76ec20626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d", "tag": "eab71317-d387-42d3-b5b9-433db85dd050"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:45.330682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.335173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.335173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.336213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.336213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.336663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.349950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-efd984bb-7fb3-4b27-a04b-cf01ee428fd3 req-4fa0d24d-6ae5-4428-9958-5bc76ec20626 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.351085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-efd984bb-7fb3-4b27-a04b-cf01ee428fd3 req-4fa0d24d-6ae5-4428-9958-5bc76ec20626 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.351534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-efd984bb-7fb3-4b27-a04b-cf01ee428fd3 req-4fa0d24d-6ae5-4428-9958-5bc76ec20626 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.365574 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-efd984bb-7fb3-4b27-a04b-cf01ee428fd3 req-4fa0d24d-6ae5-4428-9958-5bc76ec20626 service nova] Creating event network-changed:eab71317-d387-42d3-b5b9-433db85dd050 for instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d on n-h2-847009-13 Aug 23 10:54:45.372348 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-efd984bb-7fb3-4b27-a04b-cf01ee428fd3 req-4fa0d24d-6ae5-4428-9958-5bc76ec20626 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050478 Aug 23 10:54:45.372995 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2119/4292] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:45.378066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.378784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.385458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.386034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.386573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.387358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.387904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.388410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.503015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.511854 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d0a217c-9471-4e6f-967e-8bb26e41b584 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.194410 Aug 23 10:54:45.512440 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2174/4293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:45.520562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.521124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.524086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.527762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.528270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.528719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.529449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.529917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.530351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.532822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3a7f78c-627b-4cdc-b49c-9987edf7a90a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.158688 Aug 23 10:54:45.533401 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2120/4294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:45.534210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:45.550821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.551447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.557955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.558459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.558905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.559622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.560086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.560520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.611849 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b7b9f23-1795-4e5a-974f-8849606baa1d tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094971 Aug 23 10:54:45.612479 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2175/4295] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:45.618595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5383ee1e-c246-4a2b-8b48-96df33e12db9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5383ee1e-c246-4a2b-8b48-96df33e12db9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: request: PUT /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e HTTP/1.1 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 24 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": ""}} Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e', 'body': {'server': {'name': ''}}} Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '' Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 10:54:45.622522 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5383ee1e-c246-4a2b-8b48-96df33e12db9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5383ee1e-c246-4a2b-8b48-96df33e12db9 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "PUT /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 400 len: 108 microversion: 2.1 time: 0.009987 Aug 23 10:54:45.625674 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2176/4296] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 10:54:45 2022] PUT /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:54:45.633442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.634101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.641691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.642217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.642665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.643386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.643852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.644286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.703341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.711762 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e08238db-3baf-4387-b65e-89ccdd35cfe3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1485 microversion: 2.1 time: 0.167155 Aug 23 10:54:45.712343 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2121/4297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1485 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:45.732374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:45.733057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.740019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.740205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.740881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.742217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.742809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.743323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.770389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lazy-loading 'flavor' on Instance uuid 79148d86-86de-46ef-8097-55b671c0c24e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:54:45.804167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:45.964712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:45.974667 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6c19a28-a087-421f-8a31-dcf3b8c35597 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1506 microversion: 2.1 time: 0.345477 Aug 23 10:54:45.976815 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2177/4298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:45.983796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:45.984586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:45.991988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.992700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.993322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.994102 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3fc7bc6-61d2-4210-8373-a3140d944cee tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e/action" status: 202 len: 0 microversion: 2.1 time: 0.265447 Aug 23 10:54:45.994394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:45.995000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:45.995563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:45.997453 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2122/4299] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:54:45 2022] POST /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:54:46.023431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:46.024667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:46.032319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:46.037085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:46.039032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:46.039566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:46.040045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:46.043928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:46.268639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:46.277605 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1dd469f-c404-4280-9e28-30f291ab0f9e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1491 microversion: 2.1 time: 0.272358 Aug 23 10:54:46.288769 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2123/4300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1491 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:46.288769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:46.288769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:46.297032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:46.297767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:46.298219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:46.299638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:46.300227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:46.301088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:46.384656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:46.403940 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b301004-72fb-48b1-9090-85e494540d54 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.425646 Aug 23 10:54:46.410397 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2178/4301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:45 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:46.502700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:46.511387 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0eb3e5ee-f21d-42f5-9425-4be1835fb4af tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.231608 Aug 23 10:54:46.534664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:46.542454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:46.550363 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2124/4302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:46 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:46.558042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:46.558947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:46.559590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:46.560528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:46.562951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:46.563597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.070381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:47.079596 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c06dda7-f671-48c0-8f33-46eac224152a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.548513 Aug 23 10:54:47.093239 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2179/4303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:46 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:47.300518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:47.301167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:47.321090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:47.322556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:47.322668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.323130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.323438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:47.323702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.324439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.324930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.325362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.332239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.333031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.333659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.334620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.336684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.337362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.545216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:47.557541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd67dca4-3bc8-4d13-bd41-50c5343eaf1a tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1590 microversion: 2.1 time: 0.240226 Aug 23 10:54:47.559165 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2180/4304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:47 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1590 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:47.589326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6f303d28-28f7-4ea3-b4b1-6622021be1f0 req-a9bd762a-8562-45ce-a5eb-85fcf7766bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24cf52c2-0122-4173-8324-e7e3cccc60f1", "tag": "b7e7104c-d4e3-46f7-91be-098c41efd681"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:47.639246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6f303d28-28f7-4ea3-b4b1-6622021be1f0 req-a9bd762a-8562-45ce-a5eb-85fcf7766bd1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.643746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6f303d28-28f7-4ea3-b4b1-6622021be1f0 req-a9bd762a-8562-45ce-a5eb-85fcf7766bd1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.645076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6f303d28-28f7-4ea3-b4b1-6622021be1f0 req-a9bd762a-8562-45ce-a5eb-85fcf7766bd1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.658966 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6f303d28-28f7-4ea3-b4b1-6622021be1f0 req-a9bd762a-8562-45ce-a5eb-85fcf7766bd1 service nova] Creating event network-changed:b7e7104c-d4e3-46f7-91be-098c41efd681 for instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 on n-h2-847009-13 Aug 23 10:54:47.665108 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6f303d28-28f7-4ea3-b4b1-6622021be1f0 req-a9bd762a-8562-45ce-a5eb-85fcf7766bd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091261 Aug 23 10:54:47.665805 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2181/4305] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:47.679595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:47.680269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:47.685717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:47.689448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.690264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.691618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.692706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.693386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.694002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.699814 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a8f3d08-81d7-4510-b203-5ab02d485b59 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1491 microversion: 2.1 time: 0.402755 Aug 23 10:54:47.701411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2125/4306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:47 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1491 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:47.722255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:47.723075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:47.731192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.731734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.732239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.733056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:47.733532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:47.733975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:47.912410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:47.924076 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab12abb7-5867-4f33-a002-7078cada6bae tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.220861 Aug 23 10:54:47.925682 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2126/4307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:47 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:48.104112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:48.104763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:48.116367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:48.116897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:48.121598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:48.123139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:48.123819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:48.124073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:48.150072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:48.172579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=16 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:48.336941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:48.346995 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4b5db39-e167-4357-8fb0-a1babbbc68df tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.674738 Aug 23 10:54:48.356793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2182/4308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:47 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:48.357083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=24 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:48.535651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:48.551120 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7308b8a0-d2f7-4f33-b6cd-5a32eb02a017 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.452396 Aug 23 10:54:48.551963 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2127/4309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:48 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:48.723047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:48.723842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:48.739216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:48.739216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:48.743202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:48.745719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:48.745719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:48.760563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:48.952025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:48.952958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:48.962303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:48.963466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:48.964174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:48.965161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:48.965842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:48.967117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:49.289681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:49.302432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5abcd4d-4b77-43ea-8acf-a4458b912efc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.353351 Aug 23 10:54:49.326691 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2128/4310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:48 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:49.372186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:49.373029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:49.385260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:49.392585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:49.393231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:49.394543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:49.395049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:49.395495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:49.599381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:49.632483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e2e28b9-5048-4254-acdd-725f4abb77ce tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1512 microversion: 2.1 time: 0.913736 Aug 23 10:54:49.654052 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2183/4311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:48 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1512 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:49.656476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:49.657218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:49.686380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:49.686907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:49.687365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:49.688109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:49.695236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:49.699767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:49.822882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:49.832463 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ccc54ae-2e3e-4dad-8d08-4c6f3b7184b8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.463843 Aug 23 10:54:49.849334 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2129/4312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:49 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:50.128755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:50.138388 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7267a39-42fd-416d-9a43-7e4d2310cc53 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.496107 Aug 23 10:54:50.149906 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2184/4313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:49 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:50.328899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:50.329680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:50.341146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.341666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.342127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:50.346955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.347451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.348072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:50.472857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5232a9b2-b8e2-4460-8592-5a7e352794f4 req-9dd85706-ace3-49d9-be3b-e1afed026f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79148d86-86de-46ef-8097-55b671c0c24e", "name": "network-vif-plugged", "status": "completed", "tag": "947d9885-5b8f-4c8d-b8c7-7493796bd94c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:50.496197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5232a9b2-b8e2-4460-8592-5a7e352794f4 req-9dd85706-ace3-49d9-be3b-e1afed026f0b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.496792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5232a9b2-b8e2-4460-8592-5a7e352794f4 req-9dd85706-ace3-49d9-be3b-e1afed026f0b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.497433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5232a9b2-b8e2-4460-8592-5a7e352794f4 req-9dd85706-ace3-49d9-be3b-e1afed026f0b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:50.520712 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5232a9b2-b8e2-4460-8592-5a7e352794f4 req-9dd85706-ace3-49d9-be3b-e1afed026f0b service nova] Creating event network-vif-plugged:947d9885-5b8f-4c8d-b8c7-7493796bd94c for instance 79148d86-86de-46ef-8097-55b671c0c24e on n-h1-847009-13 Aug 23 10:54:50.532297 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5232a9b2-b8e2-4460-8592-5a7e352794f4 req-9dd85706-ace3-49d9-be3b-e1afed026f0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063243 Aug 23 10:54:50.533269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2185/4314] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:54:50.574233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:50.583657 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7df755d-9753-4179-935b-4d2624918a06 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.258763 Aug 23 10:54:50.584243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2130/4315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:50 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:50.662931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:50.664618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:50.671901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.672789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.673452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:50.674439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.675159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.675804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:50.832060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:50.842939 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c3229ddc-4bc2-4965-8767-1b8b7230f02d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1512 microversion: 2.1 time: 0.184243 Aug 23 10:54:50.843636 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2186/4316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:50 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:50.857813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:50.858746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:50.865981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.866802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.867261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:50.867995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:50.868468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:50.868946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:51.029548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:51.039513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3faf73e3-7389-4d52-871b-c74559826baf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.185565 Aug 23 10:54:51.040883 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2131/4317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:50 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:51.172762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:51.175464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:51.183726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:51.184422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:51.185041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:51.185900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:51.186638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:51.187391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:51.355137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:51.363916 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6acd727a-6c2d-494e-81a4-c710433633c1 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.198121 Aug 23 10:54:51.364982 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2187/4318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:51 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:51.605064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:51.606391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:51.617763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:51.618343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:51.618873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:51.619672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:51.620198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:51.620682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:51.780720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:51.790072 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5db37654-ef20-4234-a0da-de8ab609a566 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.188951 Aug 23 10:54:51.804484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2132/4319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:51 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:51.872825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:51.873347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:51.880733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:51.881778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:51.882284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:51.882993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:51.883455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:51.883877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.047951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:52.058440 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f98631f-7770-40d6-97ea-af698de565ca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1512 microversion: 2.1 time: 0.189636 Aug 23 10:54:52.060783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2188/4320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:51 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:52.061052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:52.062342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:52.068428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:52.070836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.071496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.072086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.073082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.073678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.074238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.257860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:52.266648 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c99c2b9f-2e52-4fa2-bc30-6b55561ccbed tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.209644 Aug 23 10:54:52.267702 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2133/4321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:52 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:52.387210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:52.388393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:52.395613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.396451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.397483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.399711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.400706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.401236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.554689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:52.563052 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8848f9c9-5740-49c1-9d89-df7b161f20ad tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.179924 Aug 23 10:54:52.563972 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2189/4322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:52 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:52.812226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:52.813503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:52.821285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.821849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.822301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.823249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.823901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.824521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.912316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:52.914063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:52.926657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.927166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.927610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.928986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:52.929441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:52.934043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:52.973937 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb HTTP/1.1 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '64f8abe5-3fa8-45c1-9539-535d43d6f1fb'} Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:52.982272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:52.985936 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:52.992871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:52.993975 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-934294a3-908d-4b66-a3c0-0567d9231496 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 404 len: 111 microversion: 2.1 time: 0.085562 Aug 23 10:54:52.995919 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2190/4323] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:54:52 2022] DELETE /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:54:53.013528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:53.014196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 64f8abe5-3fa8-45c1-9539-535d43d6f1fb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:53.030771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.031290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.033019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.033786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.034271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.036915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.075736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb HTTP/1.1 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '64f8abe5-3fa8-45c1-9539-535d43d6f1fb'} Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:53.082801 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 64f8abe5-3fa8-45c1-9539-535d43d6f1fb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:53.091567 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5c447902-89f2-4204-933e-5f5cca51b6af tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb" status: 404 len: 111 microversion: 2.1 time: 0.084234 Aug 23 10:54:53.092864 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2191/4324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:52 2022] GET /compute/v2.1/servers/64f8abe5-3fa8-45c1-9539-535d43d6f1fb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:53.104695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:53.105367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:53.109567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:53.122838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.123944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.127248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.128822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.129463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.132566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.141918 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28993502-d92e-4559-a3e9-fb6b7930cbf9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.328779 Aug 23 10:54:53.146924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2134/4325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:52 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:53.169208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:53.169897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:53.183223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.187392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.188027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.189503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.191962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.192584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.307342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:54:53.429514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:53.443646 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e054a640-e3a9-42cd-aeaa-947976d57ca4 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.348321 Aug 23 10:54:53.445263 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2192/4326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:53 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:53.474648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:53.481635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:53.494511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.495022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.495460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.499710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.500970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.502339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.503292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d15e17d1-23b9-4a6e-bdf0-c734242dca09 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "DELETE /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 204 len: 0 microversion: 2.1 time: 0.350867 Aug 23 10:54:53.503937 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2135/4327] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:54:53 2022] DELETE /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:54:53.510481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-618bc25c-e4f3-4bd0-8b65-d584699cb321 req-e25571c9-cb88-48b8-9d61-3879a581909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d", "name": "network-vif-plugged", "status": "completed", "tag": "eab71317-d387-42d3-b5b9-433db85dd050"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:53.525544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-618bc25c-e4f3-4bd0-8b65-d584699cb321 req-e25571c9-cb88-48b8-9d61-3879a581909d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.526285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-618bc25c-e4f3-4bd0-8b65-d584699cb321 req-e25571c9-cb88-48b8-9d61-3879a581909d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.526848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-618bc25c-e4f3-4bd0-8b65-d584699cb321 req-e25571c9-cb88-48b8-9d61-3879a581909d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.549043 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-618bc25c-e4f3-4bd0-8b65-d584699cb321 req-e25571c9-cb88-48b8-9d61-3879a581909d service nova] Creating event network-vif-plugged:eab71317-d387-42d3-b5b9-433db85dd050 for instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d on n-h2-847009-13 Aug 23 10:54:53.562617 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-618bc25c-e4f3-4bd0-8b65-d584699cb321 req-e25571c9-cb88-48b8-9d61-3879a581909d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056767 Aug 23 10:54:53.563759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2136/4328] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:53.587851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:53.589078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:53.607866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.608642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.609324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.610634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.611643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.612255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.621276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:53.718256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:53.734279 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6556f1e6-00ff-43e7-b758-b372d1ebeeb2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.271435 Aug 23 10:54:53.737877 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2193/4329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:53 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:53.753796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:53.754895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:53.774167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.775394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.778369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.779383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:53.780787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:53.782544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:53.922671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:53.937539 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-064e4730-c6e4-4d86-8380-7d35364a8bf5 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.372268 Aug 23 10:54:53.940622 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2137/4330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:53 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:54.060627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:54.068566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31ee0019-6576-42e1-a579-de590eaeda06 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.329101 Aug 23 10:54:54.070294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2194/4331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:53 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:54.170028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:54.170699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:54.179538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.180618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.181465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.182418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.183148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.183742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.400669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:54.414147 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f922a44e-ada3-468e-bb7f-ef590190a6aa tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.249112 Aug 23 10:54:54.418562 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2138/4332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:54 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:54.467133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:54.468101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:54.474279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.476686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.477429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.478238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.478934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.479557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.664062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:54.666694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:54:54.674325 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7ecf6bc-b8d0-4865-b985-ec28537221a7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.211245 Aug 23 10:54:54.675318 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2195/4333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:54 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:54.762671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:54.763424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:54.771036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.771560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.772219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.773256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.773749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.774495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.935182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:54.944566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-132d8982-0644-488d-b120-c81ca4df4049 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.186113 Aug 23 10:54:54.961399 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2139/4334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:54 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:54.972263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:54.972918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:54.980134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.980635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.981108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:54.981824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:54.982282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:54.982741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.092270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:55.093357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:55.104109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.105361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.109424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.110407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.111647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.113642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.152460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:55.161807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9e43603-fbfd-4ee4-b2cd-e6d849b7eae6 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.202178 Aug 23 10:54:55.167830 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2196/4335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:54 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:55.299325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:55.313154 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa1dec15-b2c9-436f-8048-cf7b770dd3fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.224520 Aug 23 10:54:55.333247 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2140/4336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:55 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:55.443014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:55.445054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:55.454557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.455263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.455713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.456558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.457180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.457942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.593475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e0d9495e-e505-4d53-9933-b62b0862747c req-485ae8b2-a938-44af-af4a-ca3ccc6aff48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9a6e14-fd55-466b-9038-e89536ab0cd8", "name": "network-vif-plugged", "status": "completed", "tag": "e7ddc072-e999-45dc-b2cb-29a3df769345"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:55.611423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0d9495e-e505-4d53-9933-b62b0862747c req-485ae8b2-a938-44af-af4a-ca3ccc6aff48 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.616207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0d9495e-e505-4d53-9933-b62b0862747c req-485ae8b2-a938-44af-af4a-ca3ccc6aff48 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.616843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e0d9495e-e505-4d53-9933-b62b0862747c req-485ae8b2-a938-44af-af4a-ca3ccc6aff48 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.646693 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e0d9495e-e505-4d53-9933-b62b0862747c req-485ae8b2-a938-44af-af4a-ca3ccc6aff48 service nova] Creating event network-vif-plugged:e7ddc072-e999-45dc-b2cb-29a3df769345 for instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 on n-h2-847009-13 Aug 23 10:54:55.658305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e0d9495e-e505-4d53-9933-b62b0862747c req-485ae8b2-a938-44af-af4a-ca3ccc6aff48 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069901 Aug 23 10:54:55.660293 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2141/4337] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:55.683408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:55.696671 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9af942fa-bee0-4c63-a073-b9d2141a31e0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1371 microversion: 2.1 time: 0.258734 Aug 23 10:54:55.698525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2197/4338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:55 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:55.698901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:55.699627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:55.722804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.723343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.723799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.724526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:55.725095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:55.725544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:55.965103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:55.976204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:55.987502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:55.991502 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b45d1786-5e1a-4aad-9caa-acc36c93b372 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.296504 Aug 23 10:54:55.992493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2142/4339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:55 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:56.031063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.032067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.032921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.035792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.045817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.046969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.185851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:56.186485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:56.194640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.195450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.196034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.197383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.197998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.198708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.364342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:56.377886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60f1a974-917a-412c-b84f-c732ae6330e6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.410979 Aug 23 10:54:56.381481 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2198/4340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:55 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:56.389305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:56.390341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e397356a2f6349379d081d7381c18ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298d46caabb746a2ba9abab15c248dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:56.393534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:56.405809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.406523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.407103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.407303 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a744e606-6f5f-4cff-b2cb-98ce5aeb3514 tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 200 len: 1512 microversion: 2.1 time: 0.225483 Aug 23 10:54:56.407907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2143/4341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:56 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:56.408283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.409015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.409631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.674889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:56.686873 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de528771-996b-4e35-9e9c-708ba38df1ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.303973 Aug 23 10:54:56.687979 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2199/4342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:56 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:56.722828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:56.723615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:56.738448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.739089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.740075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.741323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.741949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.742568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.941868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cfce75d8-92fc-4b9f-9b3f-fbda38b2060f req-bf9b7a99-759a-4859-8b77-6d0c47acbd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057c7307-04cc-43f0-8c9d-1233486e4b9e", "name": "network-vif-deleted", "tag": "d4b89f90-900a-49c6-8ae6-8d854e7c5ffd"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:56.955388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cfce75d8-92fc-4b9f-9b3f-fbda38b2060f req-bf9b7a99-759a-4859-8b77-6d0c47acbd53 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:56.956223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cfce75d8-92fc-4b9f-9b3f-fbda38b2060f req-bf9b7a99-759a-4859-8b77-6d0c47acbd53 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:56.957166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cfce75d8-92fc-4b9f-9b3f-fbda38b2060f req-bf9b7a99-759a-4859-8b77-6d0c47acbd53 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:56.994682 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cfce75d8-92fc-4b9f-9b3f-fbda38b2060f req-bf9b7a99-759a-4859-8b77-6d0c47acbd53 service nova] Creating event network-vif-deleted:d4b89f90-900a-49c6-8ae6-8d854e7c5ffd for instance 057c7307-04cc-43f0-8c9d-1233486e4b9e on n-h1-847009-13 Aug 23 10:54:57.009814 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cfce75d8-92fc-4b9f-9b3f-fbda38b2060f req-bf9b7a99-759a-4859-8b77-6d0c47acbd53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071336 Aug 23 10:54:57.016926 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2200/4343] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:54:57.024695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:57.026342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:57.041000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.041997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.042681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.043604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.044297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.044990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.151855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:57.170020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0dbaa29-ca76-4820-87a2-ee25c3b8f682 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1566 microversion: 2.1 time: 0.450704 Aug 23 10:54:57.173162 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2144/4344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:56 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1566 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:57.199158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:57.201675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:57.225237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.226000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.227220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.228130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.228772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.231278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.355137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:57.369737 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4a9537e-e47b-4f42-b37c-666cafeff8ee tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.179125 Aug 23 10:54:57.371097 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5aff8dee-3003-4fbc-a6a5-9b10d3dd48ef tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.352234 Aug 23 10:54:57.379103 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2145/4345] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:54:57 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:54:57.396324 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2201/4346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:57 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:57.408276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:57.409153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:57.420217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.424830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.426307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.428569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.429861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.430535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.432313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:57.433024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] [instance: 057c7307-04cc-43f0-8c9d-1233486e4b9e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:57.442194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.442901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.444168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.445176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.446116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.446912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.475740 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] HTTP exception thrown: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e could not be found. Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Request method failure captured: Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e HTTP/1.1 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLEYmdbF83iT-2D4Qi4c_AkIW_Ep7DJsYmU-HG1lBk2evv9VOHCfGo9i9gdbh4sr7m_z2oQuv07VipHTrQTiqmywCTR1ID-tG9x83P5hwzpKIPTbaj8OxL3W6p-jEmYX1ODw2dUZwlrDpo3LMTdEJtgpB7tOnxeAFsw_lRC1xtTO3vk Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_298d46caabb746a2ba9abab15c248dc1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/298d46caabb746a2ba9abab15c248dc1"}]}] Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 298d46caabb746a2ba9abab15c248dc1 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-318338364 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e397356a2f6349379d081d7381c18ec9 Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-318338364-project Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e could not be found. Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '057c7307-04cc-43f0-8c9d-1233486e4b9e'} Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e could not be found. Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e could not be found. Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:54:57.478144 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e could not be found. Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:54:57.481776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] Returning 404 to user: Instance 057c7307-04cc-43f0-8c9d-1233486e4b9e could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:54:57.486945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06356043-4ed6-4c18-aaf7-cb740eda4f7a tempest-ServersNegativeTestJSON-318338364 tempest-ServersNegativeTestJSON-318338364-project] 10.222.0.78 "GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e" status: 404 len: 111 microversion: 2.1 time: 0.061137 Aug 23 10:54:57.493251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2202/4347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:57 2022] GET /compute/v2.1/servers/057c7307-04cc-43f0-8c9d-1233486e4b9e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:54:57.718012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:57.719684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:57.735088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.736771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.737254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.740329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:57.742544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:57.743010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:57.968392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:57.989037 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cefb660-ebed-4ae4-ac5b-60e93d43d496 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.585950 Aug 23 10:54:57.992823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2146/4348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:57 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:58.050663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:58.064485 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7a60dfd-c237-4876-ba1c-d66879773ce9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1325 microversion: 2.1 time: 0.352161 Aug 23 10:54:58.065439 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2203/4349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:57 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1325 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:54:58.396500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:58.399899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:58.416897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:58.422028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:58.423125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:58.426021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:58.426679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:58.427304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:58.769125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:58.782773 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05468034-10fd-4e14-90c6-5aa2a2e3ff8e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.391291 Aug 23 10:54:58.785944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2147/4350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:58 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:59.019042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:59.020433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:59.029996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.030854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.031531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.032444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.035912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.036771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.087825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:59.088790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:59.098105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.099130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.099665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.100655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.101575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.102629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.422454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:59.435786 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-72ba176e-9adf-417c-af22-3542ad11d6eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.423010 Aug 23 10:54:59.437052 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2204/4351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:59 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:59.455814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-df8b4a34-34e9-4883-af87-7fac239263de req-7fa75e53-4bea-44ea-ac84-a041c359778c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d", "tag": "eab71317-d387-42d3-b5b9-433db85dd050"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:54:59.468946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-df8b4a34-34e9-4883-af87-7fac239263de req-7fa75e53-4bea-44ea-ac84-a041c359778c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.469592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-df8b4a34-34e9-4883-af87-7fac239263de req-7fa75e53-4bea-44ea-ac84-a041c359778c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.470347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-df8b4a34-34e9-4883-af87-7fac239263de req-7fa75e53-4bea-44ea-ac84-a041c359778c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.487372 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-df8b4a34-34e9-4883-af87-7fac239263de req-7fa75e53-4bea-44ea-ac84-a041c359778c service nova] Creating event network-changed:eab71317-d387-42d3-b5b9-433db85dd050 for instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d on n-h2-847009-13 Aug 23 10:54:59.494552 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-df8b4a34-34e9-4883-af87-7fac239263de req-7fa75e53-4bea-44ea-ac84-a041c359778c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044102 Aug 23 10:54:59.504293 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2205/4352] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:54:59.658629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:54:59.678706 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b7061b5-54de-4f91-8566-2eab576bf68a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1522 microversion: 2.1 time: 0.591292 Aug 23 10:54:59.680999 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2148/4353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:59 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:54:59.720898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:59.721647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:59.739306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.740445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.741251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.742545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.743364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.744112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.811677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:54:59.812306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:54:59.834965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.836306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.840321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:54:59.841325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:54:59.842016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:54:59.842599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:00.232057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:00.247822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53f40a88-8507-418e-bb13-cccf5a2ac66d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.441269 Aug 23 10:55:00.250737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2149/4354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:59 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:00.317329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:00.327153 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1dbe2c4e-c358-46c0-8f3f-e48cdb771ae2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1522 microversion: 2.1 time: 0.611453 Aug 23 10:55:00.337280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2206/4355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:54:59 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1522 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:00.352619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1248048206"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:00.355808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:00.374148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:00.374820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:00.376917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:00.378597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:00.379364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:00.379993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:00.468487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:00.469402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:00.498164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:00.501678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:00.502277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:00.504251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:00.505729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:00.523647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:00.920908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a4542b2-94f7-4f38-97e6-e142f2f496dc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8/action" status: 202 len: 0 microversion: 2.1 time: 0.570912 Aug 23 10:55:00.923031 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2150/4356] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:55:00 2022] POST /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 10:55:00.937094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e00e5b80-eb69-4bc7-b315-ed13c793bdbf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '.version_select at 0x7fdc9cd0f040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:01.062249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:01.072398 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7bbab6ed-2b7c-420b-b55c-dbcf20fc1ddf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.614266 Aug 23 10:55:01.082046 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2207/4357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:00 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:01.232052 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e00e5b80-eb69-4bc7-b315-ed13c793bdbf tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d" status: 204 len: 0 microversion: 2.1 time: 0.301116 Aug 23 10:55:01.236208 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2151/4358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:00 2022] DELETE /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:01.242532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abdfb2bd-cf38-4c12-b36f-4f9a7354af7a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '.version_select at 0x7fdc9c08d8b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:01.274004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:01.274684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:01.277291 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-abdfb2bd-cf38-4c12-b36f-4f9a7354af7a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Image not found. Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abdfb2bd-cf38-4c12-b36f-4f9a7354af7a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d HTTP/1.1 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '746b6465-586a-48f4-a950-2510b99a0c3d'} Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 746b6465-586a-48f4-a950-2510b99a0c3d Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 10:55:01.279629 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 746b6465-586a-48f4-a950-2510b99a0c3d could not be found. Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:55:01.283321 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:01.286383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abdfb2bd-cf38-4c12-b36f-4f9a7354af7a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:01.290111 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-abdfb2bd-cf38-4c12-b36f-4f9a7354af7a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d" status: 404 len: 62 microversion: 2.1 time: 0.052521 Aug 23 10:55:01.291008 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2208/4359] 10.222.0.78 () {58 vars in 1233 bytes} [Tue Aug 23 10:55:01 2022] GET /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:55:01.301681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:01.302723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:01.304853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:01.305536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:01.306000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:01.306759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:01.307229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:01.307665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:01.334260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:01.337184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:01.337653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:01.338401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:01.338876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:01.339318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:01.613521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:01.626509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8ac52f1-0de6-42ed-abd0-8b06edb5f3e3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1534 microversion: 2.1 time: 0.328404 Aug 23 10:55:01.628291 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2209/4360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:01 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1534 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:01.656950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:01.669524 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68df5a12-e15c-466a-971e-aa721ccb052f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.400227 Aug 23 10:55:01.672784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2152/4361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:01 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:02.109195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:02.110179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:02.125483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:02.127809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:02.129398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:02.132334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:02.136223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:02.140284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:02.141483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:02.475846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:02.485537 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99ff48c8-b347-486b-a059-1d27fd61bf35 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.380817 Aug 23 10:55:02.487923 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2210/4362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:02 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:02.654914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:02.659994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:02.681479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:02.685629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:02.689957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:02.690955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:02.691637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:02.692287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:02.699502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:02.700538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:02.712439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:02.713437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:02.714940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:02.722389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:02.725689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:02.727608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:03.041622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:03.088425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c05c55a-3544-4f21-b902-9159ccceb835 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.393275 Aug 23 10:55:03.089386 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2211/4363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:02 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:03.206005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:03.223593 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8b7fdbd-a6a6-4170-9bd9-7ec12d29f029 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1540 microversion: 2.1 time: 0.574485 Aug 23 10:55:03.225454 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2153/4364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:02 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1540 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:03.514476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:03.516023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:03.534716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:03.535419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:03.536018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:03.539065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:03.539564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:03.540015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:03.855421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:03.869715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03c9a663-1b09-4c79-ba93-2d9e4502024f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1510 microversion: 2.1 time: 0.359822 Aug 23 10:55:03.870324 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2212/4365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:03 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:04.109598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:04.110211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:04.124373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:04.125127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:04.125742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:04.126605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:04.132254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:04.132919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:04.171976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:04.247809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:04.248659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:04.260412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:04.261167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:04.263382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:04.265048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:04.267195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:04.267826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:04.438669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:04.451170 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70964dfc-da66-4c11-be51-8623fa917baf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.345349 Aug 23 10:55:04.452393 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2154/4366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:04 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:04.629323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:04.641415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d850ec9f-b1bb-49c6-9e83-26a8e5ce6058 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1540 microversion: 2.1 time: 0.397704 Aug 23 10:55:04.656391 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2213/4367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:04 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1540 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:04.900731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:04.901681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:04.936484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:04.936947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:04.937397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:04.938126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:04.941872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:04.945705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.199524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:05.213166 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8190dba6-0cfd-4cd6-bd80-91830d9765fc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1487 microversion: 2.1 time: 0.325666 Aug 23 10:55:05.225140 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2155/4368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:04 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1487 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:05.239262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:05.240199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:05.248404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.249099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.249542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.250297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.250860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.251345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.288026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:05.326824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:05.354597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f2d67d17-76ae-4d65-8405-3eb15c564f85 req-ac16bded-aeab-43a7-8f28-a559453bc606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9a6e14-fd55-466b-9038-e89536ab0cd8", "name": "network-vif-plugged", "status": "completed", "tag": "e7ddc072-e999-45dc-b2cb-29a3df769345"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:05.388352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f2d67d17-76ae-4d65-8405-3eb15c564f85 req-ac16bded-aeab-43a7-8f28-a559453bc606 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.388824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f2d67d17-76ae-4d65-8405-3eb15c564f85 req-ac16bded-aeab-43a7-8f28-a559453bc606 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.391443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f2d67d17-76ae-4d65-8405-3eb15c564f85 req-ac16bded-aeab-43a7-8f28-a559453bc606 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.418712 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7aa0520b-5b3a-4413-99d2-dd917820e518 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 204 len: 0 microversion: 2.1 time: 0.182570 Aug 23 10:55:05.421897 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2214/4369] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:05 2022] DELETE /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:05.433185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:05.434393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:05.442301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.442857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.444062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.444846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.445309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.445741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.449304 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f2d67d17-76ae-4d65-8405-3eb15c564f85 req-ac16bded-aeab-43a7-8f28-a559453bc606 service nova] Creating event network-vif-plugged:e7ddc072-e999-45dc-b2cb-29a3df769345 for instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 on n-h2-847009-13 Aug 23 10:55:05.455922 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f2d67d17-76ae-4d65-8405-3eb15c564f85 req-ac16bded-aeab-43a7-8f28-a559453bc606 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105390 Aug 23 10:55:05.461486 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2156/4370] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:05.498373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:05.499655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:05.508650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.520769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.522078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.522906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.523586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.524184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.656441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:05.669211 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0eb4fe67-5af7-497d-bcda-a6449a2e77b0 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1493 microversion: 2.1 time: 0.241745 Aug 23 10:55:05.672167 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2215/4371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:05 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1493 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:05.696953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:05.698839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:05.705631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.706385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.707301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.708238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:05.708918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:05.709552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:05.837492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:05.837492 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16b15c6b-60f8-4b8a-8289-40e1cef52078 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.361174 Aug 23 10:55:05.868512 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2157/4372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:05 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:05.948598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:05.960053 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3925e83e-1880-4a9a-9889-1c06501048d9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1540 microversion: 2.1 time: 0.271906 Aug 23 10:55:05.969239 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2216/4373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:05 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1540 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:06.702918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:06.706586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:06.725836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:06.726810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:06.727445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:06.728359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:06.730422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:06.731383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:06.872402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:06.887010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:06.900282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:06.902193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:06.902802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:06.903689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:06.904312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:06.905020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.026129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:07.037252 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d8de3d0-83a4-4b2f-be0d-8511ddb47bf2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1493 microversion: 2.1 time: 0.341206 Aug 23 10:55:07.039400 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2158/4374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:06 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1493 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:07.050772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:07.051485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:07.059219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:07.059934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:07.060463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.061433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:07.062109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:07.062748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.281719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:07.296022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d3eb679-bb63-4b21-ac28-b12e5260a2df tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1522 microversion: 2.1 time: 0.254952 Aug 23 10:55:07.297077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2159/4375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:07 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:07.318055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:07.319397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:07.332956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:07.333882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:07.335074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.336676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:07.337595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:07.338413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.379585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:07.558916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-449b745a-2e56-4f14-bbc5-02f3b0660158 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 204 len: 0 microversion: 2.1 time: 0.243792 Aug 23 10:55:07.560788 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2160/4376] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:07 2022] DELETE /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:07.580252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:07.581368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:07.589580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:07.590409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:07.591151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.592088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:07.592852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:07.593517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:07.813869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:07.839372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76fc7b9b-a631-4d2e-8916-783df597b803 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1528 microversion: 2.1 time: 0.266845 Aug 23 10:55:07.839372 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2161/4377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:07 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1528 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:07.849275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:07.871138 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29ac2a07-5dcb-4860-9c45-b9e7fd77c875 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 1.003978 Aug 23 10:55:07.874011 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2217/4378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:06 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:08.061891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:08.063014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:08.079147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.079671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.080136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:08.080917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.081415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.081855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:08.255142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:08.263816 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c9adec9-7138-42d1-9ee0-faef3a1439b3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1493 microversion: 2.1 time: 0.205962 Aug 23 10:55:08.277446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2162/4379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:08 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1493 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:08.525720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2bb3b47e-4bab-4e05-a607-e2c47da6b147 req-45a17762-25e0-4ddb-93b6-2ca18b934379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da", "name": "network-vif-deleted", "tag": "dbd8e543-e8fc-4ad5-9e5f-1b9c96222b38"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:08.560212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2bb3b47e-4bab-4e05-a607-e2c47da6b147 req-45a17762-25e0-4ddb-93b6-2ca18b934379 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.563632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2bb3b47e-4bab-4e05-a607-e2c47da6b147 req-45a17762-25e0-4ddb-93b6-2ca18b934379 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.565217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2bb3b47e-4bab-4e05-a607-e2c47da6b147 req-45a17762-25e0-4ddb-93b6-2ca18b934379 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:08.591566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2bb3b47e-4bab-4e05-a607-e2c47da6b147 req-45a17762-25e0-4ddb-93b6-2ca18b934379 service nova] Creating event network-vif-deleted:dbd8e543-e8fc-4ad5-9e5f-1b9c96222b38 for instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da on n-h1-847009-13 Aug 23 10:55:08.608919 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2bb3b47e-4bab-4e05-a607-e2c47da6b147 req-45a17762-25e0-4ddb-93b6-2ca18b934379 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086760 Aug 23 10:55:08.610437 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2218/4380] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:08.859937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:08.869661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:08.895767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:08.897048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:08.904499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.905041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.905502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:08.912133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.913938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.914079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.914878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.915535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:08.916167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:08.917141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:08.917789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:08.918910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:09.130302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:09.142689 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7e9d668-15fb-412c-8f3e-3bf05b15267a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.251978 Aug 23 10:55:09.144554 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2219/4381] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:08 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:09.191622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:09.204121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75444b09-2870-4a9d-b57f-13ab3151a637 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1528 microversion: 2.1 time: 0.347985 Aug 23 10:55:09.205441 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2163/4382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:08 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1528 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:09.295172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:09.297550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-215b7a2d-5e98-4421-99cf-3f22ac4b4213 req-a5fffeab-ef98-4807-9791-e7b261bbf403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9a6e14-fd55-466b-9038-e89536ab0cd8", "name": "network-vif-unplugged", "status": "completed", "tag": "e7ddc072-e999-45dc-b2cb-29a3df769345"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:09.298810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:09.322549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:09.323075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:09.323530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:09.326944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:09.327433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:09.327875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:09.329703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-215b7a2d-5e98-4421-99cf-3f22ac4b4213 req-a5fffeab-ef98-4807-9791-e7b261bbf403 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:09.330768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-215b7a2d-5e98-4421-99cf-3f22ac4b4213 req-a5fffeab-ef98-4807-9791-e7b261bbf403 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:09.331212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-215b7a2d-5e98-4421-99cf-3f22ac4b4213 req-a5fffeab-ef98-4807-9791-e7b261bbf403 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:09.422232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-215b7a2d-5e98-4421-99cf-3f22ac4b4213 req-a5fffeab-ef98-4807-9791-e7b261bbf403 service nova] Creating event network-vif-unplugged:e7ddc072-e999-45dc-b2cb-29a3df769345 for instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 on n-h2-847009-13 Aug 23 10:55:09.444669 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-215b7a2d-5e98-4421-99cf-3f22ac4b4213 req-a5fffeab-ef98-4807-9791-e7b261bbf403 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155083 Aug 23 10:55:09.454011 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2164/4383] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:55:09.471845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:09.472363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:09.472859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:09.473335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:09.559647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:09.578730 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-86a081ed-a03b-4640-8f4e-e71edf4a77f3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 200 len: 1304 microversion: 2.1 time: 0.295458 Aug 23 10:55:09.579420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2220/4384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:09 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 1304 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:10.165596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:10.166514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:10.182625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:10.184358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:10.185717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:10.186700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:10.189202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:10.189910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:10.228270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:10.229082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:10.236059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:10.236877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:10.237568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:10.238602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:10.239259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:10.242231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:10.487159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:10.497255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ec48d49-a197-405c-8a26-194b6820e135 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.337322 Aug 23 10:55:10.501893 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2165/4385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:10 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:10.600661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:10.601569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:10.617576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:10.618093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:10.618549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:10.619288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:10.619757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:10.620198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:10.666250 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da HTTP/1.1 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da'} Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:10.672104 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:10.675511 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:10.675864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:10.690975 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0484acc-5b8b-4881-a724-73f864af8e53 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 404 len: 111 microversion: 2.1 time: 0.095124 Aug 23 10:55:10.692760 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2166/4386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:10 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:10.769371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:10.787643 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b128fd76-24e8-4fe6-b71b-92597a5b076c tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1528 microversion: 2.1 time: 0.565233 Aug 23 10:55:10.797227 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2221/4387] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:10 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1528 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:10.991751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1224429546", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a652e942-71c8-4257-ac1b-36060246ef53"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:11.111773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] validate_networks() for [('a652e942-71c8-4257-ac1b-36060246ef53', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:55:11.527712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:11.529179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:11.542887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:11.553647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:11.554332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:11.555425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:11.555897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:11.556329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.005147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:12.024949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d5c7ca6c-fb1a-4270-ac33-20bd3682e712 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.500114 Aug 23 10:55:12.025893 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2222/4388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:11 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:12.047556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-399c3926-3180-41d5-9e53-ef30222a97a9 req-f33825a6-f28f-43f1-a3a6-fd790b0ad8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc9a6e14-fd55-466b-9038-e89536ab0cd8", "name": "network-vif-deleted", "tag": "e7ddc072-e999-45dc-b2cb-29a3df769345"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:12.104558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-399c3926-3180-41d5-9e53-ef30222a97a9 req-f33825a6-f28f-43f1-a3a6-fd790b0ad8ec service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:12.109622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-399c3926-3180-41d5-9e53-ef30222a97a9 req-f33825a6-f28f-43f1-a3a6-fd790b0ad8ec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:12.110430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-399c3926-3180-41d5-9e53-ef30222a97a9 req-f33825a6-f28f-43f1-a3a6-fd790b0ad8ec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.151916 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-399c3926-3180-41d5-9e53-ef30222a97a9 req-f33825a6-f28f-43f1-a3a6-fd790b0ad8ec service nova] Creating event network-vif-deleted:e7ddc072-e999-45dc-b2cb-29a3df769345 for instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 on n-h2-847009-13 Aug 23 10:55:12.165400 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-399c3926-3180-41d5-9e53-ef30222a97a9 req-f33825a6-f28f-43f1-a3a6-fd790b0ad8ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135561 Aug 23 10:55:12.167758 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2223/4389] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:12.186839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:12.187895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:12.204659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:12.207599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:12.208216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.211711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:12.212498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:12.214948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.220909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:55:12.222208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:55:12.222962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:55:12.223525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:55:12.224086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:55:12.247733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:12.248450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:12.250239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.252158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:12.253958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:12.254578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.306022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:55:12.313263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:12.316415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:12.318786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:12.319483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lazy-loading 'fault' on Instance uuid cc9a6e14-fd55-466b-9038-e89536ab0cd8 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:12.320058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Getting quotas for user 55db11ffc78b481087c1a3ca89fd1591 and project 27b37b69f9974fd0a7f85c4db9990f9a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:55:12.350643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:55:12.353320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:55:12.463443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dcddcc6-e506-4ad5-81a8-9fea1f68f792 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484314 Aug 23 10:55:12.464106 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2167/4390] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:55:12.497016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccf42199-4be3-4a51-a7e2-9eaf0aec9794 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:12.502152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccf42199-4be3-4a51-a7e2-9eaf0aec9794 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:12.594785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:12.611458 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d63bf1be-f8a6-4c53-8154-715bf96de216 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 200 len: 1315 microversion: 2.1 time: 0.436093 Aug 23 10:55:12.614147 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2224/4391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:12 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:12.638925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccf42199-4be3-4a51-a7e2-9eaf0aec9794 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:12.647501 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccf42199-4be3-4a51-a7e2-9eaf0aec9794 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1215 microversion: 2.1 time: 0.171614 Aug 23 10:55:12.650234 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2168/4392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:12 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:13.059918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:13.060836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:13.105547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:13.108411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:13.109868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:13.130279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:13.133226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:13.137292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:13.624935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:13.638196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:13.638824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:13.650756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c8a9ece1-1a1c-488e-add8-a4c89069b884 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.607001 Aug 23 10:55:13.664084 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2225/4393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:13 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:13.665459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:13.667594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:13.668078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:13.671367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:13.671908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:13.672366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:13.684131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:13.687480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:13.696605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:13.697484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:13.698133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:13.699150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:13.699937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:13.700582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:13.713489 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 HTTP/1.1 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'cc9a6e14-fd55-466b-9038-e89536ab0cd8'} Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:13.715433 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:13.719525 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:13.721703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:13.722879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9589eb07-dc0a-4bb6-8d3e-40c8f0dc57a2 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 404 len: 111 microversion: 2.1 time: 0.089963 Aug 23 10:55:13.724098 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2169/4394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:13 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:13.882935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:13.893759 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f9cd92e-acc8-4f40-b027-81d1bc2337eb tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1219 microversion: 2.1 time: 0.227205 Aug 23 10:55:13.897628 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2226/4395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:13 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:13.923365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-64557546", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:13.940862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:14.026901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] validate_networks() for [('d26b4e4e-92d2-42da-96e8-fce80f3d1152', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:55:14.672340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:14.673594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:14.691001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:14.693754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:14.694262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:14.695036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:14.695516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:14.695958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:14.836087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:55:14.836585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:55:14.838160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:55:14.839565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:55:14.840417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:55:14.870922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:14.871417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:14.886319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:14.887509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:14.889645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:14.890107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:14.981011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:55:15.005131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Getting quotas for user e0ff1121d80f493aa4d6d0b62a583d32 and project c92b54edcf674ea7acdbef102a9f6ce8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:55:15.054507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:55:15.056715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:55:15.098040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:15.114216 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea99b1c0-0067-4501-be1b-891bd9b730bb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1504 microversion: 2.1 time: 0.445894 Aug 23 10:55:15.130090 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2227/4396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:14 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:15.132428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:15.135012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:15.166395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:15.169916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:15.171380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:15.175479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:15.178610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:15.179088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:15.262993 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b4348839-e855-4f2a-a8e3-750db0d839c0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.342700 Aug 23 10:55:15.269835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2170/4397] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:55:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:55:15.308860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7578098c-6768-4bd6-b07f-4401d33692d0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:15.309754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7578098c-6768-4bd6-b07f-4401d33692d0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:15.453821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7578098c-6768-4bd6-b07f-4401d33692d0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:15.468904 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7578098c-6768-4bd6-b07f-4401d33692d0 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1223 microversion: 2.1 time: 0.186656 Aug 23 10:55:15.469976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2171/4398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:15 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1223 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:15.504141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:15.516449 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7d8a9a0-8145-4583-8e96-1710a31cdea6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1275 microversion: 2.1 time: 0.393813 Aug 23 10:55:15.517088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2228/4399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:15 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1275 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:16.153756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:16.156603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:16.174817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.175941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.176588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.178523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.179372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.179992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.490792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:16.491443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:16.504414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.505264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.508953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.509887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.511179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:16.512050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.512841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.524129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-203641fd-d9d6-4f66-a85d-9e54b65f022b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1504 microversion: 2.1 time: 0.389623 Aug 23 10:55:16.538565 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2172/4400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:16 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1504 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:16.573753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9b642745-9007-4bc6-8548-94943af598fc req-29b99984-893c-4c60-9b56-e91ed5c7860a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79148d86-86de-46ef-8097-55b671c0c24e", "name": "network-vif-unplugged", "status": "completed", "tag": "947d9885-5b8f-4c8d-b8c7-7493796bd94c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:16.602261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b642745-9007-4bc6-8548-94943af598fc req-29b99984-893c-4c60-9b56-e91ed5c7860a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.604277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b642745-9007-4bc6-8548-94943af598fc req-29b99984-893c-4c60-9b56-e91ed5c7860a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.604864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b642745-9007-4bc6-8548-94943af598fc req-29b99984-893c-4c60-9b56-e91ed5c7860a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.643499 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9b642745-9007-4bc6-8548-94943af598fc req-29b99984-893c-4c60-9b56-e91ed5c7860a service nova] Creating event network-vif-unplugged:947d9885-5b8f-4c8d-b8c7-7493796bd94c for instance 79148d86-86de-46ef-8097-55b671c0c24e on n-h1-847009-13 Aug 23 10:55:16.664563 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9b642745-9007-4bc6-8548-94943af598fc req-29b99984-893c-4c60-9b56-e91ed5c7860a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104246 Aug 23 10:55:16.665382 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2173/4401] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:16.685841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:16.691120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:16.708243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.708889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.709441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.710296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:16.710764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:16.711198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:16.743878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:16.752672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6401339a-282e-4c22-9070-a06c3e6245c5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1219 microversion: 2.1 time: 0.266320 Aug 23 10:55:16.753294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2229/4402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:16 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:16.840789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:16.849352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fac00244-c89d-46b5-b881-0224aa6ec238 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1273 microversion: 2.1 time: 0.180192 Aug 23 10:55:16.850875 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2174/4403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:16 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:17.549503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:17.550688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:17.559487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:17.559937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:17.560452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:17.561368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:17.561824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:17.563038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:17.776077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:17.776716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:17.789613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:17.790130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:17.796236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:17.797321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:17.797971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:17.798721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:17.851403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:17.861296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa2add3a-1167-45c9-8284-3e56066bad38 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1504 microversion: 2.1 time: 0.315679 Aug 23 10:55:17.864132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2230/4404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:17 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:17.873966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:17.875962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:17.895272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:17.895885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:17.897032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:17.897878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:17.898452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:17.898898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:17.931949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:17.937138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:17.962458 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df5444a8-6448-4cf9-b5b4-a086ffdcf193 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1275 microversion: 2.1 time: 0.190673 Aug 23 10:55:17.969206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2175/4405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:17 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:18.105326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:18.119034 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ccbc0a65-4714-4ecf-a28b-d10ef18a33bf tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.250259 Aug 23 10:55:18.120665 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2231/4406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:17 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:18.891437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:18.893137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:18.909336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:18.910292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:18.915619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:18.917725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:18.918311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:18.918774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:18.992113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:18.992752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:19.010456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:19.030851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:19.031655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:19.035051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:19.035971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:19.054414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:19.055087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:19.395039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:19.405816 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-77954491-b049-41c9-9d4a-d951b1f1e999 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 200 len: 1507 microversion: 2.1 time: 0.525790 Aug 23 10:55:19.406429 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2176/4407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:18 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:19.713467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:19.722042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-156aee0b-21ac-4217-ac0c-2b743f1107d3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1275 microversion: 2.1 time: 0.737035 Aug 23 10:55:19.729899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2232/4408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:18 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1275 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:19.734892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:19.738477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:19.759523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:19.760025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:19.760476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:19.761250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:19.761723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:19.762162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:19.857874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:19.858501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:19.866206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:19.866713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:19.867434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:19.868359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:19.868854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:19.869507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.082688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:20.094793 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2390ab2e-ea23-43ca-8046-646331fdead2 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.687287 Aug 23 10:55:20.095666 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2177/4409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:19 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:20.218825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:20.227599 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c6c4a3f9-1623-4f3d-b519-a07f786c6e20 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.496405 Aug 23 10:55:20.228186 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2233/4410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:19 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:20.258188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:20.259128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:20.272124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0718c6b4-035f-4a6c-8799-1c9ebed42ca4 req-9551e52b-a31d-4f28-84aa-cbf9fec645ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34e722f-cefc-4474-b563-3e1773e072e8", "tag": "84eecc4e-0873-4e78-b504-43ac061beeb9"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:20.284592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.285439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.286177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.287874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.288503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.289758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.290449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0718c6b4-035f-4a6c-8799-1c9ebed42ca4 req-9551e52b-a31d-4f28-84aa-cbf9fec645ec service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.290993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0718c6b4-035f-4a6c-8799-1c9ebed42ca4 req-9551e52b-a31d-4f28-84aa-cbf9fec645ec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.291648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0718c6b4-035f-4a6c-8799-1c9ebed42ca4 req-9551e52b-a31d-4f28-84aa-cbf9fec645ec service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.311203 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0718c6b4-035f-4a6c-8799-1c9ebed42ca4 req-9551e52b-a31d-4f28-84aa-cbf9fec645ec service nova] Creating event network-changed:84eecc4e-0873-4e78-b504-43ac061beeb9 for instance b34e722f-cefc-4474-b563-3e1773e072e8 on n-h1-847009-13 Aug 23 10:55:20.317061 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0718c6b4-035f-4a6c-8799-1c9ebed42ca4 req-9551e52b-a31d-4f28-84aa-cbf9fec645ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050586 Aug 23 10:55:20.318055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2234/4411] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:20.495333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:20.504523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1bb9ae2e-7d1e-4172-89a6-21e66cd38df7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.250599 Aug 23 10:55:20.506142 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2178/4412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:20 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:20.527979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:20.529010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:20.535484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.535978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.536411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.537487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.538102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.538696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.750830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:20.751457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:20.759277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.762849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.763310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.764052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.764523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.764987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.859780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:20.873008 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70dd3acb-dd89-464a-b29d-19f1b86c26af tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1281 microversion: 2.1 time: 0.125721 Aug 23 10:55:20.885937 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2179/4413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:20 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1281 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:20.914374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:20.926502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66b34366-2185-4690-b838-62d8fb7eb050 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.402794 Aug 23 10:55:20.933832 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2235/4414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:20 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:20.952298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:20.954187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:20.970093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.971937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.972685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:20.976827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:20.977746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:20.978799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.127717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:21.128840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:21.141845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.142911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.143583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.144768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.145449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.146099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.266515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:21.279382 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86ebbec-a34b-4edd-af45-805e3c7d9c4b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.332882 Aug 23 10:55:21.292572 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2180/4415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:20 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:21.305983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd91c759-eb5e-47c6-8d84-572f876d4492 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:21.315311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd91c759-eb5e-47c6-8d84-572f876d4492 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.315873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd91c759-eb5e-47c6-8d84-572f876d4492 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.319184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd91c759-eb5e-47c6-8d84-572f876d4492 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.350169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd91c759-eb5e-47c6-8d84-572f876d4492 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 10:55:21.416692 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd91c759-eb5e-47c6-8d84-572f876d4492 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.115434 Aug 23 10:55:21.432370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2181/4416] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:55:21 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:55:21.447335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:21.448080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:21.464674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.465858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.466728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.467753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.468572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.474463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.648185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:21.713364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a29d9224-3b77-41d9-8e16-64edb7694ddc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.583929 Aug 23 10:55:21.714063 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2236/4417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:21 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:21.799104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:21.814336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-291ec0fd-508a-4c7e-a7dc-b2c4636642cc tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.379538 Aug 23 10:55:21.818480 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2182/4418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:21 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:21.903816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:21.905543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:21.934570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.935876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.937536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:21.939430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:21.941273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:21.945500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:22.161918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:22.172146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81755317-090d-4399-8404-768e55f99f31 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.278349 Aug 23 10:55:22.173411 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2237/4419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:21 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:22.735441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:22.736125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:22.745438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:22.745942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:22.746456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:22.747176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:22.748285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:22.748943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:22.839489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:22.840606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:22.848003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:22.848508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:22.848991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:22.854574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:22.855072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:22.857798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:22.928910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:22.937459 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23a24311-ba1f-4516-9a9c-7002ca16e80a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.205868 Aug 23 10:55:22.938048 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2183/4420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:22 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:23.070585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:23.080210 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f040d02-feab-4ca5-bd78-050403331a60 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.244538 Aug 23 10:55:23.080861 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2238/4421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:22 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:23.198208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:23.198208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:23.201774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:23.202485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:23.203003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:23.203958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:23.204532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:23.205057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:23.352558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:23.362135 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7727391d-0103-4191-88bb-8f62bb9cafde tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.171693 Aug 23 10:55:23.362712 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2184/4422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:23 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:23.960414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:23.961297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:23.973739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:23.975333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:23.977796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:23.979879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:23.981979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:23.982641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:24.101704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:24.102337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:24.112606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:24.113498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:24.114405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:24.116029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:24.116723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:24.117263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:24.278863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:24.288671 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fcf1885-051d-4dfe-9556-f3a1d5533ebb tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.191604 Aug 23 10:55:24.290182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2185/4423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:24 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:24.384028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:24.384673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:24.393920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:24.394431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:24.394879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:24.395784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:24.397159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:24.397847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:24.599595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:24.609730 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fba2ae40-e3a3-40db-bb6a-373f89a9e896 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.229807 Aug 23 10:55:24.610493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2186/4424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:24 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:24.639159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:24.651517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd13a840-fb26-4622-bb43-19d0470377b4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.695772 Aug 23 10:55:24.667938 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2239/4425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:23 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:25.316539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:25.317177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:25.323600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:25.327774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.329344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.330023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.330964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.331631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.332259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.363382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9bb23f51-c827-4811-9532-db325000e6af req-f7c7f5f5-5223-4a02-abce-15b3b7209aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4be8e7bb-8d35-4cad-beba-4a636e40dbdd", "tag": "116d4e2b-d92a-4c53-8aec-c25b6fb2303c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:25.391518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9bb23f51-c827-4811-9532-db325000e6af req-f7c7f5f5-5223-4a02-abce-15b3b7209aef service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.394315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9bb23f51-c827-4811-9532-db325000e6af req-f7c7f5f5-5223-4a02-abce-15b3b7209aef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.394945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9bb23f51-c827-4811-9532-db325000e6af req-f7c7f5f5-5223-4a02-abce-15b3b7209aef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.412275 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9bb23f51-c827-4811-9532-db325000e6af req-f7c7f5f5-5223-4a02-abce-15b3b7209aef service nova] Creating event network-changed:116d4e2b-d92a-4c53-8aec-c25b6fb2303c for instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd on n-h1-847009-13 Aug 23 10:55:25.417837 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9bb23f51-c827-4811-9532-db325000e6af req-f7c7f5f5-5223-4a02-abce-15b3b7209aef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059982 Aug 23 10:55:25.419119 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2240/4426] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:25.460255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:25.574807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:25.589584 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b74b1a0e-9a0f-465a-9ab6-d518022ceee2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.276171 Aug 23 10:55:25.592799 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2187/4427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:25 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:25.633237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:25.635023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:25.642388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.643274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.644056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.645063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.645789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.647032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.677447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:25.678208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:25.706513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.707037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.707501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.708253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:25.709339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:25.710109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:25.904451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:25.916633 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5912e84-a000-4eac-a3b8-0126c2abd736 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.243516 Aug 23 10:55:25.919072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2188/4428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:25 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:26.037267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:26.045979 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a1057b0-e33c-4e90-8ef1-2d90ff490075 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.418000 Aug 23 10:55:26.046560 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2241/4429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:25 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:26.612064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:26.612981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:26.621829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:26.622507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:26.623042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:26.624529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:26.625552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:26.626057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:26.826438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:26.836701 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46beb2e4-e6c5-410b-91d2-ff8a74bbc1df tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.228601 Aug 23 10:55:26.837321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2189/4430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:26 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:26.939949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:26.941404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:26.949726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:26.950297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:26.951094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:26.952002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:26.952683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:26.953208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:27.073222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:27.074114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:27.083023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:27.087425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:27.088163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:27.088949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:27.092684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:27.093349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:27.178668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:27.188672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-559bc3aa-bfbc-4d11-a9ed-8084aca4f226 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.253005 Aug 23 10:55:27.189981 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2242/4431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:26 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:27.196570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-07b66979-2476-46e6-a0d6-339c9b4a3a4b req-dc73ce24-cf68-4f45-8f1a-b1168ed29f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34e722f-cefc-4474-b563-3e1773e072e8", "name": "network-vif-plugged", "status": "completed", "tag": "84eecc4e-0873-4e78-b504-43ac061beeb9"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:27.210990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07b66979-2476-46e6-a0d6-339c9b4a3a4b req-dc73ce24-cf68-4f45-8f1a-b1168ed29f30 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:27.211876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07b66979-2476-46e6-a0d6-339c9b4a3a4b req-dc73ce24-cf68-4f45-8f1a-b1168ed29f30 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:27.212561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07b66979-2476-46e6-a0d6-339c9b4a3a4b req-dc73ce24-cf68-4f45-8f1a-b1168ed29f30 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:27.228794 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-07b66979-2476-46e6-a0d6-339c9b4a3a4b req-dc73ce24-cf68-4f45-8f1a-b1168ed29f30 service nova] Creating event network-vif-plugged:84eecc4e-0873-4e78-b504-43ac061beeb9 for instance b34e722f-cefc-4474-b563-3e1773e072e8 on n-h1-847009-13 Aug 23 10:55:27.234715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-07b66979-2476-46e6-a0d6-339c9b4a3a4b req-dc73ce24-cf68-4f45-8f1a-b1168ed29f30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043286 Aug 23 10:55:27.235619 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2243/4432] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:27.319209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:27.328111 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c46eb5b-44cd-458f-9f48-dc1074bd45fd tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.263141 Aug 23 10:55:27.328981 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2190/4433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:27 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:27.857673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:27.858376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:27.867474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:27.868089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:27.868607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:27.869425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:27.869960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:27.870465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:28.029445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:28.042350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9d709d32-985b-414f-b7c1-728f490da82e tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.188940 Aug 23 10:55:28.043469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2244/4434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:27 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:28.209587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:28.210846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:28.219558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:28.220276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:28.220919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:28.221873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:28.222515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:28.223290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:28.351402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:28.352397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:28.359040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:28.359767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:28.360364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:28.361261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:28.362033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:28.362468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:28.373596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:28.381920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:28.394190 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-003a5114-c972-4282-a7f5-9065e683128c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.188605 Aug 23 10:55:28.400384 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2191/4435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:28 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:28.546032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:28.558058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b3b3f8e8-e5e2-47ef-aaf8-0a638000d14a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.211772 Aug 23 10:55:28.574275 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2245/4436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:28 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:29.065649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:29.066466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:29.073577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:29.074273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:29.075030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:29.075694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:29.076153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:29.076729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:29.224731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:29.234531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bd42b8d-76c3-405c-a174-bc1315172eff tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.173191 Aug 23 10:55:29.245074 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2192/4437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:29 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:29.425317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:29.426432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:29.434046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:29.434544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:29.435152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:29.436105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:29.436633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:29.437105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:29.595607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:29.596269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:29.602748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:29.605482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:29.606071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:29.606913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:29.608023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:29.608860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:29.609539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:29.615203 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d9cec90-3ea0-45e1-8e47-f919fdf25ef6 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1315 microversion: 2.1 time: 0.195703 Aug 23 10:55:29.615979 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2246/4438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:29 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:29.775462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:29.786913 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6afbdd47-947d-4681-ab6d-43bea695e5ee tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.194666 Aug 23 10:55:29.788257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2193/4439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:29 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:30.256024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:30.256976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:30.263822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.264526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.265478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.266412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.267076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.267711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.435962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:30.444997 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b48ff18c-127d-4efa-b6dd-0c40332a5ea2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.193416 Aug 23 10:55:30.445625 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2247/4440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:30 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:30.637319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:30.637865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:30.646583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.647239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.647713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.648622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.649274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.649709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.805062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:30.813635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e610bbc0-6b47-4f19-bf09-c2f14486a4d5 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1501 microversion: 2.1 time: 0.180599 Aug 23 10:55:30.814211 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2194/4441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:30 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1501 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:30.816345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:30.816997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:30.824412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.824966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.825457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.826338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.826938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.827496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.849581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:30.850548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:30.858284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.859308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.859960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.861036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:30.861737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:30.869972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:30.906023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'flavor' on Instance uuid b34e722f-cefc-4474-b563-3e1773e072e8 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:31.027158 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2079d09-9324-4a36-b2fb-e05993e41482 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "POST /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8/action" status: 202 len: 0 microversion: 2.1 time: 0.194969 Aug 23 10:55:31.032200 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2195/4442] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:55:30 2022] POST /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:55:31.040029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:31.046250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:31.047147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:31.054595 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-faf95afc-ba61-4099-b17e-e99528556bbc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.241381 Aug 23 10:55:31.055986 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2248/4443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:30 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:31.067214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:31.068099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:31.068712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:31.069792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:31.070446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:31.071072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:31.296500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:31.310547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7e678ef-f3f3-49a4-b456-3f979250b3a7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1509 microversion: 2.1 time: 0.276511 Aug 23 10:55:31.311374 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2196/4444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:31 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:31.474638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:31.475455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:31.482665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:31.483173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:31.483771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:31.484614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:31.485114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:31.485555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:31.667915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:31.669686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:31.683630 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-428d21a7-45f3-4d47-9500-34f350f5d408 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.209763 Aug 23 10:55:31.684584 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2249/4445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:31 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:32.078393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:32.082090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:32.096683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.097426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.098087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.099058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.099649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.100477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.243373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:32.251385 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-010797a7-5b6a-454b-9878-eea8207d925e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.178373 Aug 23 10:55:32.251964 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2197/4446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:32 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:32.331632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:32.332639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:32.336514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:32.340883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.341555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.342014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.342783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.343405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.343992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.493315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:32.502012 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0575dfd5-d25b-4f3a-b500-413eaabff7c9 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1492 microversion: 2.1 time: 0.174215 Aug 23 10:55:32.502605 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2250/4447] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:32 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1492 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:32.523575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:32.524095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:32.532094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.532603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.533158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.534259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.535103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.535922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.564094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:32.651486 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c965de1-546b-4475-99c8-bdc19333f973 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 204 len: 0 microversion: 2.1 time: 0.132046 Aug 23 10:55:32.653166 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2198/4448] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:32 2022] DELETE /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:32.661803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:32.662784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:32.669708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.670269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.670793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.671558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.672220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.672720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.707891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:32.708691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:32.717730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.718443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.719118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.720654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:32.721351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:32.721951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:32.878418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:32.887301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ace987aa-9962-4a11-addb-49269c9b1a2d tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1498 microversion: 2.1 time: 0.229565 Aug 23 10:55:32.887997 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2251/4449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:32 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:32.917907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:32.926044 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a5ec9f3-dcde-4a9b-b7ff-56a80c5d503b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.224238 Aug 23 10:55:32.926627 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2199/4450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:32 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:33.267002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:33.268043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:33.275357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.275538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:33.276071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.276296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.277124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.277593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.278158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:33.278266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.291511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.292311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.292921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.293936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.294511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.295026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.324459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:33.452650 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-251f35cd-c0d2-45e5-b44b-adc29ac88e02 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 204 len: 0 microversion: 2.42 time: 0.423354 Aug 23 10:55:33.454157 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2252/4451] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:55:33 2022] DELETE /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:55:33.470302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:33.471179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:33.472464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:33.479257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.479894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.480404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.481220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.481750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.482246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.490302 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1a15a5c-5fd5-44aa-bffc-71a5306c1bdc tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.220215 Aug 23 10:55:33.503947 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2200/4452] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:33 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:33.569657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6f3392a0-34d5-433b-83ea-36c41c1008d7 req-05fa5e6c-e485-4e95-939d-7bb3ad9edb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be8e7bb-8d35-4cad-beba-4a636e40dbdd", "name": "network-vif-plugged", "status": "completed", "tag": "116d4e2b-d92a-4c53-8aec-c25b6fb2303c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:33.580679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6f3392a0-34d5-433b-83ea-36c41c1008d7 req-05fa5e6c-e485-4e95-939d-7bb3ad9edb3f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.581285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6f3392a0-34d5-433b-83ea-36c41c1008d7 req-05fa5e6c-e485-4e95-939d-7bb3ad9edb3f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.582039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6f3392a0-34d5-433b-83ea-36c41c1008d7 req-05fa5e6c-e485-4e95-939d-7bb3ad9edb3f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.597658 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6f3392a0-34d5-433b-83ea-36c41c1008d7 req-05fa5e6c-e485-4e95-939d-7bb3ad9edb3f service nova] Creating event network-vif-plugged:116d4e2b-d92a-4c53-8aec-c25b6fb2303c for instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd on n-h1-847009-13 Aug 23 10:55:33.604948 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6f3392a0-34d5-433b-83ea-36c41c1008d7 req-05fa5e6c-e485-4e95-939d-7bb3ad9edb3f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042001 Aug 23 10:55:33.606018 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2201/4453] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:55:33.915617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:33.916721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:33.925899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.929405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.930113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:33.931078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:33.934884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:33.935614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:34.065900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:34.077226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:34.079118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:34.080472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7a2e22c-9653-45ae-a98c-6bba181159ce tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2960 microversion: 2.42 time: 0.621785 Aug 23 10:55:34.081162 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2253/4454] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:33 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2960 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:34.089365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:34.090293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:34.103622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:34.104438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:34.105012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:34.105845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:34.106379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:34.106887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:34.218305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:34.230339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b7020e9-b2f2-4e6f-8454-26e4b55716ec tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1498 microversion: 2.1 time: 0.319073 Aug 23 10:55:34.241384 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2202/4455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:33 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1498 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:34.250805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:34.259548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b67ae15-a42e-4431-8f30-f895936c66be tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.177055 Aug 23 10:55:34.260141 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2254/4456] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:34 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:34.511699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:34.512470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:34.520541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:34.521941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:34.522837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:34.523651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:34.524351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:34.525031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:34.697346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:34.706386 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3bea342-8714-4093-ad05-7a5272aa1bec tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.198675 Aug 23 10:55:34.706977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2203/4457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:34 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:35.106917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:35.108168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:35.115746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.116470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.117066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.117863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.118556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.119150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.252886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:35.253531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:35.275535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.276201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.276849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.277895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.278509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.279085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.363514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.376621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.378565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.380774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b13da13-e0f1-4260-b1dc-510623be95f0 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2960 microversion: 2.42 time: 0.278127 Aug 23 10:55:35.381517 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2255/4458] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:35 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2960 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:55:35.398207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:35.404895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:35.411506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.412292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.412911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.413763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.414365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.414938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.451692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.462978 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43c11586-dafd-4430-9b14-ae4e6c4e33c3 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1498 microversion: 2.1 time: 0.215244 Aug 23 10:55:35.463989 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2204/4459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:35 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1498 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:35.569917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.577762 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ba64d22-0b0b-4b18-a5bf-c4d8369585a3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1680 microversion: 2.1 time: 0.183430 Aug 23 10:55:35.578341 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2256/4460] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:35 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:35.733615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:35.733615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:35.747611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:35.751802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.752307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.752810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.753485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.753952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.754382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.762994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.763789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Searching by: {'deleted': False, 'project_id': 'ced522a415c24aff94350cdbd8ad197a'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:55:35.791851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.792333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.792793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.793533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.793999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.794428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.832063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:55:35.875313 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03aeae69-6c94-42b3-9c1b-5e87713a8b2c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.134175 Aug 23 10:55:35.876707 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2257/4461] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:55:35 2022] GET /compute/v2.1/servers => generated 339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:35.892908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:35.906114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:35.907043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Searching by: {'deleted': False, 'project_id': 'ced522a415c24aff94350cdbd8ad197a'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:55:35.914041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.914706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.915290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.916183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:35.916836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:35.917536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:35.951864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:55:35.996392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.003183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:36.009515 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4defe234-f130-409c-a634-cf0bd2c9a16d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.283205 Aug 23 10:55:36.009709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.011274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2205/4462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:35 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:36.025455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.026149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.026698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.166437 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cdff792b-31d6-43c1-8f72-8772529cddd9 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.278269 Aug 23 10:55:36.167074 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2258/4463] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:55:35 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:36.188222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4e6ed22-697d-4dbd-941f-e685cf868399 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:36.198558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4e6ed22-697d-4dbd-941f-e685cf868399 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014026 Aug 23 10:55:36.199288 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2206/4464] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:55:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:36.412786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:36.413632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:36.421693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.422419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.423044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.424037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.424659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.425452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.487280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:36.488187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:36.495806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.501844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.503111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.506091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.507451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.508190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.679520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.690106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.692865 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f870a94-09c6-48bf-b16e-c77ecb43d38f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1498 microversion: 2.1 time: 0.211546 Aug 23 10:55:36.693901 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2207/4465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:36 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1498 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:36.704373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:36.706689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:36.715197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.716834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.718684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-999075b3-8286-4944-9702-7ef6b1f063e8 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2960 microversion: 2.42 time: 0.309941 Aug 23 10:55:36.720495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.721191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.721807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.722665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.723270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.724379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.729517 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2259/4466] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:36 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2960 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:36.897297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:36.906140 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50f497f0-ca74-4ac3-8ec1-d6eb0c4ac7db tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1657 microversion: 2.1 time: 0.210886 Aug 23 10:55:36.906771 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2208/4467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:36 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1657 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:36.930400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1eb97c21-b837-46dd-9b79-7786d8e4d0f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:36.939181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eb97c21-b837-46dd-9b79-7786d8e4d0f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.939688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eb97c21-b837-46dd-9b79-7786d8e4d0f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.940307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eb97c21-b837-46dd-9b79-7786d8e4d0f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.975282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:36.975793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:36.979362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:36.984659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.985526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.986223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.987214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:36.987769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:36.988286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:36.989318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1eb97c21-b837-46dd-9b79-7786d8e4d0f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Going to try to start instance {{(pid=128859) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 10:55:37.028675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:37.040947 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1eb97c21-b837-46dd-9b79-7786d8e4d0f5 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.117434 Aug 23 10:55:37.045537 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2260/4468] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:55:36 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:55:37.053510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:37.054305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:37.061953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.062433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.063277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.064182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.064483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.064946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.125047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e993b8a-2533-4827-814f-890ba64f185c tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 204 len: 0 microversion: 2.1 time: 0.154172 Aug 23 10:55:37.126111 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2209/4469] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:36 2022] DELETE /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:55:37.132081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:37.133003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:37.140424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.141222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.141850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.143824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.144517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.145462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.236240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:37.252063 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5c3dc8d-e979-42bc-ad95-dca350dd76b3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.202983 Aug 23 10:55:37.252832 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2261/4470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:37 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:37.259055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:37.259944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:37.274091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.275875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.276629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.278162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.278895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.279556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.397831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:37.406914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e31f34b5-cc18-49c3-806c-036bb27e81f8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1666 microversion: 2.1 time: 0.278929 Aug 23 10:55:37.407049 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2210/4471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:37 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1666 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:37.471520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:37.474445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:37.482701 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c9e3dd30-7ebf-4a2f-a664-870a24fa8bc1 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1714 microversion: 2.1 time: 0.228534 Aug 23 10:55:37.483526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2262/4472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:37 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1714 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:37.714248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:37.714826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:37.721073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.721571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.722021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.722732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.723198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.723633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.745795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:37.746719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:37.754749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.756142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.756876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.757809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:37.758503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:37.759258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:37.889757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:37.900115 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09bb5b81-9e30-41ec-ba43-059823130b95 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1498 microversion: 2.1 time: 0.189733 Aug 23 10:55:37.900784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2211/4473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:37 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1498 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:38.135278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:38.146608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:38.148855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:38.150157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cdbb28e1-40a3-4997-8c1c-d0008b6a7dcc tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2960 microversion: 2.42 time: 0.408304 Aug 23 10:55:38.150936 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2263/4474] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:37 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2960 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:38.274803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:38.275481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:38.284469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.285917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.286905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.289267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.289755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.290199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.431404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:38.432012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:38.445366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.446007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.446454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.447170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.447632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.448058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.628663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:38.637472 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec2a2661-7f23-473f-94e7-499bf0c5997d tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1323 microversion: 2.1 time: 0.367251 Aug 23 10:55:38.641972 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2212/4475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:38 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:38.647137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:38.647771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:38.674501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.675017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.678274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.679272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.679955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.680547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.838342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:38.846560 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3978373c-87d1-4adf-a5b0-0d54d6cd27f2 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1666 microversion: 2.1 time: 0.419898 Aug 23 10:55:38.850675 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2264/4476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:38 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1666 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:38.921471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:38.922083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:38.931511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.932093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.932537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:38.933281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:38.933741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:38.934167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.001011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:39.015518 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-450d0a6d-ffdc-4943-8c19-9422fbed5793 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1714 microversion: 2.1 time: 0.370625 Aug 23 10:55:39.016353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2213/4477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:38 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1714 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:39.179559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:39.180462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:39.187338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.188075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.188887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.202318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.203099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.203877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.460248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:39.484242 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52d5cf41-e22a-44a3-a85c-dd284f6b8318 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1498 microversion: 2.1 time: 0.566842 Aug 23 10:55:39.487967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2265/4478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:38 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1498 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:39.507541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6af580e9-cea1-408d-82d2-a4ec15cec2af req-0d7a52d1-6f22-4cba-85e3-20c1d2d2ea8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34e722f-cefc-4474-b563-3e1773e072e8", "name": "network-vif-deleted", "tag": "84eecc4e-0873-4e78-b504-43ac061beeb9"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:39.534707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6af580e9-cea1-408d-82d2-a4ec15cec2af req-0d7a52d1-6f22-4cba-85e3-20c1d2d2ea8f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.547043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6af580e9-cea1-408d-82d2-a4ec15cec2af req-0d7a52d1-6f22-4cba-85e3-20c1d2d2ea8f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.547761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6af580e9-cea1-408d-82d2-a4ec15cec2af req-0d7a52d1-6f22-4cba-85e3-20c1d2d2ea8f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.585578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6af580e9-cea1-408d-82d2-a4ec15cec2af req-0d7a52d1-6f22-4cba-85e3-20c1d2d2ea8f service nova] Creating event network-vif-deleted:84eecc4e-0873-4e78-b504-43ac061beeb9 for instance b34e722f-cefc-4474-b563-3e1773e072e8 on n-h1-847009-13 Aug 23 10:55:39.593603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6af580e9-cea1-408d-82d2-a4ec15cec2af req-0d7a52d1-6f22-4cba-85e3-20c1d2d2ea8f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100436 Aug 23 10:55:39.594908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2266/4479] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:39.665335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:39.666649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:39.687780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:39.700981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.701780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.707257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.710512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.712128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:39.712541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.713196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.719592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:39.722670 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-473169c3-3775-4e0e-965a-2d7cd75c9208 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2960 microversion: 2.42 time: 0.549019 Aug 23 10:55:39.726307 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2214/4480] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:39 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2960 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:55:39.875497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:39.876410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:39.886755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.888122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.892299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:39.896469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:39.897729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:39.899738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.240656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:40.253507 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8519a3c5-0f79-484c-8e18-1882c5d39c00 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1520 microversion: 2.1 time: 0.598167 Aug 23 10:55:40.265319 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2267/4481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:39 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1520 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:40.282865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:40.282865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:40.298317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.298828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.299478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.300240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.300702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.301154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.454676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:40.465784 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-81ba975f-196f-4ba9-8f57-6fc0c38ee71b tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1666 microversion: 2.1 time: 0.594703 Aug 23 10:55:40.466378 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2215/4482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:39 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1666 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:40.471854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:40.472556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:40.479629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.482689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.483861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.484814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.485447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.486309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.527781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:40.632412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d59969e-339f-40c0-95f2-aa7441d65c46 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 204 len: 0 microversion: 2.1 time: 0.164571 Aug 23 10:55:40.633649 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2216/4483] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:40 2022] DELETE /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:40.639393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:40.640248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:40.647264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.647872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.648478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.649459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.650121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.650743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.670816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:40.686510 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c005cbb6-2a59-44b5-b987-4f128fee2397 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1714 microversion: 2.1 time: 0.419742 Aug 23 10:55:40.688108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.688407 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2268/4484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:40 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1714 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:40.688604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.689240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.689848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid b34e722f-cefc-4474-b563-3e1773e072e8 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:40.697205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:40.698200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:40.708255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.709030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.709684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.710576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.711275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.712321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.742789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:40.753637 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c08324a-d317-47ed-b808-be92e5cfd30f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1305 microversion: 2.1 time: 0.118606 Aug 23 10:55:40.754752 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2217/4485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:40 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:40.773675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:40.775647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:40.784919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.785722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.787374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:40.789222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:40.790015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:40.790809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.016283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:41.028200 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de4b604e-a4b7-4041-abfc-e7e7c95b88cb tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1526 microversion: 2.1 time: 0.337985 Aug 23 10:55:41.042255 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2269/4486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:40 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:41.100102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:41.110664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:41.114740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:41.119121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf65e7b1-e229-4a96-9263-cb660bf74192 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2939 microversion: 2.42 time: 0.359271 Aug 23 10:55:41.119918 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2218/4487] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:40 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2939 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:41.490997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:41.491843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:41.502233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.503043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.503669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.504541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.505445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.506153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.617075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-702b9f64-1054-4b1d-ae26-0305426e25a1 req-6e5b3f63-cde6-41cc-ad5e-03349a19a111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24cf52c2-0122-4173-8324-e7e3cccc60f1", "name": "network-vif-deleted", "tag": "b7e7104c-d4e3-46f7-91be-098c41efd681"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:41.643644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-702b9f64-1054-4b1d-ae26-0305426e25a1 req-6e5b3f63-cde6-41cc-ad5e-03349a19a111 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.644144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-702b9f64-1054-4b1d-ae26-0305426e25a1 req-6e5b3f63-cde6-41cc-ad5e-03349a19a111 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.644580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-702b9f64-1054-4b1d-ae26-0305426e25a1 req-6e5b3f63-cde6-41cc-ad5e-03349a19a111 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.685796 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-702b9f64-1054-4b1d-ae26-0305426e25a1 req-6e5b3f63-cde6-41cc-ad5e-03349a19a111 service nova] Creating event network-vif-deleted:b7e7104c-d4e3-46f7-91be-098c41efd681 for instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 on n-h2-847009-13 Aug 23 10:55:41.699179 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-702b9f64-1054-4b1d-ae26-0305426e25a1 req-6e5b3f63-cde6-41cc-ad5e-03349a19a111 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084553 Aug 23 10:55:41.699775 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2219/4488] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:41.713475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:41.718930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:41.719705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:41.728351 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa8dacd7-93dd-495e-b34f-2e49c167d4fe tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.243923 Aug 23 10:55:41.730331 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2270/4489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:41 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:41.737216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.738308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.742061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.743043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.743677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.745067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.753166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:41.754218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:41.773451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.774484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.777096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.779291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.779985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.780579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.793767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:41.845225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:41.850746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:41.851870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:41.852359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lazy-loading 'fault' on Instance uuid 24cf52c2-0122-4173-8324-e7e3cccc60f1 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:41.970044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a83a44e1ea47d2be803e63351c2aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced522a415c24aff94350cdbd8ad197a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:41.979806 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-336cd2f7-281d-437a-9226-1cf56f5dbcf6 tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 200 len: 1367 microversion: 2.1 time: 0.273063 Aug 23 10:55:41.982115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2220/4490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:41 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:41.997281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:41.999075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:42.010096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.016892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.018590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.019510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.024224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.029369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.092157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.092955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.094080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.094861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lazy-loading 'fault' on Instance uuid b34e722f-cefc-4474-b563-3e1773e072e8 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:42.139844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:42.152284 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13a3502e-ae6c-45a4-bc0c-72809d1e4be3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.404845 Aug 23 10:55:42.156062 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2271/4491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:41 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:42.201843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1ab71e42-194e-4e86-a080-cd292c24b061 req-840a6479-8070-4e6b-a6ec-12237cb376ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "c9d2120a-58d0-4732-aaa7-95b54da7b465"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:42.205041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db11ffc78b481087c1a3ca89fd1591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b37b69f9974fd0a7f85c4db9990f9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:42.214436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1ab71e42-194e-4e86-a080-cd292c24b061 req-840a6479-8070-4e6b-a6ec-12237cb376ff service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.215037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1ab71e42-194e-4e86-a080-cd292c24b061 req-840a6479-8070-4e6b-a6ec-12237cb376ff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.215910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1ab71e42-194e-4e86-a080-cd292c24b061 req-840a6479-8070-4e6b-a6ec-12237cb376ff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.234133 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-434142df-9baf-48e2-bb1c-983ea9d3887a tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 200 len: 1305 microversion: 2.1 time: 0.236996 Aug 23 10:55:42.235079 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1ab71e42-194e-4e86-a080-cd292c24b061 req-840a6479-8070-4e6b-a6ec-12237cb376ff service nova] Creating event network-vif-unplugged:c9d2120a-58d0-4732-aaa7-95b54da7b465 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:42.235822 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2221/4492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:41 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 1305 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:42.243280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:42.243706 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1ab71e42-194e-4e86-a080-cd292c24b061 req-840a6479-8070-4e6b-a6ec-12237cb376ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072720 Aug 23 10:55:42.244315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:42.244556 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2272/4493] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:42.252038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:42.252885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:42.253485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.254169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.254775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.256658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.257388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.257985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.260675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.261249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.262268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.263006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.263482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.263924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.577807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:42.592598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c3a1c51-cb01-49ec-b95e-d54f20e28f9b tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1526 microversion: 2.1 time: 0.354993 Aug 23 10:55:42.595908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2222/4494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:42 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:42.617337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:42.619722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:42.621088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:42.639727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:42.641288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:42.642616 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dbf47eee-8801-4687-b8dc-4994ab281e10 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2939 microversion: 2.42 time: 0.396928 Aug 23 10:55:42.645038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.646119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.647849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:42.650141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:42.651067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:42.653272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2273/4495] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:42 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2939 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:42.654795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.006752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.007510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] [instance: 24cf52c2-0122-4173-8324-e7e3cccc60f1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.019974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.020215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:43.022859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.023548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.025172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.027055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.027666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.038199 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1879025-4eeb-4587-aa02-a1a109bf1412 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.439454 Aug 23 10:55:43.050405 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2223/4496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:42 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:43.068241 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] HTTP exception thrown: Instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 could not be found. Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Request method failure captured: Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 HTTP/1.1 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLHhyRCWwb9Gbj2M8dzi4O_lTUpJxekT7I2dQ8StZGeGRCbD8PrMIy37WnoejsVvW_Zj3c5IDJeRHP42dvBMT6kuAu-RvQnt5TospjwNWzO7BRCMXgoTOPRpc8CsYzD5V9t3Ixnxyzr8QwsVMwWgDH5wfvK7GgalbOEKi4YvCcVfyxg Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ced522a415c24aff94350cdbd8ad197a Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestManualDisk-690846805 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ced522a415c24aff94350cdbd8ad197a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ced522a415c24aff94350cdbd8ad197a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ced522a415c24aff94350cdbd8ad197a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ced522a415c24aff94350cdbd8ad197a"}]}] Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestManualDisk-690846805 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ced522a415c24aff94350cdbd8ad197a Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestManualDisk-690846805 Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestManualDisk-690846805-project Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 01a83a44e1ea47d2be803e63351c2aad Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestManualDisk-690846805-project Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 could not be found. Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '24cf52c2-0122-4173-8324-e7e3cccc60f1'} Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 could not be found. Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 could not be found. Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.070126 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 could not be found. Aug 23 10:55:43.074170 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.074900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Returning 404 to user: Instance 24cf52c2-0122-4173-8324-e7e3cccc60f1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:43.075687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b96475ba-2a62-4b39-937a-a509733a8b3b tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1" status: 404 len: 111 microversion: 2.1 time: 0.075722 Aug 23 10:55:43.076281 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2274/4497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:42 2022] GET /compute/v2.1/servers/24cf52c2-0122-4173-8324-e7e3cccc60f1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:43.079494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.080151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.092247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d829a0aa-1ed3-45a2-abde-eed20f5ff9bb tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] Calling method '.version_select at 0x7fdc8fda4820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.108047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.110326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.110739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.124972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.125581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.129487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.141973 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d829a0aa-1ed3-45a2-abde-eed20f5ff9bb tempest-ServersTestManualDisk-690846805 tempest-ServersTestManualDisk-690846805-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135365970" status: 202 len: 0 microversion: 2.1 time: 0.056401 Aug 23 10:55:43.142713 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2275/4498] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:55:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135365970 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 10:55:43.259885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.260976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.274495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.279284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.279787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.280549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.283009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.283498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.321885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 HTTP/1.1 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b34e722f-cefc-4474-b563-3e1773e072e8'} Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.323501 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3df70ac-28ad-4506-83b9-c3a6e3aacb68 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 404 len: 111 microversion: 2.1 time: 0.069292 Aug 23 10:55:43.327362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2276/4499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:43 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:55:43.343262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.343771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.350690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.357190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.357730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.358500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.358993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.359430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.393393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 HTTP/1.1 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b34e722f-cefc-4474-b563-3e1773e072e8'} Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:43.398650 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06143b9b-1a27-46c8-8ba2-460593f390cc tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 404 len: 111 microversion: 2.1 time: 0.061225 Aug 23 10:55:43.402023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2277/4500] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:43 2022] DELETE /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:43.410959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.411891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b34e722f-cefc-4474-b563-3e1773e072e8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.421927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.422858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.424321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.425888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.427461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.428874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.462676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 HTTP/1.1 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b34e722f-cefc-4474-b563-3e1773e072e8'} Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.468245 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance b34e722f-cefc-4474-b563-3e1773e072e8 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:43.471767 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24594c22-af79-4f33-9363-578bed94e768 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8" status: 404 len: 111 microversion: 2.1 time: 0.065933 Aug 23 10:55:43.472406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2278/4501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:43 2022] GET /compute/v2.1/servers/b34e722f-cefc-4474-b563-3e1773e072e8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:43.480751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.481357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.490080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.490897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.491566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.492709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.493942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.494526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.529439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da HTTP/1.1 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da'} Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:43.531122 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93a8d42b-6717-4be4-8afe-a59d13292762 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 404 len: 111 microversion: 2.1 time: 0.055927 Aug 23 10:55:43.535796 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2279/4502] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:43 2022] DELETE /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:43.542519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.552890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.590838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.591352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.591804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.592538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.593032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.593465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.651565 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da HTTP/1.1 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da'} Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:43.655398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. Aug 23 10:55:43.658825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:43.660985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:43.663576 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3fab979b-422d-40c8-93fb-7779f62b534c tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da" status: 404 len: 111 microversion: 2.1 time: 0.124871 Aug 23 10:55:43.664921 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2280/4503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:43 2022] GET /compute/v2.1/servers/3330ce8c-ff6d-4bda-87d4-a2d5d2fe97da => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:43.679450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.680935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.696448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.700708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.704474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.705375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.707612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.708698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.868870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:43.883255 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c9e3375-2f56-4eaa-a338-74ea9efd04b9 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1484 microversion: 2.1 time: 0.216334 Aug 23 10:55:43.890343 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2281/4504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:43 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1484 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:43.895331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:43.896489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:43.931428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.937974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.938450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:43.939248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:43.939705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:43.940201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.110974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:44.126922 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-173c0139-ac95-4afd-be59-33fdf39689aa tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 1.065205 Aug 23 10:55:44.128022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2224/4505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:43 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:44.150082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:44.152794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:44.165363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.169609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.170275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.171218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.171848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.172850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.212155 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 HTTP/1.1 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5213bf0f-b9d3-4cd8-88e4-530a4f430820'} Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:44.217959 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.222135 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.229132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:44.230205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5302fdb0-fdaa-460a-b06d-2d890d9051e7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 404 len: 111 microversion: 2.1 time: 0.101086 Aug 23 10:55:44.232858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2225/4506] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:44 2022] DELETE /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:44.259858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-53024b2f-5e34-47da-a70a-f7265ea634b0 req-a0a29788-05f5-4639-9dcb-b1f3a12d0013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4be8e7bb-8d35-4cad-beba-4a636e40dbdd", "name": "network-vif-deleted", "tag": "116d4e2b-d92a-4c53-8aec-c25b6fb2303c"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:44.290736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-53024b2f-5e34-47da-a70a-f7265ea634b0 req-a0a29788-05f5-4639-9dcb-b1f3a12d0013 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.293504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-53024b2f-5e34-47da-a70a-f7265ea634b0 req-a0a29788-05f5-4639-9dcb-b1f3a12d0013 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.296207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-53024b2f-5e34-47da-a70a-f7265ea634b0 req-a0a29788-05f5-4639-9dcb-b1f3a12d0013 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.337282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-53024b2f-5e34-47da-a70a-f7265ea634b0 req-a0a29788-05f5-4639-9dcb-b1f3a12d0013 service nova] Creating event network-vif-deleted:116d4e2b-d92a-4c53-8aec-c25b6fb2303c for instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd on n-h1-847009-13 Aug 23 10:55:44.346484 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-53024b2f-5e34-47da-a70a-f7265ea634b0 req-a0a29788-05f5-4639-9dcb-b1f3a12d0013 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107444 Aug 23 10:55:44.350227 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2226/4507] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:44.362916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:44.364172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:44.381619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.382240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.385165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.386131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.386749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.388429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.467311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:44.483658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:44.487348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:44.491985 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edd13dac-b06e-46de-a9e4-4b9e54785bc9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2918 microversion: 2.42 time: 0.600559 Aug 23 10:55:44.493793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2282/4508] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:43 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2918 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:44.508518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:44.517179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5213bf0f-b9d3-4cd8-88e4-530a4f430820] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:44.543778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.544296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.544766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.545513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.545980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.546421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.610920 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 HTTP/1.1 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5213bf0f-b9d3-4cd8-88e4-530a4f430820'} Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:44.628400 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. Aug 23 10:55:44.633759 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.637495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5213bf0f-b9d3-4cd8-88e4-530a4f430820 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:44.638565 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3280b4c4-a48f-498d-911b-03a4cf3b7be4 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820" status: 404 len: 111 microversion: 2.1 time: 0.143890 Aug 23 10:55:44.639876 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2283/4509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:44 2022] GET /compute/v2.1/servers/5213bf0f-b9d3-4cd8-88e4-530a4f430820 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:44.648009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c25971ff-eeb5-4b36-8c59-cc2387d363d2"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:44.652225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:44.663494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.664220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.665072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.666477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.667403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.667790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.805797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:44.819116 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa52bfac-ad7b-4e4f-9888-7b7153e0c49a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.465417 Aug 23 10:55:44.820501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2227/4510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:44 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:44.829145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "45b4a255-749d-4e2a-b1d9-2962413c0338"}, {"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "d5c4df22-c16f-4712-83e2-870018b97e49"}, {"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "ada32124-6a26-48d3-b44a-884b21329b6e"}, {"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-unplugged", "status": "completed", "tag": "a864d661-858f-474f-ad0a-fcc083ec2074"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:44.843305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.844399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.845291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.873575 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Creating event network-vif-unplugged:45b4a255-749d-4e2a-b1d9-2962413c0338 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:44.874095 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Creating event network-vif-unplugged:d5c4df22-c16f-4712-83e2-870018b97e49 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:44.874603 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Creating event network-vif-unplugged:ada32124-6a26-48d3-b44a-884b21329b6e for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:44.876336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] Creating event network-vif-unplugged:a864d661-858f-474f-ad0a-fcc083ec2074 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:44.887626 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b075cc5e-7123-4f39-b1fd-e420bec9d7a7 req-ceb9a77f-4e1a-4637-94a5-479186f3ea8e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.065433 Aug 23 10:55:44.888688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2228/4511] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:44.900561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:44.903623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:44.917351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.918651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.919433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.920849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.921730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.924501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.954698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 HTTP/1.1 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b8a5a23b-45c5-4fe6-82a8-e07cbc755931'} Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:44.957725 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:44.963300 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:44.965948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:44.967350 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c87306e6-737c-4493-a12b-2178f9e6b9d7 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 404 len: 111 microversion: 2.1 time: 0.077359 Aug 23 10:55:44.968104 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2229/4512] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:44 2022] DELETE /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:44.974929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:44.975719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:44.983736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.985519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.986197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:44.987227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:44.987881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:44.989307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.021178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lazy-loading 'flavor' on Instance uuid c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:45.154776 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d959bb59-000d-4844-962c-07c0d7fe15b8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.184892 Aug 23 10:55:45.156249 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2230/4513] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:55:44 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:55:45.162436 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22761d8f-6c49-441a-a6a6-9cfe8a3cd7d0 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520352 Aug 23 10:55:45.163287 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2284/4514] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:55:44 2022] POST /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:45.168579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:45.180825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:45.182004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:45.194182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: b8a5a23b-45c5-4fe6-82a8-e07cbc755931] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:45.204534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.205724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.206529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.207514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.209577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.210184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.215192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.215875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.217272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.218152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.220485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.221132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.232276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:45.249843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.250540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.251160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.251793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lazy-loading 'fault' on Instance uuid 4be8e7bb-8d35-4cad-beba-4a636e40dbdd {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:55:45.268859 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 HTTP/1.1 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b8a5a23b-45c5-4fe6-82a8-e07cbc755931'} Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:45.273142 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance b8a5a23b-45c5-4fe6-82a8-e07cbc755931 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:45.277200 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e2953722-e531-41e6-80c9-b214c7406310 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931" status: 404 len: 111 microversion: 2.1 time: 0.112252 Aug 23 10:55:45.278849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2285/4515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:45 2022] GET /compute/v2.1/servers/b8a5a23b-45c5-4fe6-82a8-e07cbc755931 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:45.290272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e1dd65ad-b2ea-47b5-9e6a-b5455e2e2ec9 req-076dbd36-4d76-45eb-aa1c-a9308096e218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-deleted", "tag": "d5c4df22-c16f-4712-83e2-870018b97e49"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:45.304566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e1dd65ad-b2ea-47b5-9e6a-b5455e2e2ec9 req-076dbd36-4d76-45eb-aa1c-a9308096e218 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.305304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e1dd65ad-b2ea-47b5-9e6a-b5455e2e2ec9 req-076dbd36-4d76-45eb-aa1c-a9308096e218 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.305970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e1dd65ad-b2ea-47b5-9e6a-b5455e2e2ec9 req-076dbd36-4d76-45eb-aa1c-a9308096e218 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.337797 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e1dd65ad-b2ea-47b5-9e6a-b5455e2e2ec9 req-076dbd36-4d76-45eb-aa1c-a9308096e218 service nova] Creating event network-vif-deleted:d5c4df22-c16f-4712-83e2-870018b97e49 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:45.349417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e1dd65ad-b2ea-47b5-9e6a-b5455e2e2ec9 req-076dbd36-4d76-45eb-aa1c-a9308096e218 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069062 Aug 23 10:55:45.354865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2286/4516] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:45.364894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:45.374188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:45.415928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.416595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.417124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.418134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.418409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.422492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.439999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ff1121d80f493aa4d6d0b62a583d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c92b54edcf674ea7acdbef102a9f6ce8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:45.452883 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a64b856b-ecf2-4fc2-87fe-e19e3dd878ef tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 200 len: 1313 microversion: 2.1 time: 0.294841 Aug 23 10:55:45.454292 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2231/4517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:45 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:45.484790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:45.485371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:45.500608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.501168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.501617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.502341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.502809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.508907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.550301 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 HTTP/1.1 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ffe992c9-8e3f-4edb-a544-aadcc2d053e1'} Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:45.552643 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2dbe015b-b865-4bc3-b980-393c0764f0ce tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1" status: 404 len: 111 microversion: 2.1 time: 0.096661 Aug 23 10:55:45.559521 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2232/4518] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:45 2022] DELETE /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:45.560282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:45.560352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:45.576551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.577118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.577564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.578282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.589685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.590331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.924991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:45.939162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:45.958354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:45.967156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:45.969860 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-894dbc2c-911a-43fb-89fe-9dc745274fe9 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2757 microversion: 2.42 time: 0.414006 Aug 23 10:55:45.988767 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2233/4519] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:45 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2757 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:45.988767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:45.991089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: ffe992c9-8e3f-4edb-a544-aadcc2d053e1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:45.998131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:45.998641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:45.999148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:45.999873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.000393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.000885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.004534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:46.024731 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 HTTP/1.1 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ffe992c9-8e3f-4edb-a544-aadcc2d053e1'} Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.026602 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance ffe992c9-8e3f-4edb-a544-aadcc2d053e1 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45a56be3-d57c-4342-8efb-fb35dee601ea tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1" status: 404 len: 111 microversion: 2.1 time: 0.051479 Aug 23 10:55:46.031518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2234/4520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:45 2022] GET /compute/v2.1/servers/ffe992c9-8e3f-4edb-a544-aadcc2d053e1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:46.423373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:46.437403 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7fa3538d-24ec-435c-8f9a-57f50be7c529 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1678 microversion: 2.1 time: 1.074337 Aug 23 10:55:46.438653 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2287/4521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:45 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1678 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:46.478257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:46.479400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 4be8e7bb-8d35-4cad-beba-4a636e40dbdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:46.487124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.487623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.496926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.497782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.498344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.498852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.534124 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd could not be found. Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd HTTP/1.1 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd could not be found. Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '4be8e7bb-8d35-4cad-beba-4a636e40dbdd'} Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd could not be found. Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd could not be found. Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.536593 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd could not be found. Aug 23 10:55:46.540322 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.542728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance 4be8e7bb-8d35-4cad-beba-4a636e40dbdd could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:46.543811 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db70e9e1-4309-4c0b-b3ce-21e0bf03ec49 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd" status: 404 len: 111 microversion: 2.1 time: 0.071001 Aug 23 10:55:46.544606 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2235/4522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:46 2022] GET /compute/v2.1/servers/4be8e7bb-8d35-4cad-beba-4a636e40dbdd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:46.554177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f1d84f6-1b3d-4b5b-8b9d-ff39b036c813 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '.version_select at 0x7fdc8ffcd1f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:46.596292 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0f1d84f6-1b3d-4b5b-8b9d-ff39b036c813 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Image not found. Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f1d84f6-1b3d-4b5b-8b9d-ff39b036c813 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d HTTP/1.1 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '746b6465-586a-48f4-a950-2510b99a0c3d'} Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 746b6465-586a-48f4-a950-2510b99a0c3d to delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 746b6465-586a-48f4-a950-2510b99a0c3d could not be found. Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.598261 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f1d84f6-1b3d-4b5b-8b9d-ff39b036c813 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:46.605167 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f1d84f6-1b3d-4b5b-8b9d-ff39b036c813 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d" status: 404 len: 62 microversion: 2.1 time: 0.051226 Aug 23 10:55:46.607681 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2288/4523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:46 2022] DELETE /compute/v2.1/images/746b6465-586a-48f4-a950-2510b99a0c3d => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:55:46.616490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:46.617041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:46.628116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.628629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.629110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.629931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.630408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.630849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.667610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 HTTP/1.1 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'cc9a6e14-fd55-466b-9038-e89536ab0cd8'} Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:46.669275 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5344f73-3fab-409b-a912-714baa0b92db tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 404 len: 111 microversion: 2.1 time: 0.060507 Aug 23 10:55:46.674423 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2236/4524] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:46 2022] DELETE /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:46.684125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:46.684806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: cc9a6e14-fd55-466b-9038-e89536ab0cd8] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:46.696389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.697120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.699264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.700163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:46.701910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:46.703752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:46.740070 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 HTTP/1.1 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'cc9a6e14-fd55-466b-9038-e89536ab0cd8'} Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.742791 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. Aug 23 10:55:46.746618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:46.748833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance cc9a6e14-fd55-466b-9038-e89536ab0cd8 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:46.750374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c4cc9fb-bfda-4456-bf48-a17a29d9d58e tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8" status: 404 len: 111 microversion: 2.1 time: 0.073138 Aug 23 10:55:46.752024 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2289/4525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:46 2022] GET /compute/v2.1/servers/cc9a6e14-fd55-466b-9038-e89536ab0cd8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:46.760887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-223c3ff7-7055-4708-b620-884232c4473a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '.version_select at 0x7fdc9cb09550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:46.802020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-223c3ff7-7055-4708-b620-884232c4473a tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553864871" status: 202 len: 0 microversion: 2.1 time: 0.043027 Aug 23 10:55:46.806630 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2237/4526] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553864871 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:55:47.000692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:47.002292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:47.016197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:47.016980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:47.017969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:47.019030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:47.019643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:47.020294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:47.461865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:47.461999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:47.476868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:47.479323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:47.481288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:47.483394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:47.484488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:47.486210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:47.545964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:47.565597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:47.567927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:47.585063 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-95fd12fb-cc9c-4789-b3a3-cf7e5e44a007 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2710 microversion: 2.42 time: 0.589253 Aug 23 10:55:47.585812 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2290/4527] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:46 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2710 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:55:47.744189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-220859ab-b9b5-4d22-bb9e-9566dbe566a4 req-35456504-caff-4215-9485-f23b9af872e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-deleted", "tag": "a864d661-858f-474f-ad0a-fcc083ec2074"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:47.761409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-220859ab-b9b5-4d22-bb9e-9566dbe566a4 req-35456504-caff-4215-9485-f23b9af872e8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:47.769477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-220859ab-b9b5-4d22-bb9e-9566dbe566a4 req-35456504-caff-4215-9485-f23b9af872e8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:47.770069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-220859ab-b9b5-4d22-bb9e-9566dbe566a4 req-35456504-caff-4215-9485-f23b9af872e8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:47.795709 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-220859ab-b9b5-4d22-bb9e-9566dbe566a4 req-35456504-caff-4215-9485-f23b9af872e8 service nova] Creating event network-vif-deleted:a864d661-858f-474f-ad0a-fcc083ec2074 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:47.807163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-220859ab-b9b5-4d22-bb9e-9566dbe566a4 req-35456504-caff-4215-9485-f23b9af872e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066659 Aug 23 10:55:47.820844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2291/4528] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:55:47.962252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:47.972267 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e14e866e-e8fd-4984-93aa-5d3da1348826 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1661 microversion: 2.1 time: 0.516246 Aug 23 10:55:47.978772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2238/4529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:47 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1661 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:48.007306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:48.008083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:48.033415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:48.035275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:48.035275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:48.035749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:48.036633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:48.037385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:48.197678 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eefb0b24-39e5-4dd5-9eb4-dc3b89442dca tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action" status: 202 len: 0 microversion: 2.1 time: 0.195337 Aug 23 10:55:48.198817 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2292/4530] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:55:48 2022] POST /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:55:48.207106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:48.208035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:48.222267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:48.224829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:48.227818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:48.230734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:48.232539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:48.236012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:48.622347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:48.628188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:48.653614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:48.656156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:48.656156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:48.665896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:48.668298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:48.669066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:48.725832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:48.750164 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da6c1fea-85ab-44c8-a802-b9826f063a47 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1667 microversion: 2.1 time: 0.547156 Aug 23 10:55:48.753634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2239/4531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:48 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1667 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:49.776323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:49.777034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:49.792462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:49.793012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:49.793453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:49.794183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:49.794654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:49.795091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:50.148169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:50.165962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:50.175864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:50.177923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a10d0689-9c8d-458d-9d01-607246a3d0d4 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2549 microversion: 2.42 time: 1.567912 Aug 23 10:55:50.181573 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2293/4532] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:48 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2549 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:55:50.209471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-753c92c7-77ce-48af-8ce9-06793c34abf9 req-a7f4d17c-55c9-400e-bf73-61f27b6ecca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-deleted", "tag": "ada32124-6a26-48d3-b44a-884b21329b6e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:50.229951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-753c92c7-77ce-48af-8ce9-06793c34abf9 req-a7f4d17c-55c9-400e-bf73-61f27b6ecca0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:50.237139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-753c92c7-77ce-48af-8ce9-06793c34abf9 req-a7f4d17c-55c9-400e-bf73-61f27b6ecca0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:50.237837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-753c92c7-77ce-48af-8ce9-06793c34abf9 req-a7f4d17c-55c9-400e-bf73-61f27b6ecca0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:50.264446 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-753c92c7-77ce-48af-8ce9-06793c34abf9 req-a7f4d17c-55c9-400e-bf73-61f27b6ecca0 service nova] Creating event network-vif-deleted:ada32124-6a26-48d3-b44a-884b21329b6e for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:50.278316 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-753c92c7-77ce-48af-8ce9-06793c34abf9 req-a7f4d17c-55c9-400e-bf73-61f27b6ecca0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087378 Aug 23 10:55:50.280910 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2294/4533] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:55:50.503017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:50.509541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:50.516925 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ebbeef8-3ed9-42b0-9e13-7f17c4a74b52 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1667 microversion: 2.1 time: 0.744682 Aug 23 10:55:50.523352 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2240/4534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:49 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1667 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:55:51.213247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:51.217434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:51.234226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:51.237234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:51.240172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:51.243350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:51.244019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:51.246716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:51.544683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:51.546251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:51.564036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:51.568215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:51.569154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:51.572901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:51.574360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:51.575350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:51.745013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:51.763539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:51.771401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:51.774320 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-97b8e596-e6a4-41e2-a46e-f8acd9aa8e43 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 2144 microversion: 2.42 time: 0.567320 Aug 23 10:55:51.778487 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2295/4535] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:51 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 2144 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:51.789487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56ee6616-50ca-41ad-b84b-b4f7d496fdd3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '.version_select at 0x7fdc8fd9a5e0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:51.853964 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-56ee6616-50ca-41ad-b84b-b4f7d496fdd3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Image not found. Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56ee6616-50ca-41ad-b84b-b4f7d496fdd3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/images/f5d2a974-183b-4716-9fc2-1ba743fc0aa7 HTTP/1.1 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: exception: Image not found. Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'f5d2a974-183b-4716-9fc2-1ba743fc0aa7'} Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f5d2a974-183b-4716-9fc2-1ba743fc0aa7 to delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5d2a974-183b-4716-9fc2-1ba743fc0aa7 could not be found. Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:51.856528 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 10:55:51.860167 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.862494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56ee6616-50ca-41ad-b84b-b4f7d496fdd3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Image not found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:51.863735 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56ee6616-50ca-41ad-b84b-b4f7d496fdd3 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/images/f5d2a974-183b-4716-9fc2-1ba743fc0aa7" status: 404 len: 62 microversion: 2.1 time: 0.083915 Aug 23 10:55:51.865379 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2296/4536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:51 2022] DELETE /compute/v2.1/images/f5d2a974-183b-4716-9fc2-1ba743fc0aa7 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:55:51.875698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:51.877405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:51.893138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:51.915264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:51.920639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:51.922464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:51.924155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:51.925773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:51.927456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:51.977438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 HTTP/1.1 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758'} Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:51.982660 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:51.986504 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:51.988551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:51.989950 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28353236-0309-4bbe-ac7c-154d736f6dc5 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 404 len: 111 microversion: 2.1 time: 0.120146 Aug 23 10:55:51.994133 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2297/4537] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:51 2022] DELETE /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:55:52.006222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:52.012321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] [instance: 1b8db994-e1c8-44a1-9e86-add937250758] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:52.030133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:52.031596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:52.034390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:52.035334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:52.037430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:52.038591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:52.048528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:52.059719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4db1d37-739c-4421-a09d-2f4af726c05a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1667 microversion: 2.1 time: 0.519911 Aug 23 10:55:52.060479 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2241/4538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:51 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1667 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:52.081080 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] HTTP exception thrown: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Request method failure captured: Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 HTTP/1.1 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLGqNPBB4ArC6Jh_J0VpQTRhTHYMpLfFeIKRr6oZuvPkI6iSo2-msnbTN0AqHZG3kNT-S2nR7sboXHRp6XwCu011RcdTvOf8t6-MUi5zWIPFjAo54EX7EoliXhBUahRy-Ye3TGRDf-zI14c0ezt67bspRq11BSn2tx65QmJDJC4zUPI Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c92b54edcf674ea7acdbef102a9f6ce8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c92b54edcf674ea7acdbef102a9f6ce8"}]}] Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c92b54edcf674ea7acdbef102a9f6ce8 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e0ff1121d80f493aa4d6d0b62a583d32 Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1970274012-project Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1b8db994-e1c8-44a1-9e86-add937250758'} Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:52.083926 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] Returning 404 to user: Instance 1b8db994-e1c8-44a1-9e86-add937250758 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:52.088731 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd5c61f0-96cd-4bfe-9f36-fb99feedaf37 tempest-ImagesOneServerNegativeTestJSON-1970274012 tempest-ImagesOneServerNegativeTestJSON-1970274012-project] 10.222.0.78 "GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758" status: 404 len: 111 microversion: 2.1 time: 0.088262 Aug 23 10:55:52.091043 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2298/4539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:51 2022] GET /compute/v2.1/servers/1b8db994-e1c8-44a1-9e86-add937250758 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:52.308171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-deleted", "tag": "c9d2120a-58d0-4732-aaa7-95b54da7b465"}, {"server_uuid": "5161eff7-fae8-410f-bf24-73a6b1aef8f7", "name": "network-vif-deleted", "tag": "45b4a255-749d-4e2a-b1d9-2962413c0338"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:52.332080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:52.332581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:52.333722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:52.364677 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] Creating event network-vif-deleted:c9d2120a-58d0-4732-aaa7-95b54da7b465 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:52.368300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] Creating event network-vif-deleted:45b4a255-749d-4e2a-b1d9-2962413c0338 for instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 on n-h1-847009-13 Aug 23 10:55:52.382103 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-76808a26-2f41-430f-94da-709738039ba8 req-7f2e2768-3fdd-42cc-bcde-334477e06181 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077932 Aug 23 10:55:52.392583 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2242/4540] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:55:52.807365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:52.808024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:52.837350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:52.840331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:52.841015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:52.844264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:52.846743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:52.847565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.089652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:53.091241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:53.102767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:53.103907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:53.104538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.105557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:53.106582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:53.108621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.213284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:53.225575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:53.238414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:53.240585 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64a8cae2-6fb1-4a62-9a76-b99ffdcacabb tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.438587 Aug 23 10:55:53.241750 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2299/4541] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:52 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:53.394288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:53.406578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9177e94-cfe3-4e06-b481-85e009580af7 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.324653 Aug 23 10:55:53.409318 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2243/4542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:53 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:53.428085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:53.429069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:53.435573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:53.436288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:53.436958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.437837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:53.438473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:53.439048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.841709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:53.852184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eea401fa-aced-48ab-be70-a3ea1ff1cb3d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1670 microversion: 2.1 time: 0.427948 Aug 23 10:55:53.858839 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2300/4543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:53 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:53.884702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:53.885215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:53.898598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:53.903423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:53.904040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.905086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:53.905701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:53.906145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:53.951070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:53.959320 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Working on deleting snapshot d6f1983d-90d8-42e7-af4c-2345c6c3f23b from shelved instance... Aug 23 10:55:54.268202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:54.269014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:54.293038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:54.324424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:54.328359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:54.330550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:54.343158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:54.343158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:54.575168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:54.596774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:54.614393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:54.617102 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e2508c6-5ae9-4cb2-b40a-29081f77f83d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.352788 Aug 23 10:55:54.620431 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2301/4544] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:54 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:55:55.275121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Doing local delete in cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) {{(pid=128860) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 23 10:55:55.278811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:55.279448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:55.280029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:55.282962 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 23 10:55:55.293414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] deallocate_for_instance() {{(pid=128860) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 23 10:55:55.643828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:55.644448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:55.656975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:55.657481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:55.657931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:55.658688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:55.659322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:55.659763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:55.811544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:55.837046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:55.838809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:55.840064 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4fceac93-0216-44fd-9315-40678880986d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.200340 Aug 23 10:55:55.840631 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2302/4545] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:55 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:56.814355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Updating instance_info_cache with network_info: [] {{(pid=128860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 10:55:56.817333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3953a052-1e76-4c00-b656-d3d0c2d60fb7 req-928c3d15-d369-495e-93a9-537315332b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79148d86-86de-46ef-8097-55b671c0c24e", "name": "network-vif-deleted", "tag": "947d9885-5b8f-4c8d-b8c7-7493796bd94c"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:55:56.836799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3953a052-1e76-4c00-b656-d3d0c2d60fb7 req-928c3d15-d369-495e-93a9-537315332b5d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:56.837539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3953a052-1e76-4c00-b656-d3d0c2d60fb7 req-928c3d15-d369-495e-93a9-537315332b5d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:56.838201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3953a052-1e76-4c00-b656-d3d0c2d60fb7 req-928c3d15-d369-495e-93a9-537315332b5d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:56.883608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.server_external_events [req-3953a052-1e76-4c00-b656-d3d0c2d60fb7 req-928c3d15-d369-495e-93a9-537315332b5d service nova] Unable to find a host for instance 79148d86-86de-46ef-8097-55b671c0c24e. Dropping event network-vif-deleted {{(pid=128859) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 10:55:56.884979 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3953a052-1e76-4c00-b656-d3d0c2d60fb7 req-928c3d15-d369-495e-93a9-537315332b5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.071389 Aug 23 10:55:56.886131 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2303/4546] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 10:55:56.894649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:56.896435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:56.909954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:56.912168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:56.912881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:56.913830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:56.927374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:56.928162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:57.068608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:57.200024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6cfdb730-159f-4fc2-8155-d6fc924ce375 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 204 len: 0 microversion: 2.1 time: 3.320112 Aug 23 10:55:57.201223 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2244/4547] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:53 2022] DELETE /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 0 bytes in 3322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:57.214612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:57.215874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 79148d86-86de-46ef-8097-55b671c0c24e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:57.222654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:57.224227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:57.225691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:57.226660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:57.228207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:57.229716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:57.242196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:57.277256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:57.297535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:57.299515 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-634a5a7e-07ca-458a-a4ae-f63afa9064f1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.412007 Aug 23 10:55:57.300666 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2304/4548] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:56 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:57.304672 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] HTTP exception thrown: Instance 79148d86-86de-46ef-8097-55b671c0c24e could not be found. Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Request method failure captured: Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e HTTP/1.1 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-HidHNCiiYouTpQZNSTX6xSKmpIHn1LDJUIyrjpRRhD5fLRr1Oyn3WfLItexZQ089QBXqXC4xWwzl9mlyHsj-Cpf0IniFMcyW608Qn4n21ZrmY00zavgZR5tdAUEV_M1iOCrcccc9E5i7ZYpnh1Wq5GsZ5Ekr1iC4ukoJlwjCutcw Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7fefe975214d6a8482557904472914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7fefe975214d6a8482557904472914", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}] Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: ca80ea2c8904468d9e6944fc274afdb8 Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 79148d86-86de-46ef-8097-55b671c0c24e could not be found. Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '79148d86-86de-46ef-8097-55b671c0c24e'} Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79148d86-86de-46ef-8097-55b671c0c24e could not be found. Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79148d86-86de-46ef-8097-55b671c0c24e could not be found. Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:55:57.308035 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79148d86-86de-46ef-8097-55b671c0c24e could not be found. Aug 23 10:55:57.311808 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:55:57.315336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Returning 404 to user: Instance 79148d86-86de-46ef-8097-55b671c0c24e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:55:57.315336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76e0eaad-21e5-4e0e-a368-8e1ee7ab404f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e" status: 404 len: 111 microversion: 2.1 time: 0.107997 Aug 23 10:55:57.315336 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2245/4549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:57 2022] GET /compute/v2.1/servers/79148d86-86de-46ef-8097-55b671c0c24e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:55:57.324716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:57.327440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:57.335355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:57.336101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:57.337330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:57.338556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:57.339230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:57.339867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:57.402883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:55:57.562881 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78cde8ee-2dd3-4d51-9fde-344f7c67b888 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 204 len: 0 microversion: 2.1 time: 0.242893 Aug 23 10:55:57.564283 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2305/4550] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:55:57 2022] DELETE /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:55:57.574174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:57.574853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:57.588699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:57.590958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:57.591570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:57.594013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:57.594683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:57.595754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:58.179626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:58.193341 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5ababc6-06bc-417d-9cfd-7697c38c3b1a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1466 microversion: 2.1 time: 0.623129 Aug 23 10:55:58.209673 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2246/4551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:57 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1466 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:58.330723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:58.332095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:58.340795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:58.341631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:58.342331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:58.343281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:58.343963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:58.344616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:58.371303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:55:58.425788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:58.435397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:58.437146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:58.438653 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5071c098-2922-40b0-9066-01ef7ae2b165 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.112416 Aug 23 10:55:58.439453 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2306/4552] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:58 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:55:59.214787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:59.216018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:59.226402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:59.234039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:59.234760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:59.235741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:59.237861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:59.238418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:59.467993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:55:59.469949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:55:59.490189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:59.499577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:59.500050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:59.500842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:55:59.501312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:55:59.501940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:55:59.512084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:55:59.529500 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ad812e8-73b8-41b7-a2ff-f1d2716ca88f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1466 microversion: 2.1 time: 0.312727 Aug 23 10:55:59.533279 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2247/4553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:55:59 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:55:59.998958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:00.018644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:00.026116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:00.029768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c3540137-324c-4789-821a-84b8ead8c853 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.564928 Aug 23 10:56:00.031999 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2307/4554] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:55:59 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:00.248034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:00.249029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:00.264000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.265042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.266192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.267127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.267798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.268620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.310076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 HTTP/1.1 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1'} Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:00.312148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.315766 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.318267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:00.319927 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07c7ffdb-8747-4b32-b180-03d9f532cca8 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 404 len: 111 microversion: 2.1 time: 0.076528 Aug 23 10:56:00.320714 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2308/4555] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:56:00 2022] DELETE /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:56:00.335455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:00.336433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:00.350004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.353635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.354370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.355330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.356006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.356669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.376256 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 HTTP/1.1 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1'} Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.378148 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. Aug 23 10:56:00.381868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.383889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:00.385014 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-016077c5-a8c1-4534-94c7-d773ccc1dc84 tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1" status: 404 len: 111 microversion: 2.1 time: 0.054465 Aug 23 10:56:00.385774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2309/4556] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:00 2022] GET /compute/v2.1/servers/5f9f78bd-6a7b-45ee-a2f7-f214324a7fd1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:56:00.395785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:00.396828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:00.403879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.404575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.405137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.406016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.406630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.407202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.425272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb HTTP/1.1 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '0b328dfb-1927-4dae-ab19-9bb1946bcdfb'} Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:00.427776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.431771 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.433316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:00.434459 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20e97a30-21b8-4ef3-b3e4-746179ed4a4f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 404 len: 111 microversion: 2.1 time: 0.044595 Aug 23 10:56:00.435527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2310/4557] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:56:00 2022] DELETE /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:56:00.445389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:00.446517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] [instance: 0b328dfb-1927-4dae-ab19-9bb1946bcdfb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:00.455084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.455751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.456342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.457396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.458579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.459716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.508684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] HTTP exception thrown: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Request method failure captured: Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb HTTP/1.1 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDrHD19HnPhfm9gYl-HfdbsflTFrXXb7XpB3QeP0_sZW9fqEFQg_IP99_jSelTPTFp_6USxvWzpNaKaHtTSjeynDZozRkRQw-ZjP_xjvjeMnbGz3_dl7YQr4pN9jt71c-mbW7gBGMZeJkQsWaEL3zjwaVTA0kne-6CvM6k5PWNIGUs Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_27b37b69f9974fd0a7f85c4db9990f9a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/27b37b69f9974fd0a7f85c4db9990f9a"}]}] Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 27b37b69f9974fd0a7f85c4db9990f9a Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669393006 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 55db11ffc78b481087c1a3ca89fd1591 Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1669393006-project Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '0b328dfb-1927-4dae-ab19-9bb1946bcdfb'} Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:00.511764 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. Aug 23 10:56:00.516267 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:00.521151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] Returning 404 to user: Instance 0b328dfb-1927-4dae-ab19-9bb1946bcdfb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:00.522212 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1366eb57-5a7c-481d-9d57-d738d4cc521f tempest-DeleteServersTestJSON-1669393006 tempest-DeleteServersTestJSON-1669393006-project] 10.222.0.78 "GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb" status: 404 len: 111 microversion: 2.1 time: 0.081540 Aug 23 10:56:00.527715 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2311/4558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:00 2022] GET /compute/v2.1/servers/0b328dfb-1927-4dae-ab19-9bb1946bcdfb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:56:00.552925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:00.553821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:00.564630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.570353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.572064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.573082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.577351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.577904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.580929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1879997132", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": "none"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:00.756211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:56:00.756864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:56:00.757373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:56:00.757795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:56:00.758217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:56:00.768397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.768920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.769365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.770162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:00.770631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:00.771063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:00.813830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Getting quotas for project 90c195486d9f42abab699e4d7bd3b99a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:56:00.822554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Getting quotas for user a8f7e3b18e7e4de3aed10f2d50fe5188 and project 90c195486d9f42abab699e4d7bd3b99a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:56:00.853554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:56:00.860629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:56:00.975197 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-679bf149-779e-4460-adf7-8c5735e5b0e7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.978026 Aug 23 10:56:00.979847 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2248/4559] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:56:00.991890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ffa2b49-b6e0-48e4-81c9-29d223d618a5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:00.995476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ffa2b49-b6e0-48e4-81c9-29d223d618a5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:01.146243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.156782 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea4db2df-3fcb-412d-902d-51ed156a973d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1466 microversion: 2.1 time: 0.608870 Aug 23 10:56:01.175575 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2312/4560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:00 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1466 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:01.184384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ffa2b49-b6e0-48e4-81c9-29d223d618a5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.193479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:01.196917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:01.204359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ffa2b49-b6e0-48e4-81c9-29d223d618a5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.216156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ffa2b49-b6e0-48e4-81c9-29d223d618a5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.216156 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ffa2b49-b6e0-48e4-81c9-29d223d618a5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c" status: 200 len: 1278 microversion: 2.47 time: 0.225491 Aug 23 10:56:01.216156 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2249/4561] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:00 2022] GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:01.226228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:01.226965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:01.227919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:01.228917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:01.232678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:01.233543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:01.314437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4b552c43-9c70-499d-93a2-f2cb46c89988 req-56f71b44-2db7-4d7b-b8ca-9c3794b7ffb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9233d2d2-c13f-4c49-ac96-0784d4022b4f", "name": "network-vif-deleted", "tag": "abe64a62-3f3c-4b3c-b567-cc16fa541b16"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:01.353618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4b552c43-9c70-499d-93a2-f2cb46c89988 req-56f71b44-2db7-4d7b-b8ca-9c3794b7ffb9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:01.359373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4b552c43-9c70-499d-93a2-f2cb46c89988 req-56f71b44-2db7-4d7b-b8ca-9c3794b7ffb9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:01.360342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4b552c43-9c70-499d-93a2-f2cb46c89988 req-56f71b44-2db7-4d7b-b8ca-9c3794b7ffb9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:01.408218 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4b552c43-9c70-499d-93a2-f2cb46c89988 req-56f71b44-2db7-4d7b-b8ca-9c3794b7ffb9 service nova] Creating event network-vif-deleted:abe64a62-3f3c-4b3c-b567-cc16fa541b16 for instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f on n-h2-847009-13 Aug 23 10:56:01.442861 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4b552c43-9c70-499d-93a2-f2cb46c89988 req-56f71b44-2db7-4d7b-b8ca-9c3794b7ffb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132047 Aug 23 10:56:01.445738 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2250/4562] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:01.603623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.615752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.628718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:01.632364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1785988307", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": "none"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:01.646092 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03bdf17e-c6b8-4ba5-a1ac-853b7dfd98ca tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.460465 Aug 23 10:56:01.646747 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2313/4563] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:01 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:01.759348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:56:01.760408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:56:01.761146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:56:01.761809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:56:01.762413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:56:01.774695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:01.775363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:01.776012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:01.776845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:01.777513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:01.778188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:01.800674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Getting quotas for project 90c195486d9f42abab699e4d7bd3b99a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:56:01.807846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Getting quotas for user a8f7e3b18e7e4de3aed10f2d50fe5188 and project 90c195486d9f42abab699e4d7bd3b99a. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:56:01.824452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:56:01.827703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:56:01.916482 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f1208da-e015-4437-8c57-c936d49bfc9d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.286706 Aug 23 10:56:01.921095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2251/4564] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 10:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 10:56:01.930055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b11add8-2fb2-43de-ab6d-d4c6997f8a0d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:01.933644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b11add8-2fb2-43de-ab6d-d4c6997f8a0d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:02.009829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b11add8-2fb2-43de-ab6d-d4c6997f8a0d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "PUT /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 992 microversion: 2.47 time: 0.084442 Aug 23 10:56:02.010893 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2314/4565] 10.222.0.78 () {62 vars in 1297 bytes} [Tue Aug 23 10:56:01 2022] PUT /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 992 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:56:02.035795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd4c517e-ed62-4645-a916-b37edd0fc940 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:02.041486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd4c517e-ed62-4645-a916-b37edd0fc940 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:02.140241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd4c517e-ed62-4645-a916-b37edd0fc940 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.158671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd4c517e-ed62-4645-a916-b37edd0fc940 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.160513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd4c517e-ed62-4645-a916-b37edd0fc940 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.179852 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd4c517e-ed62-4645-a916-b37edd0fc940 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1278 microversion: 2.47 time: 0.151045 Aug 23 10:56:02.180665 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2252/4566] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:02 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:02.183263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:02.184208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:02.196086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.196591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.197713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.198447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.198918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.199353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.277247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.277744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.279581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.281039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lazy-loading 'fault' on Instance uuid 9233d2d2-c13f-4c49-ac96-0784d4022b4f {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:02.373255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.387521 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-62119e84-6d63-4987-8554-8ed9853df451 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 200 len: 1305 microversion: 2.1 time: 0.207439 Aug 23 10:56:02.392380 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2315/4567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:02 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:02.677701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:02.679037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:02.701019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.704220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.705889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.709063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.711589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.714809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.729682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:02.737651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.738342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.743747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.744837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:02.745443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:02.745957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:02.804987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-584675a1-a372-4e65-a154-eadb2a79a588 tempest-AZV2TestJSON-1586501582 tempest-AZV2TestJSON-1586501582-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.305314 Aug 23 10:56:02.813134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2253/4568] 10.222.0.78 () {58 vars in 1164 bytes} [Tue Aug 23 10:56:02 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:56:02.886296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.901522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.903791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:02.905669 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7d74825-0bd6-499d-8d57-7040eafbd9ae tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.234425 Aug 23 10:56:02.906651 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2316/4569] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:02 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:03.205563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:03.206207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:03.215225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.221587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.222182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.225539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.226178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.226626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.406849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:03.413005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:03.413641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 9233d2d2-c13f-4c49-ac96-0784d4022b4f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:03.419894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:03.421460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:03.422620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5a42ea2-0aea-4c0c-bd23-bfc688ca859b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1274 microversion: 2.47 time: 0.222938 Aug 23 10:56:03.432964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.432964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.432964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.434223 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2254/4570] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:03 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:03.454122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.454737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.456091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.503305 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] HTTP exception thrown: Instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f could not be found. Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Request method failure captured: Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f HTTP/1.1 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-HidHNCiiYouTpQZNSTX6xSKmpIHn1LDJUIyrjpRRhD5fLRr1Oyn3WfLItexZQ089QBXqXC4xWwzl9mlyHsj-Cpf0IniFMcyW608Qn4n21ZrmY00zavgZR5tdAUEV_M1iOCrcccc9E5i7ZYpnh1Wq5GsZ5Ekr1iC4ukoJlwjCutcw Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7fefe975214d6a8482557904472914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7fefe975214d6a8482557904472914", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}] Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ca80ea2c8904468d9e6944fc274afdb8 Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f could not be found. Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9233d2d2-c13f-4c49-ac96-0784d4022b4f'} Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f could not be found. Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f could not be found. Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:03.507411 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f could not be found. Aug 23 10:56:03.512728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:03.518633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Returning 404 to user: Instance 9233d2d2-c13f-4c49-ac96-0784d4022b4f could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:03.523350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9cc9fae5-be42-4029-83f4-e6e6fd3d1a3f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f" status: 404 len: 111 microversion: 2.1 time: 0.112016 Aug 23 10:56:03.524103 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2317/4571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:03 2022] GET /compute/v2.1/servers/9233d2d2-c13f-4c49-ac96-0784d4022b4f => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:56:03.532993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:03.533620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:03.548281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.548688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.549176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.549893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.550342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.550779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.622925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:56:03.759915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:03.884352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6c93909-2f47-4cb5-a331-6cea9116fbec tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 204 len: 0 microversion: 2.1 time: 0.355327 Aug 23 10:56:03.888276 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2255/4572] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:56:03 2022] DELETE /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:56:03.893976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:03.894598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:03.909073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.909592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.910075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.912011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.913794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.914606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.949056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:03.949854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:03.966201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.967040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.969770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:03.971214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:03.973109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:03.975045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:04.179214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.189374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.199081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.200950 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67a0696f-6099-46b8-8144-e0385dcec3e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.256492 Aug 23 10:56:04.203958 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2256/4573] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:03 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:04.349411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.358607 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3421d0a9-15b6-49c1-a4d1-5b92288b817a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1507 microversion: 2.1 time: 0.468593 Aug 23 10:56:04.364607 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2318/4574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:03 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1507 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:04.452689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:04.453600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:04.485725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:04.486872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:04.488572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:04.491413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:04.493934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:04.496685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:04.740402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.751167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.752592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:04.760200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1d8e013-2475-48b3-84fb-3b33efce7386 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1330 microversion: 2.47 time: 0.315018 Aug 23 10:56:04.761136 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2257/4575] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:04 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1330 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:05.228833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:05.230039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:05.244473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:05.247119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:05.247865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:05.252117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:05.252806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:05.253412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:05.390765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:05.391393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:05.400698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:05.401247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:05.402029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:05.406478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:05.409793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:05.413466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:05.506477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:05.517625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:05.532478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:05.534503 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0c57abad-2399-4dd5-8099-864e20e330db tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.309981 Aug 23 10:56:05.535098 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2319/4576] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:05 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:05.790066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:05.793203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:05.794150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:05.810219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:05.811931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:05.813307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c8fb5ce-d71b-4e5f-9dd8-480aabf5d804 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1507 microversion: 2.1 time: 0.419246 Aug 23 10:56:05.814694 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2258/4577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:05 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1507 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:05.828809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:05.837020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:05.840178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:05.842693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:06.107088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:06.124071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:06.131701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:06.135677 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ebfa59df-21a8-4fde-bd4f-ae6bb21cba1b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1338 microversion: 2.47 time: 0.353507 Aug 23 10:56:06.136924 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2320/4578] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:05 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1338 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:06.563140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:06.574345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:06.640441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:06.641566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:06.648307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:06.654565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:06.658301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:06.665498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:06.838346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:06.840721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:06.844628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:06.852011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:06.853157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:06.853860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:06.855924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:06.857239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:06.858000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:06.865154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:06.867115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:06.874012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e96a433-a25c-4644-9542-7478aadbb331 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.315394 Aug 23 10:56:06.874982 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2259/4579] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:06 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:06.978884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ab5089df-f0f8-4637-9b68-6018c75f07dc req-eb0f3650-446f-4cf4-8606-f00ede562c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac63c0d-8cc0-42f9-a618-f01c54ff5346", "name": "network-vif-deleted", "tag": "ad434aae-3b0c-40c6-8346-4f892b8d6e30"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:07.016124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab5089df-f0f8-4637-9b68-6018c75f07dc req-eb0f3650-446f-4cf4-8606-f00ede562c6f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:07.017802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab5089df-f0f8-4637-9b68-6018c75f07dc req-eb0f3650-446f-4cf4-8606-f00ede562c6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:07.023992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab5089df-f0f8-4637-9b68-6018c75f07dc req-eb0f3650-446f-4cf4-8606-f00ede562c6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:07.070792 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ab5089df-f0f8-4637-9b68-6018c75f07dc req-eb0f3650-446f-4cf4-8606-f00ede562c6f service nova] Creating event network-vif-deleted:ad434aae-3b0c-40c6-8346-4f892b8d6e30 for instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 on n-h1-847009-13 Aug 23 10:56:07.095547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ab5089df-f0f8-4637-9b68-6018c75f07dc req-eb0f3650-446f-4cf4-8606-f00ede562c6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121762 Aug 23 10:56:07.101710 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2260/4580] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 23 10:56:07.166198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:07.167162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:07.189115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:07.189821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:07.197701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:07.198446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:07.198700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:07.203881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:07.219644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:07.241239 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01a9a4c8-753a-41b5-93c4-95945f8cf8fd tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1465 microversion: 2.1 time: 0.409444 Aug 23 10:56:07.241844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2321/4581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:06 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1465 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:07.514678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:07.536313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:07.540498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:07.551359 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd62e0df-beba-40d4-a7c6-509482d7edbf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1336 microversion: 2.47 time: 0.385245 Aug 23 10:56:07.551359 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2261/4582] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:07 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1336 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:07.905455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:07.907093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:07.931678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:07.932688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:07.936797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:07.945221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:07.946213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:07.947023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:08.151681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.169351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.170936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.172220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5baae3d0-82ad-4916-a8d7-6166a561dfe1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.273128 Aug 23 10:56:08.180281 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2322/4583] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:07 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:08.266211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:08.267384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:08.285078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:08.290394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:08.291108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:08.291893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:08.293554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:08.295823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:08.478440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:08.479060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:08.479518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:08.486727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lazy-loading 'fault' on Instance uuid eac63c0d-8cc0-42f9-a618-f01c54ff5346 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:08.574082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:08.574895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:08.583796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:08.596457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:08.597416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:08.599567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:08.605106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:08.605458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.605977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:08.618117 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd0be3f4-5c80-424e-b17f-6ead53c5527f tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 200 len: 1305 microversion: 2.1 time: 0.353056 Aug 23 10:56:08.635723 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2262/4584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:08 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 1305 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:08.742113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.759468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.766877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:08.768555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc86bb31-d2dc-4498-b5e5-4baaf6a62478 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1336 microversion: 2.47 time: 0.199079 Aug 23 10:56:08.772119 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2323/4585] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:08 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1336 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:09.213980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:09.214995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:09.230691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.231195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.231653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.232395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.233019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.233331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.647246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:09.648938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: eac63c0d-8cc0-42f9-a618-f01c54ff5346] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:09.672257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.672685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.673170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.677098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.677799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.680155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.727923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] HTTP exception thrown: Instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 could not be found. Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Request method failure captured: Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 HTTP/1.1 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBK-HidHNCiiYouTpQZNSTX6xSKmpIHn1LDJUIyrjpRRhD5fLRr1Oyn3WfLItexZQ089QBXqXC4xWwzl9mlyHsj-Cpf0IniFMcyW608Qn4n21ZrmY00zavgZR5tdAUEV_M1iOCrcccc9E5i7ZYpnh1Wq5GsZ5Ekr1iC4ukoJlwjCutcw Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7fefe975214d6a8482557904472914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7fefe975214d6a8482557904472914", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}] Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ca80ea2c8904468d9e6944fc274afdb8 Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 could not be found. Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'eac63c0d-8cc0-42f9-a618-f01c54ff5346'} Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 could not be found. Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 could not be found. Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:09.730483 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 could not be found. Aug 23 10:56:09.734293 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:09.740522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Returning 404 to user: Instance eac63c0d-8cc0-42f9-a618-f01c54ff5346 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:09.744006 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c392caa-d40c-402a-86af-59f71d42771d tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346" status: 404 len: 111 microversion: 2.1 time: 0.100650 Aug 23 10:56:09.748463 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2324/4586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:09 2022] GET /compute/v2.1/servers/eac63c0d-8cc0-42f9-a618-f01c54ff5346 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:56:09.759858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:09.764705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:09.776053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.776828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.780462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.781839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.783686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.784423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.797564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:09.824072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:09.825930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:09.827184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-972d9ee2-3131-4e3b-9107-a45543ab9c92 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.628979 Aug 23 10:56:09.849190 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2263/4587] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:09 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:09.856701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:09.857693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:09.863035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:56:09.866650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.867356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.868383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:09.869720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:09.870469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:09.871109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.080195 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-296d6a60-36a1-452c-932e-333c5d4f2ebf tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 204 len: 0 microversion: 2.1 time: 0.329751 Aug 23 10:56:10.081328 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2325/4588] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:56:09 2022] DELETE /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:56:10.090164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:10.093322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:10.107786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:10.133350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:10.135764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:10.136192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:10.137305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.142947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:10.143798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:10.144291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:10.145885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.151836 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5af5b3e2-9b3e-442d-bd47-016adb430695 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1336 microversion: 2.47 time: 0.298215 Aug 23 10:56:10.153411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2264/4589] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:09 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1336 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:10.171278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:10.187026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:10.190155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:10.217352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:10.218058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:10.221574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.224377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:10.227076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:10.229750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.230711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lazy-loading 'flavor' on Instance uuid 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:10.511484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b8d682d-b41c-4a5b-9ab3-d41319404b3b tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/action" status: 200 len: 32 microversion: 2.1 time: 0.427937 Aug 23 10:56:10.512122 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2326/4590] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:56:10 2022] POST /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/action => generated 32 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:56:10.527856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:10.528584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:10.551800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:10.552324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:10.552799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.553543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:10.554015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:10.554454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:10.902387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:10.943075 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d48264ea-798f-4bcb-9a63-a2608517f337 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.411761 Aug 23 10:56:10.944819 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2327/4591] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:10 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:10.978165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:10.993169 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65fefb52-b568-40b0-91f8-979b470737e3 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1494 microversion: 2.1 time: 0.835093 Aug 23 10:56:10.994872 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2265/4592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:10 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1494 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:10.997711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:10.999026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:11.024878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.025905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.026571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.027521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.028198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.028866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.178216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:11.179417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:11.188070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.189601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.190276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.191223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.192505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.193231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.290147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:11.308136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:11.310221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:11.316846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a339345f-984d-4818-8575-669147118aec tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1357 microversion: 2.47 time: 0.142328 Aug 23 10:56:11.320978 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2266/4593] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:11 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:11.337644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:11.349714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:11.353725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:11.369465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:11.373986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.374501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.375633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.380653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:11.381945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.383609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.384069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.385215 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f884db3-bac1-411e-a396-6cb3e1606ba1 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.417921 Aug 23 10:56:11.386090 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2328/4594] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:10 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:11.524512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:56:11.524975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:56:11.525451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:56:11.526319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:56:11.526751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:56:11.653565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:11.663023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.663759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.664649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.668546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.670567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.671444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.719551 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75b32eb2-7ff3-44fc-9423-402008ad98a6 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "POST /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99/action" status: 202 len: 1079 microversion: 2.47 time: 0.378066 Aug 23 10:56:11.721761 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2267/4595] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 10:56:11 2022] POST /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99/action => generated 1079 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 23 10:56:11.749169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:11.749713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:11.763159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.776552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.777281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.778199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.793176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.793675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.986091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:11.986754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:11.996842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:11.997687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:11.998341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:11.999394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:12.000059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:12.000819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:12.110150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.130538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.141924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.142942 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22b522dc-526a-435b-8bed-b9b1cd15f319 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.397923 Aug 23 10:56:12.145988 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2329/4596] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:11 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:12.157759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:12.171694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:12.172338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:12.211584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:12.212250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:12.212714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:12.219623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:12.221207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:12.221664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:12.418344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.430499 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03485d2d-57f4-4177-8e87-31dadf4bd510 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.463548 Aug 23 10:56:12.431750 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2268/4597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:11 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:12.437983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:12.441134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:12.455355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:12.456170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:12.457012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:12.458817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:12.459461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:12.460178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:12.563026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.590378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.606708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:12.611326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-883840a7-5418-4851-aaab-3181bedad4ed tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.174656 Aug 23 10:56:12.612872 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2269/4598] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:12 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:13.114957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:13.125402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-302c59ef-19a3-45c1-b698-c32aeb7002ad tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1494 microversion: 2.1 time: 0.978021 Aug 23 10:56:13.126006 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2330/4599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:12 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1494 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:13.173315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:13.174553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:13.181309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:13.217930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:13.219239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:13.221393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:13.223752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:13.224420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:13.225843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:13.306020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:13.458688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:13.458986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:13.478486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:13.482378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:13.482879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:13.484127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:13.484615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:13.487720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:13.533034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:13.549698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:13.566822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:13.568150 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56b361fa-1fad-4a43-bd6d-48ee60de094d tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.399680 Aug 23 10:56:13.574814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2270/4600] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:13 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:13.640210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:13.641148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:13.653209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:13.658047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:13.664448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:13.665456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:13.666495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:13.670795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:13.672106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:14.081970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.095988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.103912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.105443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e294ca6-1629-40df-bafe-f9fd93c255de tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.469944 Aug 23 10:56:14.107999 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2271/4601] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:13 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:14.147265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:14.147897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:14.160485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:14.161327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:14.161543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:14.169593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:14.170307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:14.170983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:14.306326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.318721 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8b1ad53-5c27-454d-9f3e-3abf8e5c4893 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1452 microversion: 2.1 time: 0.176257 Aug 23 10:56:14.319335 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2272/4602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:14 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:14.591731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:14.592368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:14.607466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:14.607966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:14.608410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:14.609256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:14.609720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:14.610145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:14.963889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.975657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.978145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:14.981407 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78d00eb3-371e-4d5f-a3ed-22223f6e08d7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.393762 Aug 23 10:56:14.986271 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2273/4603] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:14 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:14.991836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-68ad953b-a4ca-4bd3-a32a-1a86d034daf4 req-2ac29f9a-cf81-4e94-9c35-00a2910dd9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3557b860-853d-4b7c-831c-de9d7f3f0ce2", "name": "network-vif-deleted", "tag": "c4f6c5f9-a3ae-4ec7-9b27-4a31ac667e24"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:15.038176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-68ad953b-a4ca-4bd3-a32a-1a86d034daf4 req-2ac29f9a-cf81-4e94-9c35-00a2910dd9b3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:15.039008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-68ad953b-a4ca-4bd3-a32a-1a86d034daf4 req-2ac29f9a-cf81-4e94-9c35-00a2910dd9b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:15.039619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-68ad953b-a4ca-4bd3-a32a-1a86d034daf4 req-2ac29f9a-cf81-4e94-9c35-00a2910dd9b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:15.071355 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-68ad953b-a4ca-4bd3-a32a-1a86d034daf4 req-2ac29f9a-cf81-4e94-9c35-00a2910dd9b3 service nova] Creating event network-vif-deleted:c4f6c5f9-a3ae-4ec7-9b27-4a31ac667e24 for instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 on n-h2-847009-13 Aug 23 10:56:15.095881 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-68ad953b-a4ca-4bd3-a32a-1a86d034daf4 req-2ac29f9a-cf81-4e94-9c35-00a2910dd9b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108011 Aug 23 10:56:15.101487 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2274/4604] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:15.133937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:15.134984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:15.145620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:15.146127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:15.149342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:15.150340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:15.150880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:15.157259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:15.170128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:15.187401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-045c6635-eac9-4f30-9425-e4c341db1242 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 1.735126 Aug 23 10:56:15.188368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2331/4605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:13 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:15.319850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:15.339679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:15.340540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:15.351058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:15.351411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:15.351713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:15.352547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:15.353049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:15.360644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:15.366335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:15.367477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:15.368227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a92a8ba-4b5b-467b-82d8-46c21b1238bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.239148 Aug 23 10:56:15.369226 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2275/4606] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:15 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:15.444009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:15.444720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:15.449433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:15.450162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lazy-loading 'fault' on Instance uuid 3557b860-853d-4b7c-831c-de9d7f3f0ce2 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:15.624140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:15.636488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87609bae-80d9-4e9f-9fa7-505e40912900 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 200 len: 1305 microversion: 2.1 time: 0.300466 Aug 23 10:56:15.649648 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2332/4607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:15 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 1305 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:16.012359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:16.013253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:16.025733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.026596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.027944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.029076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.029802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.030450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.221617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:16.224294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:16.235468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.239755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.240635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.241348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.242316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.242882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.245264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.295319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.306683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.315142 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9199eb41-5c36-473a-a407-925703ef6f52 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.305004 Aug 23 10:56:16.316514 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2276/4608] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:16 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:16.395807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:16.397359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:16.429739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.430326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.430703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.431432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.431905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.432530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.763276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.785548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.789981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.791312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:16.794528 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9bd03d5-0aa2-457a-8364-b67487046b3d tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.402330 Aug 23 10:56:16.796608 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2277/4609] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:16 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:16.807533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:16.809448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: 3557b860-853d-4b7c-831c-de9d7f3f0ce2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:16.826204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.827838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.828661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.830366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.833652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.835305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.850000 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d83688d6-0296-49ab-8a1b-a8a4280d4df7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.633162 Aug 23 10:56:16.851344 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2333/4610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:16 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:16.884878 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] HTTP exception thrown: Instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 could not be found. Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Request method failure captured: Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 HTTP/1.1 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-HidHNCiiYouTpQZNSTX6xSKmpIHn1LDJUIyrjpRRhD5fLRr1Oyn3WfLItexZQ089QBXqXC4xWwzl9mlyHsj-Cpf0IniFMcyW608Qn4n21ZrmY00zavgZR5tdAUEV_M1iOCrcccc9E5i7ZYpnh1Wq5GsZ5Ekr1iC4ukoJlwjCutcw Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7fefe975214d6a8482557904472914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7fefe975214d6a8482557904472914", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}] Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: ca80ea2c8904468d9e6944fc274afdb8 Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 could not be found. Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '3557b860-853d-4b7c-831c-de9d7f3f0ce2'} Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 could not be found. Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 could not be found. Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:16.886558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 could not be found. Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Returning 404 to user: Instance 3557b860-853d-4b7c-831c-de9d7f3f0ce2 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52e8a717-21b0-425e-a512-7e357e738095 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2" status: 404 len: 111 microversion: 2.1 time: 0.089225 Aug 23 10:56:16.890326 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2278/4611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:16 2022] GET /compute/v2.1/servers/3557b860-853d-4b7c-831c-de9d7f3f0ce2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:56:16.899197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:16.900102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:16.921042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.925460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.927109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:16.937504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:16.937858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:16.938282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.008305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:56:17.274014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:17.281898 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-551f399f-8a57-48cc-943e-ad6b419ba8a8 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 204 len: 0 microversion: 2.1 time: 0.386484 Aug 23 10:56:17.286483 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2334/4612] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:56:16 2022] DELETE /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:56:17.295983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:17.297214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:17.307314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.307963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.308686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.309508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.310057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.310611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.346737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:17.348577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:17.392442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.399792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.400341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.401128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.401607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.402033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.655098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:17.668425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:17.670250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:17.673993 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d4a631a-aaec-4f57-b733-b4bb6b681ae7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.333778 Aug 23 10:56:17.696908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2335/4613] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:17 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:17.800279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:17.809977 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fa40cd0-d9da-4c5c-94c6-5a84f32e696a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1676 microversion: 2.1 time: 0.519362 Aug 23 10:56:17.814111 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2279/4614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:17 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1676 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:17.853568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:17.854428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:17.867291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.868080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.873555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.874568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.875207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.875825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.879010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:17.879665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:17.892149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.892654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.894218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:17.894218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:17.904794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:17.905364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:18.139874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:18.151356 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0854468f-4027-4012-9ba4-f186c2e3b6b3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.276181 Aug 23 10:56:18.152210 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2280/4615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:17 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:18.698432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:18.699303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:18.715700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:18.716208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:18.716657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:18.717416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:18.717885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:18.718320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:18.795356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:18.810968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:18.817728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:18.821908 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb9a3d58-106b-425f-9832-8f25ba311277 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.971249 Aug 23 10:56:18.822915 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2336/4616] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:17 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:18.845341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:18.848556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:18.886312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:18.888283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:18.892014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:18.898467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:18.899098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:18.899589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:18.995952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:19.011417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:19.024698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:19.026092 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0fe098f-dcbf-43b3-a7ea-328037c3149b tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.331641 Aug 23 10:56:19.057085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2281/4617] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:18 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:19.177729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:19.178369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:19.220402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:19.221630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:19.224612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:19.226324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:19.226984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:19.242848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:19.875315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:19.899476 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c0a333e-2ba7-4d58-be8a-408304c5dae8 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.726448 Aug 23 10:56:19.913291 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2282/4618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:19 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:19.926907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:19.927929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:19.942041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:19.942897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:19.943581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:19.944549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:19.948043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:19.948716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:20.103199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.119520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.120300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59e00e7a-95ea-4188-a59a-c29096cbf3a6 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1676 microversion: 2.1 time: 1.282404 Aug 23 10:56:20.125583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2337/4619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:18 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1676 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:20.137514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.141724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.143303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:20.144108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:20.148674 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcff60f5-614e-4082-b437-82a3f6cd03bd tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.228618 Aug 23 10:56:20.167876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2283/4620] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:19 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:20.182934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:20.187909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:20.188554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:20.189487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:20.190106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:20.195098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:20.621002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.637124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:20.668227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.672193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:20.675520 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-215c89dc-fd3b-4648-ac65-bbc3f96f604f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.547766 Aug 23 10:56:20.679860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2338/4621] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:20 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:20.928546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:20.929578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:20.946418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:20.946936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:20.947395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:20.954074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:20.955017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:20.955665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:21.185258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:21.186524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:21.205181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:21.212324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:21.213309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:21.214230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:21.216378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:21.219980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:21.361498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:21.375075 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96fce384-629c-4f42-b7b6-59196683a8cf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.451809 Aug 23 10:56:21.386065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2284/4622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:20 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:21.397494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:21.398521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:21.411452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:21.425095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:21.425334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:21.426628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:21.427374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:21.430468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:21.554105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:21.567068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:21.576063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:21.577573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5bd37bf5-1c13-4a8d-983a-484ce65c7210 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.189512 Aug 23 10:56:21.579114 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2285/4623] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:21 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:22.018612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cecc959-7ccd-4a96-aee7-de3fbdd1c718 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Action: 'create', calling method: .version_select at 0x7fdca1e0a280>, body: {"keypair": {"name": "tempest-keypair-413031388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBkxlxCRyOWOrZi4/ohcDv1rAOfUOPN4ms53X7CgASKcwn3rNhMEovpaFhQ6txASEUE//24y4vobYlodGI+dBwyqgsI1P4SfctlN2Lp/oJYTnks7ODDs1AuHU0Om0QpAg=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:22.087881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.099924 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-896f58ec-2992-4394-acc1-c73da1405b03 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1676 microversion: 2.1 time: 0.935421 Aug 23 10:56:22.100881 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2339/4624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:21 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1676 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:22.106524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:22.108665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3cecc959-7ccd-4a96-aee7-de3fbdd1c718 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Getting quotas for project 1460e8cc80774e8bb46c8711969ee882. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:56:22.118972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:22.125937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3cecc959-7ccd-4a96-aee7-de3fbdd1c718 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Getting quotas for user 91a4a75a2ad447499597931d6557f9fd and project 1460e8cc80774e8bb46c8711969ee882. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:56:22.144236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:22.151447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:22.155458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:22.156519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:22.157315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:22.157975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:22.197808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cecc959-7ccd-4a96-aee7-de3fbdd1c718 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.616824 Aug 23 10:56:22.198859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2286/4625] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:56:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:22.382795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.404212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.420941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:22.422297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:22.427011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.428810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5bf511c-04c8-4bcb-bf86-1b1a77962403 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.325899 Aug 23 10:56:22.443675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:22.447573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:22.449375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2340/4626] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:22 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:22.450070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:22.450943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:22.454671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:22.455396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:22.610332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:22.611484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:22.625944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:22.630484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:22.631163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:22.632065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:22.632689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:22.633315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:22.822579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.838520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.840059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:22.847514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-097fdfe3-40a9-468f-b128-186cc91d822a tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1604 microversion: 2.42 time: 0.241484 Aug 23 10:56:22.866577 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2341/4627] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:22 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:23.125150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:23.126592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:23.139806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:23.145542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:23.146414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:23.148918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:23.149675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:23.154511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:23.443395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:23.453884 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-823baac5-304a-46be-8d71-4c0723407ac3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 1.037636 Aug 23 10:56:23.466523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2287/4628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:22 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:23.471330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:23.471958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:23.489080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:23.506636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:23.507340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:23.507944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:23.508854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:23.509474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:23.510058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:23.514237 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-42cce0c3-32d2-4067-af58-7bf73bb3b2b0 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1608 microversion: 2.1 time: 0.393504 Aug 23 10:56:23.519298 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2342/4629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:23 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1608 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:23.706537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:23.726112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:23.729635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:23.734936 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5585bac6-0095-4d7f-8f1f-023ba2429e07 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.265131 Aug 23 10:56:23.736297 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2288/4630] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:23 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:23.884915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:23.886272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:23.954986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:23.983317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:23.984863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:23.987477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:23.991936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:23.992511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.108602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.110492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.111290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.113173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lazy-loading 'fault' on Instance uuid 5161eff7-fae8-410f-bf24-73a6b1aef8f7 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:24.156769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2015ae8e-d7dc-47d0-b465-78f6711eadbf req-111e357d-1864-4fe2-9643-641c54149186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd", "name": "network-vif-deleted", "tag": "651db17c-ded9-4b54-ba91-bde612eb06fd"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:24.197741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2015ae8e-d7dc-47d0-b465-78f6711eadbf req-111e357d-1864-4fe2-9643-641c54149186 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.201950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2015ae8e-d7dc-47d0-b465-78f6711eadbf req-111e357d-1864-4fe2-9643-641c54149186 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.205618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2015ae8e-d7dc-47d0-b465-78f6711eadbf req-111e357d-1864-4fe2-9643-641c54149186 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.224785 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2015ae8e-d7dc-47d0-b465-78f6711eadbf req-111e357d-1864-4fe2-9643-641c54149186 service nova] Creating event network-vif-deleted:651db17c-ded9-4b54-ba91-bde612eb06fd for instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd on n-h1-847009-13 Aug 23 10:56:24.231138 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2015ae8e-d7dc-47d0-b465-78f6711eadbf req-111e357d-1864-4fe2-9643-641c54149186 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079575 Aug 23 10:56:24.235632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:24.246027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2289/4631] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:24.251224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:24.254042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edca120d209c451c9f1060248decf0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32562dc9516b4d7c9694f3fe66ecf22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:24.256080 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33e9597d-b778-4af1-9026-ef67d18444e2 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 200 len: 1371 microversion: 2.42 time: 0.378565 Aug 23 10:56:24.290054 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2343/4632] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:23 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:24.482311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:24.484728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:24.505592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.507222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.509645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.511016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.512090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.513701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.541301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:24.542106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:24.559570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.561823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.562386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.563542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.567060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.567768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:24.570018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.620537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.621557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.623139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.624825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lazy-loading 'fault' on Instance uuid c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:24.891510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:24.906947 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4325283-c60f-4db9-9695-59c6466c4e7c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.431137 Aug 23 10:56:24.907882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca80ea2c8904468d9e6944fc274afdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7fefe975214d6a8482557904472914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:24.923714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-004201be-29a3-4a2a-be77-0b33429475e1 tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 200 len: 1329 microversion: 2.1 time: 0.386477 Aug 23 10:56:24.924316 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2290/4633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:24 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:24.927735 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2344/4634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:24 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 1329 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:24.935462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:24.939453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:24.987738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.992827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.993482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:24.994474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:24.995099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:24.998462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:25.147238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:25.159676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:25.164064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:25.165638 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e54ae69f-777d-4a7e-8a06-2a38c0da9b55 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.237246 Aug 23 10:56:25.166714 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2291/4635] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:24 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:25.285379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:25.286486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:25.300277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:25.305596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:25.306358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:25.308911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:25.309559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:25.313680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:25.354698 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] HTTP exception thrown: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Request method failure captured: Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 HTTP/1.1 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDFU3cJd-_TdP7GJauXcL17O2cXc27lpi67G13rk1_MARgKm5nSXMeziD0vh-Y520YeYKEc3nUFgKF0_ZhXO9nSmZIE2LQmg6AWTqOejbu5S76TsqQ0ZIwgbxXD3LScwlvyDN1RUs5M5wPnlbMtzKrCgMPbhaTSoWQFYpvJyIEMAdo Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.42 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 32562dc9516b4d7c9694f3fe66ecf22e Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32562dc9516b4d7c9694f3fe66ecf22e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32562dc9516b4d7c9694f3fe66ecf22e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32562dc9516b4d7c9694f3fe66ecf22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32562dc9516b4d7c9694f3fe66ecf22e"}]}] Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 32562dc9516b4d7c9694f3fe66ecf22e Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TaggedBootDevicesTest_v242-1324436679-project Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: edca120d209c451c9f1060248decf0bf Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1324436679-project Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5161eff7-fae8-410f-bf24-73a6b1aef8f7'} Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:25.358767 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:25.364182 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:25.368624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Returning 404 to user: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:25.370177 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f7489ac-7262-4a16-ae71-540096aba995 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 404 len: 111 microversion: 2.42 time: 0.091812 Aug 23 10:56:25.376716 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2345/4636] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:25 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:56:25.381135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2897513-4c77-4d02-8ecf-a0deda75a045 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '.version_select at 0x7fdc9c3b89d0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:25.431191 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2897513-4c77-4d02-8ecf-a0deda75a045 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-335380121" status: 204 len: 0 microversion: 2.42 time: 0.054657 Aug 23 10:56:25.431828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2292/4637] 10.222.0.78 () {60 vars in 1259 bytes} [Tue Aug 23 10:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-335380121 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 10:56:25.931050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:25.931874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:25.947937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:25.949203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] [instance: c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:25.951396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:25.952037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:25.952724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:25.953744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:25.954330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:25.957993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:25.969929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:25.980715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:25.981219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:25.984635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:25.985203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:25.985663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:26.047727 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] HTTP exception thrown: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd could not be found. Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Request method failure captured: Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd HTTP/1.1 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBK-HidHNCiiYouTpQZNSTX6xSKmpIHn1LDJUIyrjpRRhD5fLRr1Oyn3WfLItexZQ089QBXqXC4xWwzl9mlyHsj-Cpf0IniFMcyW608Qn4n21ZrmY00zavgZR5tdAUEV_M1iOCrcccc9E5i7ZYpnh1Wq5GsZ5Ekr1iC4ukoJlwjCutcw Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7fefe975214d6a8482557904472914"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7fefe975214d6a8482557904472914", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7fefe975214d6a8482557904472914"}]}] Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c7fefe975214d6a8482557904472914 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-1012154738 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: ca80ea2c8904468d9e6944fc274afdb8 Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-1012154738-project Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd could not be found. Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd'} Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd could not be found. Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd could not be found. Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:26.057581 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd could not be found. Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Returning 404 to user: Instance c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:26.061809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a8cca48-5c2e-4a2f-8f36-a6d2f6d9098c tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd" status: 404 len: 111 microversion: 2.1 time: 0.115094 Aug 23 10:56:26.062459 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2293/4638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:25 2022] GET /compute/v2.1/servers/c51aaa49-71e1-44e0-bb2c-43d9ce1b90bd => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:56:26.070778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd6fdb4d-c8bf-49ef-8bde-8eeb1a6bd73a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] Calling method '.version_select at 0x7fdc8ffd4dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:26.126791 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd6fdb4d-c8bf-49ef-8bde-8eeb1a6bd73a tempest-ServerActionsTestJSON-1012154738 tempest-ServerActionsTestJSON-1012154738-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965829258" status: 202 len: 0 microversion: 2.1 time: 0.060594 Aug 23 10:56:26.128255 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2294/4639] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 10:56:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1965829258 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:56:26.195083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:26.195946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:26.211213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:26.212977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:26.218442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:26.219375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:26.220050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:26.220988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:26.484449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:26.492900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:26.507004 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1a779c70-a009-4481-a373-58c4f8ac35bb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.579809 Aug 23 10:56:26.518267 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2346/4640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:25 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:26.519751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:26.528931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:26.531980 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16541016-b6f7-4642-80a7-3744cb5f5635 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.342581 Aug 23 10:56:26.538469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2295/4641] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:26 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:27.540571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:27.541476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:27.566650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:27.567846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:27.575201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:27.577479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:27.578088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:27.578972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:27.581413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:27.584554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:27.589970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:27.591670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:27.593695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:27.597249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:27.601440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:27.605759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:28.156612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:28.169624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:28.171140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:28.172339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cd7a9f9-e0e3-45a1-8e4e-7cac6dc8ee41 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.612036 Aug 23 10:56:28.204274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2296/4642] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:27 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:28.336560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:28.349970 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-76314cb6-324c-4b75-99f9-f656c0951e86 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.813931 Aug 23 10:56:28.354614 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2347/4643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:27 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:28.977139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e590abb8-1252-4739-97f2-6b877770edd6"}], "security_groups": [{"name": "tempest-securitygroup--85858732"}], "key_name": "tempest-keypair-413031388", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:29.200002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:29.201335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:29.209938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:29.210746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:29.211387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:29.213270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:29.214206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:29.219582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:29.401394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:29.443416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:29.445306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:29.447887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a96f2d9f-79e6-45d5-b7f7-2cbcbaa41a4f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.252028 Aug 23 10:56:29.449122 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2348/4644] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:29 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:29.454197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:29.454966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:29.464453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:29.465329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:29.465953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:29.467128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:29.468222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:29.468883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:29.984790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:29.996697 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2eca997e-92af-4f51-a82f-1448edc58ac5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.546092 Aug 23 10:56:29.998142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2349/4645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:29 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:30.017228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] validate_networks() for [('e590abb8-1252-4739-97f2-6b877770edd6', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:56:30.475784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:30.477343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:30.494567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:30.496964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:30.501133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:30.507249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:30.507935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:30.511989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:30.648365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:30.659142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:30.666982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:30.671022 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d83b536-f98e-4f96-9ee0-91ba8aad39b2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.197404 Aug 23 10:56:30.675192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2350/4646] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:30 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:31.027237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:31.034022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:31.053571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:31.054286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:31.056057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:31.062832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:31.063641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:31.064415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:31.581114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:56:31.581666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:56:31.583681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:56:31.584118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:56:31.584618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:56:31.604121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:31.606378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:31.607047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:31.608043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:31.610916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:31.611714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:31.658934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Getting quotas for project 1460e8cc80774e8bb46c8711969ee882. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:56:31.673475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Getting quotas for user 91a4a75a2ad447499597931d6557f9fd and project 1460e8cc80774e8bb46c8711969ee882. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:56:31.700135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:56:31.703364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:56:31.789269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:31.810219 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f874210c-c086-42ad-9244-4d6b2a168dcc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.791914 Aug 23 10:56:31.855021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2351/4647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:31 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:31.872193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:31.872853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:31.877408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e53ed07-1370-49a9-a703-3f21ad287a36 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.912089 Aug 23 10:56:31.878084 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2297/4648] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:56:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 2914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:56:31.897203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:31.899472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:31.900204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:31.901552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74173474-60c0-4951-96e0-2323fc30b09f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:31.902185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74173474-60c0-4951-96e0-2323fc30b09f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:31.902746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:31.903748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:31.904987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:32.163335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:32.173070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74173474-60c0-4951-96e0-2323fc30b09f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:32.182044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:32.184967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:32.193498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74173474-60c0-4951-96e0-2323fc30b09f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1225 microversion: 2.1 time: 0.306658 Aug 23 10:56:32.196988 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13b88430-b327-461e-962b-025e2c9dace7 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.339279 Aug 23 10:56:32.197538 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2298/4649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:31 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1225 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:32.197929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2352/4650] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:31 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:32.415255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-859140895", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "c172e128-8338-44a9-9fc3-46f547f2eb42"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:32.560793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] validate_networks() for [('c172e128-8338-44a9-9fc3-46f547f2eb42', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:56:32.835910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:32.836549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:32.856296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:32.858548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:32.859042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:32.860434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:32.860944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:32.865292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:33.379246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:33.396101 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-284dbd9d-f237-4b74-a453-d03c46ac4f6d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.565422 Aug 23 10:56:33.396821 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2353/4651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:32 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:33.414365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:33.415011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:33.429150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:33.429724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:33.430181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:33.434983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:33.435485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:33.435937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:33.579754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:33.593907 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84bb9c2d-9dd6-42ad-92ad-7a2e9aee3052 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1277 microversion: 2.1 time: 0.193828 Aug 23 10:56:33.611269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2354/4652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:33 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:33.626795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:33.629622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:33.658342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:33.665293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:33.666188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:33.667171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:33.667834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:33.668434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:33.702736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:33.791927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:33.815050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:33.816605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:33.820937 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92600968-9343-4108-acfa-323f48ae95be tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.208252 Aug 23 10:56:33.829288 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2355/4653] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:33 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:34.417937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:34.418647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:34.431785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:34.432790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:34.433414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:34.436232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:34.447132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:34.452280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:34.594961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:56:34.595486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:56:34.596001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:56:34.596462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:56:34.598294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:56:34.617360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:34.617675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:34.625875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:34.639953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:34.645040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:34.645631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:34.707543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Getting quotas for project a57eb76bfcdc4cd6ae534b11e7659dad. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:56:34.723777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Getting quotas for user 43edaa7653af4b4ab3fc937a2799eb73 and project a57eb76bfcdc4cd6ae534b11e7659dad. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:56:34.779875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Going to run 2 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:56:34.786774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:56:34.880500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:34.896984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=af9adc3a-9ebc-4975-b6bd-a0dad019e4df,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:56:35.030576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06d26ce4-6963-4608-bd05-2aabaf9547d8 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.752241 Aug 23 10:56:35.036988 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2299/4654] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:56:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:56:35.037943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:35.038962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:35.051717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:35.052226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:35.052681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:35.053524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:35.053998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:35.055024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:35.321360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:35.334245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d4c95e4-4802-457e-a420-f77e8ac2b654 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1283 microversion: 2.1 time: 0.301407 Aug 23 10:56:35.334850 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2300/4655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:35 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1283 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:35.344830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:35.359439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:35.360076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:35.373447 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f1b5af5-7f03-4262-b289-56b75c840bda tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.959465 Aug 23 10:56:35.377961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:35.378321 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2356/4656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:34 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:35.378503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:35.379668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:35.380402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:35.380909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:35.381336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:35.387696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:35.401960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:35.402913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Searching by: {'deleted': False, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:56:35.424609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:35.425332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:35.425762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:35.427446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:35.428219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:35.429226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:35.490625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d9969de-cf0f-425d-8c24-2b49f62aa173 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.107366 Aug 23 10:56:35.493020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2357/4657] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:56:35 2022] GET /compute/v2.1/servers => generated 675 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:35.508611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4b3f674-e55e-461f-9513-17d8c431cd56 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:35.513952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4b3f674-e55e-461f-9513-17d8c431cd56 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:35.683097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:35.708629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:35.710188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:35.715423 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-016f172e-e515-49b3-bbb5-077cec14fa3f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.375607 Aug 23 10:56:35.716333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2301/4658] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:35 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:36.071648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4b3f674-e55e-461f-9513-17d8c431cd56 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:36.090467 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4b3f674-e55e-461f-9513-17d8c431cd56 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1219 microversion: 2.1 time: 0.589836 Aug 23 10:56:36.095404 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2358/4659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:35 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1219 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:36.357707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:36.358334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:36.368773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:36.369152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:36.382384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:36.385812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:36.387919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:36.391323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:36.402138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:36.403043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:36.417526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:36.424157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:36.424918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:36.427264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:36.428007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:36.428693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:36.822450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:36.839141 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dfe05ec5-ba1a-417f-a1dd-10d1680927d3 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 0.485256 Aug 23 10:56:36.856539 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2302/4660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:36 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:36.875778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:36.876508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:36.895452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:36.896033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:36.896526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:36.903762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:36.905420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:36.905992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.205270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:37.250306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:37.256669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:37.265450 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b16e6be-cbd0-462b-8cb8-d73e2eb42e88 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.402943 Aug 23 10:56:37.267448 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2303/4661] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:36 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:37.318319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:37.318979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:37.371792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.372318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.379854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.381723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.384919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.385769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.389146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:37.405371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49764565-b628-4b68-8d85-3fc9cc5ba803 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 1.007852 Aug 23 10:56:37.405967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2359/4662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:36 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:37.424231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:37.430306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:37.451672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.458081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.458527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.459277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.459743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.473123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.503192 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] HTTP exception thrown: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Request method failure captured: Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 HTTP/1.1 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDFU3cJd-_TdP7GJauXcL17O2cXc27lpi67G13rk1_MARgKm5nSXMeziD0vh-Y520YeYKEc3nUFgKF0_ZhXO9nSmZIE2LQmg6AWTqOejbu5S76TsqQ0ZIwgbxXD3LScwlvyDN1RUs5M5wPnlbMtzKrCgMPbhaTSoWQFYpvJyIEMAdo Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.42 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 32562dc9516b4d7c9694f3fe66ecf22e Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32562dc9516b4d7c9694f3fe66ecf22e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32562dc9516b4d7c9694f3fe66ecf22e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32562dc9516b4d7c9694f3fe66ecf22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32562dc9516b4d7c9694f3fe66ecf22e"}]}] Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 32562dc9516b4d7c9694f3fe66ecf22e Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TaggedBootDevicesTest_v242-1324436679-project Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: edca120d209c451c9f1060248decf0bf Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1324436679-project Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5161eff7-fae8-410f-bf24-73a6b1aef8f7'} Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:37.505935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.509903 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.512074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Returning 404 to user: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:37.513564 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-578a3ae8-4ef7-40ef-a86b-7039912ae88c tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 404 len: 111 microversion: 2.42 time: 0.102748 Aug 23 10:56:37.514688 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2360/4663] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:56:37 2022] DELETE /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:56:37.526215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:37.534270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] [instance: 5161eff7-fae8-410f-bf24-73a6b1aef8f7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:37.538541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:37.548906 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00828c8f-379c-404f-bbab-d25d6d56a4a1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1271 microversion: 2.1 time: 0.266621 Aug 23 10:56:37.550226 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2304/4664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:37 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1271 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:37.555992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.556654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.557140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.557898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.558366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.558806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.577724 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] HTTP exception thrown: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Request method failure captured: Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 HTTP/1.1 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLDFU3cJd-_TdP7GJauXcL17O2cXc27lpi67G13rk1_MARgKm5nSXMeziD0vh-Y520YeYKEc3nUFgKF0_ZhXO9nSmZIE2LQmg6AWTqOejbu5S76TsqQ0ZIwgbxXD3LScwlvyDN1RUs5M5wPnlbMtzKrCgMPbhaTSoWQFYpvJyIEMAdo Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.42 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 32562dc9516b4d7c9694f3fe66ecf22e Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/32562dc9516b4d7c9694f3fe66ecf22e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_32562dc9516b4d7c9694f3fe66ecf22e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32562dc9516b4d7c9694f3fe66ecf22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/32562dc9516b4d7c9694f3fe66ecf22e"}]}] Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 32562dc9516b4d7c9694f3fe66ecf22e Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1324436679 Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TaggedBootDevicesTest_v242-1324436679-project Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: edca120d209c451c9f1060248decf0bf Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1324436679-project Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '5161eff7-fae8-410f-bf24-73a6b1aef8f7'} Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.579320 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. Aug 23 10:56:37.583928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:56:37.587175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] Returning 404 to user: Instance 5161eff7-fae8-410f-bf24-73a6b1aef8f7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:37.588283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a11685d1-05ed-46e1-914d-a40bf6e64a17 tempest-TaggedBootDevicesTest_v242-1324436679 tempest-TaggedBootDevicesTest_v242-1324436679-project] 10.222.0.78 "GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7" status: 404 len: 111 microversion: 2.42 time: 0.069138 Aug 23 10:56:37.589981 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2361/4665] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:37 2022] GET /compute/v2.1/servers/5161eff7-fae8-410f-bf24-73a6b1aef8f7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:56:37.860678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:37.861322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:37.879611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.880391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.881011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:37.881883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:37.894844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:37.895615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:38.303045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:38.303693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:38.330914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:38.332400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:38.333165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:38.334253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:38.336398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:38.337224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:38.584631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:38.608966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:38.614974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:38.630471 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9a0e4905-16ba-4506-bfaa-6eced11b685a tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.339541 Aug 23 10:56:38.631068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2362/4666] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:38 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:38.650004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:38.652332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:38.676868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:38.678015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:38.678626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:38.679510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:38.680131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:38.688079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:39.229103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:39.241417 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-044c79d6-d162-4491-88d3-72f16cb60b91 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 1.381335 Aug 23 10:56:39.242849 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2305/4667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:37 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:39.261206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:39.262233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:39.272911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:39.274254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:39.276869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:39.277834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:39.279400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:39.280214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:39.419618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:39.434451 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-974020a9-fd27-454b-bb59-c451fe52e056 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1737 microversion: 2.1 time: 0.795686 Aug 23 10:56:39.457858 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2363/4668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:38 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1737 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:39.467968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5fee4e71-056e-4e91-978e-102eb9f17507 req-e5d4378e-2b74-4b71-bc66-f0c076fc2888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155176ba-3061-403d-aee8-b0a2ddb5113d", "tag": "b7bb14c0-aea5-40da-b207-167073d37f08"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:39.491922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5fee4e71-056e-4e91-978e-102eb9f17507 req-e5d4378e-2b74-4b71-bc66-f0c076fc2888 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:39.496288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5fee4e71-056e-4e91-978e-102eb9f17507 req-e5d4378e-2b74-4b71-bc66-f0c076fc2888 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:39.497001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5fee4e71-056e-4e91-978e-102eb9f17507 req-e5d4378e-2b74-4b71-bc66-f0c076fc2888 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:39.521997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:39.528921 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5fee4e71-056e-4e91-978e-102eb9f17507 req-e5d4378e-2b74-4b71-bc66-f0c076fc2888 service nova] Creating event network-changed:b7bb14c0-aea5-40da-b207-167073d37f08 for instance 155176ba-3061-403d-aee8-b0a2ddb5113d on n-h1-847009-13 Aug 23 10:56:39.535614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c85acd06-e04c-418f-a977-487ebcf29454 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1277 microversion: 2.1 time: 0.290127 Aug 23 10:56:39.539581 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2306/4669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:39 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1277 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:39.557543 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5fee4e71-056e-4e91-978e-102eb9f17507 req-e5d4378e-2b74-4b71-bc66-f0c076fc2888 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081019 Aug 23 10:56:39.559058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2364/4670] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:39.657677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:39.658199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:39.671605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:39.672106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:39.674374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:39.675166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:39.675976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:39.677106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:40.264218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:40.264965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:40.280582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:40.281114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:40.281564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:40.282308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:40.282763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:40.283200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:40.477525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:40.494197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:40.496584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:40.498137 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-088bfca9-2c36-47da-9be7-2c7c8305da5e tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.844666 Aug 23 10:56:40.500603 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2307/4671] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:39 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:40.513586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:40.517522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:40.528179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:40.528899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:40.529657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:40.530477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:40.531047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:40.531669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:40.601722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:40.611447 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13007f99-58b0-472f-b422-9c89427b9a44 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 0.351397 Aug 23 10:56:40.626230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2365/4672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:40 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:40.631927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:40.632973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:40.642332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:40.651476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:40.653316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:40.654573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:40.655767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:40.656578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.073193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:41.085153 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-befb76a7-050c-4cbc-be6d-54a7fc1bbc75 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1717 microversion: 2.1 time: 0.583016 Aug 23 10:56:41.086503 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2308/4673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:40 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1717 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:41.182877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:41.213272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7fb368ee-c2e0-4a3e-95ca-6a8cc544dc96 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.572759 Aug 23 10:56:41.213272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2366/4674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:40 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:41.280374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:41.281269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:41.291706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.292617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.293336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.294721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.295418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.296097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.468119 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Cannot 'detach_volume' instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d while it is in vm_state rescued Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments/c25971ff-eeb5-4b36-8c59-cc2387d363d2 HTTP/1.1 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: exception: Cannot 'detach_volume' instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d while it is in vm_state rescued Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'server_id': '0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d', 'id': 'c25971ff-eeb5-4b36-8c59-cc2387d363d2'} Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d while it is in vm_state rescued Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:41.469983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:41.474580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:41.474580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:41.474580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:41.474580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:41.474580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d while it is in vm_state rescued Aug 23 10:56:41.474580 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:41.479883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 409 to user: Cannot 'detach_volume' instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d while it is in vm_state rescued {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:41.481526 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04beb4e9-1fb6-4db3-b8cb-d37eea905bb6 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments/c25971ff-eeb5-4b36-8c59-cc2387d363d2" status: 409 len: 152 microversion: 2.1 time: 0.205359 Aug 23 10:56:41.482282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2309/4675] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 10:56:41 2022] DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments/c25971ff-eeb5-4b36-8c59-cc2387d363d2 => generated 152 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 10:56:41.491976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:41.492816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:41.505102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.510722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.511866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.512902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.514130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.514842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.527233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:41.527970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:41.537807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.538551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.539285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.540152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.541492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.542805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.637473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0127ebd1-9bf7-40b7-b2fd-1ba56222915f tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/action" status: 202 len: 0 microversion: 2.1 time: 0.150113 Aug 23 10:56:41.638721 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2367/4676] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:56:41 2022] POST /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:56:41.644898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:41.656385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:41.663882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.665677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.666576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.670961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.671633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.672272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.817801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:41.831172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:41.837343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:41.838961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c97f6d21-2325-4eaf-8877-c0c2e7c668fc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.316495 Aug 23 10:56:41.843105 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2310/4677] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:41 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:56:41.853086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:41.855077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:41.888246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.889015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.889652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:41.895424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:41.895925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:41.896361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:42.644797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:42.653107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:42.666381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0518d903-1ed6-4b26-a11c-bb0697fe5974 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1725 microversion: 2.1 time: 0.821852 Aug 23 10:56:42.667789 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2311/4678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:41 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1725 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:42.673605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:42.674353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:42.692586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:42.693181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:42.694711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:42.696728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:42.697386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:42.699056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:43.177516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:43.194380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4324474d-8f01-45d0-9fe4-f878481f279e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.525308 Aug 23 10:56:43.195010 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2312/4679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:42 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:43.208857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:43.208857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:43.218885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:43.244151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-755b530b-b293-4410-946c-7c53b8b9dd2b tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 1.603883 Aug 23 10:56:43.257917 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2368/4680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:41 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:43.258273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:43.258273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:43.258273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:43.258649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:43.260595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:43.260595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:43.354785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:43.369763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:43.371435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:43.372627 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c390a125-f899-441c-a5ab-37b6c19ff767 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1366 microversion: 2.47 time: 0.176677 Aug 23 10:56:43.373397 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2313/4681] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:43 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:43.694740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:43.695378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:43.707397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:43.708000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:43.708464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:43.713192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:43.713795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:43.715137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:44.218212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:44.218838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:44.236355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:44.236894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:44.237346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:44.249668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:44.250234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:44.250700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:44.350173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:44.363822 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9797ce60-0ce2-4ac3-b957-3bf4a3ca95e5 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1725 microversion: 2.1 time: 0.673457 Aug 23 10:56:44.369056 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2369/4682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:43 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1725 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:44.378329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:44.379252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:44.397534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:44.398718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:44.400953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:44.401977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:44.404198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:44.406048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:44.688138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:44.764714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=18 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:45.072586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:45.088558 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfcd580e-990f-44e0-b256-f0272d8aff82 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 0.717940 Aug 23 10:56:45.091978 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2370/4683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:44 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:45.100559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:45.110324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:45.135110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:45.143242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.145881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.146141 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f3d0494-b790-421c-b18c-76adfd4895cd tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.931954 Aug 23 10:56:45.146999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:45.147796 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2314/4684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:44 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:45.148988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.151401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.155702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:45.167817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-35467bf8-698c-4a12-9917-e46386281ee4 req-8bbebc0c-3c2a-4323-b857-227658bc1667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc2bd77-1584-4e7c-92ba-1c90df91a236", "tag": "a68d0244-bfb9-4534-a19a-0e0cc582e118"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:45.195413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-35467bf8-698c-4a12-9917-e46386281ee4 req-8bbebc0c-3c2a-4323-b857-227658bc1667 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.208008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-35467bf8-698c-4a12-9917-e46386281ee4 req-8bbebc0c-3c2a-4323-b857-227658bc1667 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.209222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-35467bf8-698c-4a12-9917-e46386281ee4 req-8bbebc0c-3c2a-4323-b857-227658bc1667 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:45.247183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-35467bf8-698c-4a12-9917-e46386281ee4 req-8bbebc0c-3c2a-4323-b857-227658bc1667 service nova] Creating event network-changed:a68d0244-bfb9-4534-a19a-0e0cc582e118 for instance 6bc2bd77-1584-4e7c-92ba-1c90df91a236 on n-h1-847009-13 Aug 23 10:56:45.257603 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-35467bf8-698c-4a12-9917-e46386281ee4 req-8bbebc0c-3c2a-4323-b857-227658bc1667 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107265 Aug 23 10:56:45.258907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2315/4685] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:45.265247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-19ad9b12-4345-47aa-9897-e262b7ce80c0 req-8edd1eca-0e41-4205-bee4-84dbbf3cfa78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9adc3a-9ebc-4975-b6bd-a0dad019e4df", "tag": "6e645850-adf4-405a-ba18-106179cd3b27"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:45.277614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19ad9b12-4345-47aa-9897-e262b7ce80c0 req-8edd1eca-0e41-4205-bee4-84dbbf3cfa78 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.279270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19ad9b12-4345-47aa-9897-e262b7ce80c0 req-8edd1eca-0e41-4205-bee4-84dbbf3cfa78 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.279947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-19ad9b12-4345-47aa-9897-e262b7ce80c0 req-8edd1eca-0e41-4205-bee4-84dbbf3cfa78 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:45.287060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:45.295470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-19ad9b12-4345-47aa-9897-e262b7ce80c0 req-8edd1eca-0e41-4205-bee4-84dbbf3cfa78 service nova] Creating event network-changed:6e645850-adf4-405a-ba18-106179cd3b27 for instance af9adc3a-9ebc-4975-b6bd-a0dad019e4df on n-h1-847009-13 Aug 23 10:56:45.301212 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-19ad9b12-4345-47aa-9897-e262b7ce80c0 req-8edd1eca-0e41-4205-bee4-84dbbf3cfa78 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040644 Aug 23 10:56:45.302551 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2316/4686] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:45.319369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:45.322625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:45.324140 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adaa758a-51b8-4c84-b41a-989f21f9b183 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1372 microversion: 2.47 time: 0.230901 Aug 23 10:56:45.325466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2371/4687] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:45 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:45.388373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:45.389137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:45.401668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.402308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.403062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:45.403898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.404476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.405072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:45.747074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:45.779333 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b10aadc5-7f8c-425d-98d2-804629985e91 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1725 microversion: 2.1 time: 0.391320 Aug 23 10:56:45.792770 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2317/4688] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:45 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1725 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:45.954047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2a2d7e92-0fbc-4a7e-8e63-dd31125194aa req-49d4bec8-d22d-424a-98f7-ca538cfeb28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155176ba-3061-403d-aee8-b0a2ddb5113d", "name": "network-vif-plugged", "status": "completed", "tag": "b7bb14c0-aea5-40da-b207-167073d37f08"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:45.966155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:45.982004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2a2d7e92-0fbc-4a7e-8e63-dd31125194aa req-49d4bec8-d22d-424a-98f7-ca538cfeb28c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:45.982602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2a2d7e92-0fbc-4a7e-8e63-dd31125194aa req-49d4bec8-d22d-424a-98f7-ca538cfeb28c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:45.983196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2a2d7e92-0fbc-4a7e-8e63-dd31125194aa req-49d4bec8-d22d-424a-98f7-ca538cfeb28c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.021928 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2a2d7e92-0fbc-4a7e-8e63-dd31125194aa req-49d4bec8-d22d-424a-98f7-ca538cfeb28c service nova] Creating event network-vif-plugged:b7bb14c0-aea5-40da-b207-167073d37f08 for instance 155176ba-3061-403d-aee8-b0a2ddb5113d on n-h1-847009-13 Aug 23 10:56:46.036912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2a2d7e92-0fbc-4a7e-8e63-dd31125194aa req-49d4bec8-d22d-424a-98f7-ca538cfeb28c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084767 Aug 23 10:56:46.040271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2372/4689] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:46.114750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:46.115607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:46.122763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.123641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.124353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.125290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.125911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.126514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.174286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:46.179054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:46.228120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:46.230392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.231162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.231789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.243312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.246845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.249426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.453557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:46.469372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-815eb8a4-1fda-493f-af61-26935608e986 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 0.359632 Aug 23 10:56:46.482807 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2318/4690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:46 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:46.489842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:46.490486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:46.496656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.497186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.497634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.498354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.498819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.499252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.601911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:46.620546 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38cc1d76-0750-4e6a-856c-c7c7e38c25e6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.451937 Aug 23 10:56:46.624367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2373/4691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:46 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:46.647227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:46.662898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:46.665095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:46.666912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69abe38d-51f0-4b2e-bd86-eaa2b7ef07e3 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1372 microversion: 2.47 time: 0.195538 Aug 23 10:56:46.679059 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2319/4692] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:46 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:46.826735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:46.827825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:46.845970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.846489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.847566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:46.848413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:46.848901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:46.849334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:47.309431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:47.321473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3bd17493-cf8b-4cb5-a580-0d4e8867cccd tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1725 microversion: 2.1 time: 0.511603 Aug 23 10:56:47.337751 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2374/4693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:46 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1725 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:47.491353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:47.492601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:47.501045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:47.501795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:47.502766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:47.503878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:47.504509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:47.505424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:47.650078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:47.651388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:47.653453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:47.663497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:47.666530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:47.667227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:47.673620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:47.674137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:47.674638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:47.727195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:47.965637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:47.983441 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-400fdc5a-d135-496e-aca5-a2c066a13a91 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.337810 Aug 23 10:56:47.993193 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2375/4694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:47 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:47.997896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:47.999842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:48.016217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:48.017134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:48.018055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:48.019540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:48.020210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:48.020829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:48.280443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:48.294902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:48.296652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:48.305542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da987f44-e92e-4fa4-8a46-2561d6b873b8 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1372 microversion: 2.47 time: 0.316477 Aug 23 10:56:48.321417 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2376/4695] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:47 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:48.345558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:48.346283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:48.366252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:48.367055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:48.368960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:48.370801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:48.371172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:48.371812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:48.627575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:48.638197 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46c37ce1-f8f2-436e-8413-8ffbc8015417 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1725 microversion: 2.1 time: 0.296847 Aug 23 10:56:48.639300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2377/4696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:48 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:48.652568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:48.663810 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8da54ed-d07d-4104-81ae-29809bdc2d74 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 1.176812 Aug 23 10:56:48.665144 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2320/4697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:47 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:48.795682 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 23 10:56:48.795912 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 10:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 10:56:49.009721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:49.010478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:49.018380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.019531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.020120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.021003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.021544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.022156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.248516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:49.282058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2d77862-321f-4efb-996b-db914d1c4fb9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.276826 Aug 23 10:56:49.283385 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2378/4698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:49 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:49.330398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:49.331254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:49.338222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.339047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.339679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.340555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.341212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.341801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.518460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:49.533429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:49.537285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:49.538610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3e59f2d-5b6c-4a9c-a28d-4ff96eb54168 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1357 microversion: 2.47 time: 0.212351 Aug 23 10:56:49.539230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2321/4699] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:49 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:49.563065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:49.569807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:49.570927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Searching by: {'deleted': False, 'project_id': '90c195486d9f42abab699e4d7bd3b99a'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:56:49.600066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.600971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.601597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.602587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.603216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.603887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.661671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:49.663386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:49.681586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.685445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.686248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.687554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:49.688063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:49.688598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:49.877358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:56:50.064038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:50.085505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.088689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.089185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.110090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:50.117626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:50.181359 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aac98561-fed6-400b-b1f7-635d9296ec0c tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.622558 Aug 23 10:56:50.202348 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2379/4700] 10.222.0.78 () {60 vars in 1187 bytes} [Tue Aug 23 10:56:49 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:50.217005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:50.220868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:50.221028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:50.235743 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4cd7d04-7c9f-4963-b7ae-75f7e2556cc3 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1725 microversion: 2.1 time: 0.578690 Aug 23 10:56:50.237799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.242177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.242819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.243873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.244501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.245131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.249205 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2322/4701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:49 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1725 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:50.255856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:50.256365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:50.274497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.275286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.276198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.280544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.281338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.281940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.326705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:56:50.506578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68be7fdc-5c56-4799-8418-7122fb71f8ce tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "DELETE /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 204 len: 0 microversion: 2.47 time: 0.255796 Aug 23 10:56:50.507623 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2323/4702] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:56:50 2022] DELETE /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:56:50.521136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:50.522211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:50.531424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.532218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.533819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.534863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.537355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.538024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.567954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:50.579579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-42db68d6-f33b-4cfb-afdc-8ac88408bfc5 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 0.374983 Aug 23 10:56:50.593742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2380/4703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:50 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:50.602014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:50.603039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:50.647685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.652377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.653372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:50.654649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:50.655437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:50.656168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:51.026853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:51.038179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:51.039725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:51.041008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7570f4c1-48c6-426d-8638-0186a71752fd tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1363 microversion: 2.47 time: 0.445636 Aug 23 10:56:51.066576 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2381/4704] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:50 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:51.125305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:51.144313 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dfc7c33-d68a-4aaa-b337-ddd2c2d847c6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.634913 Aug 23 10:56:51.149956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2324/4705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:50 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:51.266011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:51.266640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:51.281183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:51.281692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:51.282163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:51.282896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:51.283366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:51.283801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:51.607114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:51.608076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:51.618247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:51.618958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:51.619995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:51.621421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:51.622095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:51.622708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.099891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:52.113528 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aefd9022-3452-47ac-9825-25635fdeb783 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1349 microversion: 2.1 time: 0.509055 Aug 23 10:56:52.113528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2325/4706] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:51 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1349 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:52.120706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:52.124981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:52.138877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.139412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.142781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.152148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.153213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.153919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.313658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:52.328539 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-843b2dff-1581-4f65-b839-21fceff51711 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1731 microversion: 2.1 time: 1.066422 Aug 23 10:56:52.330022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2382/4707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:51 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1731 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:52.342495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:52.354704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:52.365053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:52.366345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:52.371824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:52.373371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-209fb4b4-268a-4e2e-8cb8-656f6c2c3601 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1363 microversion: 2.47 time: 0.256517 Aug 23 10:56:52.376219 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2326/4708] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:52 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:52.379935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.382231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.384068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:52.384197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.384939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:52.386939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.387536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.388334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.419816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.420667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.421368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.422478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.423131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.429947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.760179 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-279b0ba7-dd33-47d4-bcbf-cea6cb45a808 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.382453 Aug 23 10:56:52.768333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2327/4709] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:56:52 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-interface => generated 285 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:52.790144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fadda957-7e5d-4e09-8f93-277649eb10f5 req-7631d7f3-4ddb-4c3a-92ae-eb852e7212ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc2bd77-1584-4e7c-92ba-1c90df91a236", "name": "network-vif-plugged", "status": "completed", "tag": "a68d0244-bfb9-4534-a19a-0e0cc582e118"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:52.814555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fadda957-7e5d-4e09-8f93-277649eb10f5 req-7631d7f3-4ddb-4c3a-92ae-eb852e7212ff service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:52.815318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fadda957-7e5d-4e09-8f93-277649eb10f5 req-7631d7f3-4ddb-4c3a-92ae-eb852e7212ff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:52.816293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fadda957-7e5d-4e09-8f93-277649eb10f5 req-7631d7f3-4ddb-4c3a-92ae-eb852e7212ff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:52.837153 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fadda957-7e5d-4e09-8f93-277649eb10f5 req-7631d7f3-4ddb-4c3a-92ae-eb852e7212ff service nova] Creating event network-vif-plugged:a68d0244-bfb9-4534-a19a-0e0cc582e118 for instance 6bc2bd77-1584-4e7c-92ba-1c90df91a236 on n-h1-847009-13 Aug 23 10:56:52.871470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fadda957-7e5d-4e09-8f93-277649eb10f5 req-7631d7f3-4ddb-4c3a-92ae-eb852e7212ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085425 Aug 23 10:56:52.872799 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2328/4710] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:53.134784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:53.135649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:53.152844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:53.153592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:53.154084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:53.154898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:53.155455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:53.155978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:53.168852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:53.312981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:53.337384 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-856d0b9b-fe27-4745-bc27-98734f6aee38 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 1.001855 Aug 23 10:56:53.341399 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2383/4711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:52 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:53.402701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:53.403640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:53.426076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:53.428525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:53.430026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:53.430977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:53.434530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:53.436710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:53.641215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:53.670480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:53.698867 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb0917f0-dd8d-492b-8a5b-efd366619a0d tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1539 microversion: 2.1 time: 0.568176 Aug 23 10:56:53.699489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2329/4712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:53 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1539 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:53.722350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:53.723352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:53.729121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:53.730871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:53.732108 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-72bd617e-e433-4c11-ae59-bbb5b9b1c4c0 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1363 microversion: 2.47 time: 0.336005 Aug 23 10:56:53.732793 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2384/4713] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:53 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:53.733940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:53.734606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:53.735201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:53.737678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:53.738585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:53.739163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:53.941104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f64073e-6dc4-436e-b198-771992adadfe tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.222527 Aug 23 10:56:53.958462 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2330/4714] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:56:53 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:56:54.363574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:54.365142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:54.377978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:54.381025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:54.381738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:54.384359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:54.385069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:54.385598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:54.768392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:54.770190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:54.795260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:54.796042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:54.796510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:54.797836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:54.799187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:54.807443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:54.888345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:54.894039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:54.894735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:54.895618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lazy-loading 'fault' on Instance uuid df463bbc-ed0e-4917-a981-f7e33e0d2b99 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:56:55.076823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:55.091359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:55.096469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:55.102230 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88f4c346-1d88-40e2-9b49-7612208b5fae tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 200 len: 1368 microversion: 2.47 time: 0.340892 Aug 23 10:56:55.103747 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2331/4715] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:54 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:55.305889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:55.324807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02d1d40e-599d-42c4-abf5-1f7b0b3666e7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1319 microversion: 2.1 time: 0.958882 Aug 23 10:56:55.329434 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2385/4716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:54 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1319 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:56.128554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:56.130060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: df463bbc-ed0e-4917-a981-f7e33e0d2b99] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:56.146381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.149341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.151538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.152686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.155896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.156633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.215715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] HTTP exception thrown: Instance df463bbc-ed0e-4917-a981-f7e33e0d2b99 could not be found. Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Request method failure captured: Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 HTTP/1.1 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLI_kxHUxCiZ6ditZvDuo6eaI1k8-R8XJya7NRiLQRXBZ_rzc3F98Orf6REvbMLiXblW0k_Jtrpjzcai0NhQ5TVGcaePhZZHID-K1PpyQRaNe2HS-MX1Ouim5LYyqa8sPUtPKQNudhF3WBJ91r66W7VqcD6qWO5JPsYmk6vnilOpPKY Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.47 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 90c195486d9f42abab699e4d7bd3b99a Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerShowV247Test-803613111 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/90c195486d9f42abab699e4d7bd3b99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_90c195486d9f42abab699e4d7bd3b99a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/90c195486d9f42abab699e4d7bd3b99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/90c195486d9f42abab699e4d7bd3b99a"}]}] Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerShowV247Test-803613111 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 90c195486d9f42abab699e4d7bd3b99a Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerShowV247Test-803613111 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerShowV247Test-803613111-project Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a8f7e3b18e7e4de3aed10f2d50fe5188 Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerShowV247Test-803613111-project Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance df463bbc-ed0e-4917-a981-f7e33e0d2b99 could not be found. Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'df463bbc-ed0e-4917-a981-f7e33e0d2b99'} Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df463bbc-ed0e-4917-a981-f7e33e0d2b99 could not be found. Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df463bbc-ed0e-4917-a981-f7e33e0d2b99 could not be found. Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:56:56.220639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df463bbc-ed0e-4917-a981-f7e33e0d2b99 could not be found. Aug 23 10:56:56.228164 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:56:56.230296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Returning 404 to user: Instance df463bbc-ed0e-4917-a981-f7e33e0d2b99 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:56:56.231702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-977e6741-85a7-462e-9d58-fb3d07d35caf tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99" status: 404 len: 111 microversion: 2.47 time: 0.108898 Aug 23 10:56:56.233273 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2332/4717] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:56 2022] GET /compute/v2.1/servers/df463bbc-ed0e-4917-a981-f7e33e0d2b99 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:56:56.244002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:56.244580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:56.256502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.268033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.268698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.270987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.271479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.274309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.295219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-61938166-5468-422e-bfab-fe7ac92e38a3 req-7cdaec9c-e86a-4ac6-be4f-12a2f828dccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155176ba-3061-403d-aee8-b0a2ddb5113d", "tag": "b7bb14c0-aea5-40da-b207-167073d37f08"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:56.306756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-61938166-5468-422e-bfab-fe7ac92e38a3 req-7cdaec9c-e86a-4ac6-be4f-12a2f828dccd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.307246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-61938166-5468-422e-bfab-fe7ac92e38a3 req-7cdaec9c-e86a-4ac6-be4f-12a2f828dccd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.307683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-61938166-5468-422e-bfab-fe7ac92e38a3 req-7cdaec9c-e86a-4ac6-be4f-12a2f828dccd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.321416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-61938166-5468-422e-bfab-fe7ac92e38a3 req-7cdaec9c-e86a-4ac6-be4f-12a2f828dccd service nova] Creating event network-changed:b7bb14c0-aea5-40da-b207-167073d37f08 for instance 155176ba-3061-403d-aee8-b0a2ddb5113d on n-h1-847009-13 Aug 23 10:56:56.327031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-61938166-5468-422e-bfab-fe7ac92e38a3 req-7cdaec9c-e86a-4ac6-be4f-12a2f828dccd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035642 Aug 23 10:56:56.330706 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2333/4718] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:56:56.343666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:56:56.353853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:56.354973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:56.374743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.375358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.375788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.376536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.377038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.377475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.569852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-433c69f2-1680-44ad-9158-609efd8580d5 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c" status: 204 len: 0 microversion: 2.47 time: 0.325737 Aug 23 10:56:56.574288 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2386/4719] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 10:56:56 2022] DELETE /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:56:56.587557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:56.589477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:56.608462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.609310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.609964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.617044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.617044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.617447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.746025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:56.759071 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c944c15d-511b-4304-b437-71c51afb80ac tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 200 len: 1508 microversion: 2.1 time: 0.409416 Aug 23 10:56:56.759839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2334/4720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:56 2022] GET /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:56:56.781312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:56.782235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:56.789070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.789871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.790475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:56.791338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:56.791954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:56.792535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:57.174013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:57.188532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c5ff1c0-c6a6-429d-9f0a-024112659bca tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df" status: 200 len: 1319 microversion: 2.1 time: 0.410982 Aug 23 10:56:57.191990 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2335/4721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:56 2022] GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:57.231699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-65cb6d73-02b0-45cd-83e2-bb85ed3b8045 req-e9199c08-166a-4d1d-89b7-0f4fb2602bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9adc3a-9ebc-4975-b6bd-a0dad019e4df", "name": "network-vif-plugged", "status": "completed", "tag": "6e645850-adf4-405a-ba18-106179cd3b27"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:57.245411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-65cb6d73-02b0-45cd-83e2-bb85ed3b8045 req-e9199c08-166a-4d1d-89b7-0f4fb2602bae service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:57.246246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-65cb6d73-02b0-45cd-83e2-bb85ed3b8045 req-e9199c08-166a-4d1d-89b7-0f4fb2602bae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:57.247272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-65cb6d73-02b0-45cd-83e2-bb85ed3b8045 req-e9199c08-166a-4d1d-89b7-0f4fb2602bae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:57.267381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-65cb6d73-02b0-45cd-83e2-bb85ed3b8045 req-e9199c08-166a-4d1d-89b7-0f4fb2602bae service nova] Creating event network-vif-plugged:6e645850-adf4-405a-ba18-106179cd3b27 for instance af9adc3a-9ebc-4975-b6bd-a0dad019e4df on n-h1-847009-13 Aug 23 10:56:57.275432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-65cb6d73-02b0-45cd-83e2-bb85ed3b8045 req-e9199c08-166a-4d1d-89b7-0f4fb2602bae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059115 Aug 23 10:56:57.278130 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2336/4722] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:57.407661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:57.429230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:57.430903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:57.432891 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2d6085b-5937-40df-9bc1-00463532dec2 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c" status: 200 len: 1363 microversion: 2.47 time: 0.857049 Aug 23 10:56:57.433463 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2387/4723] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:56 2022] GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c => generated 1363 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:58.213659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:58.214953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:58.232609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:58.233383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:58.233990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:58.234896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:58.235507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:58.236099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:58.414640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-35e4e328-0ea9-43e6-8e75-d4c1514a4c73 req-993da040-640a-4226-a520-a9a64e8910b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d", "tag": "eab71317-d387-42d3-b5b9-433db85dd050"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:56:58.437932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35e4e328-0ea9-43e6-8e75-d4c1514a4c73 req-993da040-640a-4226-a520-a9a64e8910b0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:58.438427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35e4e328-0ea9-43e6-8e75-d4c1514a4c73 req-993da040-640a-4226-a520-a9a64e8910b0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:58.438873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35e4e328-0ea9-43e6-8e75-d4c1514a4c73 req-993da040-640a-4226-a520-a9a64e8910b0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:58.485404 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-35e4e328-0ea9-43e6-8e75-d4c1514a4c73 req-993da040-640a-4226-a520-a9a64e8910b0 service nova] Creating event network-changed:eab71317-d387-42d3-b5b9-433db85dd050 for instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d on n-h2-847009-13 Aug 23 10:56:58.493102 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-35e4e328-0ea9-43e6-8e75-d4c1514a4c73 req-993da040-640a-4226-a520-a9a64e8910b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088639 Aug 23 10:56:58.495034 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2388/4724] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:56:58.504540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:58.506411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:58.525654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:58.528078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:58.529051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:58.530210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:58.531937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:58.532589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:58.571965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:58.580487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cbaa5785-5311-4c72-9d4f-90c84fe9e25e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df" status: 200 len: 1319 microversion: 2.1 time: 0.371980 Aug 23 10:56:58.582094 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2337/4725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:58 2022] GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:56:58.726233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:58.753972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:58.757675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:56:58.760094 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-924cb07e-c113-4eea-a4ef-944ae291b9cc tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c" status: 200 len: 1363 microversion: 2.47 time: 0.263451 Aug 23 10:56:58.762144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2389/4726] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:58 2022] GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 10:56:59.603911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:59.605984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:59.621593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:59.622159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:59.622621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:59.623377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:59.623851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:59.624291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:59.786579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:56:59.793234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:56:59.794148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:56:59.853413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:59.854730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:59.857948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:56:59.859412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:56:59.861706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:56:59.864220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:00.290840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:00.306396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3dafcf2-23fa-4da1-9783-f6f838e75591 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df" status: 200 len: 1319 microversion: 2.1 time: 0.707712 Aug 23 10:57:00.320773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2338/4727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:56:59 2022] GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:00.357212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:00.357938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:00.660316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c47c2b5b-8ab9-4a36-8158-d5b806371eff req-2965d251-8f61-438d-ab1f-cb0c876efb0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d", "tag": "eab71317-d387-42d3-b5b9-433db85dd050"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:00.679947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c47c2b5b-8ab9-4a36-8158-d5b806371eff req-2965d251-8f61-438d-ab1f-cb0c876efb0a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:00.680767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c47c2b5b-8ab9-4a36-8158-d5b806371eff req-2965d251-8f61-438d-ab1f-cb0c876efb0a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:00.682368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c47c2b5b-8ab9-4a36-8158-d5b806371eff req-2965d251-8f61-438d-ab1f-cb0c876efb0a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:00.703091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c47c2b5b-8ab9-4a36-8158-d5b806371eff req-2965d251-8f61-438d-ab1f-cb0c876efb0a service nova] Creating event network-changed:eab71317-d387-42d3-b5b9-433db85dd050 for instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d on n-h2-847009-13 Aug 23 10:57:00.723407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:00.728003 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c47c2b5b-8ab9-4a36-8158-d5b806371eff req-2965d251-8f61-438d-ab1f-cb0c876efb0a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071702 Aug 23 10:57:00.729035 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2339/4728] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:00.735837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:00.740298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8f7e3b18e7e4de3aed10f2d50fe5188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c195486d9f42abab699e4d7bd3b99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:00.743345 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58270f17-ee6a-4840-aa10-f0aae9486a10 tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c" status: 200 len: 1363 microversion: 2.47 time: 0.957915 Aug 23 10:57:00.744515 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2390/4729] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:56:59 2022] GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c => generated 1363 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 10:57:01.336521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:01.337956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:01.356663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:01.361593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:01.362721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:01.365004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:01.369502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:01.370204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:01.774185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:01.776070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] [instance: c0d6ec8a-dc84-46b2-8437-04c3c8fb708c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:01.797103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:01.805832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:01.806853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:01.808129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:01.809030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:01.809870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:01.858968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] HTTP exception thrown: Instance c0d6ec8a-dc84-46b2-8437-04c3c8fb708c could not be found. Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Request method failure captured: Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c HTTP/1.1 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLI_kxHUxCiZ6ditZvDuo6eaI1k8-R8XJya7NRiLQRXBZ_rzc3F98Orf6REvbMLiXblW0k_Jtrpjzcai0NhQ5TVGcaePhZZHID-K1PpyQRaNe2HS-MX1Ouim5LYyqa8sPUtPKQNudhF3WBJ91r66W7VqcD6qWO5JPsYmk6vnilOpPKY Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.47 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 90c195486d9f42abab699e4d7bd3b99a Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerShowV247Test-803613111 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/90c195486d9f42abab699e4d7bd3b99a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_90c195486d9f42abab699e4d7bd3b99a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/90c195486d9f42abab699e4d7bd3b99a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/90c195486d9f42abab699e4d7bd3b99a"}]}] Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerShowV247Test-803613111 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 90c195486d9f42abab699e4d7bd3b99a Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerShowV247Test-803613111 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerShowV247Test-803613111-project Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a8f7e3b18e7e4de3aed10f2d50fe5188 Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerShowV247Test-803613111-project Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c0d6ec8a-dc84-46b2-8437-04c3c8fb708c could not be found. Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c0d6ec8a-dc84-46b2-8437-04c3c8fb708c'} Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0d6ec8a-dc84-46b2-8437-04c3c8fb708c could not be found. Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0d6ec8a-dc84-46b2-8437-04c3c8fb708c could not be found. Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:01.861882 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0d6ec8a-dc84-46b2-8437-04c3c8fb708c could not be found. Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] Returning 404 to user: Instance c0d6ec8a-dc84-46b2-8437-04c3c8fb708c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:57:01.867830 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7250d50a-9a97-4856-b500-39d55d57876f tempest-ServerShowV247Test-803613111 tempest-ServerShowV247Test-803613111-project] 10.222.0.78 "GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c" status: 404 len: 111 microversion: 2.47 time: 0.096183 Aug 23 10:57:01.872016 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2391/4730] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 10:57:01 2022] GET /compute/v2.1/servers/c0d6ec8a-dc84-46b2-8437-04c3c8fb708c => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 10:57:01.884193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:01.914537 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16be8029-7e31-4487-a49b-4ee5f55f136e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df" status: 200 len: 1508 microversion: 2.1 time: 0.584752 Aug 23 10:57:01.919508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2340/4731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:01 2022] GET /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:01.967598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:01.968999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:01.990215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:01.994902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:01.995879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:02.003260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:02.006993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:02.007725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:02.125759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: af9adc3a-9ebc-4975-b6bd-a0dad019e4df] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:57:02.406337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7c9cc67-430a-41d0-8cfa-d433ab5e93ab tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df" status: 204 len: 0 microversion: 2.1 time: 0.460538 Aug 23 10:57:02.412259 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2392/4732] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:57:01 2022] DELETE /compute/v2.1/servers/af9adc3a-9ebc-4975-b6bd-a0dad019e4df => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:57:02.417481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:02.417994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:02.428829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:02.429330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:02.429759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:02.430484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:02.430946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:02.431374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:02.535792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 6bc2bd77-1584-4e7c-92ba-1c90df91a236] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:57:02.780719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:02.860446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fb26270-7f26-4cc5-b927-e47c09857b9a tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236" status: 204 len: 0 microversion: 2.1 time: 0.446251 Aug 23 10:57:02.861794 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2341/4733] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:57:02 2022] DELETE /compute/v2.1/servers/6bc2bd77-1584-4e7c-92ba-1c90df91a236 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:57:03.091809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-255224621", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "c172e128-8338-44a9-9fc3-46f547f2eb42"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:03.203732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] validate_networks() for [('c172e128-8338-44a9-9fc3-46f547f2eb42', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:57:04.969392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7145f77a-d62a-4659-8034-8c239c06dadb tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Action: 'create', calling method: .version_select at 0x7fdc9cc44d30>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:05.057710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7145f77a-d62a-4659-8034-8c239c06dadb tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Getting quotas for project 638e9b309a8a49d48d6cdf2bbf34428e. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:05.063941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7145f77a-d62a-4659-8034-8c239c06dadb tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Getting quotas for user af3a16268cec40619294b4a8ba437dd0 and project 638e9b309a8a49d48d6cdf2bbf34428e. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:05.138982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7145f77a-d62a-4659-8034-8c239c06dadb tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Getting quotas for project 638e9b309a8a49d48d6cdf2bbf34428e. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:05.182447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7145f77a-d62a-4659-8034-8c239c06dadb tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Getting quotas for user af3a16268cec40619294b4a8ba437dd0 and project 638e9b309a8a49d48d6cdf2bbf34428e. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:05.217063 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7145f77a-d62a-4659-8034-8c239c06dadb tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.783116 Aug 23 10:57:05.218281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2342/4734] 10.222.0.78 () {62 vars in 1214 bytes} [Tue Aug 23 10:57:04 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 10:57:05.238539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a5c794a-5c4f-4156-a018-23030e4dad46 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:05.276120 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a5c794a-5c4f-4156-a018-23030e4dad46 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.049897 Aug 23 10:57:05.282989 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2343/4735] 10.222.0.78 () {60 vars in 1193 bytes} [Tue Aug 23 10:57:05 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:57:05.304367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f17a8014-0066-4170-b341-8d96bd9251e1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:05.316266 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f17a8014-0066-4170-b341-8d96bd9251e1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370" status: 200 len: 235 microversion: 2.64 time: 0.020270 Aug 23 10:57:05.324550 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2344/4736] 10.222.0.78 () {60 vars in 1304 bytes} [Tue Aug 23 10:57:05 2022] GET /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370 => generated 235 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 10:57:05.330456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73c48d87-a7db-4257-80a6-8353e7c07743 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:05.368361 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73c48d87-a7db-4257-80a6-8353e7c07743 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370" status: 204 len: 0 microversion: 2.64 time: 0.042353 Aug 23 10:57:05.369154 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2345/4737] 10.222.0.78 () {60 vars in 1307 bytes} [Tue Aug 23 10:57:05 2022] DELETE /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 10:57:05.380573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a708d3c-5946-4ed1-bfec-b43ed191c9f1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:05.407216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8a708d3c-5946-4ed1-bfec-b43ed191c9f1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] HTTP exception thrown: Instance group 8543bfa8-7f6f-435b-946e-08011238f370 could not be found. Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a708d3c-5946-4ed1-bfec-b43ed191c9f1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Request method failure captured: Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370 HTTP/1.1 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKAc2zZ174TUJ-NQwmS44YLdxKxV6JUONVZUr1UovpIiloti8dZjsFQ1VbnokN-93yf8JnjYrqCIK6Z91nt4TrgztpfaJG0lP7-AGqyN0iNcnWP8f02seVmQjzLDM1EQLHqTjSve2bsuRqeWSooQBzY-FD6nvFGwAAVJQEnlsBU8zM Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.64 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 638e9b309a8a49d48d6cdf2bbf34428e Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroup264TestJSON-1776864092 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/638e9b309a8a49d48d6cdf2bbf34428e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_638e9b309a8a49d48d6cdf2bbf34428e", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/638e9b309a8a49d48d6cdf2bbf34428e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/638e9b309a8a49d48d6cdf2bbf34428e"}]}] Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroup264TestJSON-1776864092 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 638e9b309a8a49d48d6cdf2bbf34428e Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1776864092 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroup264TestJSON-1776864092-project Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: af3a16268cec40619294b4a8ba437dd0 Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroup264TestJSON-1776864092-project Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance group 8543bfa8-7f6f-435b-946e-08011238f370 could not be found. Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8543bfa8-7f6f-435b-946e-08011238f370'} Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8543bfa8-7f6f-435b-946e-08011238f370 could not be found. Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8543bfa8-7f6f-435b-946e-08011238f370 could not be found. Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:57:05.426109 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8543bfa8-7f6f-435b-946e-08011238f370 could not be found. Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a708d3c-5946-4ed1-bfec-b43ed191c9f1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] Returning 404 to user: Instance group 8543bfa8-7f6f-435b-946e-08011238f370 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a708d3c-5946-4ed1-bfec-b43ed191c9f1 tempest-ServerGroup264TestJSON-1776864092 tempest-ServerGroup264TestJSON-1776864092-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370" status: 404 len: 117 microversion: 2.64 time: 0.053149 Aug 23 10:57:05.429862 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2346/4738] 10.222.0.78 () {60 vars in 1307 bytes} [Tue Aug 23 10:57:05 2022] DELETE /compute/v2.1/os-server-groups/8543bfa8-7f6f-435b-946e-08011238f370 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 10:57:05.657436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:57:05.658536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:57:05.659337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:57:05.660911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:57:05.661571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:57:05.684864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:05.686795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:05.688683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:05.689759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:05.693259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:05.694031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:05.727218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Getting quotas for project a57eb76bfcdc4cd6ae534b11e7659dad. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:05.742365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Getting quotas for user 43edaa7653af4b4ab3fc937a2799eb73 and project a57eb76bfcdc4cd6ae534b11e7659dad. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:05.767989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Going to run 2 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:57:05.771564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:57:05.835785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=3326e53e-4d03-48b7-bd30-4abfd6475475,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:57:05.935988 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-beed1e78-e8a0-4515-bcaa-c7f096b7f4b9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.850798 Aug 23 10:57:05.941578 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2393/4739] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:57:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 2857 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 23 10:57:05.946459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:05.951349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:05.952019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Searching by: {'deleted': False, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 10:57:05.997010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:05.997736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:05.998470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:06.047875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:06.048940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:06.052703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:06.108507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 10:57:06.157335 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b5c94a1-5122-4917-bb0c-0932978d11a4 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.214656 Aug 23 10:57:06.158954 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2347/4740] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 10:57:05 2022] GET /compute/v2.1/servers => generated 1333 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:06.172302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e00e9db-e770-4e19-a8bc-fb2661dd70be tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:06.173195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e00e9db-e770-4e19-a8bc-fb2661dd70be tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:06.556910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e00e9db-e770-4e19-a8bc-fb2661dd70be tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:06.570661 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e00e9db-e770-4e19-a8bc-fb2661dd70be tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1217 microversion: 2.1 time: 0.401592 Aug 23 10:57:06.572324 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2394/4741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:06 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1217 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:07.598608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:07.609748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:07.642228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:07.646582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:07.647253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:07.649757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:07.650363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:07.653431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:07.768967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1f361579-5e31-486b-87bb-f5733490cc1e req-31ad687e-9863-4ab9-b86a-9a9e3a994f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc2bd77-1584-4e7c-92ba-1c90df91a236", "name": "network-vif-deleted", "tag": "a68d0244-bfb9-4534-a19a-0e0cc582e118"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:07.807840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1f361579-5e31-486b-87bb-f5733490cc1e req-31ad687e-9863-4ab9-b86a-9a9e3a994f51 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:07.814262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1f361579-5e31-486b-87bb-f5733490cc1e req-31ad687e-9863-4ab9-b86a-9a9e3a994f51 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:07.814803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1f361579-5e31-486b-87bb-f5733490cc1e req-31ad687e-9863-4ab9-b86a-9a9e3a994f51 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:07.838903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:07.852108 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1f361579-5e31-486b-87bb-f5733490cc1e req-31ad687e-9863-4ab9-b86a-9a9e3a994f51 service nova] Creating event network-vif-deleted:a68d0244-bfb9-4534-a19a-0e0cc582e118 for instance 6bc2bd77-1584-4e7c-92ba-1c90df91a236 on n-h1-847009-13 Aug 23 10:57:07.853275 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8bb7a55c-83c6-49c4-ab2e-ad2961032f8e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1213 microversion: 2.1 time: 0.257789 Aug 23 10:57:07.869614 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2348/4742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:07 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1213 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:07.885601 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1f361579-5e31-486b-87bb-f5733490cc1e req-31ad687e-9863-4ab9-b86a-9a9e3a994f51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121009 Aug 23 10:57:07.888483 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2395/4743] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:57:08.886663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:08.887528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:08.936730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:08.938592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:08.939812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:08.942628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:08.945741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:08.947294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:09.210517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:09.219188 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f263e95-1a74-4507-b4ea-6299f457de83 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1269 microversion: 2.1 time: 0.337169 Aug 23 10:57:09.224633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2349/4744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:08 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1269 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:09.383386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-08c29c78-59bf-420a-8c82-cfd13c50dae4 req-8dccab81-2e4f-4998-9586-8c6174c77737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9adc3a-9ebc-4975-b6bd-a0dad019e4df", "name": "network-vif-deleted", "tag": "6e645850-adf4-405a-ba18-106179cd3b27"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:09.432938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-08c29c78-59bf-420a-8c82-cfd13c50dae4 req-8dccab81-2e4f-4998-9586-8c6174c77737 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:09.433684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-08c29c78-59bf-420a-8c82-cfd13c50dae4 req-8dccab81-2e4f-4998-9586-8c6174c77737 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:09.437110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-08c29c78-59bf-420a-8c82-cfd13c50dae4 req-8dccab81-2e4f-4998-9586-8c6174c77737 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:09.475228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-08c29c78-59bf-420a-8c82-cfd13c50dae4 req-8dccab81-2e4f-4998-9586-8c6174c77737 service nova] Creating event network-vif-deleted:6e645850-adf4-405a-ba18-106179cd3b27 for instance af9adc3a-9ebc-4975-b6bd-a0dad019e4df on n-h1-847009-13 Aug 23 10:57:09.482923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-08c29c78-59bf-420a-8c82-cfd13c50dae4 req-8dccab81-2e4f-4998-9586-8c6174c77737 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104459 Aug 23 10:57:09.499097 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2396/4745] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:10.257211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:10.257967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:10.279863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:10.285560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:10.286282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:10.287078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:10.287555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:10.288383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:10.694878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:10.705910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49e59d30-6abc-4566-861e-6763b1916294 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1275 microversion: 2.1 time: 0.465723 Aug 23 10:57:10.706556 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2350/4746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:10 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1275 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:11.731458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:11.733620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:11.750470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:11.751263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:11.751924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:11.753440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:11.755183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:11.761951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:11.954353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:11.992007 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aaeb7949-428c-4a8e-996b-39b4ec52c30b tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1275 microversion: 2.1 time: 0.267701 Aug 23 10:57:11.992612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2397/4747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:11 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1275 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:13.017209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:13.019528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:13.036952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:13.037594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:13.038160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:13.045133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:13.045773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:13.046325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:13.098754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:14.024463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:14.034536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f253a8c9-7c8b-4a15-994b-46ca7a90983c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 1.021605 Aug 23 10:57:14.044565 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2351/4748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:13 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:15.072977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:15.074753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:15.085883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:15.089285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:15.089896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:15.093086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:15.093678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:15.094075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:15.717401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:16.191098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:16.226194 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a0efa19b-8483-46b9-83c2-2e1070c49d04 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 1.166340 Aug 23 10:57:16.228131 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2398/4749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:15 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:17.252553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:17.253363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:17.267378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:17.268256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:17.270134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:17.270642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:17.271263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:17.275257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:17.289788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:17.290339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:18.008042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:18.017307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b68dff1-d466-4916-bbd8-4b1b28611ae6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.771339 Aug 23 10:57:18.021747 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2352/4750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:17 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:18.052873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-15e49ddb-c96c-44e4-8b7c-330e50149aa3 req-f0f587a0-fb2f-40a1-9dc2-bfafae6dd3e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3326e53e-4d03-48b7-bd30-4abfd6475475", "tag": "959f28c9-d2b2-4542-a6c8-15fd625f0e9b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:18.064055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:18.068576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:18.083648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15e49ddb-c96c-44e4-8b7c-330e50149aa3 req-f0f587a0-fb2f-40a1-9dc2-bfafae6dd3e2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:18.085862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15e49ddb-c96c-44e4-8b7c-330e50149aa3 req-f0f587a0-fb2f-40a1-9dc2-bfafae6dd3e2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:18.090015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15e49ddb-c96c-44e4-8b7c-330e50149aa3 req-f0f587a0-fb2f-40a1-9dc2-bfafae6dd3e2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:18.117078 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-15e49ddb-c96c-44e4-8b7c-330e50149aa3 req-f0f587a0-fb2f-40a1-9dc2-bfafae6dd3e2 service nova] Creating event network-changed:959f28c9-d2b2-4542-a6c8-15fd625f0e9b for instance 3326e53e-4d03-48b7-bd30-4abfd6475475 on n-h2-847009-13 Aug 23 10:57:18.129372 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-15e49ddb-c96c-44e4-8b7c-330e50149aa3 req-f0f587a0-fb2f-40a1-9dc2-bfafae6dd3e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080266 Aug 23 10:57:18.131396 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2399/4751] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:19.042630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:19.043506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:19.063525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:19.066221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:19.067103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:19.070402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:19.076253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:19.077382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:19.704428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:19.712878 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92b88052-0f57-40ad-b54e-a0e02ee309a2 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.674230 Aug 23 10:57:19.717659 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2353/4752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:19 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:20.198035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2203874a-196a-4d47-90d4-bbbdd354aada req-96aaec2e-5b40-412e-b5e9-55715f29a93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4", "tag": "79e94b97-d75a-4571-9591-bec67ec27ab5"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:20.218844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2203874a-196a-4d47-90d4-bbbdd354aada req-96aaec2e-5b40-412e-b5e9-55715f29a93e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:20.219382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2203874a-196a-4d47-90d4-bbbdd354aada req-96aaec2e-5b40-412e-b5e9-55715f29a93e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:20.219781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2203874a-196a-4d47-90d4-bbbdd354aada req-96aaec2e-5b40-412e-b5e9-55715f29a93e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:20.267326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2203874a-196a-4d47-90d4-bbbdd354aada req-96aaec2e-5b40-412e-b5e9-55715f29a93e service nova] Creating event network-changed:79e94b97-d75a-4571-9591-bec67ec27ab5 for instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 on n-h2-847009-13 Aug 23 10:57:20.278704 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2203874a-196a-4d47-90d4-bbbdd354aada req-96aaec2e-5b40-412e-b5e9-55715f29a93e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087391 Aug 23 10:57:20.286828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2400/4753] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:57:20.741232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:20.741916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:20.753257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:20.762574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:20.763215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:20.764062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:20.764691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:20.765222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:21.285338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:21.300717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06fa0200-64bf-4da8-88c1-83a4cac36adf tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.558240 Aug 23 10:57:21.322368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2354/4754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:20 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:22.353666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:22.357713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:22.385936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:22.387294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:22.387752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:22.388701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:22.389203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:22.389819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:22.589508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:22.605112 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a85214e5-7a2c-4164-936b-35efe3a60e92 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.278621 Aug 23 10:57:22.606475 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2401/4755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:22 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:23.639866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:23.641203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:23.651825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:23.655451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:23.656087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:23.657085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:23.657468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:23.657902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:24.335345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:24.346626 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40f168a0-e515-40fc-82bf-46dfc55bb33c tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.710095 Aug 23 10:57:24.350072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2355/4756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:23 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:25.371657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:25.372283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:25.379285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:25.379848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:25.380133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:25.381162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:25.381834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:25.382458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:25.766750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:25.787507 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bbbe3c8d-6295-45b8-a31d-5672456c6eb7 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.422018 Aug 23 10:57:25.789867 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2402/4757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:25 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:26.810995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:26.813470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:26.831161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:26.834504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:26.835181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:26.836284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:26.837075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:26.839491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:27.155288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:27.168485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-415e18cf-b7bc-4a9f-8a25-135c85f6c68e tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.361949 Aug 23 10:57:27.171418 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2356/4758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:26 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:28.195924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:28.196944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:28.217187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:28.217889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:28.218799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:28.223058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:28.227200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:28.228399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:29.066397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:29.081812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0d75d469-4c83-4cbd-8675-f4678d56bba3 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.891114 Aug 23 10:57:29.097575 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2403/4759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:28 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:29.448019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2bd50063-8cf5-43a2-896d-9dc5d4d51c88 req-b1384c74-591c-4473-92c5-59f54dbdcf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3326e53e-4d03-48b7-bd30-4abfd6475475", "name": "network-vif-plugged", "status": "completed", "tag": "959f28c9-d2b2-4542-a6c8-15fd625f0e9b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:29.478845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2bd50063-8cf5-43a2-896d-9dc5d4d51c88 req-b1384c74-591c-4473-92c5-59f54dbdcf44 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:29.481072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2bd50063-8cf5-43a2-896d-9dc5d4d51c88 req-b1384c74-591c-4473-92c5-59f54dbdcf44 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:29.493243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2bd50063-8cf5-43a2-896d-9dc5d4d51c88 req-b1384c74-591c-4473-92c5-59f54dbdcf44 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:29.539822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2bd50063-8cf5-43a2-896d-9dc5d4d51c88 req-b1384c74-591c-4473-92c5-59f54dbdcf44 service nova] Creating event network-vif-plugged:959f28c9-d2b2-4542-a6c8-15fd625f0e9b for instance 3326e53e-4d03-48b7-bd30-4abfd6475475 on n-h2-847009-13 Aug 23 10:57:29.578610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2bd50063-8cf5-43a2-896d-9dc5d4d51c88 req-b1384c74-591c-4473-92c5-59f54dbdcf44 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139022 Aug 23 10:57:29.582826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2357/4760] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:30.100872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:30.102389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:30.115295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:30.115912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:30.119126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:30.119920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:30.120643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:30.121463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:30.766070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:30.769888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:30.788534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:30.810187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:30.823442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c19f8b8d-6046-4063-88f3-dfc67eccdf14 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.724148 Aug 23 10:57:30.824317 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2404/4761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:30 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:30.838412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:30.839139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:30.840696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:30.843220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:30.845458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:30.848173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:31.096383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lazy-loading 'services' on Instance uuid 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:57:31.308249 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ef15def-9f97-4ee4-8840-1e1329a38ebb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments/c25971ff-eeb5-4b36-8c59-cc2387d363d2" status: 202 len: 0 microversion: 2.1 time: 0.531702 Aug 23 10:57:31.309668 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2358/4762] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 10:57:30 2022] DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments/c25971ff-eeb5-4b36-8c59-cc2387d363d2 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:57:31.319345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:31.322198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:31.339147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:31.339918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:31.341359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:31.345008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:31.345856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:31.349989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:31.435980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-557c2cad-83af-414f-a1b9-9154a98d0a8d tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122077 Aug 23 10:57:31.437891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2405/4763] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:31 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:31.690215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cf9013c3-b5c3-414f-a59a-3fc37c457723 req-5e92209d-a8ad-435c-a566-c7e4f350b412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4", "name": "network-vif-plugged", "status": "completed", "tag": "79e94b97-d75a-4571-9591-bec67ec27ab5"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:31.713752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cf9013c3-b5c3-414f-a59a-3fc37c457723 req-5e92209d-a8ad-435c-a566-c7e4f350b412 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:31.714245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cf9013c3-b5c3-414f-a59a-3fc37c457723 req-5e92209d-a8ad-435c-a566-c7e4f350b412 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:31.714684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cf9013c3-b5c3-414f-a59a-3fc37c457723 req-5e92209d-a8ad-435c-a566-c7e4f350b412 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:31.771344 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cf9013c3-b5c3-414f-a59a-3fc37c457723 req-5e92209d-a8ad-435c-a566-c7e4f350b412 service nova] Creating event network-vif-plugged:79e94b97-d75a-4571-9591-bec67ec27ab5 for instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 on n-h2-847009-13 Aug 23 10:57:31.802628 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cf9013c3-b5c3-414f-a59a-3fc37c457723 req-5e92209d-a8ad-435c-a566-c7e4f350b412 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115625 Aug 23 10:57:31.808248 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2359/4764] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:31.850154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:31.850793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:31.876968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:31.877530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:31.877985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:31.878808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:31.879209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:31.901161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:32.450771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:32.453112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:32.477409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:32.480154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:32.480651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:32.481464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:32.483487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:32.484942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:32.602724 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f6cc460-c617-482b-b0f5-41dfbcd16dbf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156220 Aug 23 10:57:32.606234 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2360/4765] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:32 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:33.213796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:33.226144 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43ed808f-9b6a-41ae-bbc2-0ba704d07042 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 1.381113 Aug 23 10:57:33.230362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2406/4766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:31 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:33.620115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:33.623817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:33.656878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:33.661893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:33.664294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:33.666066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:33.668131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:33.668880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:33.783902 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a4d9758-e32c-4cea-a773-d876901b8e58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168409 Aug 23 10:57:33.791382 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2361/4767] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:33 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:34.253692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:34.254368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:34.271044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:34.271540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:34.273398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:34.274200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:34.274683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:34.275121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:34.799624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:34.817067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:34.837009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:34.845239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:34.862145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7f53cb5d-36bb-4ef6-a820-03ff807a75f1 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1317 microversion: 2.1 time: 0.614931 Aug 23 10:57:34.874468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2407/4768] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:34 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:34.889622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:34.890325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:34.895558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:34.896544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:34.897264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:34.897860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:34.971374 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0b14a91-080e-4375-a71d-d50f54bbe880 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175363 Aug 23 10:57:34.980146 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2362/4769] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:34 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:35.551062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Calling method '.version_select at 0x7fdc8ffcd1f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:35.552639 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 10:57:35.552639 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 10:57:35.554397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:35.555670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:35.556445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:35.604343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:35.604877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:35.605336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:35.637456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:35.638031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:35.638486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:35.661827 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47369d86-cebf-44a7-9628-5ab18485c6ca tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1089079293-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.425467 Aug 23 10:57:35.662461 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2408/4770] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 10:57:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:35.910937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:35.912193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:35.961328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:35.966198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:35.967122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:35.968554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:35.974612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:35.976224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:35.993449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:36.001651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:36.027226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:36.028369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:36.029421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:36.030967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:36.032081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:36.034652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:36.153727 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60ca0661-a8aa-471e-9547-efd096d0057c tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171578 Aug 23 10:57:36.158789 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2409/4771] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:35 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:57:36.326943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:36.340092 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc145bef-d0c8-40f4-aa8c-cde6c12103a6 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 200 len: 1506 microversion: 2.1 time: 0.447670 Aug 23 10:57:36.343626 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2363/4772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:35 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 1506 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:36.369233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:36.376523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:36.404707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:36.408594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:36.411405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:36.421024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:36.426565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:36.431651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.118513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:37.136607 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-219b4ccf-fad0-411d-b388-59bbed0e2071 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475" status: 200 len: 1506 microversion: 2.1 time: 0.769609 Aug 23 10:57:37.140230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2410/4773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:36 2022] GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:37.172093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:37.173163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:37.174520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:37.176080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:37.184092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:37.194351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:37.195035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.196015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:37.196701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:37.197274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:37.197784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:37.198126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.208691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.209608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:37.210106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:37.218344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.302551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:57:37.358956 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d967aac5-1f95-46fc-8d9d-44a193d2dd96 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192512 Aug 23 10:57:37.375787 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2364/4774] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:37 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:37.577367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ca87c37-fdac-4a44-94fd-c740e974bb41 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475" status: 204 len: 0 microversion: 2.1 time: 0.407686 Aug 23 10:57:37.583779 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2411/4775] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:57:37 2022] DELETE /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:57:37.590833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:37.591344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:37.617138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:37.617950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:37.623270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.626103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:37.626609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:37.641264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:37.714575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:57:37.955690 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef9d32c7-7942-4e8e-bbb4-ac69640edcc0 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "DELETE /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 204 len: 0 microversion: 2.1 time: 0.368370 Aug 23 10:57:37.956309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2365/4776] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:57:37 2022] DELETE /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:57:37.975031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:37.976915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:38.002387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:38.003523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:38.003976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:38.004703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:38.005198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:38.005630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:38.380591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:38.382952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:38.413237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:38.413761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:38.415041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:38.420803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:38.421807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:38.422419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:38.571431 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80a58ea6-a20f-4677-b237-c572bc5d4be9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195751 Aug 23 10:57:38.580786 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2366/4777] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:38 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:39.950697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:39.954019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:39.976596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:39.985050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:39.987853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:39.988961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:39.991040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:39.992660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:40.055745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:40.086517 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c36e135-3ddd-41d3-aee7-d59a04f979fc tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.503166 Aug 23 10:57:40.087647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2367/4778] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:39 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:40.161012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:40.189080 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1beb5ed4-24f3-4ce1-8093-81fbc6426e25 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475" status: 200 len: 1512 microversion: 2.1 time: 2.213846 Aug 23 10:57:40.192312 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2412/4779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:37 2022] GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 => generated 1512 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:40.255167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-171029867", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:40.367934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:57:41.102196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:41.104502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:41.122642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:41.123158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:41.123611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:41.127894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:41.128763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:41.131138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:41.244400 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5aae6c08-4103-424d-9051-7f861a685fed tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147271 Aug 23 10:57:41.246999 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2413/4780] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:41 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:57:41.264082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:41.268704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:41.288317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:41.288912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:41.292499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:41.293362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:41.294441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:41.294901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:42.772393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:57:42.773582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:57:42.774092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:57:42.774703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:57:42.775109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:57:42.789988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:42.809597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:42.812365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:42.816931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:42.818983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:42.821028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:42.982699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:43.007826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:43.022347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:43.030038 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3aa725eb-4455-440a-830d-6351b314b8e9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475" status: 200 len: 1512 microversion: 2.1 time: 1.776987 Aug 23 10:57:43.030038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2414/4781] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:41 2022] GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 => generated 1512 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:43.115381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:57:43.125684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:57:43.192857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-558913880", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "c66493dd-0126-4d77-a36d-a98fe5ad0c18"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:43.320499 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5fd5f70-8adc-4cf1-9d09-5b6e440d15c3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.231502 Aug 23 10:57:43.323714 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2368/4782] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:57:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:57:43.346357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:43.354417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:43.367741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:43.368261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:43.370901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:43.371879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:43.372366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:43.373733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] validate_networks() for [('c66493dd-0126-4d77-a36d-a98fe5ad0c18', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:57:43.374985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:43.505583 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c5ea908-64d1-48f8-a416-f34669b78df9 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175668 Aug 23 10:57:43.509751 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2369/4783] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:43 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:43.516558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90210daa-351b-4232-a3c9-3f695dc87ef9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:43.528775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90210daa-351b-4232-a3c9-3f695dc87ef9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:43.723076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90210daa-351b-4232-a3c9-3f695dc87ef9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:43.744717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90210daa-351b-4232-a3c9-3f695dc87ef9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1192 microversion: 2.1 time: 0.227430 Aug 23 10:57:43.749074 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2370/4784] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:43 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1192 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:43.956613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cb25fee9-05c0-43be-8676-4361d974b654 req-e1e2c1bd-128f-4765-a3f1-53e96ee04a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3326e53e-4d03-48b7-bd30-4abfd6475475", "name": "network-vif-deleted", "tag": "959f28c9-d2b2-4542-a6c8-15fd625f0e9b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:44.002874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb25fee9-05c0-43be-8676-4361d974b654 req-e1e2c1bd-128f-4765-a3f1-53e96ee04a3f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:44.010462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb25fee9-05c0-43be-8676-4361d974b654 req-e1e2c1bd-128f-4765-a3f1-53e96ee04a3f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:44.012333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb25fee9-05c0-43be-8676-4361d974b654 req-e1e2c1bd-128f-4765-a3f1-53e96ee04a3f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:44.040708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cb25fee9-05c0-43be-8676-4361d974b654 req-e1e2c1bd-128f-4765-a3f1-53e96ee04a3f service nova] Creating event network-vif-deleted:959f28c9-d2b2-4542-a6c8-15fd625f0e9b for instance 3326e53e-4d03-48b7-bd30-4abfd6475475 on n-h2-847009-13 Aug 23 10:57:44.071974 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cb25fee9-05c0-43be-8676-4361d974b654 req-e1e2c1bd-128f-4765-a3f1-53e96ee04a3f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.320228 Aug 23 10:57:44.075779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2371/4785] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:44.096781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:44.097848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:44.110127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:44.111710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:44.113845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:44.115975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:44.116934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:44.117648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:44.262311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:44.263061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:44.264077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:44.285018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lazy-loading 'fault' on Instance uuid 3326e53e-4d03-48b7-bd30-4abfd6475475 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:57:44.435506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43edaa7653af4b4ab3fc937a2799eb73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57eb76bfcdc4cd6ae534b11e7659dad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:44.457181 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ec19a96-6fec-401b-ab77-b94025e32c10 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475" status: 200 len: 1307 microversion: 2.1 time: 0.376493 Aug 23 10:57:44.459128 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2372/4786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:44 2022] GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:44.600211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2061823663", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "3bf8e1b1-33f9-43a0-bfdf-d705d485fd67"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:44.730588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] validate_networks() for [('3bf8e1b1-33f9-43a0-bfdf-d705d485fd67', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:57:45.698501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:57:45.699153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:57:45.699393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:57:45.699991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:57:45.700702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:57:45.723738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:45.724659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:45.725459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:45.726457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:45.727080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:45.727755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:45.776361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:57:45.776875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:57:45.777295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:57:45.777714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:57:45.778216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:57:45.786462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Getting quotas for project bfdf5f7099d848ab998f1458fbe40c08. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:45.794619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:45.795124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:45.795571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:45.796314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:45.799970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Getting quotas for user 1227f4970d7a49f79cd897ed1b936907 and project bfdf5f7099d848ab998f1458fbe40c08. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:45.800842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:45.801381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:45.828406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:57:45.831838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:57:45.848529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Getting quotas for project ba81d0b9941548df84a8183150e57208. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:45.871679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Getting quotas for user cf66fbaf026945bcb050568edb1ecffe and project ba81d0b9941548df84a8183150e57208. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:45.912494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:57:45.915074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:57:45.969096 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04565048-7561-4424-ae1a-9eb5299c2b62 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487089 Aug 23 10:57:45.969818 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2373/4787] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:57:45.994279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2092888237", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "faae728c-9bdc-46ea-bd05-e18939fe1f04"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:46.009168 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b84d982f-d386-44c5-bf92-0d98a7944984 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.978416 Aug 23 10:57:46.018451 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2415/4788] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:57:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:57:46.025630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:46.037154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:46.046507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.047245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.047849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.049148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.049817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.050420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.107908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] validate_networks() for [('faae728c-9bdc-46ea-bd05-e18939fe1f04', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:57:46.131801 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6224f311-1081-4bf1-a5bd-1d28295542ca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112477 Aug 23 10:57:46.133062 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2416/4789] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:46 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:46.138530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-85944e34-2462-4851-9d13-999ab846b4d8 req-400f9dbc-1820-4e60-8f9b-6cd2c19319ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4", "name": "network-vif-unplugged", "status": "completed", "tag": "79e94b97-d75a-4571-9591-bec67ec27ab5"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:46.167236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-85944e34-2462-4851-9d13-999ab846b4d8 req-400f9dbc-1820-4e60-8f9b-6cd2c19319ae service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.169029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-85944e34-2462-4851-9d13-999ab846b4d8 req-400f9dbc-1820-4e60-8f9b-6cd2c19319ae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.172236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-85944e34-2462-4851-9d13-999ab846b4d8 req-400f9dbc-1820-4e60-8f9b-6cd2c19319ae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.198044 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-85944e34-2462-4851-9d13-999ab846b4d8 req-400f9dbc-1820-4e60-8f9b-6cd2c19319ae service nova] Creating event network-vif-unplugged:79e94b97-d75a-4571-9591-bec67ec27ab5 for instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 on n-h2-847009-13 Aug 23 10:57:46.211625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-85944e34-2462-4851-9d13-999ab846b4d8 req-400f9dbc-1820-4e60-8f9b-6cd2c19319ae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077073 Aug 23 10:57:46.217092 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2417/4790] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:46.229788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:46.232901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:46.249832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.254329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.256789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.257755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.258494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.259251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.549050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:46.563863 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3da32e9d-d93b-473d-ac28-957958b70928 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1252 microversion: 2.1 time: 0.343716 Aug 23 10:57:46.568109 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2418/4791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:46 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1252 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:46.588198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:46.590875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 3326e53e-4d03-48b7-bd30-4abfd6475475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:46.608021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.613272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.613793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.614569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:46.615049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:46.615490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:46.653831 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] HTTP exception thrown: Instance 3326e53e-4d03-48b7-bd30-4abfd6475475 could not be found. Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Request method failure captured: Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 HTTP/1.1 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLJfrw3lVRsi_H2GzJ62BjM4zp7Hsz7_TjFnVbTPSDLCDQ3SylDoUjsMjNujRlPYD4ZeQAVADHH3KslFJxfaerbqn6AUdpkBUXEASOdoTpBZX3K34dOIGvu_mNlSVwF9vEf6U-k2i25jnzIrpn0aUzkvCThXPlf7k0PHJ8kdvXxSN7s Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: a57eb76bfcdc4cd6ae534b11e7659dad Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-MultipleCreateTestJSON-565188427 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a57eb76bfcdc4cd6ae534b11e7659dad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a57eb76bfcdc4cd6ae534b11e7659dad", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a57eb76bfcdc4cd6ae534b11e7659dad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a57eb76bfcdc4cd6ae534b11e7659dad"}]}] Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-MultipleCreateTestJSON-565188427 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: a57eb76bfcdc4cd6ae534b11e7659dad Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-MultipleCreateTestJSON-565188427 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-MultipleCreateTestJSON-565188427-project Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 43edaa7653af4b4ab3fc937a2799eb73 Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-MultipleCreateTestJSON-565188427-project Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 3326e53e-4d03-48b7-bd30-4abfd6475475 could not be found. Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '3326e53e-4d03-48b7-bd30-4abfd6475475'} Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3326e53e-4d03-48b7-bd30-4abfd6475475 could not be found. Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3326e53e-4d03-48b7-bd30-4abfd6475475 could not be found. Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:46.656776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3326e53e-4d03-48b7-bd30-4abfd6475475 could not be found. Aug 23 10:57:46.663255 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:46.664935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Returning 404 to user: Instance 3326e53e-4d03-48b7-bd30-4abfd6475475 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:57:46.666006 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28313534-3686-458e-be4c-c04c431845d9 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475" status: 404 len: 111 microversion: 2.1 time: 0.095701 Aug 23 10:57:46.666608 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2419/4792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:46 2022] GET /compute/v2.1/servers/3326e53e-4d03-48b7-bd30-4abfd6475475 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:57:46.714081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5026ac3a-0ec6-47b5-8ca6-00c09dca64d3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:46.714758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5026ac3a-0ec6-47b5-8ca6-00c09dca64d3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:46.889234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5026ac3a-0ec6-47b5-8ca6-00c09dca64d3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:46.901905 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5026ac3a-0ec6-47b5-8ca6-00c09dca64d3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1218 microversion: 2.1 time: 0.228666 Aug 23 10:57:46.902771 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2420/4793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:46 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:46.920125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ae2a1bb-5e33-4c4b-bd14-ae46815f7966 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:46.921245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ae2a1bb-5e33-4c4b-bd14-ae46815f7966 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:47.037916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ae2a1bb-5e33-4c4b-bd14-ae46815f7966 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:47.051464 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ae2a1bb-5e33-4c4b-bd14-ae46815f7966 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1227 microversion: 2.1 time: 0.146281 Aug 23 10:57:47.065764 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2421/4794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:46 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1227 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:47.071185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-be0e08f9-2114-4e4f-81d3-6b6081b50815 req-4d9a48c1-8a34-41a4-82fe-ceb7410290bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4", "name": "network-vif-deleted", "tag": "79e94b97-d75a-4571-9591-bec67ec27ab5"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:47.083465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-be0e08f9-2114-4e4f-81d3-6b6081b50815 req-4d9a48c1-8a34-41a4-82fe-ceb7410290bb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.084160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-be0e08f9-2114-4e4f-81d3-6b6081b50815 req-4d9a48c1-8a34-41a4-82fe-ceb7410290bb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.084782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-be0e08f9-2114-4e4f-81d3-6b6081b50815 req-4d9a48c1-8a34-41a4-82fe-ceb7410290bb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.119552 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-be0e08f9-2114-4e4f-81d3-6b6081b50815 req-4d9a48c1-8a34-41a4-82fe-ceb7410290bb service nova] Creating event network-vif-deleted:79e94b97-d75a-4571-9591-bec67ec27ab5 for instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 on n-h2-847009-13 Aug 23 10:57:47.137597 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-be0e08f9-2114-4e4f-81d3-6b6081b50815 req-4d9a48c1-8a34-41a4-82fe-ceb7410290bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066882 Aug 23 10:57:47.140009 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2422/4795] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:47.147324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:47.148448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] [instance: 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:47.171984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.172480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.172964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.174437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.175093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.175700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.195951 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] HTTP exception thrown: Instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 could not be found. Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Request method failure captured: Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 HTTP/1.1 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLJfrw3lVRsi_H2GzJ62BjM4zp7Hsz7_TjFnVbTPSDLCDQ3SylDoUjsMjNujRlPYD4ZeQAVADHH3KslFJxfaerbqn6AUdpkBUXEASOdoTpBZX3K34dOIGvu_mNlSVwF9vEf6U-k2i25jnzIrpn0aUzkvCThXPlf7k0PHJ8kdvXxSN7s Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: a57eb76bfcdc4cd6ae534b11e7659dad Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-MultipleCreateTestJSON-565188427 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a57eb76bfcdc4cd6ae534b11e7659dad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a57eb76bfcdc4cd6ae534b11e7659dad", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a57eb76bfcdc4cd6ae534b11e7659dad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a57eb76bfcdc4cd6ae534b11e7659dad"}]}] Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-MultipleCreateTestJSON-565188427 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: a57eb76bfcdc4cd6ae534b11e7659dad Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-MultipleCreateTestJSON-565188427 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-MultipleCreateTestJSON-565188427-project Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 43edaa7653af4b4ab3fc937a2799eb73 Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-MultipleCreateTestJSON-565188427-project Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 could not be found. Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4'} Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 could not be found. Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 could not be found. Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:47.206806 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 could not be found. Aug 23 10:57:47.211413 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:47.213022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] Returning 404 to user: Instance 92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:57:47.217164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30b7ca0c-e854-434b-a8c7-6716c4c6c260 tempest-MultipleCreateTestJSON-565188427 tempest-MultipleCreateTestJSON-565188427-project] 10.222.0.78 "GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4" status: 404 len: 111 microversion: 2.1 time: 0.075702 Aug 23 10:57:47.223381 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2423/4796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:47 2022] GET /compute/v2.1/servers/92aab474-7bad-4a3b-be6a-f0fdb5b1b9b4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:57:47.228958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:47.251864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:47.273465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.274165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.274992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.275908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.276535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.277156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.358846 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c204b81c-88b1-41f4-9680-a95d6da60d14 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133855 Aug 23 10:57:47.368822 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2424/4797] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:47 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:47.593057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:47.593805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:47.600983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.601491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.601939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.602649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.603203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.608171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.614518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:47.850242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:57:47.851288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:57:47.851772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:57:47.852180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:57:47.853318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:57:47.877125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.877793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.895226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:47.899260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:47.923066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:47.933463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.001307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:48.010548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b45e6fb-8e6e-44c8-b7e3-6be2ae3acef7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1250 microversion: 2.1 time: 0.420938 Aug 23 10:57:48.025993 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2425/4798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:47 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1250 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:48.027815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Getting quotas for project 50bcfd42fb814f318149a42613b43bc8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:57:48.041608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:48.042644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:48.055747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Getting quotas for user 233bd6d1cf654ddcaca07760de91d51f and project 50bcfd42fb814f318149a42613b43bc8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:57:48.062948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.063748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.065872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.068507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.072149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.073045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.123912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:57:48.130693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:57:48.209842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:48.227517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-404b5c94-23d8-4434-a5b0-f83862efb34c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1222 microversion: 2.1 time: 0.197583 Aug 23 10:57:48.229414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2426/4799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:48 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:48.240338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:48.241411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:48.249727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.250579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.251461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.261018 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03e89514-1024-44f1-b734-9f7c46b7da0b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282917 Aug 23 10:57:48.262188 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2374/4800] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:57:48.275227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-625240c5-5968-4975-9cd0-e2f1e52a9ede tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:48.276043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-625240c5-5968-4975-9cd0-e2f1e52a9ede tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:48.285452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.290342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.291622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.510896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:48.541123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f372fe7-b429-441d-a577-2c293cd16d87 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1279 microversion: 2.1 time: 0.308931 Aug 23 10:57:48.544558 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2427/4801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:48 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1279 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:48.551779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:48.572433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:48.606611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.613305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.617635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.624054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.624846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.625669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.736344 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-742a7d50-ade6-43e4-82bf-0cb6858cf191 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.190151 Aug 23 10:57:48.739740 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2428/4802] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 10:57:48 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d/os-volume_attachments => generated 25 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 10:57:48.884080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-625240c5-5968-4975-9cd0-e2f1e52a9ede tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:48.909537 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-625240c5-5968-4975-9cd0-e2f1e52a9ede tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1219 microversion: 2.1 time: 0.639218 Aug 23 10:57:48.911481 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2375/4803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:48 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1219 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:48.956088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:48.958494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:48.988852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.989849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.992021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:48.995228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:48.995909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:48.998687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.035632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:49.036333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.052778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.053491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.054164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.055021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.057481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.059827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.104909 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Cannot 'reboot' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action HTTP/1.1 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 28 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: {"reboot": {"type": "HARD"}} Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'reboot' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'aaa94ba5-70c5-4ab2-af55-5704a28c7527', 'body': {'reboot': {'type': 'HARD'}}} Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3539, in reboot Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:57:49.114459 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.119886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.126291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 409 to user: Cannot 'reboot' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:57:49.128262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca7a5e36-548d-4726-8658-d8bf03a70185 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action" status: 409 len: 145 microversion: 2.1 time: 0.182874 Aug 23 10:57:49.139153 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2429/4804] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:57:48 2022] POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action => generated 145 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:57:49.149931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:49.158506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.179403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.179951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.181600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.182897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.185519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.186471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.245056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:49.251230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Cannot 'rebuild' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.254157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c7829ed-aa28-4589-afb5-9ae3a3214ea9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1250 microversion: 2.1 time: 0.223948 Aug 23 10:57:49.264997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2376/4805] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:49 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1250 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:49.264997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:49.264997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action HTTP/1.1 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 65 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: exception: Cannot 'rebuild' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'aaa94ba5-70c5-4ab2-af55-5704a28c7527', 'body': {'rebuild': {'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8'}}} Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:57:49.270535 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 409 to user: Cannot 'rebuild' instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 while it is in vm_state rescued {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:57:49.275023 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d8a30fb-6ff1-47da-a937-20a0c5aed83e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action" status: 409 len: 146 microversion: 2.1 time: 0.132924 Aug 23 10:57:49.280158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2430/4806] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:57:49 2022] POST /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527/action => generated 146 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 10:57:49.291479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.291994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.292446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.293000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:49.294215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.294215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.294215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.294450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.310857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.312608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.314745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.315876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.317751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.319038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.384917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:57:49.614718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:49.625092 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd7c60d6-38b3-44dd-8da9-542f1b8a5507 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1270 microversion: 2.1 time: 0.366847 Aug 23 10:57:49.636528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2377/4807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:49 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1270 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:49.649077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:49.649696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.652716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6b694af-ecec-421f-9d66-26cb44373345 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 204 len: 0 microversion: 2.1 time: 0.371255 Aug 23 10:57:49.657742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2431/4808] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:57:49 2022] DELETE /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:57:49.668412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:49.671593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.688630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.689868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.697607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.699888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.700663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.701858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.703093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.703277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.703686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.704056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.704193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.704632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.886875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:49.897170 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ac73c1f-7852-4de4-a8a5-fa93103e70b7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1297 microversion: 2.1 time: 0.257771 Aug 23 10:57:49.912872 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2378/4809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:49 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1297 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:49.936890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:49.937918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:49.951150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.952388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.953099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:49.954085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:49.957526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:49.960376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:50.100557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:50.127216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48c40468-bd4f-44e2-adf7-35b55dc28a00 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1223 microversion: 2.1 time: 0.193511 Aug 23 10:57:50.129047 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2379/4810] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:49 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:50.277191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:50.277815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:50.295363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:50.297031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:50.297827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:50.299991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:50.300706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:50.301437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:50.506433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:50.521926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-982dd6f1-93df-4e6b-9b4b-e197df6c3f30 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1250 microversion: 2.1 time: 0.248389 Aug 23 10:57:50.526962 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2380/4811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:50 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1250 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:50.659579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:50.660475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:50.669336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:50.675810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:50.679692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:50.682892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:50.686203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:50.690996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:50.916616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:50.927307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09ef445b-21a9-45b0-bf7c-d32b66048b3a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1288 microversion: 2.1 time: 0.272748 Aug 23 10:57:50.947943 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2381/4812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:50 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1288 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:50.953459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:50.955624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:50.989384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:50.991636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:50.993420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.007950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.039341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.042465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.175795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:51.197136 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-70ca30dc-0c71-4b45-8a7f-1a465d4357eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1691 microversion: 2.1 time: 1.532675 Aug 23 10:57:51.198828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2432/4813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:49 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1691 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:51.209441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:51.210415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:51.218534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:51.240870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.245279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.255431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.256644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.261288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.262011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.300336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:51.316123 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e05b8451-f1e7-428b-a0aa-f44d4bff8e19 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1285 microversion: 2.1 time: 0.366543 Aug 23 10:57:51.319015 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2382/4814] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:50 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1285 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:51.519001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:51.537887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26c0ca52-3860-49de-8f33-c30c897a571f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1289 microversion: 2.1 time: 0.337445 Aug 23 10:57:51.538762 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2433/4815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:51 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1289 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:51.562363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:51.563622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:51.584920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.586037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.586788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.587864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.588340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.594383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.950265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:51.950898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:51.964003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.966924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.967552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:51.968470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:51.975228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:51.975876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.106684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:52.116275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:52.116620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bb2369f-e478-4b93-9a45-614592e1afc6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.561591 Aug 23 10:57:52.132978 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0abf310c-96ce-4cb8-9a72-8499a48ca370 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1288 microversion: 2.1 time: 0.183046 Aug 23 10:57:52.133946 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2434/4816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:51 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1288 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:52.137513 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2383/4817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:51 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:52.222569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:52.225421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:52.247038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:52.248044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:52.253177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.254584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:52.255464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:52.257408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.342169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:52.343352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:52.356497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:52.357060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:52.357516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.359301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:52.361619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:52.363475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.552339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:52.581640 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0742b14c-72b4-40b8-816c-1a24f9b7403d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1285 microversion: 2.1 time: 0.244071 Aug 23 10:57:52.587720 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2384/4818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:52 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1285 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:52.604136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:52.605962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:52.618883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:52.624568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:52.626441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:52.626766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.629510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:52.630012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:52.631720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:52.793672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:52.802400 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06b2c020-8b6d-46d5-a8e3-bd175b433d06 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1277 microversion: 2.1 time: 0.211195 Aug 23 10:57:52.807192 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2385/4819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:52 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:52.941266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:52.951534 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7f08977a-640f-452e-ac94-1ae850d3ac21 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1691 microversion: 2.1 time: 0.733170 Aug 23 10:57:52.952154 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2435/4820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:52 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1691 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:53.149906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:53.150537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:53.161711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:53.162852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:53.165257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.165761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.166212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.166935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.167402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.179547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.180304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.180986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.181155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.182227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.182883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.184538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.436250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:53.448682 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd7231e9-95b4-4940-99c8-445573971c46 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1288 microversion: 2.1 time: 0.290832 Aug 23 10:57:53.449661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2436/4821] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:53 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1288 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:53.602353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:53.602980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:53.609861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.610827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.611535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.613012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.613732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.614415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.755330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:53.766285 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17b92f12-9091-4a4e-b254-6fd6720969f8 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1285 microversion: 2.1 time: 0.167685 Aug 23 10:57:53.766911 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2437/4822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:53 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:53.829405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:53.830743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:53.837455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.838157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.838867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.839709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.840290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.840895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.945146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:53.956921 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8cc135d-4aae-4f69-a16d-ee48efc1286f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.810811 Aug 23 10:57:53.957931 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2386/4823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:53 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:53.979424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:53.980380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:53.988053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:53.988843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:53.989460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:53.990647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:54.004546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:54.005284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:54.459216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:54.487156 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09377600-83bc-4447-b8e5-8fa46793c526 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1691 microversion: 2.1 time: 0.505130 Aug 23 10:57:54.488029 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2387/4824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:53 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1691 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:54.496183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:54.502531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:54.515018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:54.515520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:54.516197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:54.517094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:54.517575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:54.518014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:54.522713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:54.646457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:54.655407 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a957ee0-a70f-4e3b-9a56-477c007c8c38 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1276 microversion: 2.1 time: 0.162814 Aug 23 10:57:54.669510 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2388/4825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:54 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:54.697160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:54.706386 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59a7814b-8749-4919-834e-0cc9be00fad3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.881614 Aug 23 10:57:54.707650 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2438/4826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:53 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:54.791866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:54.793089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:54.811942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-47c27e61-b2d0-476e-ac42-ed1b1540068b req-1c4c91df-1d62-4829-8143-65092ef5947e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bf100a6-4ed0-4adf-b696-4bbb30cd822d", "tag": "fb3baace-0297-48d1-ab48-ba512112d05e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:54.812818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:54.814277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:54.815132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:54.816195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:54.816964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:54.817663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:54.832898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-47c27e61-b2d0-476e-ac42-ed1b1540068b req-1c4c91df-1d62-4829-8143-65092ef5947e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:54.833392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-47c27e61-b2d0-476e-ac42-ed1b1540068b req-1c4c91df-1d62-4829-8143-65092ef5947e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:54.833835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-47c27e61-b2d0-476e-ac42-ed1b1540068b req-1c4c91df-1d62-4829-8143-65092ef5947e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:54.850457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-47c27e61-b2d0-476e-ac42-ed1b1540068b req-1c4c91df-1d62-4829-8143-65092ef5947e service nova] Creating event network-changed:fb3baace-0297-48d1-ab48-ba512112d05e for instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d on n-h1-847009-13 Aug 23 10:57:54.858217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-47c27e61-b2d0-476e-ac42-ed1b1540068b req-1c4c91df-1d62-4829-8143-65092ef5947e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050587 Aug 23 10:57:54.859878 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2439/4827] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:57:54.931438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:54.942075 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd115744-813e-496a-bb5c-59fb5ecd206b tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1285 microversion: 2.1 time: 0.157443 Aug 23 10:57:54.942717 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2389/4828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:54 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:55.008253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:55.011061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:55.021983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:55.024321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:55.025091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:55.026078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:55.026764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:55.027492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:55.511394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:55.513449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:55.521060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:55.522141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:55.522826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:55.523773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:55.524504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:55.525260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:55.532142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:55.558413 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a390488-16a9-49f0-a34b-622191143a49 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.579319 Aug 23 10:57:55.567183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2440/4829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:54 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:55.679552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:55.680957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:55.697617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:55.699538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:55.706317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:55.710172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:55.710958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:55.711662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:55.738634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:55.818179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:55.977069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:55.990078 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1beed4b9-fb30-4ea6-8a94-8d81cf2aabeb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1691 microversion: 2.1 time: 0.482700 Aug 23 10:57:55.990678 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2390/4830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:55 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1691 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:56.011526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:56.019822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:56.033412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.037783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.038277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.039034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.039516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.042297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.330495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:56.340148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b91d469-63fc-48dd-a8cb-75e17cac6086 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.665021 Aug 23 10:57:56.341042 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2441/4831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:55 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:56.356667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3a08620f-a83a-4e92-9154-25014296817f req-9a5428f4-e818-4de6-96cf-e77757f31c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceff7d60-84b7-4a17-8794-3be4e9f84c02", "tag": "a6f231cc-cd30-48c2-90e2-9e4c40df1d92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:56.381490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3a08620f-a83a-4e92-9154-25014296817f req-9a5428f4-e818-4de6-96cf-e77757f31c6d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.381998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3a08620f-a83a-4e92-9154-25014296817f req-9a5428f4-e818-4de6-96cf-e77757f31c6d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.382450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3a08620f-a83a-4e92-9154-25014296817f req-9a5428f4-e818-4de6-96cf-e77757f31c6d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.419183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3a08620f-a83a-4e92-9154-25014296817f req-9a5428f4-e818-4de6-96cf-e77757f31c6d service nova] Creating event network-changed:a6f231cc-cd30-48c2-90e2-9e4c40df1d92 for instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 on n-h1-847009-13 Aug 23 10:57:56.428438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3a08620f-a83a-4e92-9154-25014296817f req-9a5428f4-e818-4de6-96cf-e77757f31c6d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085043 Aug 23 10:57:56.430350 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2442/4832] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:56.438739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:56.440255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:56.448085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.448925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.449368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.450078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.450536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.453422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.730353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:56.743343 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71676961-3d98-4436-9f56-2d720cc83e38 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.751592 Aug 23 10:57:56.744243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2391/4833] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:55 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:56.749507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:56.750388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:56.757482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.758432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.758888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.759610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:56.760070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:56.760798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:56.891942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:56.900426 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e05ed16-8c56-4c99-8bb6-00bf5eac37fc tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.467518 Aug 23 10:57:56.901526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2443/4834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:56 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:57.011794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:57.012685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:57.020026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.021579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.022207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.023156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.024088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.024635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.053326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:57.137378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:57.148149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c03277c0-af66-4f58-884a-b03ba54931bf tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1623 microversion: 2.1 time: 0.140237 Aug 23 10:57:57.149486 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2444/4835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:57 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1623 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:57.366403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:57.366999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:57.386268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.386984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.387448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.388982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.390166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.390782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.437513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:57.453034 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e27a64f9-6e6d-4e4f-819f-1c7d2065b214 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.707246 Aug 23 10:57:57.453923 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2392/4836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:56 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:57.763381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:57.764033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:57.771659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.772516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.772995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.773716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.774183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.776359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.885535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:57.895544 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9932462-e00f-426c-a064-f1f3babb371b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.536847 Aug 23 10:57:57.897166 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2445/4837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:57 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:57.923778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:57.924547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:57.939772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.940199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.940639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.951514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:57.951805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:57.952249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:57.985486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:58.071541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:58.082306 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ed6efbe-05f2-4346-a79f-2016080b57fd tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.322747 Aug 23 10:57:58.093934 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2393/4838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:57 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:58.106583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9401fd36-b8a8-458d-93e7-ac68d8337730 req-5a84aaa5-27cc-4059-a3d1-323b6e592a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9429a7f-4b5f-41fb-a9be-90ebc82c125c", "tag": "4e227a08-0828-4de5-add2-b3ee20e5191e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:58.129716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9401fd36-b8a8-458d-93e7-ac68d8337730 req-5a84aaa5-27cc-4059-a3d1-323b6e592a69 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.130538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9401fd36-b8a8-458d-93e7-ac68d8337730 req-5a84aaa5-27cc-4059-a3d1-323b6e592a69 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.131228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9401fd36-b8a8-458d-93e7-ac68d8337730 req-5a84aaa5-27cc-4059-a3d1-323b6e592a69 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.147504 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9401fd36-b8a8-458d-93e7-ac68d8337730 req-5a84aaa5-27cc-4059-a3d1-323b6e592a69 service nova] Creating event network-changed:4e227a08-0828-4de5-add2-b3ee20e5191e for instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c on n-h2-847009-13 Aug 23 10:57:58.154731 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9401fd36-b8a8-458d-93e7-ac68d8337730 req-5a84aaa5-27cc-4059-a3d1-323b6e592a69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054347 Aug 23 10:57:58.156920 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2394/4839] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:58.172412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:58.173968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:58.182777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.183334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.183839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.184583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.185736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.187841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.233070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.233757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.234518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.235154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lazy-loading 'fault' on Instance uuid 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:57:58.383059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:58.405908 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ef11c1b-72a7-4769-9d64-c00c86ab55bf tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.487748 Aug 23 10:57:58.425178 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2446/4840] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:57 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:58.477527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:58.478164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:58.507989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.508592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.512618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.518085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.520339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.523031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.616617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:58.624929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2815dcea-e7b9-418e-ab30-d0a81731e3c7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 200 len: 1335 microversion: 2.1 time: 0.456692 Aug 23 10:57:58.642147 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2395/4841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:58 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 1335 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:58.647294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-51e9c88e-e020-470d-9025-0300a25b8aa7 req-80e2b01a-3763-4da5-ace7-c519a0549e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d", "name": "network-vif-deleted", "tag": "eab71317-d387-42d3-b5b9-433db85dd050"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:57:58.660500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-51e9c88e-e020-470d-9025-0300a25b8aa7 req-80e2b01a-3763-4da5-ace7-c519a0549e7a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.661039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-51e9c88e-e020-470d-9025-0300a25b8aa7 req-80e2b01a-3763-4da5-ace7-c519a0549e7a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.661482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-51e9c88e-e020-470d-9025-0300a25b8aa7 req-80e2b01a-3763-4da5-ace7-c519a0549e7a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.673631 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-51e9c88e-e020-470d-9025-0300a25b8aa7 req-80e2b01a-3763-4da5-ace7-c519a0549e7a service nova] Creating event network-vif-deleted:eab71317-d387-42d3-b5b9-433db85dd050 for instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d on n-h2-847009-13 Aug 23 10:57:58.680652 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-51e9c88e-e020-470d-9025-0300a25b8aa7 req-80e2b01a-3763-4da5-ace7-c519a0549e7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036777 Aug 23 10:57:58.681914 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2396/4842] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:57:58.917685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=22 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:57:58.926188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:58.928003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:58.956133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.959949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.960611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:58.961538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:58.962235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:58.963100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:59.480291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:59.495626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:59.504375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a3980a7-e0a8-40f6-92b9-bcd78a541842 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.588721 Aug 23 10:57:59.505266 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2397/4843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:58 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:57:59.511923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:59.513023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:59.521294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:59.521504 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9d0d448b-4c4c-4a6e-be0f-db63e4cda398 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 1.049839 Aug 23 10:57:59.522418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2447/4844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:58 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:59.530660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:59.531510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:57:59.534757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:59.535425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:59.538379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:59.539142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:59.539698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:59.540084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:59.540258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:59.540960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:59.554818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:57:59.556096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:57:59.557829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:57:59.955859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:57:59.980460 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82bd47c6-26e9-452b-8c73-ae7d95a8074c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.472027 Aug 23 10:57:59.981628 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2398/4845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:59 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:57:59.996670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:57:59.997796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:00.007971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.009101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.010534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.011509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.012147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.013250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.036910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:00.050367 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d could not be found. Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d HTTP/1.1 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d could not be found. Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d'} Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d could not be found. Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d could not be found. Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:00.052298 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d could not be found. Aug 23 10:58:00.056578 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:00.057397 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae3b1eca-6d3a-487f-9827-4b0f69f123aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.532494 Aug 23 10:58:00.059531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 404 to user: Instance 0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:00.060724 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c75cea2-e346-4ec7-b1fd-6d5c9fbe5fca tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d" status: 404 len: 111 microversion: 2.1 time: 0.077970 Aug 23 10:58:00.065977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2399/4846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:59 2022] GET /compute/v2.1/servers/0d74c6d9-52bf-4cdd-b5fa-c5b52ff7742d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:00.066765 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2448/4847] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:57:59 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:00.091349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83da826d-2628-4883-b4df-c15b15a5f619 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '.version_select at 0x7fdc8fc9c3a0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:00.124070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83da826d-2628-4883-b4df-c15b15a5f619 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-804367118" status: 202 len: 0 microversion: 2.1 time: 0.036230 Aug 23 10:58:00.128789 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2400/4848] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:58:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-804367118 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:58:00.181594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-88747492-ba49-41fc-b30c-1370f5a0dcbd req-8fff2c07-b572-4c8b-80b2-ec03ea7d6033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bd86f97-9229-48da-a3cd-9475d158b762", "tag": "274327e6-6f78-4d54-bc48-9bb53291c963"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:00.203513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-88747492-ba49-41fc-b30c-1370f5a0dcbd req-8fff2c07-b572-4c8b-80b2-ec03ea7d6033 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.203999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-88747492-ba49-41fc-b30c-1370f5a0dcbd req-8fff2c07-b572-4c8b-80b2-ec03ea7d6033 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.204685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-88747492-ba49-41fc-b30c-1370f5a0dcbd req-8fff2c07-b572-4c8b-80b2-ec03ea7d6033 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.232149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-88747492-ba49-41fc-b30c-1370f5a0dcbd req-8fff2c07-b572-4c8b-80b2-ec03ea7d6033 service nova] Creating event network-changed:274327e6-6f78-4d54-bc48-9bb53291c963 for instance 1bd86f97-9229-48da-a3cd-9475d158b762 on n-h2-847009-13 Aug 23 10:58:00.245024 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-88747492-ba49-41fc-b30c-1370f5a0dcbd req-8fff2c07-b572-4c8b-80b2-ec03ea7d6033 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068999 Aug 23 10:58:00.245682 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2449/4849] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:00.529248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:00.529977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:00.547472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:00.548788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:00.573200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.575857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.576441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.577344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.579122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.580780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.586577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.586825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.589346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.590189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:00.595633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:00.595633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:00.785819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:00.796519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e0cc76d3-bd6c-4940-81de-7bc11b4d9bd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.254358 Aug 23 10:58:00.798738 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2450/4850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:00 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:00.903675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:00.925303 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8fa034b-a03c-4771-8a68-241d7db38b44 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.402156 Aug 23 10:58:00.925873 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2401/4851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:00 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:01.003207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:01.004434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:01.011678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.012759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.013342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.014274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.014931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.015571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.091300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:01.092635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:01.114404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.115759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.116664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.119819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.120483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.121498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.219285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:01.231852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73c4bfb4-a4c7-43fa-9a61-c3a420333324 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.232258 Aug 23 10:58:01.233051 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2451/4852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:00 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:01.582198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:01.593260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1175443d-47c7-4edb-881d-c3008f0bb4ab tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.506918 Aug 23 10:58:01.609150 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2402/4853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:01 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:01.823970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:01.825735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:01.835307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.836539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.837413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.838594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.839729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.840791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.947790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:01.948702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:01.966909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.969454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.972342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:01.973449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:01.975284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:01.976076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:02.085781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:02.097054 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46a7230a-191b-48fc-aa8b-13150636f41b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.278537 Aug 23 10:58:02.098071 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2452/4854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:01 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:02.215435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:02.224470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0679abec-70c1-43e4-9f6d-6b1d332a2c6b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.280708 Aug 23 10:58:02.225660 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2403/4855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:01 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:02.258067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:02.262544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:02.277033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:02.279008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:02.279644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:02.280601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:02.282047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:02.283602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:02.643612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:02.664871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:02.665739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:02.675542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-972feba0-c1f0-4ab9-8d17-4d56c487bba9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.421828 Aug 23 10:58:02.681889 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2453/4856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:02 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:02.726231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:02.744579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:02.745542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:02.751253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:02.755518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:02.761348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.118635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:03.119888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:03.128298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.137931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.139765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.148991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.151476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.156938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.307026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:03.319491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-169a08a5-ab3d-48cd-8bc0-4d18f18bac2d tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.697224 Aug 23 10:58:03.320387 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2404/4857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:02 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:03.553147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:03.563239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-62718d49-39a4-42f7-93cb-66502b6bc32a req-c1f03bd7-41fe-424f-b44d-58ab3ac29ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf100a6-4ed0-4adf-b696-4bbb30cd822d", "name": "network-vif-plugged", "status": "completed", "tag": "fb3baace-0297-48d1-ab48-ba512112d05e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:03.565805 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14cfa446-536d-4128-b17e-4d361a5116aa tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.451237 Aug 23 10:58:03.567716 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2454/4858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:03 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:03.577049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-62718d49-39a4-42f7-93cb-66502b6bc32a req-c1f03bd7-41fe-424f-b44d-58ab3ac29ada service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.577777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-62718d49-39a4-42f7-93cb-66502b6bc32a req-c1f03bd7-41fe-424f-b44d-58ab3ac29ada service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.578994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-62718d49-39a4-42f7-93cb-66502b6bc32a req-c1f03bd7-41fe-424f-b44d-58ab3ac29ada service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.588286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:03.589016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:03.596623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.597549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.598445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.599585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.600334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.601013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.601249 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-62718d49-39a4-42f7-93cb-66502b6bc32a req-c1f03bd7-41fe-424f-b44d-58ab3ac29ada service nova] Creating event network-vif-plugged:fb3baace-0297-48d1-ab48-ba512112d05e for instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d on n-h1-847009-13 Aug 23 10:58:03.609090 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-62718d49-39a4-42f7-93cb-66502b6bc32a req-c1f03bd7-41fe-424f-b44d-58ab3ac29ada service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285858 Aug 23 10:58:03.610047 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2405/4859] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:03.722787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:03.723789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:03.736271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.739860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.740082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.742248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:03.744337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:03.745315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:03.918441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:03.928386 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2fd90171-38b9-4878-916e-c260a0ae334c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.357750 Aug 23 10:58:03.931271 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2455/4860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:03 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:04.168262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:04.181582 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38d5e13a-ddad-4ef3-beaa-681370abac6f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.463093 Aug 23 10:58:04.184288 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2406/4861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:03 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:04.345764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:04.347334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:04.366160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:04.368086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:04.370120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:04.373231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:04.373838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:04.374392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:04.543607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:04.554813 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d41c80ab-19ca-4c8f-b4c5-ffaa95ef71d5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.214957 Aug 23 10:58:04.555832 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2456/4862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:04 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:04.592167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:04.593404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:04.603704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:04.604575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:04.605385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:04.606330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:04.606983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:04.607605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:04.929605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:04.941668 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8530978d-aff4-45c5-a475-35e0cd2e7085 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1292 microversion: 2.1 time: 0.358038 Aug 23 10:58:04.943484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2407/4863] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:04 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:04.958968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:04.959597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:04.968397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:04.968916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:04.969529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:04.971673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:04.972198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:04.972714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:05.206219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:05.208279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:05.224204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:05.225046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:05.227942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:05.229158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:05.232666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:05.234344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:05.245881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:05.360014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:05.383991 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e31a6189-83f9-4ade-8126-8c973b8da5f8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.434757 Aug 23 10:58:05.389720 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2457/4864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:04 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:05.576277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:05.577149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:05.605620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:05.606388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:05.607085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:05.614340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:05.615133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:05.615685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:05.632409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:05.651454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24134880-86ca-4327-96f6-0ae00d1cc7a3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.452457 Aug 23 10:58:05.679013 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2408/4865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:05 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:05.992879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:05.994192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:06.021618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:06.021821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:06.022140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:06.022591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:06.023319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:06.026870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:06.029042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:06.030357 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0e9297f-3630-428f-b010-a6780c3339fa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.458428 Aug 23 10:58:06.037688 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2458/4866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:05 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:06.414174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:06.414884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:06.430400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:06.434711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:06.435207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:06.435971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:06.436463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:06.436929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:06.535735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:07.089688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:07.107082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-55ba9df5-3e33-4819-98ec-07cfebbae1d8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.699431 Aug 23 10:58:07.110455 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2459/4867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:06 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:07.129198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:07.142513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:07.153861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:07.158027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:07.161023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:07.164410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:07.166066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:07.167715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:07.241272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:07.256477 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56d5cd3f-2a2b-4c77-abfc-a47b88051708 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1473 microversion: 2.1 time: 1.278459 Aug 23 10:58:07.272915 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2409/4868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:05 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1473 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:07.272915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:07.273335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:07.299058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:07.300231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:07.301642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:07.302551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:07.304153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:07.307298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:07.528968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:07.544345 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0df204fb-5583-4cff-a91f-da281f062683 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.426072 Aug 23 10:58:07.545443 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2460/4869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:07 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:07.556970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-55c6e683-bfe2-476d-99f5-274f990cbeb7 req-8c8d7295-836f-404c-bf17-14ef1944abf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd86f97-9229-48da-a3cd-9475d158b762", "name": "network-vif-plugged", "status": "completed", "tag": "274327e6-6f78-4d54-bc48-9bb53291c963"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:07.583014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-55c6e683-bfe2-476d-99f5-274f990cbeb7 req-8c8d7295-836f-404c-bf17-14ef1944abf8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:07.583761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-55c6e683-bfe2-476d-99f5-274f990cbeb7 req-8c8d7295-836f-404c-bf17-14ef1944abf8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:07.588139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-55c6e683-bfe2-476d-99f5-274f990cbeb7 req-8c8d7295-836f-404c-bf17-14ef1944abf8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:07.627779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:07.641013 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c518c6d-5c32-42db-b9fe-e9d068775617 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.376558 Aug 23 10:58:07.642792 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2410/4870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:07 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:07.645705 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-55c6e683-bfe2-476d-99f5-274f990cbeb7 req-8c8d7295-836f-404c-bf17-14ef1944abf8 service nova] Creating event network-vif-plugged:274327e6-6f78-4d54-bc48-9bb53291c963 for instance 1bd86f97-9229-48da-a3cd-9475d158b762 on n-h2-847009-13 Aug 23 10:58:07.649366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-457075952", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:07.661812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-55c6e683-bfe2-476d-99f5-274f990cbeb7 req-8c8d7295-836f-404c-bf17-14ef1944abf8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112981 Aug 23 10:58:07.664051 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2461/4871] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:07.750693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:58:08.142593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:08.144639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:08.177245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:08.178713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:08.184769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:08.185729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:08.187938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:08.190390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:08.566850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:08.574730 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1ddc5e0-983f-4b9f-8e94-7ef0c8eb67af tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.446646 Aug 23 10:58:08.575315 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2462/4872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:08 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:08.585551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:08.593231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:08.603408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:08.606470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:08.608259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:08.609433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:08.610150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:08.613371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:08.965919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:08.969687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:58:08.970946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:58:08.971775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:58:08.972340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:58:08.973120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:58:08.991315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:08.991513 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d115071f-ac3b-4b4a-9aff-3272491c6fa5 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.409899 Aug 23 10:58:08.992082 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2463/4873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:08 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:09.007743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:09.008217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:09.014798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:09.015797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:09.017954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:09.019305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:09.019951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:09.050703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:09.051218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:09.051663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:09.052390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:09.052929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:09.053881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:09.073391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:09.088660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:09.121138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:58:09.128976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:58:09.225605 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1da953f3-1714-4053-bd58-3ec619e27818 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.581042 Aug 23 10:58:09.238978 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2411/4874] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:58:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:58:09.245205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7b2b899-3a96-49a1-8cea-2988ffc5068f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:09.247951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7b2b899-3a96-49a1-8cea-2988ffc5068f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:09.294566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7b2b899-3a96-49a1-8cea-2988ffc5068f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:09.547233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:09.556798 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa00e1b6-c06b-4d3f-a854-6017169126f2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.561372 Aug 23 10:58:09.576142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2464/4875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:08 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:09.599811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:09.601157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:09.611084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:09.611915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:09.612903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:09.616523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7b2b899-3a96-49a1-8cea-2988ffc5068f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5" status: 204 len: 0 microversion: 2.1 time: 0.376143 Aug 23 10:58:09.617407 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2412/4876] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:09 2022] DELETE /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:09.618721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:09.620026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:09.627970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:09.629445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f98467ea-e4d3-4b3b-9225-b88de5c031a6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:09.630320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f98467ea-e4d3-4b3b-9225-b88de5c031a6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:09.685255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f98467ea-e4d3-4b3b-9225-b88de5c031a6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f98467ea-e4d3-4b3b-9225-b88de5c031a6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 HTTP/1.1 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0f5b5d3a-c79d-404c-8f19-1bf42b1959c5'} Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2919, in _get_instance Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2931, in _get_instance Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:09.697384 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 10:58:09.703082 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:09.709671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f98467ea-e4d3-4b3b-9225-b88de5c031a6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:09.711282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f98467ea-e4d3-4b3b-9225-b88de5c031a6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5" status: 404 len: 111 microversion: 2.1 time: 0.089582 Aug 23 10:58:09.712069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2413/4877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:09 2022] GET /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:58:09.839892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-775065585", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:09.937513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:58:10.173967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:10.190719 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8983df79-b0e2-4543-8642-1d8961ac3adb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1318 microversion: 2.1 time: 0.595369 Aug 23 10:58:10.192056 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2465/4878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:09 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:10.208975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-777f9c9a-3fbd-4822-b8c5-fba6c667007f req-431671dd-ba25-445a-af68-d967b0785b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceff7d60-84b7-4a17-8794-3be4e9f84c02", "name": "network-vif-plugged", "status": "completed", "tag": "a6f231cc-cd30-48c2-90e2-9e4c40df1d92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:10.232163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-777f9c9a-3fbd-4822-b8c5-fba6c667007f req-431671dd-ba25-445a-af68-d967b0785b30 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:10.232971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-777f9c9a-3fbd-4822-b8c5-fba6c667007f req-431671dd-ba25-445a-af68-d967b0785b30 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:10.233634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-777f9c9a-3fbd-4822-b8c5-fba6c667007f req-431671dd-ba25-445a-af68-d967b0785b30 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:10.260656 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-777f9c9a-3fbd-4822-b8c5-fba6c667007f req-431671dd-ba25-445a-af68-d967b0785b30 service nova] Creating event network-vif-plugged:a6f231cc-cd30-48c2-90e2-9e4c40df1d92 for instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 on n-h1-847009-13 Aug 23 10:58:10.278172 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-777f9c9a-3fbd-4822-b8c5-fba6c667007f req-431671dd-ba25-445a-af68-d967b0785b30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084145 Aug 23 10:58:10.285239 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2466/4879] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:10.292450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:10.297287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:10.315407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:10.330655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:10.337705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:10.338874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:10.340003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:10.340675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:10.977379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:10.987502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:58:10.987974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:58:10.988414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:58:10.988897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:58:10.989340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:58:10.994244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5249cbc-ceed-4447-8f54-f0585afa14e8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.701966 Aug 23 10:58:11.007787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2467/4880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:10 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:11.012150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:11.012801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:11.012976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.015442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.016064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.017561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.019927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.022345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.029692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.030199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.031157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.031911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.032397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.033200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.060980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:11.064227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:11.069181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:11.112642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:58:11.115488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:58:11.203067 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93a29399-f96f-4de6-a805-82941433d33b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368284 Aug 23 10:58:11.205589 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2414/4881] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 10:58:11.212528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:11.213424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:11.220970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.221915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.222581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.223672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.224371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.225071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.259031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:11.390234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfd24b27-1799-4695-95d8-1d9b24126aa7 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 204 len: 0 microversion: 2.1 time: 0.182864 Aug 23 10:58:11.391211 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2415/4882] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:11 2022] DELETE /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:11.402789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:11.404918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:11.415539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.416657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.417243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.417985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:11.418513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:11.418996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:11.861981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:11.871060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d45c96d-66df-4023-bbb1-d1350ab128d7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1508 microversion: 2.1 time: 0.477894 Aug 23 10:58:11.874904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2416/4883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:11 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:11.889328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56fbcfff-7ef4-411f-ac99-4fccf920dfa6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:11.892084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56fbcfff-7ef4-411f-ac99-4fccf920dfa6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:12.053014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56fbcfff-7ef4-411f-ac99-4fccf920dfa6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:12.064045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:12.077001 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56fbcfff-7ef4-411f-ac99-4fccf920dfa6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1220 microversion: 2.1 time: 0.200994 Aug 23 10:58:12.081608 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c678fc61-c651-4e42-af23-73ebc4b03159 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 1.085163 Aug 23 10:58:12.082734 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2417/4884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:11 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1220 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:12.086012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2468/4885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:10 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:12.104551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:12.106138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:12.107679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:12.110824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:12.126639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.147195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.147484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.147811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.148542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.152188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.152653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.155519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.156024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.170154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.177357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.181995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.453373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:12.475856 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1aae9d9d-c6c9-4b18-921c-342fc5dcad56 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1507 microversion: 2.1 time: 0.391593 Aug 23 10:58:12.477352 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2418/4886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:12 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1507 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:12.482795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:12.483764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:12.502724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.503473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.509314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.511058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.511747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.512555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.717589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:12.719412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:12.730576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2dea2e6-745d-4588-940a-91e77471c3df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1319 microversion: 2.1 time: 0.251779 Aug 23 10:58:12.745751 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d96e605f-c45d-4ca1-bb4c-b8a9d1374079 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1508 microversion: 2.1 time: 0.655482 Aug 23 10:58:12.747163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2469/4887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:12 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1508 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:12.750446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2419/4888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:12 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:12.752514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c962ec06-9380-4011-b6c2-dae9bf79ca61 req-ca619a7a-5b57-432c-bd04-9bc54f53e28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9429a7f-4b5f-41fb-a9be-90ebc82c125c", "name": "network-vif-plugged", "status": "completed", "tag": "4e227a08-0828-4de5-add2-b3ee20e5191e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:12.789496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c962ec06-9380-4011-b6c2-dae9bf79ca61 req-ca619a7a-5b57-432c-bd04-9bc54f53e28b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.789995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c962ec06-9380-4011-b6c2-dae9bf79ca61 req-ca619a7a-5b57-432c-bd04-9bc54f53e28b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.790445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c962ec06-9380-4011-b6c2-dae9bf79ca61 req-ca619a7a-5b57-432c-bd04-9bc54f53e28b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.826181 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c962ec06-9380-4011-b6c2-dae9bf79ca61 req-ca619a7a-5b57-432c-bd04-9bc54f53e28b service nova] Creating event network-vif-plugged:4e227a08-0828-4de5-add2-b3ee20e5191e for instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c on n-h2-847009-13 Aug 23 10:58:12.833677 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c962ec06-9380-4011-b6c2-dae9bf79ca61 req-ca619a7a-5b57-432c-bd04-9bc54f53e28b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084777 Aug 23 10:58:12.838971 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2470/4889] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:12.847452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:12.852018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:12.860872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.861605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.862917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.863964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:12.864760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:12.866568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:12.989508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e8a47ada-13fe-4e66-b652-c940a6b6223e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Action: 'create', calling method: .version_select at 0x7fdc9c0c8a60>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-866375435", "policies": ["affinity"]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:13.099430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e8a47ada-13fe-4e66-b652-c940a6b6223e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:13.107347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:58:13.107811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:58:13.111439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:58:13.111979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:58:13.112859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:58:13.120453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e8a47ada-13fe-4e66-b652-c940a6b6223e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:13.228215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e8a47ada-13fe-4e66-b652-c940a6b6223e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:13.235792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e8a47ada-13fe-4e66-b652-c940a6b6223e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:13.258598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:13.271115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.274014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.275291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.276923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.279260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e8a47ada-13fe-4e66-b652-c940a6b6223e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.525331 Aug 23 10:58:13.279765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.280466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.284683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2420/4890] 10.222.0.78 () {60 vars in 1174 bytes} [Tue Aug 23 10:58:12 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:13.300120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:13.301105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:13.320029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.320821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.322236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.325418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.327101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.327680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.348947 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e50846d-2df3-4dac-8f0a-1884cc47000f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "POST /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762/action" status: 202 len: 1110 microversion: 2.1 time: 0.508318 Aug 23 10:58:13.351032 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2471/4891] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:58:12 2022] POST /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762/action => generated 1110 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 10:58:13.363049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:13.367843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:13.383816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.388635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.389338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.390271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.391646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.392285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.394106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:13.675497 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0823193e-da99-4617-a14e-d73715d0a7be tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "DELETE /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 204 len: 0 microversion: 2.1 time: 0.386230 Aug 23 10:58:13.677117 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2421/4892] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:13 2022] DELETE /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:13.695212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:13.698209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:13.715611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.717612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.718683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.722105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:13.722884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:13.725132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:13.870767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:13.885209 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bd552ae-cd8b-4df3-94d2-b10638c8abd9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1280 microversion: 2.1 time: 0.204509 Aug 23 10:58:13.896801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2422/4893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:13 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:13.902569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6267eb95-a971-4230-a431-b307992c2019 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Action: 'create', calling method: .version_select at 0x7fdc8fc65280>, body: {"server_group": {"name": "tempest-server-group-52183572", "policies": ["affinity"]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:13.956875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-6267eb95-a971-4230-a431-b307992c2019 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:13.968093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-6267eb95-a971-4230-a431-b307992c2019 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:14.083160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:14.093784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-6267eb95-a971-4230-a431-b307992c2019 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:14.098765 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44164c73-319d-4776-9f4e-d36153ce3d09 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1327 microversion: 2.1 time: 0.740275 Aug 23 10:58:14.100073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2472/4894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:13 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1327 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:14.107699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:14.109498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:14.122328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-6267eb95-a971-4230-a431-b307992c2019 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:14.137059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.137944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.139291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.140289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.141664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.142353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.162754 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6267eb95-a971-4230-a431-b307992c2019 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.272411 Aug 23 10:58:14.163658 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2423/4895] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Aug 23 10:58:13 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:14.169704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:14.170453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:14.178259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.178863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.179382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.180179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.180717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.181667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.544157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:14.561725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17353faa-e20e-4a9b-8e7b-4a8694d4edab tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.460247 Aug 23 10:58:14.597710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2473/4896] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:14 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:14.615185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:14.618440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:14.639889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.640650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.646656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.649635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.657855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.658805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.917638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:14.928234 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e79759a1-77cc-4996-9331-a8f1dc7401ea tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1663 microversion: 2.1 time: 0.328943 Aug 23 10:58:14.930726 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2474/4897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:14 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:14.937355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:14.937978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:14.949867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.950649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.951267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:14.952157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:14.952822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:14.953439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.194476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:15.202924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-917a4416-34da-454c-a7d4-5836ef033815 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 200 len: 1507 microversion: 2.1 time: 1.038248 Aug 23 10:58:15.216769 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2424/4898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:14 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 1507 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:15.216769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-151bff6b-e30c-46a3-b3b3-fb14df8516f4 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Action: 'create', calling method: .version_select at 0x7fdc9c09ae50>, body: {"server_group": {"name": "tempest-server-group-52183572", "policies": ["affinity"]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:15.275630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-151bff6b-e30c-46a3-b3b3-fb14df8516f4 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:15.286172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-151bff6b-e30c-46a3-b3b3-fb14df8516f4 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:15.289704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:15.355056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:15.363198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-151bff6b-e30c-46a3-b3b3-fb14df8516f4 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:15.367687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5fd06ded-b8de-4b5b-a36f-844a1896bf60 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1508 microversion: 2.1 time: 0.434927 Aug 23 10:58:15.368299 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2475/4899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:14 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:15.383203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2d31b215-4236-4249-8664-901c5d65c9b7 req-0eb88a1f-063f-471b-9c27-2cac8c44e5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa94ba5-70c5-4ab2-af55-5704a28c7527", "name": "network-vif-deleted", "tag": "eac5f959-8938-4b8f-b84f-3963d2b9c619"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:15.392338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-151bff6b-e30c-46a3-b3b3-fb14df8516f4 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:15.425809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-151bff6b-e30c-46a3-b3b3-fb14df8516f4 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.220902 Aug 23 10:58:15.426829 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2425/4900] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Aug 23 10:58:15 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:15.444118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:15.444776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:15.453581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2d31b215-4236-4249-8664-901c5d65c9b7 req-0eb88a1f-063f-471b-9c27-2cac8c44e5b9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.457313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2d31b215-4236-4249-8664-901c5d65c9b7 req-0eb88a1f-063f-471b-9c27-2cac8c44e5b9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.457781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2d31b215-4236-4249-8664-901c5d65c9b7 req-0eb88a1f-063f-471b-9c27-2cac8c44e5b9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.460261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.460783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.461234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.464427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.466667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.466988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.482873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:15.533391 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2d31b215-4236-4249-8664-901c5d65c9b7 req-0eb88a1f-063f-471b-9c27-2cac8c44e5b9 service nova] Creating event network-vif-deleted:eac5f959-8938-4b8f-b84f-3963d2b9c619 for instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 on n-h2-847009-13 Aug 23 10:58:15.540313 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2d31b215-4236-4249-8664-901c5d65c9b7 req-0eb88a1f-063f-471b-9c27-2cac8c44e5b9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170757 Aug 23 10:58:15.541287 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2476/4901] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:15.546818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:15.549587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:15.563585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.564422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.565306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.566211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.567372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.568014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.675814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:15.686996 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9d4131b-7c44-48a2-9eae-a786e79ff995 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1278 microversion: 2.1 time: 0.259031 Aug 23 10:58:15.696785 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2426/4902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:15 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:15.696785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-137a3f86-4419-498d-9b88-a68a199e32b0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:15.729882 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-137a3f86-4419-498d-9b88-a68a199e32b0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/b54931ff-ec0d-4837-b07d-4b994909c017" status: 204 len: 0 microversion: 2.1 time: 0.039971 Aug 23 10:58:15.734456 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2427/4903] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:15 2022] DELETE /compute/v2.1/os-server-groups/b54931ff-ec0d-4837-b07d-4b994909c017 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:15.748502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:15.749604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:15.757949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.758485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.759123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.760035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.760511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.760984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.887736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:15.902730 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f12d0537-411e-476b-8f7c-940e959d31f9 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1526 microversion: 2.1 time: 0.360008 Aug 23 10:58:15.905353 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2477/4904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:15 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1526 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:15.918351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2eada36-7cd2-489d-8741-1ee1c7d3b348 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:15.958921 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2eada36-7cd2-489d-8741-1ee1c7d3b348 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.053781 Aug 23 10:58:15.959646 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2478/4905] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:58:15 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:15.966821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:15.968015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:15.978514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.979769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.980296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:15.981737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:15.982424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:15.982981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:16.317563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:16.329791 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5956237-1340-4058-931b-a8e24ffa86e6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.592607 Aug 23 10:58:16.330820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2428/4906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:15 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:16.337743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:16.338624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:16.387115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:16.388697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:16.390578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:16.391711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:16.392421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:16.393368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:16.505433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:16.536419 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-132fe482-b103-4eed-94c5-d1d0f3e399b2 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1526 microversion: 2.1 time: 0.572019 Aug 23 10:58:16.539650 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2479/4907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:15 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1526 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:16.569096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56095577-dffb-4be3-b2be-5f2c24f3f5c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:16.622407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:16.679268 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-56095577-dffb-4be3-b2be-5f2c24f3f5c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 10:58:16.932256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:16.940228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:16.949522 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a04e2c7e-8701-4061-8873-1c3a2d579a1f tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1663 microversion: 2.1 time: 0.617307 Aug 23 10:58:16.960810 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2429/4908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:16 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1663 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:16.975970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:16.978439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: aaa94ba5-70c5-4ab2-af55-5704a28c7527] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:16.997812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:16.999355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.005290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.006216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.006707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.015092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.057121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 could not be found. Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 HTTP/1.1 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 could not be found. Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'aaa94ba5-70c5-4ab2-af55-5704a28c7527'} Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 could not be found. Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 could not be found. Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.060710 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 could not be found. Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 404 to user: Instance aaa94ba5-70c5-4ab2-af55-5704a28c7527 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:17.066023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80e27182-7709-4340-8d7e-7e9b15b3ea28 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527" status: 404 len: 111 microversion: 2.1 time: 0.106990 Aug 23 10:58:17.066698 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2430/4909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:16 2022] GET /compute/v2.1/servers/aaa94ba5-70c5-4ab2-af55-5704a28c7527 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:17.218810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:17.219910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:17.229882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.230812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.231512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.232839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.233994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.234627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.259392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] HTTP exception thrown: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Request method failure captured: Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c HTTP/1.1 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKl_FI7uZrqEHNPbKaTU-kuEFfVNv7EwIN7c8O5j_vvf-Hu5EuQAdo-3-ORFKiOYTWsmbvqvcVBEcJr7u8XyCC85a1_igtF6Cx820lIHWLIQcfFwr13Z9loUpylfFa59OO0_f_A8CxOq1u3hayIQIkzTJ7nlae8oDsWJaVAHyyrrYA Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: ce707d88e23c4229ad274a64f9e12631 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-939091888 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ce707d88e23c4229ad274a64f9e12631"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ce707d88e23c4229ad274a64f9e12631", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ce707d88e23c4229ad274a64f9e12631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ce707d88e23c4229ad274a64f9e12631"}]}] Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-939091888 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: ce707d88e23c4229ad274a64f9e12631 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-939091888 Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestMultiTenantJSON-939091888-project Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 605eca075122421681937004a0c1609b Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-939091888-project Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b9429a7f-4b5f-41fb-a9be-90ebc82c125c'} Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:17.260996 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Returning 404 to user: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee08c5b2-5e19-4882-bb94-5cecc1a21452 tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 404 len: 111 microversion: 2.1 time: 0.195003 Aug 23 10:58:17.264831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2431/4910] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:17 2022] DELETE /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:17.269174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:17.269174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:17.280558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.281106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.281594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.283350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.283632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.284064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.687644 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-56095577-dffb-4be3-b2be-5f2c24f3f5c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34892. Aug 23 10:58:17.693695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:17.695777 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56095577-dffb-4be3-b2be-5f2c24f3f5c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/41fc635a-560b-4eb8-a968-16bb4b7866e6" status: 204 len: 0 microversion: 2.1 time: 1.154859 Aug 23 10:58:17.701202 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2480/4911] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:16 2022] DELETE /compute/v2.1/os-server-groups/41fc635a-560b-4eb8-a968-16bb4b7866e6 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:17.706056 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f58f534-aaf1-4ea4-a39d-dd16c037c1e5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.441687 Aug 23 10:58:17.707442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:17.708132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:17.708414 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2432/4912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:17 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:17.716883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:17.717757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:17.736068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.736807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.737459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.737679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.738128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.738786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.739282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.739914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.740404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.740757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.741102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.741687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.776895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:17.951771 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a350eb69-41dc-464b-a00c-8fe75dcba936 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 204 len: 0 microversion: 2.1 time: 0.248327 Aug 23 10:58:17.952838 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2481/4913] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:17 2022] DELETE /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:17.963770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:17.964775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:17.976399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.976661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.977003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:17.977739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:17.978342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:17.978795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.251000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:18.259510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3808d8e-f4b6-4325-9b2d-9745b4b23184 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1526 microversion: 2.1 time: 0.549781 Aug 23 10:58:18.260723 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2433/4914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:17 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1526 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:18.268981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b49bf7ad-9b35-42d5-8269-ac2fda5d0a82 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:18.282894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b49bf7ad-9b35-42d5-8269-ac2fda5d0a82 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020848 Aug 23 10:58:18.283837 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2434/4915] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:58:18 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:18.290602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:18.291281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:18.298247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.298754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.299197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.299905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.300370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.300828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.469052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:18.479449 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a79f5ca-ea36-4c99-b8be-b6354ae5df58 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.194595 Aug 23 10:58:18.480937 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2435/4916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:18 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:18.486867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:18.488539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:18.497779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.498560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.499349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.500304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.501778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.502280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.585797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:18.597924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d20e815-4d38-4a99-9a48-ecd07d600a29 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1597 microversion: 2.1 time: 0.115708 Aug 23 10:58:18.598823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2436/4917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:18 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1597 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:18.603671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Action: 'update', calling method: >, body: {"server": {"name": "b9429a7f-4b5f-41fb-a9be-90ebc82c125c_new"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:18.606239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:18.614823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.615858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.615858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.616489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.617291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.617948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.636223 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] HTTP exception thrown: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Request method failure captured: Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: request: PUT /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c HTTP/1.1 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 64 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKl_FI7uZrqEHNPbKaTU-kuEFfVNv7EwIN7c8O5j_vvf-Hu5EuQAdo-3-ORFKiOYTWsmbvqvcVBEcJr7u8XyCC85a1_igtF6Cx820lIHWLIQcfFwr13Z9loUpylfFa59OO0_f_A8CxOq1u3hayIQIkzTJ7nlae8oDsWJaVAHyyrrYA Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: ce707d88e23c4229ad274a64f9e12631 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-939091888 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ce707d88e23c4229ad274a64f9e12631"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ce707d88e23c4229ad274a64f9e12631", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ce707d88e23c4229ad274a64f9e12631"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ce707d88e23c4229ad274a64f9e12631"}]}] Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-939091888 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: ce707d88e23c4229ad274a64f9e12631 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-939091888 Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestMultiTenantJSON-939091888-project Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 605eca075122421681937004a0c1609b Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-939091888-project Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "b9429a7f-4b5f-41fb-a9be-90ebc82c125c_new"}} Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b9429a7f-4b5f-41fb-a9be-90ebc82c125c', 'body': {'server': {'name': 'b9429a7f-4b5f-41fb-a9be-90ebc82c125c_new'}}} Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 10:58:18.638497 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:18.644563 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:18.648514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] Returning 404 to user: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:18.649693 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c23c00df-ac54-4b2b-9fa1-b596e0523d9e tempest-ServersNegativeTestMultiTenantJSON-939091888 tempest-ServersNegativeTestMultiTenantJSON-939091888-project] 10.222.0.78 "PUT /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 404 len: 111 microversion: 2.1 time: 0.049904 Aug 23 10:58:18.650541 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2437/4918] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 10:58:18 2022] PUT /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:18.655803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27053e7d-45ee-4688-85db-250f6c7ca178 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Action: 'create', calling method: .version_select at 0x7fdc9d686430>, body: {"server_group": {"name": "tempest-server-group-53506361", "policies": ["affinity"]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:18.681171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-27053e7d-45ee-4688-85db-250f6c7ca178 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:18.690292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-27053e7d-45ee-4688-85db-250f6c7ca178 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:18.760375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-27053e7d-45ee-4688-85db-250f6c7ca178 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:18.766050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-27053e7d-45ee-4688-85db-250f6c7ca178 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:18.783957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27053e7d-45ee-4688-85db-250f6c7ca178 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.130271 Aug 23 10:58:18.790529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2438/4919] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Aug 23 10:58:18 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:18.792503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:18.793024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:18.804751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.805361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.805959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.807077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:18.807664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:18.808509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:18.841001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:18.994810 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbc5a2bf-277d-452d-9f36-a4d2b0b8d9f7 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 204 len: 0 microversion: 2.1 time: 0.207186 Aug 23 10:58:18.995413 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2439/4920] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:18 2022] DELETE /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:19.006077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.007566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:19.021260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.021789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.022214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.023745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.024214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.024653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.214862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:19.231300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-111573e8-3a44-4e8b-b980-1b01fe847310 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 1.276557 Aug 23 10:58:19.231938 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2482/4921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:17 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:19.252007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69087220-3670-41ad-984b-3f3a97e08bd1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.288397 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69087220-3670-41ad-984b-3f3a97e08bd1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/28bb6747-4a39-4a22-8094-4d9f7c1adf96" status: 204 len: 0 microversion: 2.1 time: 0.041251 Aug 23 10:58:19.289529 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2483/4922] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:19 2022] DELETE /compute/v2.1/os-server-groups/28bb6747-4a39-4a22-8094-4d9f7c1adf96 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:19.299403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.300139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:19.315116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.316161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.316819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.317631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.318160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.318812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.397933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:19.409837 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-032a8dee-7dd6-4dd8-a295-5681fb8c1595 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.410835 Aug 23 10:58:19.410535 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2440/4923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:18 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:19.416215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a17d8961-0b25-4dbc-9917-6ae6f7398976 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.430514 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a17d8961-0b25-4dbc-9917-6ae6f7398976 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018702 Aug 23 10:58:19.431257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2441/4924] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:58:19 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:19.445696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d95a4070-ccef-4cd7-8b8c-76df642d6af0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Action: 'create', calling method: .version_select at 0x7fdc8fc65a60>, body: {"server_group": {"name": "tempest-server-group-2068947688", "policies": ["anti-affinity"]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:19.474287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d95a4070-ccef-4cd7-8b8c-76df642d6af0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:19.482520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d95a4070-ccef-4cd7-8b8c-76df642d6af0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:19.501049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:19.540718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d95a4070-ccef-4cd7-8b8c-76df642d6af0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:19.549239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d95a4070-ccef-4cd7-8b8c-76df642d6af0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_groups'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:19.565877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d95a4070-ccef-4cd7-8b8c-76df642d6af0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.125724 Aug 23 10:58:19.568093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2442/4925] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Aug 23 10:58:19 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:19.577809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.578903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:19.587304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.587818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.588540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.589466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.590162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.590605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.780034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:19.788362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:19.795358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e5f489e-db86-4554-bc22-8725f81b25aa tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1532 microversion: 2.1 time: 0.504690 Aug 23 10:58:19.796628 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2484/4926] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:19 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1532 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:19.803482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93b581cb-4945-4539-a876-fc6493970803 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.813419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc15fafa-beec-45ac-8331-0b03c655cfe4 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.244559 Aug 23 10:58:19.813982 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2443/4927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:19 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:19.834382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.835018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:19.858594 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93b581cb-4945-4539-a876-fc6493970803 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/fa92b8d4-c039-4b72-ad77-0f1d35382835" status: 204 len: 0 microversion: 2.1 time: 0.051828 Aug 23 10:58:19.859413 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2485/4928] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:19 2022] DELETE /compute/v2.1/os-server-groups/fa92b8d4-c039-4b72-ad77-0f1d35382835 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:19.866631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.867864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.868321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.870717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2f3c31ff-c98b-4a1b-b5ed-d3d7b193b5bf req-b65fc714-385e-42f0-939a-b77f6e0fce49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155176ba-3061-403d-aee8-b0a2ddb5113d", "name": "network-vif-deleted", "tag": "b7bb14c0-aea5-40da-b207-167073d37f08"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:19.870994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.871489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.871937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.901198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2f3c31ff-c98b-4a1b-b5ed-d3d7b193b5bf req-b65fc714-385e-42f0-939a-b77f6e0fce49 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:19.902076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2f3c31ff-c98b-4a1b-b5ed-d3d7b193b5bf req-b65fc714-385e-42f0-939a-b77f6e0fce49 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:19.902814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2f3c31ff-c98b-4a1b-b5ed-d3d7b193b5bf req-b65fc714-385e-42f0-939a-b77f6e0fce49 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:19.926285 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2f3c31ff-c98b-4a1b-b5ed-d3d7b193b5bf req-b65fc714-385e-42f0-939a-b77f6e0fce49 service nova] Creating event network-vif-deleted:b7bb14c0-aea5-40da-b207-167073d37f08 for instance 155176ba-3061-403d-aee8-b0a2ddb5113d on n-h1-847009-13 Aug 23 10:58:19.932606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2f3c31ff-c98b-4a1b-b5ed-d3d7b193b5bf req-b65fc714-385e-42f0-939a-b77f6e0fce49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070439 Aug 23 10:58:19.933941 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2486/4929] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:19.953501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78c9778d-0f12-4908-8016-78c3237b1132 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:19.980843 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78c9778d-0f12-4908-8016-78c3237b1132 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.045229 Aug 23 10:58:19.981919 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2487/4930] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:58:19 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:20.091961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a4a75a2ad447499597931d6557f9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1460e8cc80774e8bb46c8711969ee882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:20.104988 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9a932d7-91ec-4911-8400-fccd3c981a5c tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 200 len: 1597 microversion: 2.1 time: 0.274687 Aug 23 10:58:20.114121 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2444/4931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:19 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 1597 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:20.184421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1352448683", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "e205c044-1b18-4ffa-bacf-d1c305afaf3e"}]}, "os:scheduler_hints": {"group": "6c5c37a9-100e-452d-9a17-8b7b7ea50463"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:20.255628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] validate_networks() for [('e205c044-1b18-4ffa-bacf-d1c305afaf3e', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:58:20.258484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:20.259230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:20.283888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:20.284564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:20.287864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:20.288788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:20.292230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:20.293146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:20.686095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:20.703198 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-092aaffe-17e0-4ca4-8229-baa0d267e848 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.449698 Aug 23 10:58:20.704661 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2445/4932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:20 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:20.724456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:20.724682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:20.749922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:20.750428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:20.763619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:20.764600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:20.765127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:20.765590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:21.031673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:21.329506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:21.343182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2162ee4-3a47-49f4-b980-1fdfe109bfc0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.620625 Aug 23 10:58:21.353464 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2446/4933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:20 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:21.353464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:21.353743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:21.367894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:21.370725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:21.370725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:21.370980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:21.371500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:21.372010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:21.934503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:21.945572 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9880916-9705-4160-b6b7-a504533d7703 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1532 microversion: 2.1 time: 0.599279 Aug 23 10:58:21.948368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2447/4934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:21 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1532 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:21.998429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:22.000258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:22.009749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.010677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.011402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.012783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.013733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.014386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.334392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:58:22.335307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:58:22.335903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:58:22.336647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:58:22.337212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:58:22.381678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.383137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.384692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.385740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.387616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.389143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.435840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:22.453360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:22.509181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:22.523909 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d14dc1df-93d3-4683-8b3c-46125a1924eb tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1522 microversion: 2.1 time: 0.570494 Aug 23 10:58:22.525417 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2448/4935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:21 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:22.533160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:22.533794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:58:22.537272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:58:22.549118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] [instance: 155176ba-3061-403d-aee8-b0a2ddb5113d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:22.556258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.557150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.557750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.558624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.569545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.570014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.613293 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] HTTP exception thrown: Instance 155176ba-3061-403d-aee8-b0a2ddb5113d could not be found. Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Request method failure captured: Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d HTTP/1.1 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLJVsC_3gvnSJ3cT-e5uaAWqy_HQGr1tc76_Kyi46bTD-dzsLPYe41FYGvwjTcvF4qkfEdZQVZEbXY3JQWXBEzjpYTqAe_mUhiWQ0_WG1bu70UvMyE3pHnZocy-zNzHcf4Ux2XNKVYA2_9me55tNvgmylHZBobs5CFcRoKdmkwJsGAY Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1460e8cc80774e8bb46c8711969ee882 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestFqdnHostnames-785591855 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1460e8cc80774e8bb46c8711969ee882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1460e8cc80774e8bb46c8711969ee882", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1460e8cc80774e8bb46c8711969ee882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1460e8cc80774e8bb46c8711969ee882"}]}] Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestFqdnHostnames-785591855 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1460e8cc80774e8bb46c8711969ee882 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-785591855 Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestFqdnHostnames-785591855-project Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 91a4a75a2ad447499597931d6557f9fd Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestFqdnHostnames-785591855-project Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 155176ba-3061-403d-aee8-b0a2ddb5113d could not be found. Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '155176ba-3061-403d-aee8-b0a2ddb5113d'} Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155176ba-3061-403d-aee8-b0a2ddb5113d could not be found. Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155176ba-3061-403d-aee8-b0a2ddb5113d could not be found. Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:22.618807 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155176ba-3061-403d-aee8-b0a2ddb5113d could not be found. Aug 23 10:58:22.623097 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:22.626747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Returning 404 to user: Instance 155176ba-3061-403d-aee8-b0a2ddb5113d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:22.628629 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-084cb441-0585-498f-9c61-d2100e4d61bb tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d" status: 404 len: 111 microversion: 2.1 time: 0.102028 Aug 23 10:58:22.631925 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2449/4936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:22 2022] GET /compute/v2.1/servers/155176ba-3061-403d-aee8-b0a2ddb5113d => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:22.650709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:22.652363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:22.678104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.678623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.679079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.679815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:22.680284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:22.680721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:22.724349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:22.755489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:22.860227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:22.886473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Getting quotas for user abc49ae6aad74e6991e7f0348069b278 and project 5843119e460e46f0b6576a92d6c27c3c. Resources: {'server_group_members'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:23.001604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59133313-fb6d-473a-a640-1589218fafcf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.821041 Aug 23 10:58:23.008899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2488/4937] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:58:23.014510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-74c39c9f-c060-4241-98ed-6dba1d6f583a req-7555de6a-9fdc-4931-9026-bb39e17922f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f16184-eb9b-48fa-ba29-38039b238afe", "tag": "8e5f415b-d6a4-4963-acef-e1625cd50cab"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:23.037043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-74c39c9f-c060-4241-98ed-6dba1d6f583a req-7555de6a-9fdc-4931-9026-bb39e17922f6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.038073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-74c39c9f-c060-4241-98ed-6dba1d6f583a req-7555de6a-9fdc-4931-9026-bb39e17922f6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.038946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-74c39c9f-c060-4241-98ed-6dba1d6f583a req-7555de6a-9fdc-4931-9026-bb39e17922f6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.053727 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-74c39c9f-c060-4241-98ed-6dba1d6f583a req-7555de6a-9fdc-4931-9026-bb39e17922f6 service nova] Creating event network-changed:8e5f415b-d6a4-4963-acef-e1625cd50cab for instance f2f16184-eb9b-48fa-ba29-38039b238afe on n-h1-847009-13 Aug 23 10:58:23.061288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-74c39c9f-c060-4241-98ed-6dba1d6f583a req-7555de6a-9fdc-4931-9026-bb39e17922f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050595 Aug 23 10:58:23.062866 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2489/4938] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:23.077174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:23.078581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:23.088345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.089224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.089847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.090732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.093688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.094865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.128621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:23.139896 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1c2c964-c939-411d-9ea0-f7165f727c83 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.506360 Aug 23 10:58:23.140421 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2450/4939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:22 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:23.413606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:23.414736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2147a4a4-4947-4adf-b9c4-20edc5e4e08e req-a01e1e6c-7561-44d5-949a-e3df7500bec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9429a7f-4b5f-41fb-a9be-90ebc82c125c", "name": "network-vif-deleted", "tag": "4e227a08-0828-4de5-add2-b3ee20e5191e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:23.430742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78ebb566-a69d-4dcf-830f-4cd376f12844 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.363619 Aug 23 10:58:23.440572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2147a4a4-4947-4adf-b9c4-20edc5e4e08e req-a01e1e6c-7561-44d5-949a-e3df7500bec0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.441576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2147a4a4-4947-4adf-b9c4-20edc5e4e08e req-a01e1e6c-7561-44d5-949a-e3df7500bec0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.442952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2147a4a4-4947-4adf-b9c4-20edc5e4e08e req-a01e1e6c-7561-44d5-949a-e3df7500bec0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.463468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2490/4940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:23 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:23.464474 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2147a4a4-4947-4adf-b9c4-20edc5e4e08e req-a01e1e6c-7561-44d5-949a-e3df7500bec0 service nova] Creating event network-vif-deleted:4e227a08-0828-4de5-add2-b3ee20e5191e for instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c on n-h2-847009-13 Aug 23 10:58:23.471513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2147a4a4-4947-4adf-b9c4-20edc5e4e08e req-a01e1e6c-7561-44d5-949a-e3df7500bec0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329849 Aug 23 10:58:23.477824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85bf3881-d789-4248-9cb4-1bc4e11889c6 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] Calling method '.version_select at 0x7fdc9c038f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:23.497685 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2451/4941] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:23.510853 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85bf3881-d789-4248-9cb4-1bc4e11889c6 tempest-ServersTestFqdnHostnames-785591855 tempest-ServersTestFqdnHostnames-785591855-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413031388" status: 202 len: 0 microversion: 2.1 time: 0.042776 Aug 23 10:58:23.522850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2491/4942] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 10:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413031388 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:58:23.528362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:23.536207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:23.559788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.565705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54af8231-92da-428e-8cb7-6bfe84b74814 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:23.568311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.569194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.569588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54af8231-92da-428e-8cb7-6bfe84b74814 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:23.571667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.574475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.577663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.600333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:23.693195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54af8231-92da-428e-8cb7-6bfe84b74814 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:23.705500 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54af8231-92da-428e-8cb7-6bfe84b74814 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1213 microversion: 2.1 time: 0.176791 Aug 23 10:58:23.709538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2492/4943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:23 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1213 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:23.710996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.711528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.712381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.712855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lazy-loading 'fault' on Instance uuid b9429a7f-4b5f-41fb-a9be-90ebc82c125c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:58:23.722745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:23.723376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:23.739073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.739578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.741281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.743117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:23.743757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:23.744411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:23.843334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf66fbaf026945bcb050568edb1ecffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba81d0b9941548df84a8183150e57208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:23.853715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5be27817-0756-4bff-aaf4-b2afc9f61b36 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 200 len: 1317 microversion: 2.1 time: 0.347082 Aug 23 10:58:23.854300 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2452/4944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:23 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:23.897364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:23.909166 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ceaa6740-def9-4237-a5f5-f9c9ebe9e2e2 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1480 microversion: 2.1 time: 0.198264 Aug 23 10:58:23.910076 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2493/4945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:23 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1480 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:24.166574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:24.168668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:24.180511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.181538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.182435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.183354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.187390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.188730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.490215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:24.491449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:24.499564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.500261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.500935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.502126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.502754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.503976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.523459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:24.534853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7af4b185-dcff-4f38-82bb-397a87f8109d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.376489 Aug 23 10:58:24.537460 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2453/4946] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:24 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:24.710700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:24.721566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adb8a6a4-7f7d-4549-a86b-a25e561f5c37 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.236383 Aug 23 10:58:24.722497 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2494/4947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:24 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:24.744512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:24.745192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:24.753756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.754265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.754901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.755640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.756109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.756541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.881122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:24.882559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] [instance: b9429a7f-4b5f-41fb-a9be-90ebc82c125c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:24.894917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.895942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.896484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.897347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.897918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.898451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.914675 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] HTTP exception thrown: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Request method failure captured: Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c HTTP/1.1 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKSti3sHPjpnaUpPVuGfSpsjjgd_Td89Tla0zg1cG9a3qKM2ByMnaDGlmMBFb1lfbdh8ukNCLfEhebem6z8OBLjDxgvawrq5a17mJMLeLd_YiGFjdN4iG-fgjpwovTXZ2NQfiOVhiDqktGGEcNUJZ6p8aypszieRoXqG4swIHXeue8 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ba81d0b9941548df84a8183150e57208 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-765106388 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ba81d0b9941548df84a8183150e57208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ba81d0b9941548df84a8183150e57208", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba81d0b9941548df84a8183150e57208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ba81d0b9941548df84a8183150e57208"}]}] Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-765106388 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ba81d0b9941548df84a8183150e57208 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-765106388 Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestMultiTenantJSON-765106388-project Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cf66fbaf026945bcb050568edb1ecffe Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-765106388-project Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b9429a7f-4b5f-41fb-a9be-90ebc82c125c'} Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:24.916473 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. Aug 23 10:58:24.920432 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:24.931834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] Returning 404 to user: Instance b9429a7f-4b5f-41fb-a9be-90ebc82c125c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:24.934393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a01aad61-da2e-4895-9680-db98c2526dd5 tempest-ServersNegativeTestMultiTenantJSON-765106388 tempest-ServersNegativeTestMultiTenantJSON-765106388-project] 10.222.0.78 "GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c" status: 404 len: 111 microversion: 2.1 time: 0.058412 Aug 23 10:58:24.935209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2495/4948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:24 2022] GET /compute/v2.1/servers/b9429a7f-4b5f-41fb-a9be-90ebc82c125c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:58:24.941586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:24.942389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:24.952235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.953048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.953919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:24.955218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:24.955860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:24.956298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:25.210062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:25.224074 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-357a4478-17b5-437d-bbfc-f90de0d04746 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1265 microversion: 2.1 time: 0.485839 Aug 23 10:58:25.224581 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2454/4949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:24 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1265 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:25.498714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5049ab26-2657-49a3-8dd5-3dda85904d96 req-fcb185cd-0578-4750-8806-4c293397b270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69836824-35ef-49e2-9b18-8ea94744cc8e", "name": "network-vif-deleted", "tag": "149d5707-d13d-45d7-b809-ba896ae8aaf7"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:25.522477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5049ab26-2657-49a3-8dd5-3dda85904d96 req-fcb185cd-0578-4750-8806-4c293397b270 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:25.523309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5049ab26-2657-49a3-8dd5-3dda85904d96 req-fcb185cd-0578-4750-8806-4c293397b270 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:25.523919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5049ab26-2657-49a3-8dd5-3dda85904d96 req-fcb185cd-0578-4750-8806-4c293397b270 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:25.544815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '661fb95cf8664a7a8eb9322155164792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8e517070ce248b08c60a477f1e40f00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:25.547087 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5049ab26-2657-49a3-8dd5-3dda85904d96 req-fcb185cd-0578-4750-8806-4c293397b270 service nova] Creating event network-vif-deleted:149d5707-d13d-45d7-b809-ba896ae8aaf7 for instance 69836824-35ef-49e2-9b18-8ea94744cc8e on n-h1-847009-13 Aug 23 10:58:25.562570 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2fe4ddf6-a0ce-43ae-8625-64e4b1b0945e tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 200 len: 1480 microversion: 2.1 time: 0.625554 Aug 23 10:58:25.563737 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2496/4950] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:24 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 1480 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:25.572125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:25.572803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:25.575023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:25.577005 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5049ab26-2657-49a3-8dd5-3dda85904d96 req-fcb185cd-0578-4750-8806-4c293397b270 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081959 Aug 23 10:58:25.578243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2455/4951] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:25.601138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:25.601709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:25.602189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:25.602951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:25.603613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:25.604053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:25.753749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:25.755368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:25.769710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:25.770740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:25.772134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:25.773277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:25.773897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:25.775005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:26.123901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:26.138182 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b6882416-1271-4243-8d17-88c9812e5ea4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.572735 Aug 23 10:58:26.146023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2497/4952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:25 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:26.245902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:26.246522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:26.254814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:26.255314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:26.255753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:26.256466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:26.256984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:26.257412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:26.329192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:26.342530 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e19477bb-8223-4385-95a7-98a7c6b52b4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.595624 Aug 23 10:58:26.358125 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2456/4953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:25 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:26.391792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:26.409818 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-704e77d2-12d4-42ab-9452-0a17455f0ba9 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1271 microversion: 2.1 time: 0.168441 Aug 23 10:58:26.420372 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2498/4954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:26 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:26.587673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:26.588205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] [instance: 69836824-35ef-49e2-9b18-8ea94744cc8e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:26.600806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:26.602792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:26.603324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:26.604981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:26.605452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:26.605888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:26.624561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] HTTP exception thrown: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e could not be found. Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Request method failure captured: Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e HTTP/1.1 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLF31IoaKy9xxrpD9UjQMAzrKAohiVeq2DHy_XnHOMNPqYB2c5pY_I3V6yYWuZjQHD_FriFLS8KtULOH8_edEidOihKcqRNLZR0495nuo1fu8eH4hsY4wmN_6inubkzTZbSqsLGCZr1RLTjWnwbem0yD1pV2VKCSSuaIL271yUGhLyY Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e8e517070ce248b08c60a477f1e40f00", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e8e517070ce248b08c60a477f1e40f00"}]}] Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: e8e517070ce248b08c60a477f1e40f00 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-944870762 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 661fb95cf8664a7a8eb9322155164792 Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-944870762-project Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e could not be found. Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '69836824-35ef-49e2-9b18-8ea94744cc8e'} Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e could not be found. Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e could not be found. Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:26.630150 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e could not be found. Aug 23 10:58:26.636512 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:26.640014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] Returning 404 to user: Instance 69836824-35ef-49e2-9b18-8ea94744cc8e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:26.641889 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-007f8f6f-4a3e-40b2-aeb7-4860f26f6d23 tempest-ServerRescueNegativeTestJSON-944870762 tempest-ServerRescueNegativeTestJSON-944870762-project] 10.222.0.78 "GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e" status: 404 len: 111 microversion: 2.1 time: 0.059473 Aug 23 10:58:26.643612 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2457/4955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:26 2022] GET /compute/v2.1/servers/69836824-35ef-49e2-9b18-8ea94744cc8e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:27.167675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:27.168423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:27.182157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:27.184878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:27.185709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:27.186953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:27.190580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:27.191313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:27.364850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:27.366110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:27.379963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:27.385581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:27.386288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:27.387216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:27.387849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:27.388464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:27.623254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:27.633169 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82ddfa73-a8d8-4bb8-8ac4-90efaa749544 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.469625 Aug 23 10:58:27.634398 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2499/4956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:27 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:27.639990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:27.640791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:27.648995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:27.649749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:27.650857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:27.653851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:27.654574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:27.655234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:28.017674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:28.037742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-62a6ebdc-962b-4316-afbd-1a013286c9a0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 0.401443 Aug 23 10:58:28.039558 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2500/4957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:27 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:28.271101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:28.278579 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85ae8130-6e9e-46c9-b78e-6763618c54df tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.918878 Aug 23 10:58:28.299007 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2458/4958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:27 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:28.674862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:28.678340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:28.686707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:28.688374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:28.692579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:28.694817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:28.696718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:28.697928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:28.760239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:29.061411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:29.062452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:29.088778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:29.088778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:29.089152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:29.090223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:29.091031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:29.091652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:29.505421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:29.537049 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-229c41e3-0dee-438a-9705-df929c26cd54 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 0.480090 Aug 23 10:58:29.546029 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2459/4959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:29 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:29.557043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:29.558714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:29.567074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=56 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:29.569690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:29.571182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:29.571988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:29.572943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:29.573755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:29.574671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:29.577732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:29.586007 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34d0bc63-8eee-4c25-8ffd-862cb43d1c1a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.929996 Aug 23 10:58:29.592719 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2501/4960] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:28 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:29.597811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-fa602c0a-06b7-4b89-bac7-4e52e8c5e954 req-38bb2a65-8302-4243-a170-4e895d72d18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f16184-eb9b-48fa-ba29-38039b238afe", "name": "network-vif-plugged", "status": "completed", "tag": "8e5f415b-d6a4-4963-acef-e1625cd50cab"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:29.623809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fa602c0a-06b7-4b89-bac7-4e52e8c5e954 req-38bb2a65-8302-4243-a170-4e895d72d18a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:29.624311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fa602c0a-06b7-4b89-bac7-4e52e8c5e954 req-38bb2a65-8302-4243-a170-4e895d72d18a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:29.624859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fa602c0a-06b7-4b89-bac7-4e52e8c5e954 req-38bb2a65-8302-4243-a170-4e895d72d18a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:29.639837 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-fa602c0a-06b7-4b89-bac7-4e52e8c5e954 req-38bb2a65-8302-4243-a170-4e895d72d18a service nova] Creating event network-vif-plugged:8e5f415b-d6a4-4963-acef-e1625cd50cab for instance f2f16184-eb9b-48fa-ba29-38039b238afe on n-h1-847009-13 Aug 23 10:58:29.645653 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-fa602c0a-06b7-4b89-bac7-4e52e8c5e954 req-38bb2a65-8302-4243-a170-4e895d72d18a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051624 Aug 23 10:58:29.646280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2502/4961] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:30.034711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:30.060795 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f22a5e2-c8b1-4984-8d03-9f82d93ea649 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.510443 Aug 23 10:58:30.066679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2460/4962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:29 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:30.093360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a70444bd-460e-4986-896d-6ca026a51498 req-fbdecfd1-f7fd-4c89-99f0-1cba4a605f4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c7c03c-d401-4851-aa06-7a5e131172ee", "tag": "a137057e-bbd3-49c1-bddb-2a3582a6d48e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:30.139076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a70444bd-460e-4986-896d-6ca026a51498 req-fbdecfd1-f7fd-4c89-99f0-1cba4a605f4d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:30.143030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a70444bd-460e-4986-896d-6ca026a51498 req-fbdecfd1-f7fd-4c89-99f0-1cba4a605f4d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:30.146396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a70444bd-460e-4986-896d-6ca026a51498 req-fbdecfd1-f7fd-4c89-99f0-1cba4a605f4d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:30.195167 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a70444bd-460e-4986-896d-6ca026a51498 req-fbdecfd1-f7fd-4c89-99f0-1cba4a605f4d service nova] Creating event network-changed:a137057e-bbd3-49c1-bddb-2a3582a6d48e for instance 70c7c03c-d401-4851-aa06-7a5e131172ee on n-h2-847009-13 Aug 23 10:58:30.215355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a70444bd-460e-4986-896d-6ca026a51498 req-fbdecfd1-f7fd-4c89-99f0-1cba4a605f4d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131771 Aug 23 10:58:30.221393 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2503/4963] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:30.567113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:30.567871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:30.580342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:30.586239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:30.587073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:30.588280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:30.588967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:30.589552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:30.615919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:30.617353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:30.633151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:30.633862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:30.638215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:30.643032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:30.648782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:30.649470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:31.361408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:31.381644 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f45c86b6-cdda-434c-90c8-87ff6b558aec tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.770567 Aug 23 10:58:31.382601 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2504/4964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:30 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:31.394626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:31.398295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:31.414272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:31.415920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:31.417462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:31.419830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:31.424144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:31.426872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:32.102266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:32.114436 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcded3ee-1756-4bee-9ef5-70769515e05f tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 1.552374 Aug 23 10:58:32.116539 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2461/4965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:30 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:32.123886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:32.144366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-942dd621-53af-43e3-b630-953160cea57e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1320 microversion: 2.1 time: 0.757751 Aug 23 10:58:32.158615 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2505/4966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:31 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1320 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:32.413637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:32.415684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:32.429480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:32.429986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:32.430434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:32.431159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:32.431629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:32.432064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:32.830075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:32.838254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4d995c6-ea06-4b76-93e9-f0e586f26e20 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.438586 Aug 23 10:58:32.838828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2462/4967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:32 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:33.140473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:33.142541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:33.145106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:33.158345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.160334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.163272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.166340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.167601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:33.168234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:33.171051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.171817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.189542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.190101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.190563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.191315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.191783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.192217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.439962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:33.456866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33c4b75b-01f0-48b0-a8b8-82ee908ec018 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1501 microversion: 2.1 time: 0.292942 Aug 23 10:58:33.457471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2463/4968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:33 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:33.480683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:33.482370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:33.495312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.497563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.498849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.502310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.503658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.505856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.699304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=16 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:33.825896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:33.847749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5875a65f-cabf-4652-8b62-16046b3ad2d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1501 microversion: 2.1 time: 0.372217 Aug 23 10:58:33.850353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2464/4969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:33 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1501 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:33.868156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:33.868940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:33.883031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.885834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.887547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:33.889903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:33.892191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:33.895320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:34.208522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:34.225159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68c0036e-71ab-47cf-ae06-007c04a66efe tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.359668 Aug 23 10:58:34.226167 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2465/4970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:33 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:34.242030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:34.244156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:34.262998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:34.263531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:34.264905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:34.270614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:34.270614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:34.270614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:34.334645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:34.582576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a5d8b3c-48b8-46e5-bbb0-b866cc25ebfd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 204 len: 0 microversion: 2.1 time: 0.355073 Aug 23 10:58:34.583913 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2466/4971] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:34 2022] DELETE /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:34.593458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:34.595326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:34.597333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:34.604346 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3909cf33-ddda-4e6d-acab-c7f6e8ff9ac3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 1.468403 Aug 23 10:58:34.610742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2506/4972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:33 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:34.636941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:34.637851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:34.639131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:34.640273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:34.643860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:34.644629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:35.002018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:35.035029 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d814565-4e0b-4d97-884e-134351120ff3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1507 microversion: 2.1 time: 0.446040 Aug 23 10:58:35.046333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2467/4973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:34 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1507 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:35.251095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:35.254145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:35.285098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:35.285808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:35.287175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:35.296295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:35.301380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:35.305624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:35.633124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:35.634835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:35.651046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:35.653198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:35.655659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:35.656974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:35.661701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:35.662560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:35.702104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:36.104203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:36.118729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-559ae7af-66e6-4c3f-811b-6b04b18c4a26 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.874849 Aug 23 10:58:36.136020 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2507/4974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:35 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:36.155414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:36.160794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:36.181534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:36.185247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:36.189449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:36.190614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:36.191339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:36.192024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:36.342431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:36.353898 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36614e1d-4806-4515-8e5e-af361fddc98e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 0.724410 Aug 23 10:58:36.354508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2468/4975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:35 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:37.086388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:37.121447 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6ec6a11-4af1-4419-9b7b-b53b122b9bd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1507 microversion: 2.1 time: 0.974042 Aug 23 10:58:37.123567 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2508/4976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:36 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1507 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:37.144433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:37.145098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:37.161653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:37.162184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:37.162642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:37.163390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:37.163862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:37.164651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:37.377085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:37.377952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:37.390549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:37.392235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:37.395467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:37.396643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:37.397324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:37.398257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:37.836686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:37.851975 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10f296ff-7bb5-4545-8440-bcc93d651cac tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.711494 Aug 23 10:58:37.852940 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2469/4977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:37 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:37.871773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-71a49957-81ae-4fd0-80e7-87a9cc0222a0 req-c1480595-5fda-440a-aa34-cfd7b4c036fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7c03c-d401-4851-aa06-7a5e131172ee", "name": "network-vif-plugged", "status": "completed", "tag": "a137057e-bbd3-49c1-bddb-2a3582a6d48e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:37.885734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-71a49957-81ae-4fd0-80e7-87a9cc0222a0 req-c1480595-5fda-440a-aa34-cfd7b4c036fd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:37.889880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-71a49957-81ae-4fd0-80e7-87a9cc0222a0 req-c1480595-5fda-440a-aa34-cfd7b4c036fd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:37.894832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-71a49957-81ae-4fd0-80e7-87a9cc0222a0 req-c1480595-5fda-440a-aa34-cfd7b4c036fd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:37.917831 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-71a49957-81ae-4fd0-80e7-87a9cc0222a0 req-c1480595-5fda-440a-aa34-cfd7b4c036fd service nova] Creating event network-vif-plugged:a137057e-bbd3-49c1-bddb-2a3582a6d48e for instance 70c7c03c-d401-4851-aa06-7a5e131172ee on n-h2-847009-13 Aug 23 10:58:37.929657 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-71a49957-81ae-4fd0-80e7-87a9cc0222a0 req-c1480595-5fda-440a-aa34-cfd7b4c036fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075092 Aug 23 10:58:37.937184 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2470/4978] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:38.148894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:38.150678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:38.170631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:38.173154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:38.175125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:38.176109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:38.177698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:38.180856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:38.443512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:38.454311 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ce463c8-da1a-4fb1-914b-103a21572969 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1507 microversion: 2.1 time: 0.313511 Aug 23 10:58:38.472867 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2471/4979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:38 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:38.876669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:38.877339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:38.889555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:38.890054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:38.890494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:38.896502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:38.897073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:38.897519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:39.174334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:39.184061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:39.184573 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-765d8f4c-bb5e-4e56-8e50-06ad28032030 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 1.812438 Aug 23 10:58:39.184833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2509/4980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:37 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:39.201589 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f1cc75b-75ea-4f55-a147-730084dab557 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.329601 Aug 23 10:58:39.202765 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2472/4981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:38 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:39.477468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:39.478384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:39.496288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:39.498258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:39.499031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:39.500623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:39.501465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:39.502287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:39.699598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:39.708579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93585f52-59c5-4ca3-9145-9fe725d475d8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1465 microversion: 2.1 time: 0.236027 Aug 23 10:58:39.711876 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2510/4982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:39 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1465 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:39.880228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-24b85c47-8b8e-4252-8e0e-89a5d04df778 req-819f28b2-ab53-44c6-b2a2-310df3b4fca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f16184-eb9b-48fa-ba29-38039b238afe", "name": "network-vif-deleted", "tag": "8e5f415b-d6a4-4963-acef-e1625cd50cab"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:39.893589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-24b85c47-8b8e-4252-8e0e-89a5d04df778 req-819f28b2-ab53-44c6-b2a2-310df3b4fca4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:39.894074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-24b85c47-8b8e-4252-8e0e-89a5d04df778 req-819f28b2-ab53-44c6-b2a2-310df3b4fca4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:39.894533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-24b85c47-8b8e-4252-8e0e-89a5d04df778 req-819f28b2-ab53-44c6-b2a2-310df3b4fca4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:39.932564 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-24b85c47-8b8e-4252-8e0e-89a5d04df778 req-819f28b2-ab53-44c6-b2a2-310df3b4fca4 service nova] Creating event network-vif-deleted:8e5f415b-d6a4-4963-acef-e1625cd50cab for instance f2f16184-eb9b-48fa-ba29-38039b238afe on n-h1-847009-13 Aug 23 10:58:39.950814 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-24b85c47-8b8e-4252-8e0e-89a5d04df778 req-819f28b2-ab53-44c6-b2a2-310df3b4fca4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074312 Aug 23 10:58:39.951679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2473/4983] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:58:40.205362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:40.208006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:40.216395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.224612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:40.225527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:40.230525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.235602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.238790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.239784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.240291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.240844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.243764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.244395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.247540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.248986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.252066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.755573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:40.767612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38cc3c65-b904-4ba2-a0f5-818fef731845 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1313 microversion: 2.1 time: 0.566627 Aug 23 10:58:40.769340 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2511/4984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:40 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:40.785903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:40.786670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:40.796728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.798819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.799544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.800669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.801276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.801837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.845924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:40.847479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:40.848209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:40.848996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lazy-loading 'fault' on Instance uuid f2f16184-eb9b-48fa-ba29-38039b238afe {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:58:40.945597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:40.955980 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6aa0259b-2a9f-4ad4-af91-acf44486497a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 200 len: 1310 microversion: 2.1 time: 0.185328 Aug 23 10:58:40.959391 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2512/4985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:40 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 1310 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:41.093212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:41.107011 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b36b397-3c7b-4fef-9133-448cef9bd970 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.886485 Aug 23 10:58:41.120879 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2474/4986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:40 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:41.798069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:41.802151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:41.820983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:41.821494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:41.821944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:41.822679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:41.828877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:41.829792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.002160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:42.003984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:42.053263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.058867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.059884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.064054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.065550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.072704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.106918 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe HTTP/1.1 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f2f16184-eb9b-48fa-ba29-38039b238afe'} Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:42.121400 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:42.127896 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:42.127896 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:42.127896 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:42.127896 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:42.127896 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 10:58:42.127896 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:42.134134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:42.147718 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dafc65cd-65bd-4f23-8143-76b6d0fd3efc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 404 len: 111 microversion: 2.1 time: 0.159956 Aug 23 10:58:42.149266 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2475/4987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:41 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:42.162235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:42.163333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:42.171324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.174132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.174820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.175749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.176527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.177481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.396531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:42.410326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7e76796d-daee-49e7-b4f9-64184fa60f84 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1499 microversion: 2.1 time: 0.624914 Aug 23 10:58:42.428016 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2513/4988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:41 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1499 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:42.441398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b469a5f-347d-42e1-94d8-b1d405ee656d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: .version_select at 0x7fdc9c1ca5e0>, body: {"keypair": {"name": "tempest-key-86592100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeLPp8o+URGb2YTTIl5bdU67w1ttlG8rzwlr65nziJLPnc3k1AkokqGaaazGGqGadWg/UnyXjgmq0AjSZ78j/nw8kx4YkYqP6Mwc6tRFvOztmXNdLetydIRwmqsRDAk/w=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:42.459984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4b469a5f-347d-42e1-94d8-b1d405ee656d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:42.466002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4b469a5f-347d-42e1-94d8-b1d405ee656d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:42.521200 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b469a5f-347d-42e1-94d8-b1d405ee656d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 380 microversion: 2.1 time: 0.091976 Aug 23 10:58:42.522148 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2514/4989] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:58:42 2022] POST /compute/v2.1/os-keypairs => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:42.536336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41b30e37-18b5-4ac7-a408-eeb17f742a75 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:42.554184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:42.558053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.server_groups [None req-41b30e37-18b5-4ac7-a408-eeb17f742a75 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Querying cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) for 1 instances {{(pid=128859) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 10:58:42.564202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b30e37-18b5-4ac7-a408-eeb17f742a75 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.564941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b30e37-18b5-4ac7-a408-eeb17f742a75 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.570978 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dd59427-4ba2-46cd-a45c-1b50495723b6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.418453 Aug 23 10:58:42.573003 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2476/4990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:42 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:42.580243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41b30e37-18b5-4ac7-a408-eeb17f742a75 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.585615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53a6dd28-cabe-46f6-b1d4-bc06a1c3ce77 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '.version_select at 0x7fdc8fcf7c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:42.604008 n-d-847009-13 devstack@n-api.service[128860]: WARNING oslo_db.sqlalchemy.utils [None req-53a6dd28-cabe-46f6-b1d4-bc06a1c3ce77 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 10:58:42.619854 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53a6dd28-cabe-46f6-b1d4-bc06a1c3ce77 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 349 microversion: 2.1 time: 0.041220 Aug 23 10:58:42.625780 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41b30e37-18b5-4ac7-a408-eeb17f742a75 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/6c5c37a9-100e-452d-9a17-8b7b7ea50463" status: 200 len: 221 microversion: 2.1 time: 0.094661 Aug 23 10:58:42.627527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2515/4991] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:58:42 2022] GET /compute/v2.1/os-server-groups/6c5c37a9-100e-452d-9a17-8b7b7ea50463 => generated 221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:42.629828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2477/4992] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 10:58:42 2022] GET /compute/v2.1/os-keypairs => generated 349 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:42.638741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:42.639247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:42.654680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.655229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.660634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.661472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.661959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.662405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.710337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:58:42.848959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-146684312", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-key-86592100", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:42.894393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1084d754-ff06-4615-9210-28c8227e631a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 204 len: 0 microversion: 2.1 time: 0.259465 Aug 23 10:58:42.895964 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2516/4993] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:42 2022] DELETE /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:42.905691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:42.909886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:42.917605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.918371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.919157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.920181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:42.920972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:42.923310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:42.995757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:58:43.310523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:43.325442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-561ebdaa-6f9a-4866-87dd-71a6912147b6 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1505 microversion: 2.1 time: 0.423293 Aug 23 10:58:43.327323 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2517/4994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:42 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:43.598172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:43.599133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:43.605439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:43.606163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:43.606916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:43.607813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:43.608505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:43.609899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.013662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:44.026436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:44.029445 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1979e262-1764-4e7d-9095-1fd57117a2fa tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.436507 Aug 23 10:58:44.032595 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2518/4995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:43 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:44.093649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:58:44.094731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:58:44.095404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:58:44.095986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:58:44.096811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:58:44.116170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:44.116635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:44.122335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.123165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:44.123662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:44.124116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.139331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:44.147770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:58:44.156594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:58:44.169910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61752e35-65cd-4dda-9dbc-e72ad60b162a", "device": "/dev/sdb"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:44.173544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:44.183665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:44.184177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:44.184626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.190413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:58:44.190754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:44.191268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:44.191725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.193970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:58:44.331756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30b606aa-e1b4-442b-b493-65cd426aabdc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481070 Aug 23 10:58:44.333758 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2478/4996] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 10:58:44.388001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-588bd6bb-7c84-49cc-87d8-366ab11a8b2c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:44.395664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-588bd6bb-7c84-49cc-87d8-366ab11a8b2c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:44.566447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-588bd6bb-7c84-49cc-87d8-366ab11a8b2c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:44.576130 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-588bd6bb-7c84-49cc-87d8-366ab11a8b2c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1226 microversion: 2.1 time: 0.235751 Aug 23 10:58:44.579232 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2479/4997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:44 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:44.589322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:44.590253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:44.607305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:44.608096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:44.608901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.610412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:44.611811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:44.613109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:44.716170 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d9369c5-f9a3-432c-b495-531ad2ac833b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "POST /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549590 Aug 23 10:58:44.720273 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2519/4998] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 10:58:44 2022] POST /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:58:44.899698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:44.915844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ad1caec-4a32-4cca-a911-1a9c08f393ae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1505 microversion: 2.1 time: 0.331797 Aug 23 10:58:44.916453 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2480/4999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:44 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:45.055269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:45.056843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:45.073231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:45.074961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:45.075685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:45.076672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:45.077812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:45.079708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:45.603198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:45.603935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:45.617972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:45.619530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:45.620584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:45.623791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:45.627842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:45.628506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:45.765164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:45.778849 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ec8cf85-971a-40b9-ac94-3f6f3137ea61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1222 microversion: 2.1 time: 0.178273 Aug 23 10:58:45.779655 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2481/5000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:45 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:45.941674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:45.942326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:45.977160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:45.979835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:45.980356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:45.981165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:45.981651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:45.982101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:46.036344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:46.045310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9bc7560e-fee7-4c88-910a-fe4dbd2d0b71 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1515 microversion: 2.1 time: 0.996179 Aug 23 10:58:46.045910 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2520/5001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:45 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1515 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:46.411519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:46.440566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67b2161c-8151-4da6-98ae-cac2ff81a7c0 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1505 microversion: 2.1 time: 0.501458 Aug 23 10:58:46.445690 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2482/5002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:45 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:46.805015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:46.806203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:46.816445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:46.824583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:46.826465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:46.828616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:46.832574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:46.841227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:47.068327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:47.068990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:47.098270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:47.100409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:47.102315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:47.104444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:47.105176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:47.105779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:47.282633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:47.295947 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10002251-2ca2-414d-92af-bd7c1bd7f1ac tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1284 microversion: 2.1 time: 0.494813 Aug 23 10:58:47.297850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2521/5003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:46 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1284 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:47.471624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:47.472315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:47.483431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:47.483942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:47.484436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:47.488985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:47.489492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:47.491085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:47.808635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:47.817282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f20ade5-d39f-47d9-814e-135c4c45a081 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1521 microversion: 2.1 time: 0.753150 Aug 23 10:58:47.824651 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2483/5004] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:47 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1521 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:48.002779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:48.021654 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-637de8b8-3a08-4867-bb82-da9ff31be19b tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1505 microversion: 2.1 time: 0.551087 Aug 23 10:58:48.024866 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2522/5005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:47 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:48.331679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:48.333056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:48.353730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:48.357872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:48.358863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:48.363424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:48.364106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:48.366528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:48.528341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b32df353-db0a-4e28-b5da-e7aa7da91f54 req-db55a683-5f96-4676-96a3-4fd723e3220f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c7c03c-d401-4851-aa06-7a5e131172ee", "name": "network-vif-deleted", "tag": "a137057e-bbd3-49c1-bddb-2a3582a6d48e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:48.580950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b32df353-db0a-4e28-b5da-e7aa7da91f54 req-db55a683-5f96-4676-96a3-4fd723e3220f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:48.581656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b32df353-db0a-4e28-b5da-e7aa7da91f54 req-db55a683-5f96-4676-96a3-4fd723e3220f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:48.582117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b32df353-db0a-4e28-b5da-e7aa7da91f54 req-db55a683-5f96-4676-96a3-4fd723e3220f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:48.617058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b32df353-db0a-4e28-b5da-e7aa7da91f54 req-db55a683-5f96-4676-96a3-4fd723e3220f service nova] Creating event network-vif-deleted:a137057e-bbd3-49c1-bddb-2a3582a6d48e for instance 70c7c03c-d401-4851-aa06-7a5e131172ee on n-h2-847009-13 Aug 23 10:58:48.638694 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b32df353-db0a-4e28-b5da-e7aa7da91f54 req-db55a683-5f96-4676-96a3-4fd723e3220f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108850 Aug 23 10:58:48.639704 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2523/5006] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:58:48.840733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:48.841470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:48.857520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:48.859988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:48.860873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:48.870498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:48.871014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:48.871467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:49.310420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:49.329422 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10485e58-66ae-4d56-bef7-98ab03ec4a80 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1284 microversion: 2.1 time: 1.013237 Aug 23 10:58:49.330028 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2484/5007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:48 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1284 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:49.341107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:49.347675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:49.362311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:49.362799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:49.363243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:49.363974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:49.364428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:49.371539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:49.427598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:49.428115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:49.433474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:49.433963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lazy-loading 'fault' on Instance uuid 70c7c03c-d401-4851-aa06-7a5e131172ee {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:58:49.556360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abc49ae6aad74e6991e7f0348069b278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5843119e460e46f0b6576a92d6c27c3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:49.571359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:49.574198 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e3e0fd6-e444-4246-a19a-4a69bc9dc98a tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 200 len: 1303 microversion: 2.1 time: 0.235838 Aug 23 10:58:49.589052 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2485/5008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:49 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 1303 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:49.602570 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3f9834a8-885c-48b7-ade3-7219670b1ec9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1521 microversion: 2.1 time: 0.765655 Aug 23 10:58:49.603141 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2524/5009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:48 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1521 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:50.350819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:50.351445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:50.366347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.366848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.367291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.368006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.373017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.375193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.602220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:50.603016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:50.620160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.623518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.623518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.626129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.627328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.630276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.673561 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee HTTP/1.1 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '70c7c03c-d401-4851-aa06-7a5e131172ee'} Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:50.678378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:50.683078 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:58:50.685069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:50.686106 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd666db2-4c7d-4d39-9115-0063afdbecae tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 404 len: 111 microversion: 2.1 time: 0.088305 Aug 23 10:58:50.689137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2525/5010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:50 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:58:50.702842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:50.709052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:50.723574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.725432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.727035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.727878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.728435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.730848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.850051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:50.874432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-10b4e5c2-6dd4-413a-9460-84c9a20715a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.527656 Aug 23 10:58:50.876318 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2486/5011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:50 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:50.887750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-609cdc0d-a1ae-4f43-8101-520a2293489e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:50.928059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.compute.server_groups [None req-609cdc0d-a1ae-4f43-8101-520a2293489e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Querying cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) for 1 instances {{(pid=128860) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 10:58:50.933539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-609cdc0d-a1ae-4f43-8101-520a2293489e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:50.934357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-609cdc0d-a1ae-4f43-8101-520a2293489e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:50.935139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-609cdc0d-a1ae-4f43-8101-520a2293489e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:50.987547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-609cdc0d-a1ae-4f43-8101-520a2293489e tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.109544 Aug 23 10:58:50.988961 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2487/5012] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 10:58:50 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:51.011325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c12e2d28-ddb3-43b1-8f76-7cdd6d4900b1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.037951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.compute.server_groups [None req-c12e2d28-ddb3-43b1-8f76-7cdd6d4900b1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Querying cell b4651072-3bad-40e5-b8b2-6cbc5d12f544(cell1) for 1 instances {{(pid=128860) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 10:58:51.039547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12e2d28-ddb3-43b1-8f76-7cdd6d4900b1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.040710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12e2d28-ddb3-43b1-8f76-7cdd6d4900b1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.041391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12e2d28-ddb3-43b1-8f76-7cdd6d4900b1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:51.057153 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c12e2d28-ddb3-43b1-8f76-7cdd6d4900b1 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/6c5c37a9-100e-452d-9a17-8b7b7ea50463" status: 200 len: 183 microversion: 2.1 time: 0.055034 Aug 23 10:58:51.068485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2488/5013] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 10:58:50 2022] GET /compute/v2.1/os-server-groups/6c5c37a9-100e-452d-9a17-8b7b7ea50463 => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:51.073852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.074634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:51.085288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.086052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.086768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:51.087826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.088518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.089904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:51.111446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee HTTP/1.1 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '70c7c03c-d401-4851-aa06-7a5e131172ee'} Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:51.113841 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.119342 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.122925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:51.124222 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-449c3f9f-8388-43f7-a3d8-10814e58f626 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 404 len: 111 microversion: 2.1 time: 0.054531 Aug 23 10:58:51.129426 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2489/5014] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:58:51 2022] DELETE /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:51.137544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.138469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] [instance: 70c7c03c-d401-4851-aa06-7a5e131172ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:51.147315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.148227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.148933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:51.150342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.150976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.152219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:51.169685 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee HTTP/1.1 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '70c7c03c-d401-4851-aa06-7a5e131172ee'} Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.173383 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. Aug 23 10:58:51.178096 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.179585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance 70c7c03c-d401-4851-aa06-7a5e131172ee could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:51.180795 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f8d4062-c716-441d-839f-e7cc6ca12c11 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee" status: 404 len: 111 microversion: 2.1 time: 0.049114 Aug 23 10:58:51.186300 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2490/5015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:51 2022] GET /compute/v2.1/servers/70c7c03c-d401-4851-aa06-7a5e131172ee => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:51.192618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f7816fd-ecff-4a84-90e8-63177494b437 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.203863 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-9f7816fd-ecff-4a84-90e8-63177494b437 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance group fa92b8d4-c039-4b72-ad77-0f1d35382835 could not be found. Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f7816fd-ecff-4a84-90e8-63177494b437 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-server-groups/fa92b8d4-c039-4b72-ad77-0f1d35382835 HTTP/1.1 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance group fa92b8d4-c039-4b72-ad77-0f1d35382835 could not be found. Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'fa92b8d4-c039-4b72-ad77-0f1d35382835'} Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fa92b8d4-c039-4b72-ad77-0f1d35382835 could not be found. Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fa92b8d4-c039-4b72-ad77-0f1d35382835 could not be found. Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.205682 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.209587 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.209587 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.209587 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:51.209587 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:51.209587 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fa92b8d4-c039-4b72-ad77-0f1d35382835 could not be found. Aug 23 10:58:51.209587 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.213556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f7816fd-ecff-4a84-90e8-63177494b437 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance group fa92b8d4-c039-4b72-ad77-0f1d35382835 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:51.215596 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f7816fd-ecff-4a84-90e8-63177494b437 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/fa92b8d4-c039-4b72-ad77-0f1d35382835" status: 404 len: 117 microversion: 2.1 time: 0.027149 Aug 23 10:58:51.216194 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2491/5016] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:51 2022] DELETE /compute/v2.1/os-server-groups/fa92b8d4-c039-4b72-ad77-0f1d35382835 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:51.234705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b5b2e8d-26e6-4e2d-9315-c58fd1561532 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.254344 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4b5b2e8d-26e6-4e2d-9315-c58fd1561532 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance group 28bb6747-4a39-4a22-8094-4d9f7c1adf96 could not be found. Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b5b2e8d-26e6-4e2d-9315-c58fd1561532 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-server-groups/28bb6747-4a39-4a22-8094-4d9f7c1adf96 HTTP/1.1 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance group 28bb6747-4a39-4a22-8094-4d9f7c1adf96 could not be found. Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '28bb6747-4a39-4a22-8094-4d9f7c1adf96'} Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 28bb6747-4a39-4a22-8094-4d9f7c1adf96 could not be found. Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 28bb6747-4a39-4a22-8094-4d9f7c1adf96 could not be found. Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.258815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 28bb6747-4a39-4a22-8094-4d9f7c1adf96 could not be found. Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.262664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b5b2e8d-26e6-4e2d-9315-c58fd1561532 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance group 28bb6747-4a39-4a22-8094-4d9f7c1adf96 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:51.264487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b5b2e8d-26e6-4e2d-9315-c58fd1561532 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/28bb6747-4a39-4a22-8094-4d9f7c1adf96" status: 404 len: 117 microversion: 2.1 time: 0.041155 Aug 23 10:58:51.270846 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2492/5017] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:51 2022] DELETE /compute/v2.1/os-server-groups/28bb6747-4a39-4a22-8094-4d9f7c1adf96 => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:58:51.291621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7a89543-cf63-4892-927b-c47e474436cf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.318492 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c7a89543-cf63-4892-927b-c47e474436cf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance group 41fc635a-560b-4eb8-a968-16bb4b7866e6 could not be found. Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7a89543-cf63-4892-927b-c47e474436cf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-server-groups/41fc635a-560b-4eb8-a968-16bb4b7866e6 HTTP/1.1 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance group 41fc635a-560b-4eb8-a968-16bb4b7866e6 could not be found. Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '41fc635a-560b-4eb8-a968-16bb4b7866e6'} Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41fc635a-560b-4eb8-a968-16bb4b7866e6 could not be found. Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41fc635a-560b-4eb8-a968-16bb4b7866e6 could not be found. Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.324619 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41fc635a-560b-4eb8-a968-16bb4b7866e6 could not be found. Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7a89543-cf63-4892-927b-c47e474436cf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance group 41fc635a-560b-4eb8-a968-16bb4b7866e6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:51.331171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7a89543-cf63-4892-927b-c47e474436cf tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/41fc635a-560b-4eb8-a968-16bb4b7866e6" status: 404 len: 117 microversion: 2.1 time: 0.057067 Aug 23 10:58:51.335774 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2493/5018] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:51 2022] DELETE /compute/v2.1/os-server-groups/41fc635a-560b-4eb8-a968-16bb4b7866e6 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:51.352121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95be5159-a6f9-4105-9f74-551a037f84af tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.365898 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-95be5159-a6f9-4105-9f74-551a037f84af tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] HTTP exception thrown: Instance group b54931ff-ec0d-4837-b07d-4b994909c017 could not be found. Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95be5159-a6f9-4105-9f74-551a037f84af tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Request method failure captured: Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-server-groups/b54931ff-ec0d-4837-b07d-4b994909c017 HTTP/1.1 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLEazByGhiVWIxBFo_lsJt4DRp2qMlwiOn5LUKPv8bCP69YwNVLjycSUXwgq1s1yG5VmXrI86phWEDAJ5X1HUT9hAJi9726k8vbDsFbmOeGvKu991SVW8PVNf5ILDRpY0khistQjHNcUlzFvMv3l8DTQiTSNsvUJOH83wYFTy75oPU Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5843119e460e46f0b6576a92d6c27c3c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5843119e460e46f0b6576a92d6c27c3c"}]}] Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 5843119e460e46f0b6576a92d6c27c3c Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerGroupTestJSON-970490626 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: abc49ae6aad74e6991e7f0348069b278 Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerGroupTestJSON-970490626-project Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance group b54931ff-ec0d-4837-b07d-4b994909c017 could not be found. Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b54931ff-ec0d-4837-b07d-4b994909c017'} Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b54931ff-ec0d-4837-b07d-4b994909c017 could not be found. Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b54931ff-ec0d-4837-b07d-4b994909c017 could not be found. Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.369138 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:58:51.374122 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:58:51.374122 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:58:51.374122 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:58:51.374122 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:58:51.374122 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b54931ff-ec0d-4837-b07d-4b994909c017 could not be found. Aug 23 10:58:51.374122 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:58:51.377635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95be5159-a6f9-4105-9f74-551a037f84af tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Returning 404 to user: Instance group b54931ff-ec0d-4837-b07d-4b994909c017 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:58:51.379049 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95be5159-a6f9-4105-9f74-551a037f84af tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/b54931ff-ec0d-4837-b07d-4b994909c017" status: 404 len: 117 microversion: 2.1 time: 0.038490 Aug 23 10:58:51.379826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2494/5019] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:51 2022] DELETE /compute/v2.1/os-server-groups/b54931ff-ec0d-4837-b07d-4b994909c017 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:58:51.392480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b68437b-9459-4d58-8722-8fb7ec027fb3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.459717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b68437b-9459-4d58-8722-8fb7ec027fb3 tempest-ServerGroupTestJSON-970490626 tempest-ServerGroupTestJSON-970490626-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/6c5c37a9-100e-452d-9a17-8b7b7ea50463" status: 204 len: 0 microversion: 2.1 time: 0.073916 Aug 23 10:58:51.460791 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2495/5020] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 10:58:51 2022] DELETE /compute/v2.1/os-server-groups/6c5c37a9-100e-452d-9a17-8b7b7ea50463 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:58:51.897559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:51.898577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:51.913637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.914450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.915063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:51.917069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:51.918731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:51.919354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:52.474871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:52.594289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:52.622631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-23675815-a59d-493b-ab7f-9c5aa22884bb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1521 microversion: 2.1 time: 1.930305 Aug 23 10:58:52.623480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2526/5021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:50 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1521 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:52.676099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:52.679680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:52.690213 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dfe97886-1846-44de-b34d-a4b5f472aa71 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.797098 Aug 23 10:58:52.691238 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2496/5022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:51 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:53.649973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:53.651644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:53.668406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:53.668936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:53.669381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:53.670098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:53.675496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:53.675599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:53.711946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:53.713425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:53.735368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:53.735867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:53.736311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:53.737354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:53.737816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:53.738241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:54.137779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:54.273092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:54.285348 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33154432-bae8-4b14-afed-930a1b6f7ed6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1521 microversion: 2.1 time: 0.643385 Aug 23 10:58:54.286102 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2527/5023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:53 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1521 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:54.288831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:54.309206 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5659fc6-3fdd-44a3-91f0-5f4f37eacf07 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.601455 Aug 23 10:58:54.310801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2497/5024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:53 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:58:54.820321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-210e157a-a7e2-47ef-85ca-6b879ed8f8ed req-7ec9e823-92ca-4808-8f3c-262946884af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd86f97-9229-48da-a3cd-9475d158b762", "name": "network-vif-plugged", "status": "completed", "tag": "274327e6-6f78-4d54-bc48-9bb53291c963"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:54.851058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-210e157a-a7e2-47ef-85ca-6b879ed8f8ed req-7ec9e823-92ca-4808-8f3c-262946884af3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:54.851863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-210e157a-a7e2-47ef-85ca-6b879ed8f8ed req-7ec9e823-92ca-4808-8f3c-262946884af3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:54.853358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-210e157a-a7e2-47ef-85ca-6b879ed8f8ed req-7ec9e823-92ca-4808-8f3c-262946884af3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:54.870568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-210e157a-a7e2-47ef-85ca-6b879ed8f8ed req-7ec9e823-92ca-4808-8f3c-262946884af3 service nova] Creating event network-vif-plugged:274327e6-6f78-4d54-bc48-9bb53291c963 for instance 1bd86f97-9229-48da-a3cd-9475d158b762 on n-h2-847009-13 Aug 23 10:58:54.884925 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-210e157a-a7e2-47ef-85ca-6b879ed8f8ed req-7ec9e823-92ca-4808-8f3c-262946884af3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071193 Aug 23 10:58:54.885507 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2528/5025] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:58:55.309663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:55.310937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:55.316978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:55.323334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:55.336985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:55.338071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:55.343613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:55.345174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:55.348613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:55.350768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:55.351431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:55.357128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:55.358691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:55.362078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:55.363010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:55.363645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:55.364956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:55.917846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:55.931195 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-140bc674-070b-45cb-9ba6-61c4dcee892e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1521 microversion: 2.1 time: 0.627274 Aug 23 10:58:55.931774 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2498/5026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:55 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1521 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:56.052365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c8eeda0a-aa2c-461b-a353-79c87f43b01e req-e29d02f0-8c66-4ab5-9853-62bf911b9b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa73bec0-5d72-46ff-b247-6c5ca8b0e339", "tag": "2ebc8eb8-f9bb-4129-82f1-2fc05131b797"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:56.078537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8eeda0a-aa2c-461b-a353-79c87f43b01e req-e29d02f0-8c66-4ab5-9853-62bf911b9b6a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:56.079308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8eeda0a-aa2c-461b-a353-79c87f43b01e req-e29d02f0-8c66-4ab5-9853-62bf911b9b6a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:56.081966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8eeda0a-aa2c-461b-a353-79c87f43b01e req-e29d02f0-8c66-4ab5-9853-62bf911b9b6a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:56.098353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:56.099508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c8eeda0a-aa2c-461b-a353-79c87f43b01e req-e29d02f0-8c66-4ab5-9853-62bf911b9b6a service nova] Creating event network-changed:2ebc8eb8-f9bb-4129-82f1-2fc05131b797 for instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 on n-h1-847009-13 Aug 23 10:58:56.105145 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c8eeda0a-aa2c-461b-a353-79c87f43b01e req-e29d02f0-8c66-4ab5-9853-62bf911b9b6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057541 Aug 23 10:58:56.107515 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2499/5027] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:58:56.120273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f1365f68-76b8-4659-8f43-d90b4412e8fd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.792393 Aug 23 10:58:56.127990 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2529/5028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:55 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:56.959152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:56.961370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:56.968552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:56.969247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:56.969689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:56.970406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:56.970859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:56.974960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:57.146247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:57.147914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:57.155427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:58:57.158552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:57.159285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:57.160329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:57.161421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:57.162977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:57.163636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:57.531883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:57.549423 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-57d14bf0-e90c-40df-9260-83959932e4c7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1521 microversion: 2.1 time: 0.601430 Aug 23 10:58:57.563183 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2500/5029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:56 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:57.637905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:57.650010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f14ddc5-7de5-4862-ac25-e440694263ad tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.510548 Aug 23 10:58:57.665811 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2530/5030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:57 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:58.398909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1500615065", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a60b537e-13d6-4ff7-b0f1-459ba3346108"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:58:58.477313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] validate_networks() for [('a60b537e-13d6-4ff7-b0f1-459ba3346108', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:58:58.579659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:58.581751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:58.599077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:58.603544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:58.604091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:58.606033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:58.611070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:58.628314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:59.232951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:59.244592 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eae972e4-9a2f-409a-9687-57c5eb6f791d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1506 microversion: 2.1 time: 0.670421 Aug 23 10:58:59.265690 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2531/5031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:58 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:59.278669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:59.282471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:59.291111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:59.292002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:59.297799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:59.299248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:59.300162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:59.302181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:59.723325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:58:59.733550 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-05dc93d3-6210-48b8-9282-588512b903f3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.465414 Aug 23 10:58:59.738481 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2532/5032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:59 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:58:59.755215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:58:59.756221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:58:59.766536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:59.767434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:59.768041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:58:59.768998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:58:59.769977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:58:59.770573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.142723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:00.155149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7552117c-b59e-4c44-811d-ca4e0389deda tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 200 len: 1506 microversion: 2.1 time: 0.414688 Aug 23 10:59:00.158308 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2533/5033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:58:59 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:00.185341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:00.186066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:00.188584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:00.189435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:00.189704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:00.190324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:00.190922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:00.200840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:00.201605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:00.202238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.203360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:00.204200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:00.204836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.210540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:00.211055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:00.211506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.212257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:00.217501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:00.219753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.257709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:59:00.277167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Getting quotas for project 592e04806f0e48fb97ef24cb732f98e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:00.286373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Getting quotas for user e580ba14c5164b3790309ee7914143a5 and project 592e04806f0e48fb97ef24cb732f98e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:00.324945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:00.331041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:00.339968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:00.431855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ecf82afb-2f8c-45f4-af1d-0926dcd82f49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 204 len: 0 microversion: 2.1 time: 0.255490 Aug 23 10:59:00.433328 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2534/5034] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:59:00 2022] DELETE /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:59:00.456341 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05444d76-d426-4d8f-9109-096249e4e81f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.337355 Aug 23 10:59:00.467243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2501/5035] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:00.490579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b896eff-c50b-43a6-8a06-c2260eab4cdd tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:00.491727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b896eff-c50b-43a6-8a06-c2260eab4cdd tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:00.760527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:00.761304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:00.776358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:00.776919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:00.777794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.778549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:00.779022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:00.779458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:00.901722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3b896eff-c50b-43a6-8a06-c2260eab4cdd tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:00.917527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b896eff-c50b-43a6-8a06-c2260eab4cdd tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1217 microversion: 2.1 time: 0.439828 Aug 23 10:59:00.919111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2535/5036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:00 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1217 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:00.933290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-503064773", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "3bf8e1b1-33f9-43a0-bfdf-d705d485fd67"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:01.043819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] validate_networks() for [('3bf8e1b1-33f9-43a0-bfdf-d705d485fd67', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:59:01.475339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:01.525234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a46403ab-d6b8-433b-b959-2a43deaad4b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.765078 Aug 23 10:59:01.529529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2502/5037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:00 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:01.943147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:01.944324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:01.984245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:01.989950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:01.990648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:01.996100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:01.997098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:02.001008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:02.255401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:02.269712 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-be0d57b9-dbbf-4a49-85e0-05570303c6cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1213 microversion: 2.1 time: 0.333517 Aug 23 10:59:02.280151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2503/5038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:01 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1213 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:02.550015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:02.550699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:02.566584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:02.567103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:02.567554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:02.568323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:02.568823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:02.569278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:03.807252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:03.829322 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-985d2cbf-2aab-477b-bb97-d2f80fd761a9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 1.273043 Aug 23 10:59:03.844564 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2504/5039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:02 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:03.850062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:03.851075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:03.860102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:03.861017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:03.861966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:03.862920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:03.864700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:03.865389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:04.027439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:04.038241 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b573e461-9016-4178-8807-54d92685d4de tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1275 microversion: 2.1 time: 0.192012 Aug 23 10:59:04.039080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2505/5040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:03 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:04.854285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:04.855591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:04.870371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:04.872535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:04.873299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:04.875547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:04.876252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:04.876970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:05.197027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:05.206723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:05.208277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:05.210272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:05.211460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:05.235933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:05.236460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:05.237314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:05.238481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:05.239003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:05.239546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:05.300836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Getting quotas for project bfdf5f7099d848ab998f1458fbe40c08. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:05.332391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Getting quotas for user 1227f4970d7a49f79cd897ed1b936907 and project bfdf5f7099d848ab998f1458fbe40c08. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:05.354612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:05.357877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:05.521452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc8cba1c-5805-4906-9d15-0f72941fc2d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.600173 Aug 23 10:59:05.527701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2536/5041] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:05.536382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:05.548913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:05.567666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:05.579001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:05.579974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:05.582445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:05.584052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:05.584657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:05.967943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:05.981686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d580a399-3859-4ef1-af23-e0c09bb0effc tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 1.134828 Aug 23 10:59:05.982285 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2506/5042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:04 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:06.005741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dca26ae4-10af-47ba-84a9-ad38aacdabb7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:06.006661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dca26ae4-10af-47ba-84a9-ad38aacdabb7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:06.316873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dca26ae4-10af-47ba-84a9-ad38aacdabb7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:06.326034 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dca26ae4-10af-47ba-84a9-ad38aacdabb7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1217 microversion: 2.1 time: 0.329696 Aug 23 10:59:06.341289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2507/5043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:05 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:06.490520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-88badfd4-ffea-4164-b3ec-ab3240c94cbc req-191513f1-ebd0-4407-a8c1-3355d06ea4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa73bec0-5d72-46ff-b247-6c5ca8b0e339", "name": "network-vif-plugged", "status": "completed", "tag": "2ebc8eb8-f9bb-4129-82f1-2fc05131b797"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:06.495731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:06.517090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-88badfd4-ffea-4164-b3ec-ab3240c94cbc req-191513f1-ebd0-4407-a8c1-3355d06ea4ba service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:06.517590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-88badfd4-ffea-4164-b3ec-ab3240c94cbc req-191513f1-ebd0-4407-a8c1-3355d06ea4ba service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:06.518037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-88badfd4-ffea-4164-b3ec-ab3240c94cbc req-191513f1-ebd0-4407-a8c1-3355d06ea4ba service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:06.573173 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-88badfd4-ffea-4164-b3ec-ab3240c94cbc req-191513f1-ebd0-4407-a8c1-3355d06ea4ba service nova] Creating event network-vif-plugged:2ebc8eb8-f9bb-4129-82f1-2fc05131b797 for instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 on n-h1-847009-13 Aug 23 10:59:06.593994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-88badfd4-ffea-4164-b3ec-ab3240c94cbc req-191513f1-ebd0-4407-a8c1-3355d06ea4ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105950 Aug 23 10:59:06.597147 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2508/5044] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:59:06.845945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e4149152-6cfd-48b1-bc85-6cc845e8d319 req-4ef40b2b-bf54-4496-a702-0d209ad42771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bd86f97-9229-48da-a3cd-9475d158b762", "name": "network-vif-deleted", "tag": "274327e6-6f78-4d54-bc48-9bb53291c963"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:06.889599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e4149152-6cfd-48b1-bc85-6cc845e8d319 req-4ef40b2b-bf54-4496-a702-0d209ad42771 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:06.898613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e4149152-6cfd-48b1-bc85-6cc845e8d319 req-4ef40b2b-bf54-4496-a702-0d209ad42771 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:06.902119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e4149152-6cfd-48b1-bc85-6cc845e8d319 req-4ef40b2b-bf54-4496-a702-0d209ad42771 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:06.948438 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e4149152-6cfd-48b1-bc85-6cc845e8d319 req-4ef40b2b-bf54-4496-a702-0d209ad42771 service nova] Creating event network-vif-deleted:274327e6-6f78-4d54-bc48-9bb53291c963 for instance 1bd86f97-9229-48da-a3cd-9475d158b762 on n-h2-847009-13 Aug 23 10:59:06.992403 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e4149152-6cfd-48b1-bc85-6cc845e8d319 req-4ef40b2b-bf54-4496-a702-0d209ad42771 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151987 Aug 23 10:59:07.002841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2509/5045] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:59:07.025973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:07.028141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:07.034234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:07.047076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c25d6b82-9edb-4d7e-9481-0c59e3c04d69 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 1.517690 Aug 23 10:59:07.048833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2537/5046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:05 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:07.050130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:07.053346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:07.053798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:07.054532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:07.054993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:07.055427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:07.352645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:07.353444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:07.371918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:07.373159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:07.376410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:07.381746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:07.385476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:07.387719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:07.794636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:07.799458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:07.821052 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03e73451-f616-4001-9794-e97cba5a890e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.816707 Aug 23 10:59:07.828871 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d261b69a-0c99-43d2-ab0b-e181700246bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1269 microversion: 2.1 time: 0.480184 Aug 23 10:59:07.829559 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2538/5047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:07 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1269 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:07.842499 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2510/5048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:07 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:08.070762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:08.071199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:08.090330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:08.090836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:08.091285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:08.092006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:08.097257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:08.098245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:08.854327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:08.854950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:08.888346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:08.889136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:08.889858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:08.890816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:08.891497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:08.892172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:09.009267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:09.025050 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2009704-bf67-4798-b503-8b05127b489f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 0.960028 Aug 23 10:59:09.028518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2539/5049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:08 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:09.041906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:09.044322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:09.059880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:09.061292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:09.062530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:09.064159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:09.065438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:09.065900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:09.179723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:09.192567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05c8938d-8433-48b8-bdd6-424e8075e52f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1275 microversion: 2.1 time: 0.342575 Aug 23 10:59:09.193806 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2511/5050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:08 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:09.549231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e79d486c-215b-475f-b38a-02f84e69310c req-ec59f205-30f7-4990-b1dd-ff075785fa6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41404783-95f3-4599-ae93-d23c1d721f5c", "tag": "547a759e-353e-418a-832c-e785b14d7a3d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:09.567372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e79d486c-215b-475f-b38a-02f84e69310c req-ec59f205-30f7-4990-b1dd-ff075785fa6d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:09.567882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e79d486c-215b-475f-b38a-02f84e69310c req-ec59f205-30f7-4990-b1dd-ff075785fa6d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:09.568332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e79d486c-215b-475f-b38a-02f84e69310c req-ec59f205-30f7-4990-b1dd-ff075785fa6d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:09.605887 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e79d486c-215b-475f-b38a-02f84e69310c req-ec59f205-30f7-4990-b1dd-ff075785fa6d service nova] Creating event network-changed:547a759e-353e-418a-832c-e785b14d7a3d for instance 41404783-95f3-4599-ae93-d23c1d721f5c on n-h2-847009-13 Aug 23 10:59:09.613047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e79d486c-215b-475f-b38a-02f84e69310c req-ec59f205-30f7-4990-b1dd-ff075785fa6d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070104 Aug 23 10:59:09.614289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2512/5051] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:09.969839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:09.989068 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f940bd40-a96c-4523-83a0-be9a4d4050c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1326 microversion: 2.1 time: 0.958447 Aug 23 10:59:09.990297 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2540/5052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:09 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1326 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:10.053199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:10.057990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:10.074108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:10.074831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:10.075298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:10.076142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:10.076910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:10.078091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:10.213897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:10.214712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:10.225697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:10.226462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:10.227074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:10.231879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:10.232607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:10.233673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:10.258988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:10.577409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:10.588702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d3443bd-79b4-4c74-a084-5fb6c87b86ee tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1275 microversion: 2.1 time: 0.378675 Aug 23 10:59:10.606622 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2541/5053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:10 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1275 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:10.660756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:10.691260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 0.645120 Aug 23 10:59:10.693724 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2513/5054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:10 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:11.014332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:11.016726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:11.028446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:11.029685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:11.030359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:11.031334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:11.032029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:11.034921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:11.130904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:11.131897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-afcc2c24-99f8-4207-96ba-d4ee4d382b6f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001369 Aug 23 10:59:11.139490 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2514/5055] 10.222.0.78 () {56 vars in 886 bytes} [Tue Aug 23 10:59:11 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 10:59:11.612290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:11.621508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:11.643702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:11.647548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:11.648124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:11.649135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:11.649830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:11.653744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:11.838547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:11.851356 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-236fbabe-7976-48e0-af40-2a008f84a0c2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1507 microversion: 2.1 time: 0.844245 Aug 23 10:59:11.857117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2542/5056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:11 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:11.863295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:11.865432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:11.888617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:11.889592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:11.891053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:11.891976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:11.892609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:11.893248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:12.695520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:12.714864 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3227d9d6-0827-4ae4-a197-ca22b829da94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 1.102865 Aug 23 10:59:12.716681 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2515/5057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:11 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:12.753955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:12.755204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:12.773221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:12.774296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:12.774988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:12.776366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:12.777254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:12.777949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:12.891315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:12.906634 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7857db65-724f-4882-92b7-09c3bc340994 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 1.048175 Aug 23 10:59:12.912221 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2543/5058] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:11 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:13.519196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:13.533086 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c57484d3-91d2-47ae-8cf4-8111af857f91 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1507 microversion: 2.1 time: 0.813522 Aug 23 10:59:13.550546 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2516/5059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:12 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:13.559016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:13.559764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:13.568806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:13.569467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:13.570115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:13.572131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:13.572891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:13.573459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:13.616992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:59:13.725793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:13.797022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-816e25f1-06f5-4a9b-be0a-ed8457749016 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: .version_select at 0x7fdc9c038670>, body: {"keypair": {"name": "tempest-keypair-851050213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyaCrey5XWt/5Jl5O2oPQFKcxgfAbvsAlGsecVxUFcOFWB8Z+YEXT4fEDnDRkg7NnW+dEN4pT05DMNVre7FyEvvuRILupzqaeXla/DhMWoZXR/urOWa5HPBouc4wBmA4A=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:13.830393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-816e25f1-06f5-4a9b-be0a-ed8457749016 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:13.857277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-816e25f1-06f5-4a9b-be0a-ed8457749016 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:13.911001 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-816e25f1-06f5-4a9b-be0a-ed8457749016 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.865603 Aug 23 10:59:13.912844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2544/5060] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 10:59:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:59:13.917993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:13.921420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:13.933932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:13.937421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:13.938057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:13.940697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:13.940866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5934c3d4-eedf-4b11-8af9-8bc96b356920 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 204 len: 0 microversion: 2.1 time: 0.385685 Aug 23 10:59:13.941485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:13.941783 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2517/5061] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:59:13 2022] DELETE /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 10:59:13.942912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:13.947457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:13.948231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:13.976413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:13.977016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:13.977461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:13.978180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:13.978643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:13.979072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:14.771769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:14.782628 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-786e351c-531f-4294-b8a9-6cbea7240c34 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 0.839548 Aug 23 10:59:14.784549 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2518/5062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:13 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:14.795287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:14.805441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:14.841131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:14.841625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:14.842033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:14.842603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:14.844461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:14.851372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:14.852205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:14.856359 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7fd0d50b-d307-4843-803c-774b164df69b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.937297 Aug 23 10:59:14.858823 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2545/5063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:13 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:15.598254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-58c3f5d8-8080-450e-9a4c-439967a0cb4b req-3bdd788f-b2ea-41ce-aef8-79c72482bbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8f1906-b3b1-40ab-b4b2-c42df679a13b", "tag": "d7cfbb2c-c625-44b7-8e66-36f230902fbe"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:15.634034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:15.637711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-58c3f5d8-8080-450e-9a4c-439967a0cb4b req-3bdd788f-b2ea-41ce-aef8-79c72482bbd7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:15.637711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-58c3f5d8-8080-450e-9a4c-439967a0cb4b req-3bdd788f-b2ea-41ce-aef8-79c72482bbd7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:15.641483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-58c3f5d8-8080-450e-9a4c-439967a0cb4b req-3bdd788f-b2ea-41ce-aef8-79c72482bbd7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:15.692286 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-58c3f5d8-8080-450e-9a4c-439967a0cb4b req-3bdd788f-b2ea-41ce-aef8-79c72482bbd7 service nova] Creating event network-changed:d7cfbb2c-c625-44b7-8e66-36f230902fbe for instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b on n-h2-847009-13 Aug 23 10:59:15.711848 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-58c3f5d8-8080-450e-9a4c-439967a0cb4b req-3bdd788f-b2ea-41ce-aef8-79c72482bbd7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124135 Aug 23 10:59:15.713088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2546/5064] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:15.807030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:15.808012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:15.821386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:15.824265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:15.825956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:15.827305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:15.835227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:15.844301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:15.849295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:15.853076 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe0d31ac-e20a-4b79-ba1d-4c9895833102 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1513 microversion: 2.1 time: 1.063482 Aug 23 10:59:15.857077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2519/5065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:14 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1513 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:15.887512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:15.888404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:15.914655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:15.915730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:15.918776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:15.921393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:15.923123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:15.925877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:16.320982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:16.601972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:16.625954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df8480a3-79b8-471c-91f8-b52c88587a59 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.749915 Aug 23 10:59:16.626820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2520/5066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:15 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:16.878633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:16.880655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:16.893125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:16.894189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:16.894852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:16.895896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:16.896510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:16.898553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:17.714604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:17.725926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e93ed99-2ffe-46b5-9945-c5561c205e8e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1513 microversion: 2.1 time: 0.851223 Aug 23 10:59:17.726524 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2521/5067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:16 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1513 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:17.745335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-695886b8-9142-47ca-8e0e-f523f41aa3c2 req-02c8755e-e45f-4c94-ab40-469b96601511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41404783-95f3-4599-ae93-d23c1d721f5c", "name": "network-vif-plugged", "status": "completed", "tag": "547a759e-353e-418a-832c-e785b14d7a3d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:17.769958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-695886b8-9142-47ca-8e0e-f523f41aa3c2 req-02c8755e-e45f-4c94-ab40-469b96601511 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:17.770448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-695886b8-9142-47ca-8e0e-f523f41aa3c2 req-02c8755e-e45f-4c94-ab40-469b96601511 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:17.770931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-695886b8-9142-47ca-8e0e-f523f41aa3c2 req-02c8755e-e45f-4c94-ab40-469b96601511 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:17.798789 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-695886b8-9142-47ca-8e0e-f523f41aa3c2 req-02c8755e-e45f-4c94-ab40-469b96601511 service nova] Creating event network-vif-plugged:547a759e-353e-418a-832c-e785b14d7a3d for instance 41404783-95f3-4599-ae93-d23c1d721f5c on n-h2-847009-13 Aug 23 10:59:17.804289 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-695886b8-9142-47ca-8e0e-f523f41aa3c2 req-02c8755e-e45f-4c94-ab40-469b96601511 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066067 Aug 23 10:59:17.805547 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2522/5068] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:17.812538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:17.813809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:17.820731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:17.823776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:17.824476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:17.826939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:17.829299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:17.830004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:18.066791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:18.093151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31d2dac8-111a-4a58-aa7a-1688b8ccffc5 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 2.290331 Aug 23 10:59:18.105360 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2547/5069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:15 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:18.701763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:18.715867 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-195d1007-d019-4697-b732-cb8a4e1300b5 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.905944 Aug 23 10:59:18.720430 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2523/5070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:17 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:18.752092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:18.752718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:18.783449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:18.784826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:18.785986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:18.786883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:18.788054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:18.792272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:19.008053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:19.031959 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-106aec46-3120-460f-9b96-09c7764af4b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 200 len: 1471 microversion: 2.1 time: 0.277192 Aug 23 10:59:19.033868 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2548/5071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:18 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:19.089480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c410af19-47d5-4f8c-9e33-f10d7ea82351 req-677eb6a9-4a6a-4b1c-a81c-31c2648460e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa73bec0-5d72-46ff-b247-6c5ca8b0e339", "name": "network-vif-deleted", "tag": "2ebc8eb8-f9bb-4129-82f1-2fc05131b797"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:19.123225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:19.123901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:19.159963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:19.160479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:19.160966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:19.163445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c410af19-47d5-4f8c-9e33-f10d7ea82351 req-677eb6a9-4a6a-4b1c-a81c-31c2648460e4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:19.164049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c410af19-47d5-4f8c-9e33-f10d7ea82351 req-677eb6a9-4a6a-4b1c-a81c-31c2648460e4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:19.164498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c410af19-47d5-4f8c-9e33-f10d7ea82351 req-677eb6a9-4a6a-4b1c-a81c-31c2648460e4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:19.166866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:19.167548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:19.173369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:19.262452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c410af19-47d5-4f8c-9e33-f10d7ea82351 req-677eb6a9-4a6a-4b1c-a81c-31c2648460e4 service nova] Creating event network-vif-deleted:2ebc8eb8-f9bb-4129-82f1-2fc05131b797 for instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 on n-h1-847009-13 Aug 23 10:59:19.307510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c410af19-47d5-4f8c-9e33-f10d7ea82351 req-677eb6a9-4a6a-4b1c-a81c-31c2648460e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222220 Aug 23 10:59:19.321661 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2524/5072] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:19.745504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:19.746987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:19.758186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:19.759226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:19.759908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:19.760940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:19.761714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:19.762679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:19.819942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:19.836495 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53e11246-3f3c-4ddc-af57-3d00697346fe tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 0.718142 Aug 23 10:59:19.851200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2549/5073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:19 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:20.071445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:20.072197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:20.091322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:20.092151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:20.093307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:20.094451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:20.095149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:20.095938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:20.127799 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 10:59:20.128411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 HTTP/1.1 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fa73bec0-5d72-46ff-b247-6c5ca8b0e339'} Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:20.131923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:20.136449 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:59:20.136449 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:59:20.136449 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:59:20.136449 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:59:20.136449 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 10:59:20.136449 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:20.139002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:59:20.141063 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-abb270e7-5313-4d52-9f43-cddbea119fd7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 404 len: 111 microversion: 2.1 time: 0.089776 Aug 23 10:59:20.142197 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2550/5074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:20 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 10:59:20.144642 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-396ec5f0-ac5e-49d1-847b-af2d67ed7d37 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.403332 Aug 23 10:59:20.145579 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2525/5075] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:19 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:20.166536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5898c0ef-26b4-43b3-a1ce-56ce04402f61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '.version_select at 0x7fdca1ebdd30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:20.196501 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5898c0ef-26b4-43b3-a1ce-56ce04402f61 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-key-86592100" status: 202 len: 0 microversion: 2.1 time: 0.037692 Aug 23 10:59:20.198521 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2551/5076] 10.222.0.78 () {58 vars in 1203 bytes} [Tue Aug 23 10:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-86592100 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:59:20.329476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1798197506", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:20.402657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:59:20.862036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:20.862996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:20.870988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:20.871788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:20.872465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:20.873450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:20.874588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:20.875231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:21.139611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:21.153515 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-303acbee-2332-4b3a-92e2-5fa56cbe53af tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1317 microversion: 2.1 time: 0.295529 Aug 23 10:59:21.154779 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2552/5077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:20 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:21.178384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:21.179321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:21.198073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:21.198938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:21.199544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:21.200714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:21.201374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:21.201994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:22.185133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:22.196688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5fbc0bed-af7e-44d3-8a91-9b019d5cc3b4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 1.029092 Aug 23 10:59:22.201787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2553/5078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:21 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:22.216673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-781056770", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f55c759-5d12-4910-a3ab-34c9a1a8a48c"}], "security_groups": [{"name": "tempest-securitygroup--1436688721"}], "key_name": "tempest-keypair-851050213", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:22.491001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] validate_networks() for [('3f55c759-5d12-4910-a3ab-34c9a1a8a48c', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:59:22.719450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:22.720011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:22.720359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:22.720803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:22.721486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:22.731345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:22.732573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:22.733716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:22.735004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:22.735671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:22.736281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:22.769887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:22.782763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:22.797044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:22.799645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:22.867625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14dcfd83-5cd0-4171-a889-7a8ed9b8c804 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.541937 Aug 23 10:59:22.869036 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2526/5079] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:22.876907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:22.878019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:22.884969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:22.885612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:22.886160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:22.886980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:22.887726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:22.888577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.428045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:23.441482 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4c88048-a537-4ffd-a0a0-5231edb35986 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1506 microversion: 2.1 time: 0.570873 Aug 23 10:59:23.448904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2527/5080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:22 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:23.477753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:23.479787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:23.485368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:23.486639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:23.487131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:23.487601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:23.488027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:23.496272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=13 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:23.518275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.520663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.521330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.521864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.522368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.522807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.523970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.526852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.527156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.528199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.529666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.531258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.595524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:23.618276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:23.651122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:23.656510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:23.699266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lazy-loading 'services' on Instance uuid ceff7d60-84b7-4a17-8794-3be4e9f84c02 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:59:23.769756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a891994d-efb5-4997-a728-9c4feba24496 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.565576 Aug 23 10:59:23.771163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2554/5081] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:59:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:23.776958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:23.778224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:23.781542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:23.792884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.794359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.795378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.797631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.798826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.799645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.885297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:23.895984 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17ee6a7d-79bf-45a7-9262-8cded7900643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1213 microversion: 2.1 time: 0.123302 Aug 23 10:59:23.896690 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2555/5082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:23 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:23.898065 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eac69010-7f6c-431a-a0cf-d93303d95fd9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02/os-volume_attachments/61752e35-65cd-4dda-9dbc-e72ad60b162a" status: 202 len: 0 microversion: 2.1 time: 0.446649 Aug 23 10:59:23.898668 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2528/5083] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 10:59:23 2022] DELETE /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02/os-volume_attachments/61752e35-65cd-4dda-9dbc-e72ad60b162a => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:59:23.913235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:23.914117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:23.924232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.925415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.927519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.928532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.933460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.938567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.939178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:23.941345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:23.954797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.957006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.957840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:23.959079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:23.963343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:23.964124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:24.028128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:24.029380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf5b60b2-10a2-4aab-9ce0-055d02ccb552 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c/os-instance-actions/req-05444d76-d426-4d8f-9109-096249e4e81f" status: 200 len: 313 microversion: 2.1 time: 0.129574 Aug 23 10:59:24.039157 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2529/5084] 10.222.0.78 () {58 vars in 1419 bytes} [Tue Aug 23 10:59:23 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c/os-instance-actions/req-05444d76-d426-4d8f-9109-096249e4e81f => generated 313 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:24.045157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11d6504b-2f19-4c7c-9cd6-8483570fd59b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:24.047103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11d6504b-2f19-4c7c-9cd6-8483570fd59b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:24.272935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:24.276539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:24.286480 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1091c27-0fe9-45c4-9ea5-bb070b1b2930 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.388423 Aug 23 10:59:24.298627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-11d6504b-2f19-4c7c-9cd6-8483570fd59b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:24.301161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2556/5085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:23 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:24.307246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:24.308935 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11d6504b-2f19-4c7c-9cd6-8483570fd59b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1240 microversion: 2.1 time: 0.267765 Aug 23 10:59:24.310610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:24.314584 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2530/5086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:24 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1240 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:24.320018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:24.320872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:24.321642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:24.322527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:24.323094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:24.323789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:24.418458 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ffebe4de-2be7-4764-8ca4-719d0950f9e1 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "POST /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c/action" status: 202 len: 0 microversion: 2.1 time: 0.115588 Aug 23 10:59:24.419876 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2557/5087] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:59:24 2022] POST /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 10:59:24.428555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:24.429358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:24.446619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:24.451466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:24.453321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:24.454808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:24.455498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:24.456293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:24.761927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:24.803031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-361aee27-3424-45bb-8c77-ae4700db21cc tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1508 microversion: 2.1 time: 0.375752 Aug 23 10:59:24.803647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2531/5088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:24 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:24.926890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:24.928604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:24.945405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:24.946796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:24.947420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:24.948318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:24.949014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:24.949597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.042914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9b1088fc-8f89-4aa0-be85-8c602e85c564 req-0a44c23e-94ba-4e8f-bf3c-5c254eb9fd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8f1906-b3b1-40ab-b4b2-c42df679a13b", "name": "network-vif-plugged", "status": "completed", "tag": "d7cfbb2c-c625-44b7-8e66-36f230902fbe"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:25.062148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b1088fc-8f89-4aa0-be85-8c602e85c564 req-0a44c23e-94ba-4e8f-bf3c-5c254eb9fd89 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.062790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b1088fc-8f89-4aa0-be85-8c602e85c564 req-0a44c23e-94ba-4e8f-bf3c-5c254eb9fd89 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.066589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9b1088fc-8f89-4aa0-be85-8c602e85c564 req-0a44c23e-94ba-4e8f-bf3c-5c254eb9fd89 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.110666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:25.124518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8658ad45-ce66-445b-a049-28d0ff5404b3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1261 microversion: 2.1 time: 0.204063 Aug 23 10:59:25.127510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9b1088fc-8f89-4aa0-be85-8c602e85c564 req-0a44c23e-94ba-4e8f-bf3c-5c254eb9fd89 service nova] Creating event network-vif-plugged:d7cfbb2c-c625-44b7-8e66-36f230902fbe for instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b on n-h2-847009-13 Aug 23 10:59:25.128480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2558/5089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:24 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:25.160767 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9b1088fc-8f89-4aa0-be85-8c602e85c564 req-0a44c23e-94ba-4e8f-bf3c-5c254eb9fd89 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121794 Aug 23 10:59:25.162685 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2532/5090] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:59:25.308276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:25.309125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:25.324961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.331667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:25.332078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.332627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:25.333611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.334549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.337137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.344878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.351080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.354397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.358025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.361998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.363143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.363973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.680237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:25.708166 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63dccc6c-3840-4190-9e75-c18e04635800 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1236 microversion: 2.1 time: 0.375706 Aug 23 10:59:25.711134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2533/5091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:25 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1236 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:25.828202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:25.829002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:25.849643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.850208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.850669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.857088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:25.857606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:25.858091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:25.877508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:25.886831 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2e567a3-a782-43bf-86a0-c60d1fb13926 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.582921 Aug 23 10:59:25.887922 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2559/5092] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:25 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:26.153931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:26.154692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:26.165782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:26.170010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:26.172102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:26.189765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:26.194688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:26.198799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:26.413969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:26.438632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-255ca3fd-1f8f-463d-a704-68d85a01b350 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1267 microversion: 2.1 time: 0.284801 Aug 23 10:59:26.456497 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2560/5093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:26 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:26.735970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:26.737244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:26.751354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:26.755552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:26.757549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:26.762157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:26.762909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:26.763908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:26.948365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:26.963061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:26.985356 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b464bd83-c2fd-4090-a900-55c9dd4cddc3 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1508 microversion: 2.1 time: 1.151462 Aug 23 10:59:26.996776 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9a4c76b4-58db-45e2-814a-e2d1d3fdb31a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1310 microversion: 2.1 time: 0.256807 Aug 23 10:59:26.996776 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2561/5094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:26 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:26.996776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:26.996776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:26.997380 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2534/5095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:25 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1508 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:27.016791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:27.017639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:27.017729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:27.018396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:27.018867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:27.019653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:27.465210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:27.465851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:27.469657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:27.478040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:27.478520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:27.478968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:27.479279 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f27866f0-2e0d-4881-a30e-12786dd93a94 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1317 microversion: 2.1 time: 0.487311 Aug 23 10:59:27.479687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:27.480161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:27.480702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:27.490732 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2562/5096] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:26 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:28.013388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:28.014029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:28.026248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:28.029600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:28.030670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:28.035272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:28.035780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:28.036231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:28.423964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:28.432602 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68e5b73d-60c6-434c-bee4-cc7174a855da tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.971684 Aug 23 10:59:28.433228 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2535/5097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:27 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:28.454616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:28.455271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:28.471706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:28.472216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:28.472665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:28.473419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:28.479694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:28.480353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:28.506933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:28.531994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0bd5ecc7-3350-442d-b193-add61438035e tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1506 microversion: 2.1 time: 0.524868 Aug 23 10:59:28.545134 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2563/5098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:28 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:28.552810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:28.553570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:28.576349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:28.577014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:28.589405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:28.590530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:28.594994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:28.595461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.091856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:29.098125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:29.113985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2486031f-b3c6-4313-80f8-d87514fab7d3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.676001 Aug 23 10:59:29.130116 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2536/5099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:28 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:29.137253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '.version_select at 0x7fdc9c0c8040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:29.138098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:29.147892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.148697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.162964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.163747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.178371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.187508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.317300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-940c9840-240c-4527-8c13-8e1baee018ea tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.185074 Aug 23 10:59:29.317907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2537/5100] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Aug 23 10:59:29 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c/os-instance-actions => generated 611 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:29.338206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:29.338714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:29.348168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:29.360945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b27eb06-fb6f-49e9-893e-91a3ccfee5d1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1508 microversion: 2.1 time: 0.813563 Aug 23 10:59:29.361141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.362990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.363460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.366446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.367237 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2564/5101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:28 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1508 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:29.368849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.370509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.395231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:29.399113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:29.413504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.413868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.414124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.414873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.426739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.433207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.485904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:59:29.706574 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-237fec99-1765-4f4f-9abd-1cc087b47097 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 204 len: 0 microversion: 2.1 time: 0.371830 Aug 23 10:59:29.708095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2538/5102] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:59:29 2022] DELETE /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:59:29.718069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:29.721224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:29.740280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.741364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.742168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:29.744600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:29.746775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:29.747240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.121028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:30.134636 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac2bee89-79ea-4048-b5e7-0b57ff7547fe tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.424943 Aug 23 10:59:30.136429 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2539/5103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:29 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:30.141326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:30.145483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:30.154689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.157660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.158533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.159631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.160210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.160844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.226096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:30.243211 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-697d0288-13c5-473d-9023-794fc73b7c85 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1508 microversion: 2.1 time: 0.857166 Aug 23 10:59:30.244564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2565/5104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:29 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1508 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:30.251885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:30.252882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:30.260340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.261278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.261917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.262845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.263692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.264393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.428491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:30.442427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-502d1fb3-4ead-4ef2-998c-90b0a9c2041f tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1512 microversion: 2.1 time: 0.304766 Aug 23 10:59:30.456850 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2540/5105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:30 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:30.462325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:30.465281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:30.472617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.473410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.474024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.474958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.475596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.476196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.564556 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b65d869b-18f0-49ae-97d8-8527d6609cfd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "PUT /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1080 microversion: 2.1 time: 0.106164 Aug 23 10:59:30.578354 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2541/5106] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 10:59:30 2022] PUT /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1080 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:30.585131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:30.586048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:30.594917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.595679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.596285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:30.597228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:30.597883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:30.598624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.064212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:31.078134 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-945d3218-5460-4290-9117-050f7b50fcee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.831235 Aug 23 10:59:31.078735 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2566/5107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:30 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:31.162478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:31.163115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:31.171168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.171891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.172362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.173125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.173599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.174034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.206002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:31.223920 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcfd0b8e-1171-429b-86b1-5de97d487fb8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1506 microversion: 2.1 time: 0.642743 Aug 23 10:59:31.224353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2542/5108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:30 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1506 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:31.248172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:31.249111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:31.259589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.260105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.260554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.261328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.261798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.262228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.743270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:31.759134 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94d7a107-c64d-4b4f-944b-271497351dc0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1506 microversion: 2.1 time: 0.515103 Aug 23 10:59:31.760038 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2543/5109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:31 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:31.780948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-70b7491b-0c3c-4ccb-b660-3b31ba455ac4 req-6aa59d2d-eda3-4cf7-bb4c-7152ad51e470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d83c63c-97d7-4a2c-865d-e423bdaa0bdd", "tag": "3f9397c2-957e-44c0-9c96-bf67c8f92a4f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:31.802111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70b7491b-0c3c-4ccb-b660-3b31ba455ac4 req-6aa59d2d-eda3-4cf7-bb4c-7152ad51e470 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.803276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70b7491b-0c3c-4ccb-b660-3b31ba455ac4 req-6aa59d2d-eda3-4cf7-bb4c-7152ad51e470 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.803944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-70b7491b-0c3c-4ccb-b660-3b31ba455ac4 req-6aa59d2d-eda3-4cf7-bb4c-7152ad51e470 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.829851 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-70b7491b-0c3c-4ccb-b660-3b31ba455ac4 req-6aa59d2d-eda3-4cf7-bb4c-7152ad51e470 service nova] Creating event network-changed:3f9397c2-957e-44c0-9c96-bf67c8f92a4f for instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd on n-h1-847009-13 Aug 23 10:59:31.840369 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-70b7491b-0c3c-4ccb-b660-3b31ba455ac4 req-6aa59d2d-eda3-4cf7-bb4c-7152ad51e470 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078464 Aug 23 10:59:31.844435 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2544/5110] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:31.859746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:31.860771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:31.876447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:31.889037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.891108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.891864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.892533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:31.893035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:31.893475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:31.986804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:32.004230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-091679f1-2079-4a9e-82d6-479bb445d3ff tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.840720 Aug 23 10:59:32.011928 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2567/5111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:31 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:32.039965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:32.058271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:32.071152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.071721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.072360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.073187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.073715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.074230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.209242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:32.210072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:32.210809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:32.211358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:32.221106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:32.315326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:32.324995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.325744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.328184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.329304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.330328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.330939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.372123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4982e6a0-2362-498f-a8ab-7e5063e9557a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "POST /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b/action" status: 202 len: 1112 microversion: 2.1 time: 0.343325 Aug 23 10:59:32.373176 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2568/5112] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:59:32 2022] POST /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b/action => generated 1112 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 10:59:32.391421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:32.393415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:32.400428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.401437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.402136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.409920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.412167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.412788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.637439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:32.647943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cfb93d04-acd6-444d-a207-9dd08b697bbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.273382 Aug 23 10:59:32.652972 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2569/5113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:32 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:32.653586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:32.654196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:32.662744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.663351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.664484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.665586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:32.666612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:32.667417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:32.685014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:32.758913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:32.769181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:32.784944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d3fbcb5a-d561-4ee7-bf89-bde38fbdd697 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1512 microversion: 2.1 time: 0.936295 Aug 23 10:59:32.786347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2545/5114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:31 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1512 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:32.840372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:32.854443 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bbae7dd3-83f2-4168-8009-2a478a33ce60 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.204482 Aug 23 10:59:32.868058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2570/5115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:32 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:33.040312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:33.041041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:33.050999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.052035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.052649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.053967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.054484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.055107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.087040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:33.087040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:33.099367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.099993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.100447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.101197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.101764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.102215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.161281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 10:59:33.306969 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0526ef5e-cb5b-48d7-b9c4-0edf0f864776 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 204 len: 0 microversion: 2.1 time: 0.224934 Aug 23 10:59:33.308321 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2571/5116] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 10:59:33 2022] DELETE /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 10:59:33.455965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:33.466110 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ff8758c-5789-4729-a805-d3b0b0493df3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.430846 Aug 23 10:59:33.481756 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2546/5117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:33 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:33.494017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:33.499011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:33.512514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.513055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.513827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.515293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.515949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.516879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.561524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:33.637420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:33.865644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:33.875463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-344137546", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:33.883142 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33862b7d-865f-4191-9e75-72f8b52dc985 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1514 microversion: 2.1 time: 0.397979 Aug 23 10:59:33.883744 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2547/5118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:33 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:33.917904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:33.919065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:33.937568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.939144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.939789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:33.941451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:33.942106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:33.943460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.008769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] validate_networks() for [('2a2c9465-600f-4e4d-a0d0-1c390d5f9fc8', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:59:34.167861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:34.179840 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56a1d551-d807-49e3-903f-65d675a5da08 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.295024 Aug 23 10:59:34.181084 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2548/5119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:33 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:34.199940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-807b440b-e121-4fed-974c-be22502b2e45 req-b17078bf-daf4-41b6-9fb1-7c298e727f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41404783-95f3-4599-ae93-d23c1d721f5c", "name": "network-vif-deleted", "tag": "547a759e-353e-418a-832c-e785b14d7a3d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:34.229170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-807b440b-e121-4fed-974c-be22502b2e45 req-b17078bf-daf4-41b6-9fb1-7c298e727f7f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.230194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-807b440b-e121-4fed-974c-be22502b2e45 req-b17078bf-daf4-41b6-9fb1-7c298e727f7f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.230759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-807b440b-e121-4fed-974c-be22502b2e45 req-b17078bf-daf4-41b6-9fb1-7c298e727f7f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.267350 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-807b440b-e121-4fed-974c-be22502b2e45 req-b17078bf-daf4-41b6-9fb1-7c298e727f7f service nova] Creating event network-vif-deleted:547a759e-353e-418a-832c-e785b14d7a3d for instance 41404783-95f3-4599-ae93-d23c1d721f5c on n-h2-847009-13 Aug 23 10:59:34.277614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-807b440b-e121-4fed-974c-be22502b2e45 req-b17078bf-daf4-41b6-9fb1-7c298e727f7f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094867 Aug 23 10:59:34.278544 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2549/5120] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:34.289143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:34.290466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:34.297853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.298650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.299276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.300168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.300873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.301492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.320243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:34.365727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.366827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.367947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.368578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lazy-loading 'fault' on Instance uuid 41404783-95f3-4599-ae93-d23c1d721f5c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:59:34.424026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e580ba14c5164b3790309ee7914143a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592e04806f0e48fb97ef24cb732f98e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:34.433918 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e319383-0dcc-44c7-9891-07fbe8fb101a tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 200 len: 1307 microversion: 2.1 time: 0.150133 Aug 23 10:59:34.435287 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2550/5121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:34 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:34.453824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:34.454679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:34.464773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.465611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.466649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.467791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.468374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.469070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.661145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:34.674767 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62a5be1f-55d7-45e3-954a-85ebbd4b4a6a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.236169 Aug 23 10:59:34.675412 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2551/5122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:34 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:34.697168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2c1ff24a-9458-49e5-87a1-657ef96729f0 req-4afbba47-dd69-473c-a047-bf54f5b1ac92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7", "tag": "0bf1932a-8dea-4b17-8c39-6ac30d081cdc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:34.719034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2c1ff24a-9458-49e5-87a1-657ef96729f0 req-4afbba47-dd69-473c-a047-bf54f5b1ac92 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.719553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2c1ff24a-9458-49e5-87a1-657ef96729f0 req-4afbba47-dd69-473c-a047-bf54f5b1ac92 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.720620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2c1ff24a-9458-49e5-87a1-657ef96729f0 req-4afbba47-dd69-473c-a047-bf54f5b1ac92 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.746562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:34.751725 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2c1ff24a-9458-49e5-87a1-657ef96729f0 req-4afbba47-dd69-473c-a047-bf54f5b1ac92 service nova] Creating event network-changed:0bf1932a-8dea-4b17-8c39-6ac30d081cdc for instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 on n-h1-847009-13 Aug 23 10:59:34.768000 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2c1ff24a-9458-49e5-87a1-657ef96729f0 req-4afbba47-dd69-473c-a047-bf54f5b1ac92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089411 Aug 23 10:59:34.770259 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2552/5123] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:34.782620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:34.783504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:34.793103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.793852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.794501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.796526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.797365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.798001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.897431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:34.898023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:34.898951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:34.899392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:34.899807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:34.924937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.929102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.930783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:34.933130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:34.939413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:34.940275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.026431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Getting quotas for project 98b3358e35ea4237be958bf13d333edd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:35.040086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Getting quotas for user 39013f6c37ef4490bfee4efec898a6ce and project 98b3358e35ea4237be958bf13d333edd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:35.066550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:35.071996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:35.074189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:35.085873 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f95f9792-fcaf-4030-9783-c6d9c79fc474 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.312954 Aug 23 10:59:35.087235 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2553/5124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:34 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:35.093626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:35.094737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:35.110553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.113914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.114995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.117219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.117950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.118666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.161633 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00022f85-08ba-459d-90db-7d633b198eaf tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.846827 Aug 23 10:59:35.162548 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2572/5125] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:59:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:35.178534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17c1450e-806a-4ccf-9cc9-b1e3e1acf3b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:35.179156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17c1450e-806a-4ccf-9cc9-b1e3e1acf3b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:35.327303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17c1450e-806a-4ccf-9cc9-b1e3e1acf3b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:35.343060 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17c1450e-806a-4ccf-9cc9-b1e3e1acf3b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1213 microversion: 2.1 time: 0.168689 Aug 23 10:59:35.343907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2573/5126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:35 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:35.359403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:35.360332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:35.370169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.371387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.372933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.374963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.375657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.376257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.400705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:35.414453 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43299a20-5047-47d8-80ec-7d856fd5cbb9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1514 microversion: 2.1 time: 0.324999 Aug 23 10:59:35.430182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2554/5127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:35 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1514 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:35.458211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:35.458842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] [instance: 41404783-95f3-4599-ae93-d23c1d721f5c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:35.468155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.468854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.474607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.477508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.477923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.478349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.528278 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] HTTP exception thrown: Instance 41404783-95f3-4599-ae93-d23c1d721f5c could not be found. Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Request method failure captured: Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c HTTP/1.1 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLLxmApMU972Jgr_4RPV6GwYE9-YpJktfGc00hJ9E35dPHDnh6P3yG5aZnk0l4WKi485_9xbonWz1MJp43mrc8kmQzjVLh64I0KBhxOmVQxlWlQgYbdxgYzKnkDcxhiSODifQL4H-pnpMZnpJzny0EsbJ70xxkQzN-8dtCT4iC0UnWQ Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 592e04806f0e48fb97ef24cb732f98e0 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-InstanceActionsTestJSON-532626992 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/592e04806f0e48fb97ef24cb732f98e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_592e04806f0e48fb97ef24cb732f98e0", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/592e04806f0e48fb97ef24cb732f98e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/592e04806f0e48fb97ef24cb732f98e0"}]}] Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-InstanceActionsTestJSON-532626992 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 592e04806f0e48fb97ef24cb732f98e0 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-InstanceActionsTestJSON-532626992 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-InstanceActionsTestJSON-532626992-project Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e580ba14c5164b3790309ee7914143a5 Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-InstanceActionsTestJSON-532626992-project Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 41404783-95f3-4599-ae93-d23c1d721f5c could not be found. Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '41404783-95f3-4599-ae93-d23c1d721f5c'} Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41404783-95f3-4599-ae93-d23c1d721f5c could not be found. Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41404783-95f3-4599-ae93-d23c1d721f5c could not be found. Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:59:35.533839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41404783-95f3-4599-ae93-d23c1d721f5c could not be found. Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 10:59:35.539114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] Returning 404 to user: Instance 41404783-95f3-4599-ae93-d23c1d721f5c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:59:35.550750 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ec2114c-415a-4a92-9491-2482eea3bdc4 tempest-InstanceActionsTestJSON-532626992 tempest-InstanceActionsTestJSON-532626992-project] 10.222.0.78 "GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c" status: 404 len: 111 microversion: 2.1 time: 0.091666 Aug 23 10:59:35.554864 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2555/5128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:35 2022] GET /compute/v2.1/servers/41404783-95f3-4599-ae93-d23c1d721f5c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:59:35.701313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:35.703594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:35.714792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.715843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.719152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.720051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:35.721422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:35.724028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:35.962662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:35.973282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2af1bbb-ff28-4d2c-8044-bab50eb64e92 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.628126 Aug 23 10:59:35.973880 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2574/5129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:35 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:36.077710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:36.095264 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2de92bbd-2ed2-4f70-b9ef-0d252e348521 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.391103 Aug 23 10:59:36.096607 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2556/5130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:35 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:36.109148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:36.110080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:36.135815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:36.137794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:36.137794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:36.138450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:36.139270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:36.139706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:36.367443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:36.368392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:36.380201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:36.380712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:36.390393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:36.392729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:36.394549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:36.395070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:36.626585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:36.638214 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd5d41c0-8dce-496f-82b3-4b515fa4e5e5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1209 microversion: 2.1 time: 0.278087 Aug 23 10:59:36.642013 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2557/5131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:36 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1209 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:36.651176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:36.652056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:36.676299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:36.679188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:36.679709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:36.682930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:36.683953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:36.684466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.075986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:37.087269 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1838d3d9-d058-4e0c-9875-a1440c111ac3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1514 microversion: 2.1 time: 0.442122 Aug 23 10:59:37.088532 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2558/5132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:36 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1514 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:37.098699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:37.099325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:37.118381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.118889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.119336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.120043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.125459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.126210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.335111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:37.351252 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec3360d2-e575-44fb-84e6-7dec5f693843 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 1.246930 Aug 23 10:59:37.352014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2575/5133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:36 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:37.365264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:37.366339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:37.392191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.393498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.394223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.395523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.396221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.396930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.673259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:37.690454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5111602e-7950-4b49-a2e8-5c4efd1bb24c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.599962 Aug 23 10:59:37.691365 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2559/5134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:37 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:37.708848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:37.710113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:37.717918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.718948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.719604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.720539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.721322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.722536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.858311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:37.873157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a3ec35d-3f63-4746-8cb2-d4a04b0aeb50 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1271 microversion: 2.1 time: 0.180278 Aug 23 10:59:37.874537 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2560/5135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:37 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:37.893573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-199b224f-018d-4e5a-8de4-3e96a9972138 req-12bfb406-3fa5-4937-a523-95d1c7e9bce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d83c63c-97d7-4a2c-865d-e423bdaa0bdd", "name": "network-vif-plugged", "status": "completed", "tag": "3f9397c2-957e-44c0-9c96-bf67c8f92a4f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:37.903820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-199b224f-018d-4e5a-8de4-3e96a9972138 req-12bfb406-3fa5-4937-a523-95d1c7e9bce6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:37.904621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-199b224f-018d-4e5a-8de4-3e96a9972138 req-12bfb406-3fa5-4937-a523-95d1c7e9bce6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:37.905860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-199b224f-018d-4e5a-8de4-3e96a9972138 req-12bfb406-3fa5-4937-a523-95d1c7e9bce6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:37.927513 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-199b224f-018d-4e5a-8de4-3e96a9972138 req-12bfb406-3fa5-4937-a523-95d1c7e9bce6 service nova] Creating event network-vif-plugged:3f9397c2-957e-44c0-9c96-bf67c8f92a4f for instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd on n-h1-847009-13 Aug 23 10:59:37.933839 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-199b224f-018d-4e5a-8de4-3e96a9972138 req-12bfb406-3fa5-4937-a523-95d1c7e9bce6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046892 Aug 23 10:59:37.934679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2561/5136] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:38.115082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:38.116089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:38.127505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.128074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.128706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.129627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.130264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.130847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.134542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:38.147043 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-05304c44-54fb-4f13-af09-d768c774a76c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.793646 Aug 23 10:59:38.162292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2576/5137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:37 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:38.375290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:38.375947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:38.383196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.383678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.384118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.384856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.385320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.385754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.625657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:38.637975 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b1587e4-6b3f-450c-bb0b-c8975b1cdf3f tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1514 microversion: 2.1 time: 0.527454 Aug 23 10:59:38.638625 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2562/5138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:38 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:38.684265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-260301a1-f5f1-44a4-92cf-077e08a833a9 req-82d00d67-99c5-45d9-b28b-64ddd13f6c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceff7d60-84b7-4a17-8794-3be4e9f84c02", "name": "network-vif-deleted", "tag": "a6f231cc-cd30-48c2-90e2-9e4c40df1d92"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:38.695805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-260301a1-f5f1-44a4-92cf-077e08a833a9 req-82d00d67-99c5-45d9-b28b-64ddd13f6c32 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.696722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-260301a1-f5f1-44a4-92cf-077e08a833a9 req-82d00d67-99c5-45d9-b28b-64ddd13f6c32 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.697509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-260301a1-f5f1-44a4-92cf-077e08a833a9 req-82d00d67-99c5-45d9-b28b-64ddd13f6c32 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.715888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-260301a1-f5f1-44a4-92cf-077e08a833a9 req-82d00d67-99c5-45d9-b28b-64ddd13f6c32 service nova] Creating event network-vif-deleted:a6f231cc-cd30-48c2-90e2-9e4c40df1d92 for instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 on n-h1-847009-13 Aug 23 10:59:38.722322 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-260301a1-f5f1-44a4-92cf-077e08a833a9 req-82d00d67-99c5-45d9-b28b-64ddd13f6c32 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042591 Aug 23 10:59:38.723835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2563/5139] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:38.729764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:38.731220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:38.739688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.740122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.740577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.741847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.742508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.743114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.781556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:38.791428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06708551-c8ec-4739-b6b9-23ecb9f914d6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.420630 Aug 23 10:59:38.793076 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2577/5140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:38 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:38.896017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:38.896667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:38.905355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.906135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.906770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:38.908098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:38.908564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:38.909956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.093185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:39.107602 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e2a6ba3-f3a6-4052-89b3-af6a1415c034 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1271 microversion: 2.1 time: 0.215720 Aug 23 10:59:39.109413 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2578/5141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:38 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:39.173772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:39.174630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:39.181543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:39.182099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:39.182677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.183409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:39.183870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:39.184410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.458080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:39.474119 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-77ffce3b-a49a-467d-b24d-32fc0c674aad tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.748422 Aug 23 10:59:39.475038 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2564/5142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:38 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:39.505378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:39.532036 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3211c915-5ae6-4395-90ca-c9008d4b12b0 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.364473 Aug 23 10:59:39.533007 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2579/5143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:39 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:39.659625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:39.660256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:39.670114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:39.670651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:39.671676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.672671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:39.673383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:39.673974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.805232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:39.818542 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80fd75a8-35ba-498c-9723-6a5e4f8b3f24 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1472 microversion: 2.1 time: 0.162966 Aug 23 10:59:39.819755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:39.820784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:39.830056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:39.830843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:39.831512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.832661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:39.833382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:39.834028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:39.843347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2565/5144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:39 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:40.133383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:40.135374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:40.142406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.143219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.144136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.145325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.146106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.146736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.324159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:40.332251 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2666bf52-866c-497d-b947-0f6eae829b4e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.521957 Aug 23 10:59:40.333677 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2580/5145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:39 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:40.454360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:40.477340 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f14df910-f781-4c56-9ed6-20f86248907a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.347842 Aug 23 10:59:40.481189 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2566/5146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:40 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:40.495564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:40.496921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:40.509171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.510497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.511186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.512263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.513001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.513679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.560438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:40.563734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:40.579030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.581626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.582275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.586572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.587369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.588190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.891159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:40.906373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51c74e46-b2bc-459a-97b9-7d19b1da3892 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.414619 Aug 23 10:59:40.906853 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2581/5147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:40 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:40.913871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:40.914831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:40.921924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.922637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.923086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.923806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.924273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.924708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.985964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:40.986743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:40.987197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:40.988450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lazy-loading 'fault' on Instance uuid ceff7d60-84b7-4a17-8794-3be4e9f84c02 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:59:41.059979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:41.080930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17bc70ab-0a63-44a9-96f3-bb3ada8651f7 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1309 microversion: 2.1 time: 0.172713 Aug 23 10:59:41.081545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2582/5148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:40 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1309 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:41.142073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:41.152650 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7080025e-256c-40fb-a72e-ce4836893c5b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.600181 Aug 23 10:59:41.154119 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2567/5149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:40 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:41.355012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:41.355662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:41.373467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:41.374746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:41.375414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:41.376358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:41.376864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:41.377310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:41.503722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:41.504314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:41.518105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:41.518866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:41.519474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:41.520388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:41.521034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:41.521625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:41.903860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:41.916928 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-474eaa09-a12d-4325-887a-9be32e437482 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.417119 Aug 23 10:59:41.919952 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2568/5150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:41 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:41.939329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:41.940322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:41.958265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:41.959815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:41.960445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:41.961403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:41.962025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:41.962681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.001227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:42.015391 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b886508-3b2a-4b30-a21a-24b73b6691d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1309 microversion: 2.1 time: 0.663994 Aug 23 10:59:42.025194 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2583/5151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:41 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1309 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:42.105094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:42.106936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:42.120585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.122192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.125395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.126355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.127014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.129275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.208305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.208879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.209268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.209734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lazy-loading 'fault' on Instance uuid ceff7d60-84b7-4a17-8794-3be4e9f84c02 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:59:42.292161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:42.303063 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-83cfc993-d9a3-4eaf-88b0-095e5737bd99 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 200 len: 1309 microversion: 2.1 time: 0.203607 Aug 23 10:59:42.318197 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2584/5152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:42 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 1309 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:42.324170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:42.324817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:42.332021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.332728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.333557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.334583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.335242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.335885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.533805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:42.549908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4ee8a40-8b70-4398-ac23-0fcda0f57b31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.624627 Aug 23 10:59:42.550824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2569/5153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:41 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:42.650503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5d98a774-017a-4319-aff5-cf2ffb68270c req-0fa02377-e087-4a1f-9e0e-e9d114225bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409cf04c-59c9-43cf-af87-736745569767", "tag": "ae7c98b4-a682-4dbb-af57-65f8b592eb4b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:42.673814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5d98a774-017a-4319-aff5-cf2ffb68270c req-0fa02377-e087-4a1f-9e0e-e9d114225bf4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.674313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5d98a774-017a-4319-aff5-cf2ffb68270c req-0fa02377-e087-4a1f-9e0e-e9d114225bf4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.674761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5d98a774-017a-4319-aff5-cf2ffb68270c req-0fa02377-e087-4a1f-9e0e-e9d114225bf4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.710713 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5d98a774-017a-4319-aff5-cf2ffb68270c req-0fa02377-e087-4a1f-9e0e-e9d114225bf4 service nova] Creating event network-changed:ae7c98b4-a682-4dbb-af57-65f8b592eb4b for instance 409cf04c-59c9-43cf-af87-736745569767 on n-h2-847009-13 Aug 23 10:59:42.723536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5d98a774-017a-4319-aff5-cf2ffb68270c req-0fa02377-e087-4a1f-9e0e-e9d114225bf4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078330 Aug 23 10:59:42.724435 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2570/5154] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:59:42.780955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:42.789809 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8860d91-07ec-437e-886e-d0fd589cc973 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.469487 Aug 23 10:59:42.806093 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2585/5155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:42 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:42.942050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:42.943165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:42.952394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.954512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.955848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:42.957798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:42.958891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:42.959614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.040009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:43.040645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:43.048892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:43.049686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:43.050450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.051344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:43.051978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:43.052576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.071664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:43.250868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:43.264026 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e78d357b-ba82-4e28-9a99-ee8ca821cb14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1491 microversion: 2.1 time: 0.224792 Aug 23 10:59:43.264026 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2586/5156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:43 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1491 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:43.330462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:43.331081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: ceff7d60-84b7-4a17-8794-3be4e9f84c02] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:43.337879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:43.338577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:43.339210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.340512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:43.341222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:43.341764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.362613 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] HTTP exception thrown: Instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 could not be found. Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Request method failure captured: Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 HTTP/1.1 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLI0IvuP612-ARVlWMZXpZsbXMNFwvGjD3hs1-7BHt7L-YIgfUJrNHt4836ZUYZ4I7Mjzux8hJBfOs5gvwMNtOPeoEqPS2i589KYhnA0bbE8iWs0SJzK9KOU6cIGQhha1ADvZvOV4PI3ejfs415-JQltA4u7d9kFBq0s1eGLKWY1-rU Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 50bcfd42fb814f318149a42613b43bc8 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesSnapshotTestJSON-699243733 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/50bcfd42fb814f318149a42613b43bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_50bcfd42fb814f318149a42613b43bc8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50bcfd42fb814f318149a42613b43bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50bcfd42fb814f318149a42613b43bc8"}]}] Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesSnapshotTestJSON-699243733 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 50bcfd42fb814f318149a42613b43bc8 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-699243733 Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesSnapshotTestJSON-699243733-project Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 233bd6d1cf654ddcaca07760de91d51f Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesSnapshotTestJSON-699243733-project Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 could not be found. Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ceff7d60-84b7-4a17-8794-3be4e9f84c02'} Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 could not be found. Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 could not be found. Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 10:59:43.364696 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 could not be found. Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 10:59:43.370123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Returning 404 to user: Instance ceff7d60-84b7-4a17-8794-3be4e9f84c02 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 10:59:43.371318 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c27fd555-173c-4dd7-a059-3e5d43528b39 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02" status: 404 len: 111 microversion: 2.1 time: 0.044486 Aug 23 10:59:43.376858 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2587/5157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:43 2022] GET /compute/v2.1/servers/ceff7d60-84b7-4a17-8794-3be4e9f84c02 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 10:59:43.500913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1798197506", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:43.613015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:59:43.786901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:43.798986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86a8fb7f-41b1-47aa-b7f7-fa8a9a0ad585 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.862472 Aug 23 10:59:43.812790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2571/5158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:42 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:43.812790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:43.812790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:43.818670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:43.820794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:43.820794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.820794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:43.821745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:43.822929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:43.843918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:44.353843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:44.368714 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07a547b9-e7ff-4c5d-a5a4-998ba3d739f1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.564843 Aug 23 10:59:44.369341 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2572/5159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:43 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:44.378716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:44.381941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:44.418512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.420870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.422679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.424227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.426140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.427769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.505645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:44.506693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:44.507394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:44.508213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:44.509105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:44.546973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.548201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.550058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.557952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.563738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.565460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.619958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:44.639643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:44.663393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:44.706628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:44.710905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:44.744431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:44.754756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8eebcb80-ebca-4c1a-967e-3b260b906ad7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.383719 Aug 23 10:59:44.769772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2573/5160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:44 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:44.777762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4129062f-75fc-40ba-ad45-6f8d37a2c076 req-fad0ebf0-acce-4365-9f3b-34788c080d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7", "name": "network-vif-plugged", "status": "completed", "tag": "0bf1932a-8dea-4b17-8c39-6ac30d081cdc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:44.797377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4129062f-75fc-40ba-ad45-6f8d37a2c076 req-fad0ebf0-acce-4365-9f3b-34788c080d9c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.798657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4129062f-75fc-40ba-ad45-6f8d37a2c076 req-fad0ebf0-acce-4365-9f3b-34788c080d9c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.799450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4129062f-75fc-40ba-ad45-6f8d37a2c076 req-fad0ebf0-acce-4365-9f3b-34788c080d9c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.825824 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae609739-9bc0-46ba-be8a-d9e289d32501 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329164 Aug 23 10:59:44.833560 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2588/5161] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:44.835619 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4129062f-75fc-40ba-ad45-6f8d37a2c076 req-fad0ebf0-acce-4365-9f3b-34788c080d9c service nova] Creating event network-vif-plugged:0bf1932a-8dea-4b17-8c39-6ac30d081cdc for instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 on n-h1-847009-13 Aug 23 10:59:44.845948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:44.848136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4129062f-75fc-40ba-ad45-6f8d37a2c076 req-fad0ebf0-acce-4365-9f3b-34788c080d9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076029 Aug 23 10:59:44.849006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:44.852123 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2574/5162] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:44.858867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-776b7a05-01f8-4d1f-bed2-0f1bb16c41f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:44.863342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.866280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.868856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.869825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:44.872491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:44.873706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:44.875686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-776b7a05-01f8-4d1f-bed2-0f1bb16c41f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:45.045752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-776b7a05-01f8-4d1f-bed2-0f1bb16c41f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:45.054032 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-776b7a05-01f8-4d1f-bed2-0f1bb16c41f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1209 microversion: 2.1 time: 0.199462 Aug 23 10:59:45.054640 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2575/5163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:44 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1209 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:45.366948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:45.377676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3101545f-560a-4bd2-a227-7c394b11a6ea tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.542734 Aug 23 10:59:45.378273 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2589/5164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:44 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:45.392610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:45.394388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:45.411107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:45.412568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:45.413321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:45.416839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:45.417997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:45.419791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:45.786371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:45.787009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:45.809761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:45.810718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:45.811797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:45.813841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:45.814581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:45.815189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:46.154779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:46.183104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7524598e-ee65-4465-8b5b-70c8007880d7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1366 microversion: 2.1 time: 0.795307 Aug 23 10:59:46.184332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2576/5165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:45 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1366 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:46.190466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:46.196993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:46.218718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:46.219456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:46.220079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:46.227465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:46.228422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:46.229068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:46.250581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:46.266091 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-650c7150-273f-409e-8482-dabc1a2c759c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.487478 Aug 23 10:59:46.269564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2590/5166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:45 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:46.343222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:46.360916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-20615261-b3cf-4f40-9d52-387723bd0213 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1205 microversion: 2.1 time: 0.175187 Aug 23 10:59:46.362353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2577/5167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:46 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1205 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:46.400681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:46.401728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:46.414646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:46.415195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:46.415668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:46.416446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:46.419662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:46.420944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:46.636519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:46.647411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-12ffa3ea-ad1b-4985-9676-87edd7c1509b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.252517 Aug 23 10:59:46.651679 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2591/5168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:46 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:47.210249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:47.210828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:47.229242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.229745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.232165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.241022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.241752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.242354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.291770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:47.292404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:47.308430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.308430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.308430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.308430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.308430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.308930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.568807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:47.581772 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91311d45-4261-426c-ae25-0bca3308a506 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1556 microversion: 2.1 time: 0.373878 Aug 23 10:59:47.582864 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2578/5169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:47 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1556 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:47.594087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:47.594893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:47.611008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.611992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.613266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.615390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.617656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.618922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.717474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:47.739154 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-680436ea-3bac-4da4-8d54-79cab7a9ff1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.452419 Aug 23 10:59:47.741806 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2592/5170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:47 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:47.754386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:47.757426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:47.758813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:47.767653 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5d1d874-29ef-4a59-9f67-957ea075229b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1267 microversion: 2.1 time: 0.182802 Aug 23 10:59:47.768108 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2579/5171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:47 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:47.774852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.775354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.777856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.779112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.781498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.784459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.790196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:47.790847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:47.804161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.804663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.805143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:47.810322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:47.811159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:47.811761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:48.006584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:48.016171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da834935-79be-4f54-b690-40b53c725698 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.237808 Aug 23 10:59:48.017290 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2580/5172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:47 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:48.046006 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-119c150a-8921-4040-a5a7-2193350d7bee tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.300703 Aug 23 10:59:48.046626 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2593/5173] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 10:59:47 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-interface => generated 285 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:48.784413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:48.812766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:48.814732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:48.816133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:48.851854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:48.852356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:48.852815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:48.853611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:48.854116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:48.854550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:48.855266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:48.855725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:48.856144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:48.856655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:48.864912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:48.869443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:49.275711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:49.281532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02b6691a-01fc-4a6c-a10a-741b08ec4d47 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.519119 Aug 23 10:59:49.298590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2581/5174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:48 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:49.307591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:49.308472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:49.324718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:49.325575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:49.326209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:49.328600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:49.335984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:49.336661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:49.395176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:49.412729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67e6855e-7852-46ef-b701-deb0e44b5e2b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.623448 Aug 23 10:59:49.414870 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2594/5175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:48 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:49.584579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:49.595884 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8720516-0d90-4b10-8222-24274cabd262 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.295858 Aug 23 10:59:49.597588 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2582/5176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:49 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:49.948296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b62d247a-f154-4024-95c7-960dbcf74643 req-af1be10b-3664-4a60-8732-35c9c864be1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7", "tag": "0bf1932a-8dea-4b17-8c39-6ac30d081cdc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:49.971165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b62d247a-f154-4024-95c7-960dbcf74643 req-af1be10b-3664-4a60-8732-35c9c864be1f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:49.972589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b62d247a-f154-4024-95c7-960dbcf74643 req-af1be10b-3664-4a60-8732-35c9c864be1f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:49.973255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b62d247a-f154-4024-95c7-960dbcf74643 req-af1be10b-3664-4a60-8732-35c9c864be1f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:49.996237 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b62d247a-f154-4024-95c7-960dbcf74643 req-af1be10b-3664-4a60-8732-35c9c864be1f service nova] Creating event network-changed:0bf1932a-8dea-4b17-8c39-6ac30d081cdc for instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 on n-h1-847009-13 Aug 23 10:59:50.004465 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b62d247a-f154-4024-95c7-960dbcf74643 req-af1be10b-3664-4a60-8732-35c9c864be1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064425 Aug 23 10:59:50.009341 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2595/5177] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:50.291839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-92990041-6bbd-470a-a620-271e07ce01e8 req-597a7714-366b-4fc8-9142-a8d6578c0ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b026e639-e285-49e8-90d2-c580dec527de", "tag": "3a03023a-700f-40ab-8334-3fee0fb70122"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:50.302741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:50.303442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:50.323705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.324209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.324650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:50.325390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.330786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-92990041-6bbd-470a-a620-271e07ce01e8 req-597a7714-366b-4fc8-9142-a8d6578c0ec0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.331582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.332187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:50.341162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-92990041-6bbd-470a-a620-271e07ce01e8 req-597a7714-366b-4fc8-9142-a8d6578c0ec0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.343384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-92990041-6bbd-470a-a620-271e07ce01e8 req-597a7714-366b-4fc8-9142-a8d6578c0ec0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:50.386901 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-92990041-6bbd-470a-a620-271e07ce01e8 req-597a7714-366b-4fc8-9142-a8d6578c0ec0 service nova] Creating event network-changed:3a03023a-700f-40ab-8334-3fee0fb70122 for instance b026e639-e285-49e8-90d2-c580dec527de on n-h2-847009-13 Aug 23 10:59:50.405331 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-92990041-6bbd-470a-a620-271e07ce01e8 req-597a7714-366b-4fc8-9142-a8d6578c0ec0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116658 Aug 23 10:59:50.420142 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2583/5178] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:50.436152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:50.437250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:50.444453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.445264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.445887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:50.446761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.447556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.448251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:50.779881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:50.794070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6df5b55-0ffb-43b4-b146-5b07a326c2a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.361130 Aug 23 10:59:50.797381 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2584/5179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:50 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:50.815856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:50.820156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:50.841660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.843211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.844896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:50.847644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:50.849381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:50.851184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:51.008371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:51.025474 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f413daa1-688b-4d5b-8081-0e6f588847a6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.726855 Aug 23 10:59:51.039376 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2596/5180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:50 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:51.269398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:51.278511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b33cb223-b210-4770-9e41-0cec3c058713 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.479792 Aug 23 10:59:51.280145 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2585/5181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:50 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:51.827083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:51.828006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:51.841437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:51.842555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:51.843010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:51.843734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:51.844199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:51.848168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:52.047169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:52.047898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:52.059560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:52.060174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:52.061685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:52.070210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:52.073381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:52.074123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:52.232067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:52.241720 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd793630-cdcf-4cce-b192-41f3bc2a8278 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.419550 Aug 23 10:59:52.250199 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2597/5182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:51 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:52.300900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:52.301913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:52.313926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:52.316628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:52.319574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:52.320647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:52.321372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:52.322479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:52.592772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:52.605183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17ef98f9-ba6f-4881-9735-34fc28c139f2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.308637 Aug 23 10:59:52.615421 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2598/5183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:52 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:53.216333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:53.229625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72ccf218-b8e7-4bad-9b70-49fe68f834d4 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 1.186578 Aug 23 10:59:53.246899 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2586/5184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:52 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:53.270455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:53.271826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:53.282820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:53.288716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:53.289355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:53.290268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:53.291526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:53.294989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:53.464648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a78d689d-c63f-4d37-b5fe-067fbf52fc0c req-22c46cb7-a64f-416a-a128-c7aed929ff37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409cf04c-59c9-43cf-af87-736745569767", "name": "network-vif-plugged", "status": "completed", "tag": "ae7c98b4-a682-4dbb-af57-65f8b592eb4b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:53.499364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a78d689d-c63f-4d37-b5fe-067fbf52fc0c req-22c46cb7-a64f-416a-a128-c7aed929ff37 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:53.502412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a78d689d-c63f-4d37-b5fe-067fbf52fc0c req-22c46cb7-a64f-416a-a128-c7aed929ff37 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:53.504702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a78d689d-c63f-4d37-b5fe-067fbf52fc0c req-22c46cb7-a64f-416a-a128-c7aed929ff37 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:53.535204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a78d689d-c63f-4d37-b5fe-067fbf52fc0c req-22c46cb7-a64f-416a-a128-c7aed929ff37 service nova] Creating event network-vif-plugged:ae7c98b4-a682-4dbb-af57-65f8b592eb4b for instance 409cf04c-59c9-43cf-af87-736745569767 on n-h2-847009-13 Aug 23 10:59:53.553922 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a78d689d-c63f-4d37-b5fe-067fbf52fc0c req-22c46cb7-a64f-416a-a128-c7aed929ff37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093222 Aug 23 10:59:53.561269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2587/5185] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 10:59:53.619907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:53.637006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:53.637767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:53.650686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4eb299d-6514-4220-861b-d754e837ec09 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.384143 Aug 23 10:59:53.663007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:53.666047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:53.667673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:53.668156 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2599/5186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:53 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:53.670728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:53.673335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:53.674026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:54.125013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:54.147024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0582f97-4c39-4e34-80f4-31fd91e4f1cb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.507159 Aug 23 10:59:54.151099 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2588/5187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:53 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:54.254649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:54.255107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:54.273700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1183142564", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "faae728c-9bdc-46ea-bd05-e18939fe1f04"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:54.281154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:54.282430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:54.282893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:54.283718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:54.284401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:54.291532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:54.384154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] validate_networks() for [('faae728c-9bdc-46ea-bd05-e18939fe1f04', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 10:59:54.573496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:54.585594 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-50d23275-50d1-45b5-b69f-4ca3683a0df1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.337838 Aug 23 10:59:54.587599 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2600/5188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:54 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:54.689868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:54.690856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:54.699196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:54.700451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=14 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:54.704376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:54.705431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:54.718491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:54.721503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:54.723957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:54.726086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.041970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:55.053170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:55.054922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11c5722e-3bae-4f68-9a0a-80948e903b21 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.369682 Aug 23 10:59:55.072405 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2601/5189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:54 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:55.171590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:55.172786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:55.189497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:55.190332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:55.191150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.192215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:55.193251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:55.193933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.514929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 10:59:55.515578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 10:59:55.516300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 10:59:55.517053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 10:59:55.518330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 10:59:55.545650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:55.548732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:55.551095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.552655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:55.553450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:55.554838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.580917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Getting quotas for project 50bcfd42fb814f318149a42613b43bc8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 10:59:55.588485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Getting quotas for user 233bd6d1cf654ddcaca07760de91d51f and project 50bcfd42fb814f318149a42613b43bc8. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 10:59:55.594175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:55.607194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 10:59:55.610722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 10:59:55.710888 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d38a7f29-2640-48cf-a288-9f40a5c467ed tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.439125 Aug 23 10:59:55.715397 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2589/5190] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 10:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 10:59:55.728128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:55.729028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:55.742658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:55.743989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:55.744807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.745759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:55.746598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:55.747742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:55.867565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:55.884532 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-27a42e49-3232-4094-8a12-0e5edb67c06c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1313 microversion: 2.1 time: 0.714950 Aug 23 10:59:55.885614 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2602/5191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:55 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:55.902302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b1578c0-60d7-4887-aa0a-b04790cdf982 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:55.902995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b1578c0-60d7-4887-aa0a-b04790cdf982 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:56.061919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3b1578c0-60d7-4887-aa0a-b04790cdf982 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:56.079918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b1578c0-60d7-4887-aa0a-b04790cdf982 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1219 microversion: 2.1 time: 0.193184 Aug 23 10:59:56.080661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2603/5192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:55 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:56.086713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:56.087449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:56.101689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:56.102774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:56.103460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:56.104701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:56.105411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:56.106060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:56.199987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:56.214714 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8624b043-8d59-4539-86a1-e108b02f2b25 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.497804 Aug 23 10:59:56.215879 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2590/5193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:55 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:56.543200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:56.556076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b80fd167-bd9a-4e48-9f8f-38747442bf55 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.473725 Aug 23 10:59:56.557584 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2604/5194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:56 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:56.913101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:56.915621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:56.926692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:56.927602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:56.929084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:56.930014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:56.930669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:56.931374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.101293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:57.102503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:57.112343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.113860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.117137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.118203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.118855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.122563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.249174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:57.256365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:57.265250 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7297fe36-2ca0-4d87-a71e-4b3d3ef48311 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1271 microversion: 2.1 time: 0.167705 Aug 23 10:59:57.266413 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2605/5195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:57 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:57.283775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:57.284048 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8dc50a6b-05e6-4e78-9f04-e2ebf23a97ee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1498 microversion: 2.1 time: 0.382541 Aug 23 10:59:57.284683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:57.284865 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2591/5196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:56 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1498 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:57.301459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.302220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.302832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.303736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.304516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.305147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.305963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:57.311599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:57.329800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.330286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.333349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.334262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.334925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.336856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.343814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:57.374055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 10:59:57.381859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lazy-loading 'flavor' on Instance uuid 409cf04c-59c9-43cf-af87-736745569767 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 10:59:57.554861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:57.567082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00478837-7430-4e12-b02c-05d1e315b3a9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.299230 Aug 23 10:59:57.567982 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e14825d-6b8b-46e5-96f2-a663c4a355b3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "POST /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767/action" status: 200 len: 32 microversion: 2.1 time: 0.267194 Aug 23 10:59:57.568826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2592/5197] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 10:59:57 2022] POST /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 10:59:57.569265 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2606/5198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:57 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:57.600220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:57.601621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:57.606619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:57.612968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:57.616897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.621651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.626600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.627535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.628194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.628941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.630684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.635307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.635967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:57.636939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:57.638036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:57.639126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:58.164097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:58.179762 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ed60a40a-bef6-4ba9-ad65-cbf9ab59a5e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.585604 Aug 23 10:59:58.180666 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2607/5199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:57 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:58.256417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6c623caf-9dd5-4529-a99e-92ad148a103c req-c8e5a861-8167-466e-be00-651aa498f2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b026e639-e285-49e8-90d2-c580dec527de", "name": "network-vif-plugged", "status": "completed", "tag": "3a03023a-700f-40ab-8334-3fee0fb70122"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 10:59:58.279401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6c623caf-9dd5-4529-a99e-92ad148a103c req-c8e5a861-8167-466e-be00-651aa498f2f6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:58.280052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6c623caf-9dd5-4529-a99e-92ad148a103c req-c8e5a861-8167-466e-be00-651aa498f2f6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:58.281188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6c623caf-9dd5-4529-a99e-92ad148a103c req-c8e5a861-8167-466e-be00-651aa498f2f6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:58.325349 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6c623caf-9dd5-4529-a99e-92ad148a103c req-c8e5a861-8167-466e-be00-651aa498f2f6 service nova] Creating event network-vif-plugged:3a03023a-700f-40ab-8334-3fee0fb70122 for instance b026e639-e285-49e8-90d2-c580dec527de on n-h2-847009-13 Aug 23 10:59:58.338964 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6c623caf-9dd5-4529-a99e-92ad148a103c req-c8e5a861-8167-466e-be00-651aa498f2f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092209 Aug 23 10:59:58.342653 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2608/5200] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 10:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 10:59:58.350012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:58.351871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:58.360355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:58.361668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:58.363028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:58.364217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:58.366851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:58.367708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:58.531829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:58.547117 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac012617-53c0-43ab-9537-37252b73da44 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1277 microversion: 2.1 time: 0.201747 Aug 23 10:59:58.549007 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2609/5201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:58 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:58.595905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:58.597465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:58.614668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:58.618122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:58.619451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:58.622188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:58.625944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:58.630984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:58.720074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:58.740024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15a8c956-60fe-48f2-b457-ea4439e559ec tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 1.163115 Aug 23 10:59:58.742449 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2593/5202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:57 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:59.041087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:59.055548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1571e315-918a-4ceb-b8ba-a176ea33240e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.466313 Aug 23 10:59:59.056713 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2610/5203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:58 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 10:59:59.207406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:59.208360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:59.220205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:59.220205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:59.220205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:59.220205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:59.220205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:59.220205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:59.570984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:59.571952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:59.580982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:59.588059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:59.588495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:59.589449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:59.590031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:59.592561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:59.697762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:59.714866 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e59078a-1561-45e0-8298-08bef4251361 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1277 microversion: 2.1 time: 0.142058 Aug 23 10:59:59.716028 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2611/5204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:59 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:59.763403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 10:59:59.765702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 10:59:59.774463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 10:59:59.783632 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0800d75a-9327-4bfc-9a6d-5a8905686678 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.581248 Aug 23 10:59:59.809596 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2594/5205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:59 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 10:59:59.810263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:59.812927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:59.814579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 10:59:59.815447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 10:59:59.817386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 10:59:59.817954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:00.087195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:00.088239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:00.100500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:00.105024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:00.105702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:00.106834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:00.110045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:00.110752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:00.211702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:00.231917 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de7e308c-097c-4e41-9f65-d03f2fffc65b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.471251 Aug 23 11:00:00.234357 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2612/5206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 10:59:59 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:00.535049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:00.555827 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4369c1e7-3700-43a2-8fc3-5a6808e2bec6 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.472723 Aug 23 11:00:00.557861 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2595/5207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:00 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:00.741738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:00.743386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:00.754161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:00.754929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:00.755544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:00.756465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:00.757049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:00.757493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:00.818884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:00.820278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:00.828634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:00.829425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:00.830033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:00.830944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:00.831567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:00.832317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:01.039709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:01.064390 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9447be2d-a6b7-481c-9f0a-e21078e44322 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.326572 Aug 23 11:00:01.066837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2613/5208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:00 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:01.259103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:01.259812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:01.277601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:01.277601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:01.279796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:01.282032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:01.282844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:01.283787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:01.286318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:01.301206 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b264703-f53e-4c40-a39d-949c495b30c1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.485166 Aug 23 11:00:01.301853 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2596/5209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:00 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:01.583662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:01.584547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:01.597042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:01.600902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:01.602185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:01.605102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:01.605844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:01.608290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:01.803807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:01.812521 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb467d91-4c34-4e92-b428-0ece2ba0f4c1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1309 microversion: 2.1 time: 0.558673 Aug 23 11:00:01.813532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2614/5210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:01 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1309 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:01.844393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:01.856031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2effdbb2-2c24-4892-9aa6-21a239bbea8f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1517 microversion: 2.1 time: 0.281634 Aug 23 11:00:01.861893 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2597/5211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:01 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:01.985097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-838fcc98-7296-4310-b23f-4b9988ae3b9d req-58f0a49f-cedc-4576-8dee-c3aa0ff310b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8cc3299-8702-4bf7-8e1c-04760cfb167f", "tag": "1d3fd3db-f6de-4188-8574-c97b71c94879"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:02.015507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-838fcc98-7296-4310-b23f-4b9988ae3b9d req-58f0a49f-cedc-4576-8dee-c3aa0ff310b1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.016491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-838fcc98-7296-4310-b23f-4b9988ae3b9d req-58f0a49f-cedc-4576-8dee-c3aa0ff310b1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.018099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-838fcc98-7296-4310-b23f-4b9988ae3b9d req-58f0a49f-cedc-4576-8dee-c3aa0ff310b1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:02.045308 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-838fcc98-7296-4310-b23f-4b9988ae3b9d req-58f0a49f-cedc-4576-8dee-c3aa0ff310b1 service nova] Creating event network-changed:1d3fd3db-f6de-4188-8574-c97b71c94879 for instance c8cc3299-8702-4bf7-8e1c-04760cfb167f on n-h1-847009-13 Aug 23 11:00:02.054115 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-838fcc98-7296-4310-b23f-4b9988ae3b9d req-58f0a49f-cedc-4576-8dee-c3aa0ff310b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074529 Aug 23 11:00:02.055869 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2598/5212] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:02.102826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:02.105138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:02.115949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.117149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.117924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:02.119198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.120246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.120973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:02.174148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1453556333", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "94813710-1441-4ccc-b145-6640da8b2644"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:02.288241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] validate_networks() for [('94813710-1441-4ccc-b145-6640da8b2644', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:00:02.468941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:02.485709 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9b4dac8-b4bd-4b15-adf5-b6fb68a51d50 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.397722 Aug 23 11:00:02.487258 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2599/5213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:02 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:02.517827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:02.518663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:02.526423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.529840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.534519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:02.534519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.534519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.534519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:02.852616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:02.891449 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d878e85-cc81-4254-8785-10c984f1138c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.402333 Aug 23 11:00:02.892067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2600/5214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:02 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:02.898400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:02.899271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:02.929050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.929887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.930700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:02.931703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:02.937049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:02.938357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.149145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:03.163937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d26623a-cb11-4d9c-a956-2f87e7fa81f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1490 microversion: 2.1 time: 0.270496 Aug 23 11:00:03.172722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2601/5215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:02 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1490 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:03.179859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:03.184112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:03.199415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.200031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.202239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.202916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.203992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.205424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.419410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:03.429459 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d27a876-91ed-4fca-8f76-1cd2df629ab3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1523 microversion: 2.1 time: 0.254816 Aug 23 11:00:03.441722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2602/5216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:03 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:03.449373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:03.452862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:03.459478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.459975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.466280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.466280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.466280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.466280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.642245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:00:03.642848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:00:03.643188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:00:03.643600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:00:03.644382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:00:03.659752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.660564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.661211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.663364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.664309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.664874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.686251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Getting quotas for project 585ec90481bd416eb880c6a44f31f6a7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:00:03.692091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Getting quotas for user 7136af0a6015480cb11ecbf3ac96bf6e and project 585ec90481bd416eb880c6a44f31f6a7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:00:03.708236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:00:03.710975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:00:03.802005 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bef16866-e9dc-49d1-b866-0b5421a4907c tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.986722 Aug 23 11:00:03.802619 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2615/5217] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 11:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 11:00:03.815707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:03.816854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:03.826700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.827586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.828909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.831040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:03.831698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:03.833348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:03.848381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:03.863618 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0612ec38-bd24-489e-919c-16af23c753b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1491 microversion: 2.1 time: 0.420491 Aug 23 11:00:03.865004 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2603/5218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:03 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1491 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:03.871562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08ef8044-64f0-4e9f-bff3-0f1fbeb5ac32 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:03.873159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08ef8044-64f0-4e9f-bff3-0f1fbeb5ac32 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:04.027686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08ef8044-64f0-4e9f-bff3-0f1fbeb5ac32 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.040725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08ef8044-64f0-4e9f-bff3-0f1fbeb5ac32 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.044041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08ef8044-64f0-4e9f-bff3-0f1fbeb5ac32 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.045645 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08ef8044-64f0-4e9f-bff3-0f1fbeb5ac32 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1259 microversion: 2.21 time: 0.179218 Aug 23 11:00:04.065160 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2604/5219] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:03 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:04.073158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:04.073676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:04.089579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.096358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b82d52e-ef72-40c5-b982-0fa475c6757e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.292660 Aug 23 11:00:04.097049 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2616/5220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:03 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:04.099747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.100324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.100786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.101504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.101963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.102391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.113385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:04.114004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:04.125634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.126495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.127225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.128149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.128964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.129586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.334895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.368262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4a5be5f-d45c-4bcf-9455-bba29d0ade6c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.262248 Aug 23 11:00:04.369882 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2617/5221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:04 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:04.425705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.443246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74f26c02-3a19-4746-b5bb-897a9f72a9f0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1490 microversion: 2.1 time: 0.376831 Aug 23 11:00:04.444371 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2605/5222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:04 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1490 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:04.463883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:04.464346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:04.466052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:04.468605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:04.483161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.484843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.487154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.487671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.487899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.488113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.489043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.490204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.491211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.496826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.497289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.498341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.570706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:04.715205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d047197-f5fa-4ba4-8b36-61fb907a12a4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 204 len: 0 microversion: 2.1 time: 0.254888 Aug 23 11:00:04.718989 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2606/5223] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:04 2022] DELETE /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 11:00:04.751018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:04.751900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:04.774107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.774881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.775709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.789521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:04.791016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:04.791481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:04.815353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:04.849215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:04.875850 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-302a6611-4df4-4896-962e-088a606cdfba tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1523 microversion: 2.1 time: 0.417300 Aug 23 11:00:04.878254 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2618/5224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:04 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:05.070307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:05.071414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:05.080981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.082084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.083116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.084050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.084856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.085362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.184632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:05.194095 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1ab6c0a-58ae-4c2d-aa26-1c59e4e90bce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1496 microversion: 2.1 time: 0.473720 Aug 23 11:00:05.198383 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2607/5225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:04 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1496 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:05.208609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:05.209297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:05.219519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:05.221054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.221547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.226044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.226866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.236956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.237696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.237844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:05.239365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:05.244284 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98889896-a08d-4f3c-8788-776b3bcab3ca tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1255 microversion: 2.21 time: 0.176882 Aug 23 11:00:05.249529 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2619/5226] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:05 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1255 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:05.400500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:05.401323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:05.419604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.424355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.425118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.425998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.426598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.427743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.566704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:05.679425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:05.690891 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e9931d33-6542-4f76-800e-9611d507810c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.303830 Aug 23 11:00:05.691502 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2620/5227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:05 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:05.869719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-30db1aab-98ac-4f4c-9f86-7bcf2211004d req-a63396d4-836f-49f8-80ac-fe8591b35fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8f1906-b3b1-40ab-b4b2-c42df679a13b", "name": "network-vif-unplugged", "status": "completed", "tag": "d7cfbb2c-c625-44b7-8e66-36f230902fbe"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:05.885003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-30db1aab-98ac-4f4c-9f86-7bcf2211004d req-a63396d4-836f-49f8-80ac-fe8591b35fe2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.885500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-30db1aab-98ac-4f4c-9f86-7bcf2211004d req-a63396d4-836f-49f8-80ac-fe8591b35fe2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.885941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-30db1aab-98ac-4f4c-9f86-7bcf2211004d req-a63396d4-836f-49f8-80ac-fe8591b35fe2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.913587 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-30db1aab-98ac-4f4c-9f86-7bcf2211004d req-a63396d4-836f-49f8-80ac-fe8591b35fe2 service nova] Creating event network-vif-unplugged:d7cfbb2c-c625-44b7-8e66-36f230902fbe for instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b on n-h2-847009-13 Aug 23 11:00:05.927191 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-30db1aab-98ac-4f4c-9f86-7bcf2211004d req-a63396d4-836f-49f8-80ac-fe8591b35fe2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056512 Aug 23 11:00:05.929998 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2621/5228] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:05.937413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:05.938396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:05.945878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.946649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.947344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:05.948429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:05.949106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:05.949704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:06.079255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:06.095436 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07b31be1-917f-4034-a37b-7fa6a7c1c6ee tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.894658 Aug 23 11:00:06.112261 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2608/5229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:05 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:06.146593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:06.158208 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4fffe173-8253-4d86-8142-812a6d904b75 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1523 microversion: 2.1 time: 0.225307 Aug 23 11:00:06.161748 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2622/5230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:05 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:06.218679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:06.219309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:06.226757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:06.227257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:06.227917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:06.228630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:06.229279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:06.229877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:06.276136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:06.276930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:06.285397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:06.286492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:06.288064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:06.289651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:06.290597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:06.292237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:06.384539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:06.394134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:06.395578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:06.396718 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af2d78a6-442c-4111-9cab-83ce185273ef tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1255 microversion: 2.21 time: 0.126457 Aug 23 11:00:06.409546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2623/5231] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:06 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1255 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:06.537963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:06.553780 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0d45a12-70d7-4880-abed-dc45c811837d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1496 microversion: 2.1 time: 0.338992 Aug 23 11:00:06.554564 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2609/5232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:06 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1496 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:06.715115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:06.716043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:06.728266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:06.730427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:06.732830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:06.733608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:06.734088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:06.734534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.027515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.037401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f37bd1a-448b-46c9-93cb-13c4a45a7df5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.326059 Aug 23 11:00:07.038007 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2624/5233] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:06 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:07.124431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:07.125103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:07.146080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.146586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.154984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.156841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.161543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.163417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.187261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:07.188283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:07.190591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:07.205649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.206582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.208147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.210496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.211737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.214207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.271980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:07.584900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.597247 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4de07744-ef97-4a2a-b19d-c1cdf7303482 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1523 microversion: 2.1 time: 0.416225 Aug 23 11:00:07.615406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2625/5234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:07 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:07.619594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:07.620224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:07.640060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.640588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.641067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.641804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.642274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.642709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.668539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.683713 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-204ffa32-f0bd-4912-80ee-a9464169afba tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.568010 Aug 23 11:00:07.694312 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2610/5235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:07 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:07.706643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:07.708615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:07.731156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.744755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.745397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.749050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.753462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.755554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.773921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.793671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.796751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.801609 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f4d4990-0081-425c-a4f6-3ab6624c05d9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1329 microversion: 2.21 time: 0.188884 Aug 23 11:00:07.802219 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2626/5236] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:07 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1329 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:07.830467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1396e72e-2afa-42b4-815f-a5f665610d42 req-8f2d2890-d614-4234-8ba5-0f083e2b113c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b026e639-e285-49e8-90d2-c580dec527de", "name": "network-vif-deleted", "tag": "3a03023a-700f-40ab-8334-3fee0fb70122"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:07.842384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1396e72e-2afa-42b4-815f-a5f665610d42 req-8f2d2890-d614-4234-8ba5-0f083e2b113c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:07.847631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1396e72e-2afa-42b4-815f-a5f665610d42 req-8f2d2890-d614-4234-8ba5-0f083e2b113c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:07.856122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1396e72e-2afa-42b4-815f-a5f665610d42 req-8f2d2890-d614-4234-8ba5-0f083e2b113c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:07.875230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1396e72e-2afa-42b4-815f-a5f665610d42 req-8f2d2890-d614-4234-8ba5-0f083e2b113c service nova] Creating event network-vif-deleted:3a03023a-700f-40ab-8334-3fee0fb70122 for instance b026e639-e285-49e8-90d2-c580dec527de on n-h2-847009-13 Aug 23 11:00:07.881367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1396e72e-2afa-42b4-815f-a5f665610d42 req-8f2d2890-d614-4234-8ba5-0f083e2b113c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061729 Aug 23 11:00:07.882173 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2627/5237] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:07.936860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:07.954563 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d385af4-60df-4a66-a7a9-3323ab1cea6d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 200 len: 1294 microversion: 2.1 time: 0.255853 Aug 23 11:00:07.969517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2611/5238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:07 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 1294 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:08.060576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:08.061469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:08.069561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.070818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.071439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.072367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.073090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.073684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.300536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:08.309337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f15d98cd-9a10-4467-9439-bb343e780e52 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.254480 Aug 23 11:00:08.321362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2628/5239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:08 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:08.623893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:08.625373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:08.631490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.632229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.632956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.634090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.634946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.635603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.722096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:08.723090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:08.730028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.731413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.732189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.733469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.734175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.735568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.928455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:08.939566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36ed4e2b-8365-44de-954b-3fe9c6aa9da4 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.224031 Aug 23 11:00:08.955903 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2629/5240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:08 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:08.963886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:08.965479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:08.974062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.974830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.975516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:08.976424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:08.977080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:08.978315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.084304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:09.095771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:09.097845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:09.098867 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e379362d-147a-487a-81c3-172779e7e83f tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1317 microversion: 2.21 time: 0.141802 Aug 23 11:00:09.100327 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2630/5241] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:08 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:09.106038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:09.107667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:09.128260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.129804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.129804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.129993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.130392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.130841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.181032 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de HTTP/1.1 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b026e639-e285-49e8-90d2-c580dec527de'} Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:09.184886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:09.191987 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:09.191987 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:09.191987 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:09.191987 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:09.191987 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:00:09.191987 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:09.193703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:09.195307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6a0b391-21df-4f41-a31c-005a318cbbf3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 404 len: 111 microversion: 2.1 time: 0.093023 Aug 23 11:00:09.195921 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2631/5242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:09 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:09.205423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:09.206560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:09.216016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.216715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.217459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.218390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.219024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.219813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.229707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:09.250973 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dadbbf8-9cb5-4ed6-9155-febba548dced tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1523 microversion: 2.1 time: 0.629139 Aug 23 11:00:09.251895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:09.252794 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2612/5243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:08 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:09.331735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:09.332781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:09.339847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.340444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.341167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.342915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.343882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.344082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1d28112-93ad-4c87-aedf-bd1bbd690263 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 204 len: 0 microversion: 2.1 time: 0.142892 Aug 23 11:00:09.345001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.346658 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2632/5244] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:09 2022] DELETE /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:00:09.354803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:09.368114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:09.375363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.376265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.377116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.378304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.378999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.379656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.668850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:09.677178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ee1fd1a-75a3-42ad-9092-6433deda4432 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1497 microversion: 2.1 time: 0.326884 Aug 23 11:00:09.677772 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2633/5245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:09 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1497 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:09.698902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-db03af06-a558-495d-9aa9-51039b841a89 req-93b2b506-2c6f-4e5a-ac83-a310b2285f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8f1906-b3b1-40ab-b4b2-c42df679a13b", "name": "network-vif-plugged", "status": "completed", "tag": "d7cfbb2c-c625-44b7-8e66-36f230902fbe"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:09.741701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-db03af06-a558-495d-9aa9-51039b841a89 req-93b2b506-2c6f-4e5a-ac83-a310b2285f40 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.741906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:09.742108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-db03af06-a558-495d-9aa9-51039b841a89 req-93b2b506-2c6f-4e5a-ac83-a310b2285f40 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.743866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-db03af06-a558-495d-9aa9-51039b841a89 req-93b2b506-2c6f-4e5a-ac83-a310b2285f40 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.753020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c464bad-36c4-4260-a2ce-842bac5f03eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.425131 Aug 23 11:00:09.756116 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2613/5246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:09 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:09.771519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-db03af06-a558-495d-9aa9-51039b841a89 req-93b2b506-2c6f-4e5a-ac83-a310b2285f40 service nova] Creating event network-vif-plugged:d7cfbb2c-c625-44b7-8e66-36f230902fbe for instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b on n-h2-847009-13 Aug 23 11:00:09.788546 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-db03af06-a558-495d-9aa9-51039b841a89 req-93b2b506-2c6f-4e5a-ac83-a310b2285f40 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109243 Aug 23 11:00:09.791666 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2634/5247] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:09.967915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:09.969164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:09.982949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.986828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.990654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:09.991622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:09.993576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:09.995199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.124928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:10.125641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:10.137891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.140039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.140700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.141706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.142376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.143930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.347987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:10.359452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42c7177f-9cdb-465f-99a3-bdab3485195b tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.401959 Aug 23 11:00:10.364448 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2614/5248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:09 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:10.377071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:10.378282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:10.397202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.398580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.399954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.402360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.404377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.404876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.454503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:10.465245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:10.467518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:10.468969 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a8073e3-c1cf-4a79-8641-c52b80dea0f5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.349220 Aug 23 11:00:10.470203 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2635/5249] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:10 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:00:10.702352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:10.704168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:10.712336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.713100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.714256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.715216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.716035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.717484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.773766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:10.791639 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b51c5b7-9b42-4979-9a49-7215672fe7ef tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1523 microversion: 2.1 time: 0.422546 Aug 23 11:00:10.793188 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2615/5250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:10 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:10.800189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:10.802042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:10.810704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.812815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.813672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.814846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:10.815537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:10.816410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:10.901363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:10.910283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ef39644-87fe-4c8b-b911-16cd728701ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1497 microversion: 2.1 time: 0.214747 Aug 23 11:00:10.911012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2636/5251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:10 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:11.292000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:11.301176 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d59b57f-a307-47f0-816d-29dc4a321562 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.506265 Aug 23 11:00:11.302236 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2616/5252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:10 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:11.383452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:11.384131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:11.392512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:11.393346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:11.393979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:11.395031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:11.395662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:11.396248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:11.497819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:11.498444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:11.509352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:11.510120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:11.510579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:11.511321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:11.511794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:11.512232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:11.574542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:11.586165 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-50eee9ef-2009-4631-9f60-6a3449e3ec65 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.206621 Aug 23 11:00:11.593591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2637/5253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:11 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:11.818295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:11.818909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:11.832196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:11.832727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:11.833902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:11.836655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:11.837244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:11.837877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.011182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:12.022055 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6171ffd-da14-4173-bf2d-c88f6c40e6f3 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1508 microversion: 2.1 time: 0.209762 Aug 23 11:00:12.023197 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2638/5254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:11 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:12.029357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:12.030247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:12.037800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.038506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.039134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.040456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.041193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.041806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.207798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:12.218512 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21abf08b-c955-4cf7-ac92-579df41fad74 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1497 microversion: 2.1 time: 0.193964 Aug 23 11:00:12.222693 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2639/5255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:12 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:12.232382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:12.233548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:12.257644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.259894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.260628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.262526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.265191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.266167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.414811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:12.427512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:12.434568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:12.438822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5add35a3-d1af-4806-846d-dacd32ad44cd tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.945432 Aug 23 11:00:12.442238 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2617/5256] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:11 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:00:12.454090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:12.458846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:12.482546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.483235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.489497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.491840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.496199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.499322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.771784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:12.782713 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21203328-d13a-4787-bade-648ed1e47615 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 200 len: 1508 microversion: 2.1 time: 0.557091 Aug 23 11:00:12.784861 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2640/5257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:12 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 1508 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:12.796906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:12.797558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:12.809697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.811196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.811945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:12.812869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:12.813500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:12.814123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.131584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:13.145466 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-298a81bc-aba2-42d6-9e3b-97b6b62b72c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.358360 Aug 23 11:00:13.145466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2641/5258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:12 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:13.166730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f8936930-39b9-44f1-99bc-30864d1586b8 req-1c69317b-6d08-4d9d-bcc6-c7dbe1dfb7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a9c65cc-b473-445a-92b4-4dd2c77be397", "tag": "dcbf8968-bff4-4d06-af2f-d1b3e6d43aeb"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:13.186789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8936930-39b9-44f1-99bc-30864d1586b8 req-1c69317b-6d08-4d9d-bcc6-c7dbe1dfb7c4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.189684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8936930-39b9-44f1-99bc-30864d1586b8 req-1c69317b-6d08-4d9d-bcc6-c7dbe1dfb7c4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.190482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8936930-39b9-44f1-99bc-30864d1586b8 req-1c69317b-6d08-4d9d-bcc6-c7dbe1dfb7c4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.198245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:13.230577 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f8936930-39b9-44f1-99bc-30864d1586b8 req-1c69317b-6d08-4d9d-bcc6-c7dbe1dfb7c4 service nova] Creating event network-changed:dcbf8968-bff4-4d06-af2f-d1b3e6d43aeb for instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 on n-h2-847009-13 Aug 23 11:00:13.236987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f8936930-39b9-44f1-99bc-30864d1586b8 req-1c69317b-6d08-4d9d-bcc6-c7dbe1dfb7c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077897 Aug 23 11:00:13.237860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2642/5259] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:13.243530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-120f7b0b-5906-49cc-b6a9-6e53e3ac2311 req-577e7345-662c-4605-abbc-b274707eda71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8cc3299-8702-4bf7-8e1c-04760cfb167f", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fd3db-f6de-4188-8574-c97b71c94879"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:13.267309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-120f7b0b-5906-49cc-b6a9-6e53e3ac2311 req-577e7345-662c-4605-abbc-b274707eda71 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.268049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-120f7b0b-5906-49cc-b6a9-6e53e3ac2311 req-577e7345-662c-4605-abbc-b274707eda71 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.268647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-120f7b0b-5906-49cc-b6a9-6e53e3ac2311 req-577e7345-662c-4605-abbc-b274707eda71 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.286115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:13.295071 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-120f7b0b-5906-49cc-b6a9-6e53e3ac2311 req-577e7345-662c-4605-abbc-b274707eda71 service nova] Creating event network-vif-plugged:1d3fd3db-f6de-4188-8574-c97b71c94879 for instance c8cc3299-8702-4bf7-8e1c-04760cfb167f on n-h1-847009-13 Aug 23 11:00:13.295572 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e894a07c-2da1-460a-9b0b-f6b32d200719 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.851123 Aug 23 11:00:13.296543 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2618/5260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:12 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:13.302173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:13.303159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:13.303948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-120f7b0b-5906-49cc-b6a9-6e53e3ac2311 req-577e7345-662c-4605-abbc-b274707eda71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063687 Aug 23 11:00:13.305664 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2643/5261] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:13.315912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.317126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.317973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.318810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.319297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.319785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.330977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:13.340068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:13.354804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.355666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.357852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.358752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.360316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.361160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.362499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:13.577680 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cb85d6b-1d74-4502-9b78-457336ba98bd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 204 len: 0 microversion: 2.1 time: 0.279369 Aug 23 11:00:13.581309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2619/5262] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:13 2022] DELETE /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:00:13.595479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:13.598898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:13.631692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.632374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.636194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.637264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:13.640046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:13.642579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:13.675701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:13.700396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:13.817989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:13.830548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4ce44ce-45af-41d8-85b5-26e92caf414d tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1497 microversion: 2.1 time: 0.523155 Aug 23 11:00:13.838077 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2644/5263] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:13 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1497 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:13.844011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1516959287", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "3bf8e1b1-33f9-43a0-bfdf-d705d485fd67"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:13.927588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] validate_networks() for [('3bf8e1b1-33f9-43a0-bfdf-d705d485fd67', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:00:13.997904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:14.007482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:14.009616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:14.010989 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1256f1d-b6ce-4d5d-9cba-e2498f892905 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.427631 Aug 23 11:00:14.025322 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2620/5264] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:13 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:14.164341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:14.164998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:14.177799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:14.183042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.183561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.184071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.184945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.185838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.185838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.392582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:14.402403 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c49f21e7-9389-4240-bfc8-123bb65a17c9 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1319 microversion: 2.1 time: 0.241875 Aug 23 11:00:14.403528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2621/5265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:14 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:14.410509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:14.411417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:14.418331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.419125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.420495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.421487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.422175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.422822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.428544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:14.596620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:14.605843 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c9f6d03-63ad-4550-b59c-af66ad9a4767 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.199258 Aug 23 11:00:14.622176 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2622/5266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:14 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:14.809608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:00:14.810645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:00:14.811193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:00:14.811961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:00:14.812614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:00:14.822313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.822954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.823365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.824969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.826279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.826932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.844921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Getting quotas for project bfdf5f7099d848ab998f1458fbe40c08. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:00:14.857544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:14.858261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:14.863595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Getting quotas for user 1227f4970d7a49f79cd897ed1b936907 and project bfdf5f7099d848ab998f1458fbe40c08. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:00:14.870052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.870564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.871397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.871754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.872183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.873199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.898383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:00:14.900893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:00:14.926825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:14.927320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:14.927940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:14.928591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lazy-loading 'fault' on Instance uuid 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:14.985036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:14.996194 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49b34828-90b8-4334-8d2e-103e6f2ffed3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1299 microversion: 2.1 time: 0.145127 Aug 23 11:00:14.997163 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2623/5267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:14 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:15.026610 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85e429a1-d8f1-440f-b793-89d970f97704 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186733 Aug 23 11:00:15.027908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2645/5268] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:00:15.037988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:15.038666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:15.041134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-472fc430-6d87-4d4f-a5f7-417bac69fb49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:15.041772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-472fc430-6d87-4d4f-a5f7-417bac69fb49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:15.046654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.047402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.048090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.049195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.049890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.050612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.139149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-472fc430-6d87-4d4f-a5f7-417bac69fb49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:15.148466 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-472fc430-6d87-4d4f-a5f7-417bac69fb49 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1218 microversion: 2.1 time: 0.113221 Aug 23 11:00:15.152932 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2646/5269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:15 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:15.253397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:15.273068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:15.273232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-dc9ca6fe-e27b-4f48-8e0d-26e0016c6bef req-2858a029-f14b-4799-be94-cece611723b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d83c63c-97d7-4a2c-865d-e423bdaa0bdd", "name": "network-vif-deleted", "tag": "3f9397c2-957e-44c0-9c96-bf67c8f92a4f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:15.276790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:15.279584 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad4098aa-2357-43ea-bea2-ccbd996d5ec3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.248126 Aug 23 11:00:15.280171 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2624/5270] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:15 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:15.312639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dc9ca6fe-e27b-4f48-8e0d-26e0016c6bef req-2858a029-f14b-4799-be94-cece611723b5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.313165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dc9ca6fe-e27b-4f48-8e0d-26e0016c6bef req-2858a029-f14b-4799-be94-cece611723b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.313620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-dc9ca6fe-e27b-4f48-8e0d-26e0016c6bef req-2858a029-f14b-4799-be94-cece611723b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.373948 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-dc9ca6fe-e27b-4f48-8e0d-26e0016c6bef req-2858a029-f14b-4799-be94-cece611723b5 service nova] Creating event network-vif-deleted:3f9397c2-957e-44c0-9c96-bf67c8f92a4f for instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd on n-h1-847009-13 Aug 23 11:00:15.400209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-dc9ca6fe-e27b-4f48-8e0d-26e0016c6bef req-2858a029-f14b-4799-be94-cece611723b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139070 Aug 23 11:00:15.402306 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2647/5271] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:00:15.425928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:15.426534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:15.435024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.435378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.435824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.436796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.437424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.438061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.632699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:15.641445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:15.644023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:15.655696 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a552a2e0-0ae7-4f38-8048-33c80e0109b6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1509 microversion: 2.1 time: 0.235255 Aug 23 11:00:15.662387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.663364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.664155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.665913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.666663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.667335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.669324 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2625/5272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:15 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:15.679967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b43daf3-50af-4c1a-86cb-5715f37726d7", "device": "/dev/sdb"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:15.683490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:15.691954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.692606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.693383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.694343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:15.694974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:15.695596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:15.852571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:15.863608 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-699b3d01-9e51-4e77-b518-29ea9be7c914 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.236929 Aug 23 11:00:15.864850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2648/5273] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:15 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:16.019794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:16.020413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:16.027120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.027611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.028063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.029571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.030132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.030581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.083027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.083781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.084377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.085035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lazy-loading 'fault' on Instance uuid 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:16.135188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:16.145296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14831bf6-1b35-4767-9102-5e2dc51122f4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 200 len: 1299 microversion: 2.1 time: 0.129167 Aug 23 11:00:16.146200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2649/5274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:16 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:16.171061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:16.171684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:16.178378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.179114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.179747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.180469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.181106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.181688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.187843 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d11ac2a-b475-4a13-b16d-390bda9b61f3 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "POST /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511910 Aug 23 11:00:16.190073 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2626/5275] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:00:15 2022] POST /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:16.252515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:16.260308 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edb55ce0-9e5f-4568-9a69-e775a250ca8a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1270 microversion: 2.1 time: 0.094199 Aug 23 11:00:16.269110 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2650/5276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:16 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:16.307847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:16.308680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:16.333329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.333962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.334524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.335666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.336141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.336575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.581307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:16.594749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:16.596270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:16.598539 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3207f40d-32f6-4a16-a141-2b97e2f9793a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.297737 Aug 23 11:00:16.609890 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2627/5277] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:16 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:16.896193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:16.897930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:16.915037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.915525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.918070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:16.920536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:16.921218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:16.922546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:17.168334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:17.169026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:17.182127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:17.201607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:17.206871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:17.207639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:17.210276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:17.211164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:17.211754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:17.249835 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd HTTP/1.1 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9d83c63c-97d7-4a2c-865d-e423bdaa0bdd'} Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:17.251982 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:17.257432 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:17.257432 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:17.257432 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:17.257432 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:17.257432 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:00:17.257432 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:17.259768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:17.260877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8def1d99-0485-4194-9671-2c7995cbba03 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 404 len: 111 microversion: 2.1 time: 0.097196 Aug 23 11:00:17.264793 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2628/5278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:17 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:17.293203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:17.297392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:17.318263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:17.322632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:17.323494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:17.324970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:17.328625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:17.330645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:17.405883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:17.425321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f38b52c8-077b-420b-aace-87d165cd71db tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.537238 Aug 23 11:00:17.429286 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2651/5279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:16 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:17.519719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-663400098", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:17.614751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:00:17.697437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:17.706819 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90a7d5cc-82d7-4942-acff-0a832123c892 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1278 microversion: 2.1 time: 0.425214 Aug 23 11:00:17.712216 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2629/5280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:17 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1278 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:17.723966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:17.724860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:17.737629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:17.741807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:17.742476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:17.743656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:17.745831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:17.746919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:18.433592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:18.447375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:18.468732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:18.475960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d12d82e6-0229-4712-9e5f-c0fd889ed9f3 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.761028 Aug 23 11:00:18.488770 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2630/5281] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:17 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:18.488770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:18.488770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:18.509949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:18.510532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:18.510988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:18.511724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:18.512192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:18.512629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:18.557336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:00:18.558461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:00:18.559391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:00:18.560454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:00:18.561984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:00:18.573214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:18.574999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:18.576402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:18.577437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:18.578141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:18.578802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:18.601485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:00:18.608774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:00:18.628307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:00:18.631675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:00:18.725637 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-12f2d776-e41d-4ded-ba22-2b6fe2db51ed tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212862 Aug 23 11:00:18.740477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2652/5282] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:00:18.755753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:18.763803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:18.797661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:18.803825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:18.804849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:18.806009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:18.809164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:18.809915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:19.022544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:19.031790 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a0714d1-2a29-469a-bf1e-21cfda1d8aae tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1276 microversion: 2.1 time: 0.290097 Aug 23 11:00:19.032897 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2653/5283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:18 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:19.037604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb885ab3-f94e-493d-8ab7-95657c3eb586 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:19.038410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb885ab3-f94e-493d-8ab7-95657c3eb586 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:19.152037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb885ab3-f94e-493d-8ab7-95657c3eb586 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:19.163953 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb885ab3-f94e-493d-8ab7-95657c3eb586 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1208 microversion: 2.1 time: 0.129473 Aug 23 11:00:19.164547 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2654/5284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:19 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1208 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:19.334618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:19.348522 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6acdbb54-5756-42e5-bbf4-abaf2937e360 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.865198 Aug 23 11:00:19.349592 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2631/5285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:18 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:19.515054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:19.515728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:19.521835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:19.540181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:19.541827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:19.544326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:19.551832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:19.554006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:19.554680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:19.716667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2862900d-3698-43e7-9cfd-ac0dfcd7179c req-93b8baaf-b06f-4360-abe3-ffe04a7845b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8f1906-b3b1-40ab-b4b2-c42df679a13b", "name": "network-vif-deleted", "tag": "d7cfbb2c-c625-44b7-8e66-36f230902fbe"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:19.741009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2862900d-3698-43e7-9cfd-ac0dfcd7179c req-93b8baaf-b06f-4360-abe3-ffe04a7845b3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:19.741537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2862900d-3698-43e7-9cfd-ac0dfcd7179c req-93b8baaf-b06f-4360-abe3-ffe04a7845b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:19.741996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2862900d-3698-43e7-9cfd-ac0dfcd7179c req-93b8baaf-b06f-4360-abe3-ffe04a7845b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:19.785159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2862900d-3698-43e7-9cfd-ac0dfcd7179c req-93b8baaf-b06f-4360-abe3-ffe04a7845b3 service nova] Creating event network-vif-deleted:d7cfbb2c-c625-44b7-8e66-36f230902fbe for instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b on n-h2-847009-13 Aug 23 11:00:19.798312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2862900d-3698-43e7-9cfd-ac0dfcd7179c req-93b8baaf-b06f-4360-abe3-ffe04a7845b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085769 Aug 23 11:00:19.813660 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2632/5286] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:19.977832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:19.998661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:20.001582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:20.003713 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d34612b0-db46-4d6c-a41d-116504b511e5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.502090 Aug 23 11:00:20.007634 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2655/5287] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:19 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:20.061739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:20.063080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:20.082845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:20.086860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:20.088830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:20.093078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:20.095802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:20.099756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:20.191517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:20.192704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:20.218184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:20.219559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:20.224573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:20.225787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:20.229257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:20.233189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:20.424845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:20.433352 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09eb2d35-de59-4de0-8a84-dfbb371c6fa4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1204 microversion: 2.1 time: 0.246017 Aug 23 11:00:20.441586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2656/5288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:20 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1204 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:20.454718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:20.458505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:20.477570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:20.480366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:20.482367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:20.485027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:20.485646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:20.488397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:20.707088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:20.715687 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5842502-0934-40df-baf3-b041ff75362b tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.661830 Aug 23 11:00:20.722027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2633/5289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:20 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:20.847307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:20.858606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d19e1e41-8154-4c04-a4f1-4552e475b3eb tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.415066 Aug 23 11:00:20.876520 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2657/5290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:20 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:21.035054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:21.039163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:21.057329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.059140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.061306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.062482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.063222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.064075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.207101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-15b70401-8456-448d-b9be-b73fc80f4a44 req-a96ffe52-8484-461f-bfa7-3f8f2f4cdd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9c65cc-b473-445a-92b4-4dd2c77be397", "name": "network-vif-plugged", "status": "completed", "tag": "dcbf8968-bff4-4d06-af2f-d1b3e6d43aeb"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:21.222836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15b70401-8456-448d-b9be-b73fc80f4a44 req-a96ffe52-8484-461f-bfa7-3f8f2f4cdd10 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.223825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15b70401-8456-448d-b9be-b73fc80f4a44 req-a96ffe52-8484-461f-bfa7-3f8f2f4cdd10 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.224655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15b70401-8456-448d-b9be-b73fc80f4a44 req-a96ffe52-8484-461f-bfa7-3f8f2f4cdd10 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.242125 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-15b70401-8456-448d-b9be-b73fc80f4a44 req-a96ffe52-8484-461f-bfa7-3f8f2f4cdd10 service nova] Creating event network-vif-plugged:dcbf8968-bff4-4d06-af2f-d1b3e6d43aeb for instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 on n-h2-847009-13 Aug 23 11:00:21.248912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-15b70401-8456-448d-b9be-b73fc80f4a44 req-a96ffe52-8484-461f-bfa7-3f8f2f4cdd10 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051762 Aug 23 11:00:21.251218 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2658/5291] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:00:21.465278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:21.466915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:21.478536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.483592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.484412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.487729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.488582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.489733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.716541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:21.729768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:21.733374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:21.734792 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4885f057-9040-4ed9-b156-c2aa631b71dc tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 0.706854 Aug 23 11:00:21.750082 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2634/5292] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:21 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:21.757449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:21.758462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:21.766459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.767183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.767810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.768718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:21.772104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:21.772901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:21.935719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:21.962456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a532f19d-3690-429a-a909-ab00b2355395 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1260 microversion: 2.1 time: 0.502103 Aug 23 11:00:21.983260 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2659/5293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:21 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1260 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:21.991500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:21.992603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:22.004208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:22.004937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:22.006179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:22.007094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:22.007804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:22.008407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:22.387369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:22.415963 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c7da17e8-f903-4235-89f6-d51b3d80865b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.430139 Aug 23 11:00:22.417322 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2660/5294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:21 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:22.739907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:22.754117 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8775d9bc-1411-4963-abf7-675741321129 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 1.002412 Aug 23 11:00:22.755827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2635/5295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:21 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:22.774964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:22.775618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:22.801130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:22.802473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:22.805971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:22.807096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:22.807582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:22.808413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:22.934274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-eb014f81-539d-4a07-8a67-e0f95faca6df req-2a3a3097-2fc5-4aa9-9ead-efea5cf650cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05f74af-e706-4ae2-b590-4c8c190944df", "tag": "6cc499cf-cb2c-4c3c-a754-93632f725ad4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:22.956294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eb014f81-539d-4a07-8a67-e0f95faca6df req-2a3a3097-2fc5-4aa9-9ead-efea5cf650cb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:22.956819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eb014f81-539d-4a07-8a67-e0f95faca6df req-2a3a3097-2fc5-4aa9-9ead-efea5cf650cb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:22.961115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-eb014f81-539d-4a07-8a67-e0f95faca6df req-2a3a3097-2fc5-4aa9-9ead-efea5cf650cb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:22.987825 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-eb014f81-539d-4a07-8a67-e0f95faca6df req-2a3a3097-2fc5-4aa9-9ead-efea5cf650cb service nova] Creating event network-changed:6cc499cf-cb2c-4c3c-a754-93632f725ad4 for instance a05f74af-e706-4ae2-b590-4c8c190944df on n-h1-847009-13 Aug 23 11:00:22.999899 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-eb014f81-539d-4a07-8a67-e0f95faca6df req-2a3a3097-2fc5-4aa9-9ead-efea5cf650cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070607 Aug 23 11:00:23.002688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2636/5296] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:00:23.014834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:23.018890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:23.035210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:23.035210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:23.035684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:23.041135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:23.041679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:23.042216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:23.595663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:23.609189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84e79f2f-851b-4d88-9053-b035586df9ca tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.600297 Aug 23 11:00:23.611349 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2637/5297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:23 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:23.641105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:23.642735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:23.655089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:23.659018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:23.659539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:23.660632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:23.665480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:23.666144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:24.187802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:24.199878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:24.217066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:24.218831 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb314e4e-43be-47a0-8826-32feffb7a67a tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1359 microversion: 2.21 time: 1.448543 Aug 23 11:00:24.228575 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2661/5298] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:22 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1359 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:00:24.235981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:24.244444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:24.263900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:24.264613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:24.267839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:24.268828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:24.269467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:24.272363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:24.467235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:24.477204 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d038e48-63e4-4c4a-93cc-5e89bb97f93a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.849335 Aug 23 11:00:24.481562 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2638/5299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:23 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:24.634587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:24.635961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:24.647792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:24.649841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:24.651621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:24.654910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:24.655756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:24.658200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:24.670021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:24.776630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:24.792413 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-623f7666-cd42-4742-a400-eef684ecf5bf tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.562256 Aug 23 11:00:24.793059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2662/5300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:24 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:25.244077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:25.244723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:25.274428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:25.274921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:25.276683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:25.282187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:25.283207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:25.286424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:25.287506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:25.324215 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c33fb703-9824-4ed7-a40f-c6b4ca070581 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.682460 Aug 23 11:00:25.352283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2639/5301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:24 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:25.505007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:25.509662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:25.550700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:25.551213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:25.551671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:25.552405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:25.554014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:25.555296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:25.861248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:25.873883 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5844156f-c723-40dd-8749-5b4e8e626e5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.372838 Aug 23 11:00:25.875782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2640/5302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:25 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:25.894772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:25.896130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:25.906548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:25.908360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:25.909537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:25.910802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:25.911518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:25.911897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.129497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.140360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.147014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.151335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2ff78e9f-1fd2-4bfb-977e-ee90959c182b tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1553 microversion: 2.21 time: 0.911307 Aug 23 11:00:26.155363 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2663/5303] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:25 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1553 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:00:26.170064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.178821 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f60f1d2-45e3-4138-a15f-1455e4b670fd tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.301621 Aug 23 11:00:26.180375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:26.180914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:26.183455 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2641/5304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:25 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:26.203187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.204126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.204892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.206261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.207146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.208332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.241172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:26.259641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:26.346871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:26.348054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:26.367250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.368089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.376910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.378086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.378838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.379435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.509935 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b0ff479-298d-4069-933e-9ad79ebd8c29 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 204 len: 0 microversion: 2.21 time: 0.334345 Aug 23 11:00:26.515959 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2664/5305] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:00:26 2022] DELETE /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:00:26.528304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:26.544633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:26.566333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.567630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.568435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.569843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.571166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.571813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.749017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.758424 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe52f077-7c3d-4ad8-ad4e-4067810c6610 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.415200 Aug 23 11:00:26.769597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2642/5306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:26 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:26.854492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7bda96d3-d25c-4aa3-a917-056d3f2fd48e req-47277e90-2940-4506-9469-503b7fc6dcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52715ac7-849b-41ae-8041-357cb34c253e", "tag": "9264437c-4f3f-4e00-a3d5-32385e2be443"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:26.891587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7bda96d3-d25c-4aa3-a917-056d3f2fd48e req-47277e90-2940-4506-9469-503b7fc6dcc5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:26.893513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7bda96d3-d25c-4aa3-a917-056d3f2fd48e req-47277e90-2940-4506-9469-503b7fc6dcc5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:26.895582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7bda96d3-d25c-4aa3-a917-056d3f2fd48e req-47277e90-2940-4506-9469-503b7fc6dcc5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:26.942413 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7bda96d3-d25c-4aa3-a917-056d3f2fd48e req-47277e90-2940-4506-9469-503b7fc6dcc5 service nova] Creating event network-changed:9264437c-4f3f-4e00-a3d5-32385e2be443 for instance 52715ac7-849b-41ae-8041-357cb34c253e on n-h1-847009-13 Aug 23 11:00:26.946689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.952384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7bda96d3-d25c-4aa3-a917-056d3f2fd48e req-47277e90-2940-4506-9469-503b7fc6dcc5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106570 Aug 23 11:00:26.954232 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2643/5307] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:00:26.960840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.969065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:26.981026 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-516d0a3f-6e13-46a8-a51f-d8e554ad47f9 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1559 microversion: 2.21 time: 0.452446 Aug 23 11:00:26.981026 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2665/5308] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:26 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1559 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:26.984904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:26.986220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:27.000159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:27.000973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:27.001582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:27.002460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:27.003092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:27.003783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:27.193820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:27.209015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:27.210524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:27.219834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:27.221269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:27.222397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:27.222542 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebd1fa8e-cddd-4071-af72-64cecb807019 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.264620 Aug 23 11:00:27.223137 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2644/5309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:26 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:27.237518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:27.241163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:27.242234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:27.782248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:27.783003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:27.795726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:27.796250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:27.796706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:27.797468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:27.799000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:27.802305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:27.851004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:27.870049 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8731a8da-d779-4d39-983d-73025ec83cc9 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.659841 Aug 23 11:00:27.870925 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2666/5310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:27 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:27.995849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:27.996467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:28.012418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:28.013563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:28.013966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:28.014885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:28.015351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:28.015887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:28.256610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:28.268219 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd465a2d-5dd4-4d55-b08c-71027f60e83e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.490973 Aug 23 11:00:28.269321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2645/5311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:27 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:28.274555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:28.283894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:28.306288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:28.307131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:28.307812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:28.308845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:28.310570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:28.313351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:28.589154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:28.853637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:28.871486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:28.875477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:28.877064 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f63cdbb-b2ee-4b56-a836-b5cb80b2ac08 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1559 microversion: 2.21 time: 0.885300 Aug 23 11:00:28.878183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:28.879582 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2667/5312] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:27 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1559 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:00:28.901548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:28.902678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:28.907590 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6195aed-c22e-4952-865c-2df447e3d61d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.635055 Aug 23 11:00:28.908425 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2646/5313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:28 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:28.926292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:28.927429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:28.928317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:28.929482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:28.930201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:28.930972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.160874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=16 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:29.225750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:29.238612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a0b96d02-82ab-4d4a-b3dc-787994aa1893 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.342837 Aug 23 11:00:29.243783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2668/5314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:28 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:29.293296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:29.294091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:29.302156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.302668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.303124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.303867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.304338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.312177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.560296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-006e9046-2d57-4657-97ee-b0e5e2e224f3 req-e4611cd3-2607-410e-816e-443d1f6a4c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a9c65cc-b473-445a-92b4-4dd2c77be397", "name": "network-vif-deleted", "tag": "dcbf8968-bff4-4d06-af2f-d1b3e6d43aeb"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:29.619149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-006e9046-2d57-4657-97ee-b0e5e2e224f3 req-e4611cd3-2607-410e-816e-443d1f6a4c0e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.620178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-006e9046-2d57-4657-97ee-b0e5e2e224f3 req-e4611cd3-2607-410e-816e-443d1f6a4c0e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.620991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-006e9046-2d57-4657-97ee-b0e5e2e224f3 req-e4611cd3-2607-410e-816e-443d1f6a4c0e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.656244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-006e9046-2d57-4657-97ee-b0e5e2e224f3 req-e4611cd3-2607-410e-816e-443d1f6a4c0e service nova] Creating event network-vif-deleted:dcbf8968-bff4-4d06-af2f-d1b3e6d43aeb for instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 on n-h2-847009-13 Aug 23 11:00:29.663100 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-006e9046-2d57-4657-97ee-b0e5e2e224f3 req-e4611cd3-2607-410e-816e-443d1f6a4c0e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106501 Aug 23 11:00:29.664970 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2669/5315] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:00:29.877701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:29.891292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94f2ee95-6349-4fe6-9fd9-6d7cf462ed2e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.602103 Aug 23 11:00:29.898050 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2647/5316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:29 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:29.908079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:29.908808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:29.922877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.923449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.924806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.927751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.930461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.931094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.931802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:29.933270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:29.943516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.944349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.945127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.946723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.947442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.948452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.995681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:29.996404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:29.997896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:29.999023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lazy-loading 'fault' on Instance uuid 7a9c65cc-b473-445a-92b4-4dd2c77be397 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:30.137406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:30.147637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:30.149655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7136af0a6015480cb11ecbf3ac96bf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '585ec90481bd416eb880c6a44f31f6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:30.150963 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0da21caf-53f7-4ddb-89e8-6f281ce7f349 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 200 len: 1349 microversion: 2.21 time: 0.248228 Aug 23 11:00:30.151665 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2670/5317] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:29 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 1349 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:00:30.229509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:30.256035 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8ff7b92-739e-4e34-9370-0c9742826084 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.323846 Aug 23 11:00:30.257086 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2648/5318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:29 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:30.272274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:30.272274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:30.276459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:30.279587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:30.280869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:30.283544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:30.284184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:30.285971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:30.701093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:30.709798 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d32a8f2a-69a5-47c8-9d7c-9a0fe3ed53b2 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.450124 Aug 23 11:00:30.710609 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2671/5319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:30 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:30.919407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:30.920196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:30.929431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:30.931140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:30.931661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:30.932461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:30.933040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:30.933545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.175288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:31.175912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:31.184985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.185798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.186109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.186821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.187286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.187717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.205442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] HTTP exception thrown: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Request method failure captured: Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 HTTP/1.1 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMxB7q6akXQXU2ZZE2TtiYKf52y6PW09APskoqx4mAmCaBQn5PFddrv2Xs-vCIePFWzS1FZYwuLqojacWrJbA6ptQPQGgAiM_3quCwdhM35yy8OqUxrISjvHD3lMKwG27GipHBP87TrSKjZnBAWVILk6NAPJnYVUY5xaNKErCwk9ks Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.21 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 585ec90481bd416eb880c6a44f31f6a7 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/585ec90481bd416eb880c6a44f31f6a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_585ec90481bd416eb880c6a44f31f6a7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/585ec90481bd416eb880c6a44f31f6a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/585ec90481bd416eb880c6a44f31f6a7"}]}] Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 585ec90481bd416eb880c6a44f31f6a7 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceActionsV221TestJSON-1476979860-project Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7136af0a6015480cb11ecbf3ac96bf6e Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceActionsV221TestJSON-1476979860-project Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '7a9c65cc-b473-445a-92b4-4dd2c77be397'} Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.207988 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.214787 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.217617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Returning 404 to user: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:31.218811 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edac7034-571d-4526-ab0f-a3f16307d6b5 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 404 len: 111 microversion: 2.21 time: 0.047362 Aug 23 11:00:31.219927 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2672/5320] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:31 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:00:31.227987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '.version_select at 0x7fdc9cd42430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:31.228572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:31.239583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.240456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.241215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.242715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.243359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.243949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.296767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:31.305261 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b98a0296-92e8-403c-a192-badd0839e781 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.389729 Aug 23 11:00:31.306297 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2649/5321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:30 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:31.311757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:31.312380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:31.318442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.318948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.319397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.320203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.320672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.321317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.357853 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df0b0b67-d89e-44f0-bde9-12d8ea2ab605 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.133548 Aug 23 11:00:31.366116 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2673/5322] 10.222.0.78 () {60 vars in 1337 bytes} [Tue Aug 23 11:00:31 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397/os-instance-actions => generated 611 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 11:00:31.377357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:31.377865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:31.385807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.386649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.387287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.388770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.389402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.390138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.408516 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] HTTP exception thrown: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Request method failure captured: Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 HTTP/1.1 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMxB7q6akXQXU2ZZE2TtiYKf52y6PW09APskoqx4mAmCaBQn5PFddrv2Xs-vCIePFWzS1FZYwuLqojacWrJbA6ptQPQGgAiM_3quCwdhM35yy8OqUxrISjvHD3lMKwG27GipHBP87TrSKjZnBAWVILk6NAPJnYVUY5xaNKErCwk9ks Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.21 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 585ec90481bd416eb880c6a44f31f6a7 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/585ec90481bd416eb880c6a44f31f6a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_585ec90481bd416eb880c6a44f31f6a7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/585ec90481bd416eb880c6a44f31f6a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/585ec90481bd416eb880c6a44f31f6a7"}]}] Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 585ec90481bd416eb880c6a44f31f6a7 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceActionsV221TestJSON-1476979860-project Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7136af0a6015480cb11ecbf3ac96bf6e Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceActionsV221TestJSON-1476979860-project Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '7a9c65cc-b473-445a-92b4-4dd2c77be397'} Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:31.410567 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.414980 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.417204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Returning 404 to user: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:31.418093 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52d57608-97a9-4fe3-812b-7c56635d6034 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 404 len: 111 microversion: 2.21 time: 0.046181 Aug 23 11:00:31.418675 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2674/5323] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:00:31 2022] DELETE /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:00:31.429598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:31.430312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] [instance: 7a9c65cc-b473-445a-92b4-4dd2c77be397] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:31.437928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.438427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.439027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.439743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.440258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.440693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.456104 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] HTTP exception thrown: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Request method failure captured: Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 HTTP/1.1 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMxB7q6akXQXU2ZZE2TtiYKf52y6PW09APskoqx4mAmCaBQn5PFddrv2Xs-vCIePFWzS1FZYwuLqojacWrJbA6ptQPQGgAiM_3quCwdhM35yy8OqUxrISjvHD3lMKwG27GipHBP87TrSKjZnBAWVILk6NAPJnYVUY5xaNKErCwk9ks Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.21 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 585ec90481bd416eb880c6a44f31f6a7 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/585ec90481bd416eb880c6a44f31f6a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_585ec90481bd416eb880c6a44f31f6a7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/585ec90481bd416eb880c6a44f31f6a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/585ec90481bd416eb880c6a44f31f6a7"}]}] Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 585ec90481bd416eb880c6a44f31f6a7 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1476979860 Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceActionsV221TestJSON-1476979860-project Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7136af0a6015480cb11ecbf3ac96bf6e Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceActionsV221TestJSON-1476979860-project Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '7a9c65cc-b473-445a-92b4-4dd2c77be397'} Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.457822 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] Returning 404 to user: Instance 7a9c65cc-b473-445a-92b4-4dd2c77be397 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfc2fda7-09c8-4149-be89-141a417ce051 tempest-InstanceActionsV221TestJSON-1476979860 tempest-InstanceActionsV221TestJSON-1476979860-project] 10.222.0.78 "GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397" status: 404 len: 111 microversion: 2.21 time: 0.035347 Aug 23 11:00:31.463710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2675/5324] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:00:31 2022] GET /compute/v2.1/servers/7a9c65cc-b473-445a-92b4-4dd2c77be397 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:00:31.635232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:31.646290 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f51a56e-036e-401a-bdf8-fcb75998978b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.338921 Aug 23 11:00:31.647815 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2650/5325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:31 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:31.732617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:31.733602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:31.743108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.743969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.744535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:31.745565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:31.746134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:31.746803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:32.071896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:32.080673 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e96d821-7a2c-4a5e-a075-020e9632f7fb tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.353060 Aug 23 11:00:32.081555 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2676/5326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:31 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:32.326985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:32.328402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:32.341671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:32.342676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:32.343382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:32.344347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:32.345377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:32.346034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:32.600298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:32.611009 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1ebd790-b627-4518-b681-4e6a976ed97b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.287794 Aug 23 11:00:32.626782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2651/5327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:32 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:32.667898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:32.670250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:32.677899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:32.678665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:32.679289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:32.680233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:32.680913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:32.681940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:32.781059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5d15d83c-d41f-4c5a-bfd4-ffc850df119c req-87b19fc9-b7aa-48c3-9600-6f436d20f37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f74af-e706-4ae2-b590-4c8c190944df", "name": "network-vif-plugged", "status": "completed", "tag": "6cc499cf-cb2c-4c3c-a754-93632f725ad4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:32.812218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5d15d83c-d41f-4c5a-bfd4-ffc850df119c req-87b19fc9-b7aa-48c3-9600-6f436d20f37c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:32.812218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5d15d83c-d41f-4c5a-bfd4-ffc850df119c req-87b19fc9-b7aa-48c3-9600-6f436d20f37c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:32.812652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5d15d83c-d41f-4c5a-bfd4-ffc850df119c req-87b19fc9-b7aa-48c3-9600-6f436d20f37c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:32.846319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5d15d83c-d41f-4c5a-bfd4-ffc850df119c req-87b19fc9-b7aa-48c3-9600-6f436d20f37c service nova] Creating event network-vif-plugged:6cc499cf-cb2c-4c3c-a754-93632f725ad4 for instance a05f74af-e706-4ae2-b590-4c8c190944df on n-h1-847009-13 Aug 23 11:00:32.854351 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5d15d83c-d41f-4c5a-bfd4-ffc850df119c req-87b19fc9-b7aa-48c3-9600-6f436d20f37c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081338 Aug 23 11:00:32.855803 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2652/5328] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:33.098390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:33.102776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:33.103537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:33.106927 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0986fa50-0686-4da1-9e96-45ab29e6281b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.442699 Aug 23 11:00:33.120766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:33.120766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:33.120766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:33.120766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:33.120766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:33.120766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:33.121513 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2677/5329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:32 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:33.305212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:33.341461 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99aaeba9-0f6d-4187-8c35-78b3a99b3b2c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.242765 Aug 23 11:00:33.342198 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2653/5330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:33 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:33.636698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:33.639146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:33.651747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:33.658728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:33.659660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:33.660576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:33.662043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:33.664022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:34.138883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:34.138883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:34.142371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:34.143509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:34.144261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:34.145386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:34.146402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:34.147083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:34.366070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:34.380587 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4edcebaa-62a3-40fe-b47e-7129c7214040 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.749911 Aug 23 11:00:34.381834 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2678/5331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:33 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:34.390335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:34.392295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:34.408336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:34.409008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:34.409728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:34.410717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:34.411435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:34.412086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:34.481880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:34.533628 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8aa2eb3-0db2-4e94-adbc-00642c4952fa tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1504 microversion: 2.1 time: 0.407738 Aug 23 11:00:34.537759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2654/5332] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:34 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1504 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:34.894236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6029c313-a485-460f-bf7e-68f7eeb61638 req-7f95811a-014c-45be-905a-dd6e2cae36df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52715ac7-849b-41ae-8041-357cb34c253e", "name": "network-vif-plugged", "status": "completed", "tag": "9264437c-4f3f-4e00-a3d5-32385e2be443"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:34.914258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6029c313-a485-460f-bf7e-68f7eeb61638 req-7f95811a-014c-45be-905a-dd6e2cae36df service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:34.916036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6029c313-a485-460f-bf7e-68f7eeb61638 req-7f95811a-014c-45be-905a-dd6e2cae36df service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:34.916682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6029c313-a485-460f-bf7e-68f7eeb61638 req-7f95811a-014c-45be-905a-dd6e2cae36df service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:34.948321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6029c313-a485-460f-bf7e-68f7eeb61638 req-7f95811a-014c-45be-905a-dd6e2cae36df service nova] Creating event network-vif-plugged:9264437c-4f3f-4e00-a3d5-32385e2be443 for instance 52715ac7-849b-41ae-8041-357cb34c253e on n-h1-847009-13 Aug 23 11:00:34.958482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:34.973590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2443cb14-590f-4deb-b2d7-7f24e9aff10e tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1318 microversion: 2.1 time: 0.588777 Aug 23 11:00:34.975641 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2679/5333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:34 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:35.041269 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6029c313-a485-460f-bf7e-68f7eeb61638 req-7f95811a-014c-45be-905a-dd6e2cae36df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136311 Aug 23 11:00:35.071693 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2655/5334] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:35.410497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:35.411146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:35.423913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:35.424418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:35.426086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:35.430525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:35.431235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:35.431843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:35.561303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:35.562334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:35.575326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:35.575830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:35.577526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:35.578407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:35.579855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:35.580456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:35.768377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:35.786052 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80aede5d-4109-43a0-bfd0-c005f7838827 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.383566 Aug 23 11:00:35.788066 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2680/5335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:35 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:35.995300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:35.996431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:36.005158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:36.006136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:36.006589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:36.007311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:36.008018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:36.008474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:36.095809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:36.111775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-167b5fce-fe6a-47f5-a7b9-b8db539a2bff tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1484 microversion: 2.1 time: 0.556435 Aug 23 11:00:36.113839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2656/5336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:35 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1484 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:36.329577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-253193076", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:36.406016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] validate_networks() for [('2a2c9465-600f-4e4d-a0d0-1c390d5f9fc8', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:00:36.436863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:36.454919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:36.467512 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db49db4f-3886-4300-85a0-fd9195ffba7f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1508 microversion: 2.1 time: 0.475960 Aug 23 11:00:36.468495 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2681/5337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:35 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:36.489574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:36.490527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:36.497969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:36.498808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:36.499451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:36.500476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:36.501182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:36.501807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:37.113417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:00:37.113916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:00:37.114629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:00:37.115246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:00:37.115840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:00:37.131010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:37.131523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:37.131963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:37.132710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:37.136994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:37.140603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:37.179183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Getting quotas for project 98b3358e35ea4237be958bf13d333edd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:00:37.191362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Getting quotas for user 39013f6c37ef4490bfee4efec898a6ce and project 98b3358e35ea4237be958bf13d333edd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:00:37.214283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:00:37.218063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:00:37.306226 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c47b7aa-b427-459d-a620-e080965b1f3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.983727 Aug 23 11:00:37.307238 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2657/5338] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:00:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:00:37.318382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:37.319246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:37.342297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:37.342835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:37.345416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:37.346289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:37.346789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:37.349250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:37.449274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:37.474030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:37.483006 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b1d1084-7482-4700-a443-d819e6721e8d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1508 microversion: 2.1 time: 0.998215 Aug 23 11:00:37.483604 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2682/5339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:36 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1508 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:37.516042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d9f9668-fa82-4f3c-9a5b-8416266a8a04 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:37.518515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d9f9668-fa82-4f3c-9a5b-8416266a8a04 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:37.737649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d9f9668-fa82-4f3c-9a5b-8416266a8a04 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:37.754421 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d9f9668-fa82-4f3c-9a5b-8416266a8a04 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1213 microversion: 2.1 time: 0.248885 Aug 23 11:00:37.773853 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2683/5340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:37 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1213 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:37.783735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:37.789872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:37.808374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:37.811996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:37.815459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:37.816624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:37.817379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:37.821334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.025026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:38.027303 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-635092fd-c1f1-4772-8d3b-a430104ca073 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "PUT /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1080 microversion: 2.1 time: 0.250974 Aug 23 11:00:38.036314 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2684/5341] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 11:00:37 2022] PUT /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1080 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:38.049154 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34b0ec63-f702-43f6-83fd-d874b43c8b69 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1308 microversion: 2.1 time: 0.732916 Aug 23 11:00:38.068366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:38.069730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:38.080321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2658/5342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:37 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1308 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:38.080623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.081426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.085710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.096558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.099877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.101208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.627960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:38.638986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-670f010b-53e0-4477-b213-61c3463cdb4f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1506 microversion: 2.1 time: 0.577585 Aug 23 11:00:38.655131 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2685/5343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:38 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:38.661514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:38.662581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:38.670846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.671357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.671965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.672815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.673285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.673911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.783385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:38.784451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:38.797947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.800550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.801405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.803003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.803698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.804347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.928594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:38.939620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e899138d-86cb-4ae2-8c7d-ad3dc0874a1f tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1506 microversion: 2.1 time: 0.282265 Aug 23 11:00:38.940961 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2659/5344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:38 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:38.962647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:38.967593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:38.968067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:38.974859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.975745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.976438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.977277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:38.977953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:38.978755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:38.987879 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14a55b1c-bc72-4ed4-b58c-0de282b998b7 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1265 microversion: 2.1 time: 0.211393 Aug 23 11:00:38.989889 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2686/5345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:38 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:39.056936 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91227bbe-549f-46ca-8c36-24ddf6f02167 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "PUT /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1082 microversion: 2.1 time: 0.099200 Aug 23 11:00:39.057594 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2660/5346] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 11:00:38 2022] PUT /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1082 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:39.079568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:39.080205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:39.084280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:39.084955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:39.089023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.090442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.094374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.095428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.095920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.096361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.103650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.105414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.106942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.107932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.108701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.111112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.489008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:39.498333 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2e1fccf-3d03-4390-a9a1-0e965a1abfe7 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1508 microversion: 2.1 time: 0.423981 Aug 23 11:00:39.502846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2687/5347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:39 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:39.524141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:39.525089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:39.535976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.537744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.538756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.542633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.543437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.546136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.882238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:39.897751 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7031422f-abc2-46a1-8abf-74022a75ae67 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1508 microversion: 2.1 time: 0.373459 Aug 23 11:00:39.898587 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2688/5348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:39 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:39.923040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:39.923895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:39.934682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.945344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.946120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.947344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:39.949233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:39.950650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:39.994561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:40.003976 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37ead9eb-72e5-48cc-9bc9-6678973c0dd2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1490 microversion: 2.1 time: 0.925981 Aug 23 11:00:40.007895 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2661/5349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:39 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1490 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:40.014865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:40.017442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:40.022117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:40.035153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.035732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.036192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.037662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.038193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.038636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.220828 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7eef5319-9b2b-45a9-85c5-24404d60fc54 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 204 len: 0 microversion: 2.1 time: 0.302204 Aug 23 11:00:40.221658 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2689/5350] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:39 2022] DELETE /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:00:40.231685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:40.234580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:40.252464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.253082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.258947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.259783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.260275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.260720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.348905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:40.361139 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-528ea813-03a8-4ed3-bfcf-98db2546b1f5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1271 microversion: 2.1 time: 0.350929 Aug 23 11:00:40.364908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2662/5351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:40 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1271 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:40.381338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:40.382664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:40.402985 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7998beef-0cd6-48dd-97dd-51c996d46a39 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "PUT /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1085 microversion: 2.1 time: 0.180023 Aug 23 11:00:40.405484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.406254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.407609 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2690/5352] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 11:00:40 2022] PUT /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1085 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:40.420459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.423014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.425586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.426426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.430381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:40.431015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:40.452318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.452834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.453289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.458509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.460105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.464355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.498617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:40.602678 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Instance is already in deleting state, ignoring this request Aug 23 11:00:40.607531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28511988-c902-4a93-a822-341e3bfe0c0d tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 204 len: 0 microversion: 2.1 time: 0.236643 Aug 23 11:00:40.612152 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2663/5353] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:40 2022] DELETE /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:00:40.624928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:40.628223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:40.645817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.646899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.647948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.650514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:40.652725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:40.654378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:40.941406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:40.954606 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ddf4c1b-1a6d-4738-aa09-8d9f4a628710 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1514 microversion: 2.1 time: 0.340987 Aug 23 11:00:40.955588 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2664/5354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:40 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:41.032570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:41.044962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-823f3ec7-4bf5-40f6-ad70-8ed8e586db8b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1511 microversion: 2.1 time: 0.620494 Aug 23 11:00:41.046062 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2691/5355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:40 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1511 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:41.066284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:41.066988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:41.074014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.075041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.075962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.076996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.077699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.078861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.388342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:41.389556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:41.405035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.405832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.406449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.407370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.408003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.408602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.568882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:41.570761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:41.579573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3942bd2-19ba-4e9d-8479-f4638a83c66e tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1511 microversion: 2.1 time: 0.517287 Aug 23 11:00:41.581142 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2665/5356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:41 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:41.612467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:41.613672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-156b8296-978e-46f1-8231-82372e93f941 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1271 microversion: 2.1 time: 0.228643 Aug 23 11:00:41.614102 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2692/5357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:41 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:41.614452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:41.630931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.632561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.633436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.634325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.634963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.635564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.672816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:00:41.846654 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78abdc6c-2926-4ac7-b421-14f7f196a526 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 204 len: 0 microversion: 2.1 time: 0.248827 Aug 23 11:00:41.847577 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2666/5358] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:41 2022] DELETE /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:00:41.857237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:41.858013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:41.874061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.875591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.876071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.876931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.877405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:41.877865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:41.985059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:41.986987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:41.998398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:41.999547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:42.000208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:42.001788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:42.002480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:42.003694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:42.287873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:42.300296 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dffd206-912b-4f43-9385-c9ee18688528 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1514 microversion: 2.1 time: 0.320386 Aug 23 11:00:42.302640 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2667/5359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:41 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:42.345120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:42.354830 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-759df85f-be5c-4138-84cc-295dfca86fa9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1517 microversion: 2.1 time: 0.502684 Aug 23 11:00:42.355685 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2693/5360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:41 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1517 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:42.636429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:42.638107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:42.640983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:42.653143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:42.654037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:42.654783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:42.655713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:42.668284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:42.669018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:42.972887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:42.984538 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7161515f-329e-4a64-89ba-adfab98e059c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1313 microversion: 2.1 time: 0.353164 Aug 23 11:00:42.987797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2668/5361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:42 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:43.008259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-113624fc-92eb-4cd9-b58f-3bcefbeb2fbb req-c2d13768-bac4-4547-af60-082807c4e8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2096c70-7238-4e4a-a815-30d7027bc19c", "tag": "cc38e667-35c2-47e6-9667-491102f12cbf"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:43.031959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-113624fc-92eb-4cd9-b58f-3bcefbeb2fbb req-c2d13768-bac4-4547-af60-082807c4e8c9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:43.033206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-113624fc-92eb-4cd9-b58f-3bcefbeb2fbb req-c2d13768-bac4-4547-af60-082807c4e8c9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:43.033844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-113624fc-92eb-4cd9-b58f-3bcefbeb2fbb req-c2d13768-bac4-4547-af60-082807c4e8c9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:43.057028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-113624fc-92eb-4cd9-b58f-3bcefbeb2fbb req-c2d13768-bac4-4547-af60-082807c4e8c9 service nova] Creating event network-changed:cc38e667-35c2-47e6-9667-491102f12cbf for instance b2096c70-7238-4e4a-a815-30d7027bc19c on n-h2-847009-13 Aug 23 11:00:43.067989 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-113624fc-92eb-4cd9-b58f-3bcefbeb2fbb req-c2d13768-bac4-4547-af60-082807c4e8c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062088 Aug 23 11:00:43.072727 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2694/5362] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:43.323342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:43.325656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:43.343510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:43.344634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:43.345637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:43.346917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:43.350099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:43.352065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:43.381627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:43.382253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:43.397116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:43.400909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:43.401723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:43.402473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:43.403465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:43.403895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:43.926889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:43.938346 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52c5bd6e-a83b-4ea3-a80e-30f40e60bc05 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1514 microversion: 2.1 time: 0.618958 Aug 23 11:00:43.943263 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2669/5363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:43 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1514 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:44.008038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:44.009041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:44.023072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:44.023967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:44.024663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:44.030045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:44.031550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:44.034017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:44.466272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:44.483518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c92ffc7c-1fa1-40ad-8ed6-77fbbaf10133 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1517 microversion: 2.1 time: 1.109432 Aug 23 11:00:44.486541 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2695/5364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:43 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1517 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:44.754928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:44.778630 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bc18c296-825d-44a3-b494-b33275427fee tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1313 microversion: 2.1 time: 0.774090 Aug 23 11:00:44.792325 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2670/5365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:44 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:44.967004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:44.968081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:44.977236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:44.978042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:44.979639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:44.980632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:44.981902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:44.982749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.089461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-691ae499-67fe-40d1-b8cb-081d21b3c83b req-62cec10a-a7ea-42a9-b4b4-298337cfa677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52715ac7-849b-41ae-8041-357cb34c253e", "name": "network-vif-deleted", "tag": "9264437c-4f3f-4e00-a3d5-32385e2be443"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:45.113016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-691ae499-67fe-40d1-b8cb-081d21b3c83b req-62cec10a-a7ea-42a9-b4b4-298337cfa677 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.114056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-691ae499-67fe-40d1-b8cb-081d21b3c83b req-62cec10a-a7ea-42a9-b4b4-298337cfa677 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.114955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-691ae499-67fe-40d1-b8cb-081d21b3c83b req-62cec10a-a7ea-42a9-b4b4-298337cfa677 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.129861 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-691ae499-67fe-40d1-b8cb-081d21b3c83b req-62cec10a-a7ea-42a9-b4b4-298337cfa677 service nova] Creating event network-vif-deleted:9264437c-4f3f-4e00-a3d5-32385e2be443 for instance 52715ac7-849b-41ae-8041-357cb34c253e on n-h1-847009-13 Aug 23 11:00:45.149623 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-691ae499-67fe-40d1-b8cb-081d21b3c83b req-62cec10a-a7ea-42a9-b4b4-298337cfa677 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064903 Aug 23 11:00:45.156160 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2671/5366] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:45.249170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:45.262754 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43caa693-8377-4529-8887-c3896f56c470 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1472 microversion: 2.1 time: 0.297657 Aug 23 11:00:45.285929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2696/5367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:44 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:45.510440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:45.513579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:45.527993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f8c0fab2-6ecf-41e4-b9fb-e00602a123fe req-6b4a5680-047c-4eda-ab23-cabe2669229f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05f74af-e706-4ae2-b590-4c8c190944df", "name": "network-vif-deleted", "tag": "6cc499cf-cb2c-4c3c-a754-93632f725ad4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:45.544217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:45.555181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8c0fab2-6ecf-41e4-b9fb-e00602a123fe req-6b4a5680-047c-4eda-ab23-cabe2669229f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.556035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8c0fab2-6ecf-41e4-b9fb-e00602a123fe req-6b4a5680-047c-4eda-ab23-cabe2669229f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.556692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f8c0fab2-6ecf-41e4-b9fb-e00602a123fe req-6b4a5680-047c-4eda-ab23-cabe2669229f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.575928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:45.577455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.579074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.581272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.583799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.587894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.593713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.599502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f8c0fab2-6ecf-41e4-b9fb-e00602a123fe req-6b4a5680-047c-4eda-ab23-cabe2669229f service nova] Creating event network-vif-deleted:6cc499cf-cb2c-4c3c-a754-93632f725ad4 for instance a05f74af-e706-4ae2-b590-4c8c190944df on n-h1-847009-13 Aug 23 11:00:45.620242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:45.629930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f8c0fab2-6ecf-41e4-b9fb-e00602a123fe req-6b4a5680-047c-4eda-ab23-cabe2669229f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105875 Aug 23 11:00:45.636531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2697/5368] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:00:45.715078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.717206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.717830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.718490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lazy-loading 'fault' on Instance uuid 52715ac7-849b-41ae-8041-357cb34c253e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:45.801031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:45.801900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:45.815615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.826790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.829588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.830956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:45.831869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:45.833256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:45.852554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:45.866294 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bebcc67a-ee78-4b2c-bd9c-ed6cd520ccd1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 200 len: 1319 microversion: 2.1 time: 0.362449 Aug 23 11:00:45.869473 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2672/5369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:45 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:46.290478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:46.291627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:46.305830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:46.307732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:46.308219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:46.312308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:46.314059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:46.316507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:46.468461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:46.471724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:46.472914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:46.473511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lazy-loading 'fault' on Instance uuid a05f74af-e706-4ae2-b590-4c8c190944df {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:46.594284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:46.603386 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b20940d6-49d3-48f1-979a-aee89cc1e67a tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1313 microversion: 2.1 time: 0.808371 Aug 23 11:00:46.606593 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2698/5370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:45 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1313 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:46.625551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1227f4970d7a49f79cd897ed1b936907', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfdf5f7099d848ab998f1458fbe40c08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:46.639321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-355464d5-1ae2-4bce-b46d-f178e6fe8e50 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 200 len: 1308 microversion: 2.1 time: 0.358042 Aug 23 11:00:46.644315 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2673/5371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:46 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:46.894985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:46.895596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:46.910893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:46.911659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:46.912300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:46.914145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:46.915013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:46.915649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:46.942560 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e HTTP/1.1 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '52715ac7-849b-41ae-8041-357cb34c253e'} Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:46.952419 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:46.958217 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:46.958217 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:46.958217 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:46.958217 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:46.958217 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:00:46.958217 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:46.964067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:46.965805 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a443399-a211-4cf0-ad56-651fa40fd451 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 404 len: 111 microversion: 2.1 time: 0.074505 Aug 23 11:00:46.970656 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2699/5372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:46 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:47.183216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:47.188939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-212776570", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "534fbe4f-70f8-462c-8605-6d72e9964e2d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:47.204200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:47.275369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] validate_networks() for [('534fbe4f-70f8-462c-8605-6d72e9964e2d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:00:47.628189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:47.629083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:47.647254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:47.647898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:47.648441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:47.649300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:47.649865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:47.650395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:47.769650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:48.345610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:00:48.347188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:00:48.347938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:00:48.348582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:00:48.349292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:00:48.383712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.386447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.394166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.396954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.411732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.412437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.438785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:00:48.447260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Getting quotas for user a21400f211b740a191c116777a9f414f and project 6c6e1b0e86f243309763b50022e1a480. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:00:48.467258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:00:48.470798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:00:48.544869 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf035ea4-ff32-4141-aa7a-380ccd9a37d7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.362974 Aug 23 11:00:48.547334 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2674/5373] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:00:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:00:48.555743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:48.556696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: a05f74af-e706-4ae2-b590-4c8c190944df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:48.565813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.566831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.567677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.568688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.569477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.570221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.590302 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] HTTP exception thrown: Instance a05f74af-e706-4ae2-b590-4c8c190944df could not be found. Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Request method failure captured: Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df HTTP/1.1 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKnL8cctv-BDf0kxCiekpT5aYJQdjgkiyPpp7qT4PZ8oqKzi-iBzDG76ftR0ZZsDX9EdueVgXIO7LmaMVQPPZ9A_UQGVqmh8ScMqyOI71nITXVYusB0fjfikfLt7oULHWemMXNUSsdCPpOpfGS4dFr4NnTSwWasD7T1zax3dUjOdNM Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfdf5f7099d848ab998f1458fbe40c08", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}] Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1227f4970d7a49f79cd897ed1b936907 Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance a05f74af-e706-4ae2-b590-4c8c190944df could not be found. Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'a05f74af-e706-4ae2-b590-4c8c190944df'} Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05f74af-e706-4ae2-b590-4c8c190944df could not be found. Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05f74af-e706-4ae2-b590-4c8c190944df could not be found. Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:48.592977 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05f74af-e706-4ae2-b590-4c8c190944df could not be found. Aug 23 11:00:48.597177 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.599586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Returning 404 to user: Instance a05f74af-e706-4ae2-b590-4c8c190944df could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:48.600691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74e49695-2cf5-45c3-92fa-b40965c3a05a tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df" status: 404 len: 111 microversion: 2.1 time: 0.051695 Aug 23 11:00:48.602042 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2675/5374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:48 2022] GET /compute/v2.1/servers/a05f74af-e706-4ae2-b590-4c8c190944df => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:48.607995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e0fcb46-70dc-4a64-9863-16b5100d494f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:48.609032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e0fcb46-70dc-4a64-9863-16b5100d494f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:48.721332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:48.742833 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae222ea3-d938-479d-a52a-388c3e59a850 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1313 microversion: 2.1 time: 1.115228 Aug 23 11:00:48.744778 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2700/5375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:47 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1313 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:48.760722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:48.762588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:48.779888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.781529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.783990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.785073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.789852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.790620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.832953 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] HTTP exception thrown: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Request method failure captured: Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b HTTP/1.1 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKnL8cctv-BDf0kxCiekpT5aYJQdjgkiyPpp7qT4PZ8oqKzi-iBzDG76ftR0ZZsDX9EdueVgXIO7LmaMVQPPZ9A_UQGVqmh8ScMqyOI71nITXVYusB0fjfikfLt7oULHWemMXNUSsdCPpOpfGS4dFr4NnTSwWasD7T1zax3dUjOdNM Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfdf5f7099d848ab998f1458fbe40c08", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}] Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1227f4970d7a49f79cd897ed1b936907 Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6d8f1906-b3b1-40ab-b4b2-c42df679a13b'} Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:48.835641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.839702 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.846029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Returning 404 to user: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:48.849321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06a03890-cd32-4330-adf5-0853f735e2ff tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 404 len: 111 microversion: 2.1 time: 0.100807 Aug 23 11:00:48.851017 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2701/5376] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:48 2022] DELETE /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:48.864935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:48.866979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 6d8f1906-b3b1-40ab-b4b2-c42df679a13b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:48.880588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e0fcb46-70dc-4a64-9863-16b5100d494f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:48.882553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.886170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.887850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.890296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:48.893348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:48.894101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:48.897895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e0fcb46-70dc-4a64-9863-16b5100d494f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1208 microversion: 2.1 time: 0.292802 Aug 23 11:00:48.899001 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2676/5377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:48 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1208 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:48.926576 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] HTTP exception thrown: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Request method failure captured: Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b HTTP/1.1 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKnL8cctv-BDf0kxCiekpT5aYJQdjgkiyPpp7qT4PZ8oqKzi-iBzDG76ftR0ZZsDX9EdueVgXIO7LmaMVQPPZ9A_UQGVqmh8ScMqyOI71nITXVYusB0fjfikfLt7oULHWemMXNUSsdCPpOpfGS4dFr4NnTSwWasD7T1zax3dUjOdNM Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfdf5f7099d848ab998f1458fbe40c08", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}] Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1227f4970d7a49f79cd897ed1b936907 Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6d8f1906-b3b1-40ab-b4b2-c42df679a13b'} Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:48.928769 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. Aug 23 11:00:48.933487 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:48.945941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Returning 404 to user: Instance 6d8f1906-b3b1-40ab-b4b2-c42df679a13b could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:48.950141 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a5770dcf-d0fe-4286-81fe-5e749e592dc8 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b" status: 404 len: 111 microversion: 2.1 time: 0.091929 Aug 23 11:00:48.951213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2702/5378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:48 2022] GET /compute/v2.1/servers/6d8f1906-b3b1-40ab-b4b2-c42df679a13b => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:48.981977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:48.982565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:49.000064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.000846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.001442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.002178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.002975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.003353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.040707 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] HTTP exception thrown: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Request method failure captured: Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 HTTP/1.1 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKnL8cctv-BDf0kxCiekpT5aYJQdjgkiyPpp7qT4PZ8oqKzi-iBzDG76ftR0ZZsDX9EdueVgXIO7LmaMVQPPZ9A_UQGVqmh8ScMqyOI71nITXVYusB0fjfikfLt7oULHWemMXNUSsdCPpOpfGS4dFr4NnTSwWasD7T1zax3dUjOdNM Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfdf5f7099d848ab998f1458fbe40c08", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}] Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1227f4970d7a49f79cd897ed1b936907 Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1bd86f97-9229-48da-a3cd-9475d158b762'} Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:49.046999 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Returning 404 to user: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:49.053049 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2eb6cfe3-6909-461d-bb35-378c46a889a1 tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 404 len: 111 microversion: 2.1 time: 0.095624 Aug 23 11:00:49.060944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2677/5379] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:00:48 2022] DELETE /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:49.064230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:49.064857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] [instance: 1bd86f97-9229-48da-a3cd-9475d158b762] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:49.074311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.075690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.076388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.077411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.078105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.078711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.086181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2aab602d-b8b7-42a8-9013-6d89c79fc9ee req-ec7f70fa-b6ce-424c-8cc4-f958615a841e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2096c70-7238-4e4a-a815-30d7027bc19c", "name": "network-vif-plugged", "status": "completed", "tag": "cc38e667-35c2-47e6-9667-491102f12cbf"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:49.100612 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] HTTP exception thrown: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Request method failure captured: Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 HTTP/1.1 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKnL8cctv-BDf0kxCiekpT5aYJQdjgkiyPpp7qT4PZ8oqKzi-iBzDG76ftR0ZZsDX9EdueVgXIO7LmaMVQPPZ9A_UQGVqmh8ScMqyOI71nITXVYusB0fjfikfLt7oULHWemMXNUSsdCPpOpfGS4dFr4NnTSwWasD7T1zax3dUjOdNM Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bfdf5f7099d848ab998f1458fbe40c08", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bfdf5f7099d848ab998f1458fbe40c08"}]}] Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: bfdf5f7099d848ab998f1458fbe40c08 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2147459729 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1227f4970d7a49f79cd897ed1b936907 Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiskConfigTestJSON-2147459729-project Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1bd86f97-9229-48da-a3cd-9475d158b762'} Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:00:49.102959 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. Aug 23 11:00:49.111669 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:00:49.113507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2aab602d-b8b7-42a8-9013-6d89c79fc9ee req-ec7f70fa-b6ce-424c-8cc4-f958615a841e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.113910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] Returning 404 to user: Instance 1bd86f97-9229-48da-a3cd-9475d158b762 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:00:49.114080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2aab602d-b8b7-42a8-9013-6d89c79fc9ee req-ec7f70fa-b6ce-424c-8cc4-f958615a841e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.114238 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-366c2010-dfb6-4ac0-a5ce-dfb04526e12c tempest-ServerDiskConfigTestJSON-2147459729 tempest-ServerDiskConfigTestJSON-2147459729-project] 10.222.0.78 "GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762" status: 404 len: 111 microversion: 2.1 time: 0.046104 Aug 23 11:00:49.114405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2aab602d-b8b7-42a8-9013-6d89c79fc9ee req-ec7f70fa-b6ce-424c-8cc4-f958615a841e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.116859 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2703/5380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:49 2022] GET /compute/v2.1/servers/1bd86f97-9229-48da-a3cd-9475d158b762 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:00:49.140045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2aab602d-b8b7-42a8-9013-6d89c79fc9ee req-ec7f70fa-b6ce-424c-8cc4-f958615a841e service nova] Creating event network-vif-plugged:cc38e667-35c2-47e6-9667-491102f12cbf for instance b2096c70-7238-4e4a-a815-30d7027bc19c on n-h2-847009-13 Aug 23 11:00:49.150396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2aab602d-b8b7-42a8-9013-6d89c79fc9ee req-ec7f70fa-b6ce-424c-8cc4-f958615a841e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068096 Aug 23 11:00:49.156361 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2678/5381] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:49.447529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:49.447951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:49.464416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.464970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.466172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.467134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.467778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.468401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.587812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lazy-loading 'services' on Instance uuid c8cc3299-8702-4bf7-8e1c-04760cfb167f {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:49.709128 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd3d530b-25db-4223-b640-a632f209631e tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f/os-volume_attachments/1b43daf3-50af-4c1a-86cb-5715f37726d7" status: 202 len: 0 microversion: 2.1 time: 0.264823 Aug 23 11:00:49.710401 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2704/5382] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:00:49 2022] DELETE /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f/os-volume_attachments/1b43daf3-50af-4c1a-86cb-5715f37726d7 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:00:49.766102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:49.767435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:49.782227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.782772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.783572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.789485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.790587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.791862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.921232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:49.922718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:49.940670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.941203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.941654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:49.942368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:49.946939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:49.951417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:50.094389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:50.103620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-77c36dbd-95e7-4090-a223-2ba1bf905ace tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1260 microversion: 2.1 time: 0.188106 Aug 23 11:00:50.117809 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2705/5383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:49 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:50.163915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:50.175313 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a83906b3-d9a9-4d3c-99bd-e2da4209c2c9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1313 microversion: 2.1 time: 0.415408 Aug 23 11:00:50.190732 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2679/5384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:49 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:51.128854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:51.129528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:51.149053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:51.154142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:51.163372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:51.164214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:51.165691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:51.166170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:51.202533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:51.203312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:51.227409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:51.227727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:51.233097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:51.234452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:51.235694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:51.237009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:51.315720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:51.342371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db340bca-5a44-4dd5-9c49-9b1a0281a489 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1266 microversion: 2.1 time: 0.218161 Aug 23 11:00:51.358738 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2706/5385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:51 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:51.686436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:51.707287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00a533ae-f5ba-4ff2-973d-d247c9f067d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1497 microversion: 2.1 time: 0.502201 Aug 23 11:00:51.708109 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2680/5386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:51 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1497 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:51.743370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:51.748421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:51.797295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:51.798976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:51.800458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:51.802495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:51.803792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:51.807151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:51.859447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lazy-loading 'flavor' on Instance uuid b2096c70-7238-4e4a-a815-30d7027bc19c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:00:52.051070 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f61240d-1b8e-44d2-a6ec-9fc66f02cfed tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "POST /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c/action" status: 200 len: 32 microversion: 2.1 time: 0.319224 Aug 23 11:00:52.052045 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2707/5387] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:00:51 2022] POST /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c/action => generated 32 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:00:52.072146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:52.074177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:52.097995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:52.100814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:52.101854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:52.105179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:52.105727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:52.107981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:52.364430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:52.365822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:52.378853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:52.388345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:52.389246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:52.390966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:52.391647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:52.392484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:52.550418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:52.564809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60408838-a020-45ce-a2ec-f8230c4846d5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.504379 Aug 23 11:00:52.570168 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2681/5388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:52 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:52.899563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:52.916439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-682a5a3f-0a25-47b4-ad27-fafcddb11378 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1266 microversion: 2.1 time: 0.555019 Aug 23 11:00:52.917828 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2708/5389] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:52 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1266 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:53.586538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:53.588006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:53.603699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:53.609813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:53.611253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:53.615890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:53.616626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:53.617308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:53.937706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:53.938310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:53.954802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:53.955305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:53.955747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:53.956472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:53.957014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:53.957497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:53.992577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:54.007366 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d670acf-1213-42de-910c-130c762fa53c tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.424912 Aug 23 11:00:54.007809 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2682/5390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:53 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:00:54.139134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:54.152887 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2191e615-82fc-427b-8065-095c52f39851 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1266 microversion: 2.1 time: 0.216697 Aug 23 11:00:54.152887 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2709/5391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:53 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:55.032787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:55.034162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:55.054701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:55.055620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:55.056367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:55.060841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:55.065747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:55.066592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:55.171442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:55.172137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:55.187059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:55.189722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:55.191580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:55.192492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:55.193512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:55.195216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:55.343892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:55.351934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a490e51-0e3c-4a3e-b65c-01503dab1e8b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.324382 Aug 23 11:00:55.352982 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2683/5392] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:55 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:56.146533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:56.160406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5247d356-dfb8-453b-9af9-f6df6afd38b5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.993574 Aug 23 11:00:56.176232 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2710/5393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:55 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:56.382069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:56.383366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:56.401576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:56.404442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:56.405311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:56.406950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:56.407876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:56.408547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:56.830976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:56.853945 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-929752a8-04ea-4519-8d6c-e4ac41738dd3 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.477968 Aug 23 11:00:56.854571 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2684/5394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:56 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:57.185462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:57.186710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:57.203081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:57.204149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:57.206074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:57.207116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:57.211797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:57.212570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:57.686966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:57.703941 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd89d885-a002-4c62-b2a6-a213e079b6f7 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.519943 Aug 23 11:00:57.710292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2711/5395] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:57 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:57.807677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a97ac3d0-7d7f-4a02-bfac-ec4311706d09 req-c39fdfb6-3fc6-41d8-8a7d-4b67f5610d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5320568f-a2fa-4b66-b228-9bac15be25a7", "tag": "0cffb984-b3aa-4061-8d9d-476bf29ad485"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:00:57.833110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a97ac3d0-7d7f-4a02-bfac-ec4311706d09 req-c39fdfb6-3fc6-41d8-8a7d-4b67f5610d94 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:57.837709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a97ac3d0-7d7f-4a02-bfac-ec4311706d09 req-c39fdfb6-3fc6-41d8-8a7d-4b67f5610d94 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:57.845711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a97ac3d0-7d7f-4a02-bfac-ec4311706d09 req-c39fdfb6-3fc6-41d8-8a7d-4b67f5610d94 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:57.877339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:57.878368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:57.916520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:57.921582 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a97ac3d0-7d7f-4a02-bfac-ec4311706d09 req-c39fdfb6-3fc6-41d8-8a7d-4b67f5610d94 service nova] Creating event network-changed:0cffb984-b3aa-4061-8d9d-476bf29ad485 for instance 5320568f-a2fa-4b66-b228-9bac15be25a7 on n-h1-847009-13 Aug 23 11:00:57.922057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:57.929784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:57.935283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:57.936136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:57.938370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:57.953735 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a97ac3d0-7d7f-4a02-bfac-ec4311706d09 req-c39fdfb6-3fc6-41d8-8a7d-4b67f5610d94 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154248 Aug 23 11:00:57.957618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2685/5396] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:00:58.724930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:58.738333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:58.739702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-956a2923-621e-4af4-8a41-5a4f84023654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.868724 Aug 23 11:00:58.740978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:58.741509 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2712/5397] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:57 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:58.756257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:58.773887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:58.774790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:58.775562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:58.777134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:58.778821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:58.779667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:58.888034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:00:59.086188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:00:59.105364 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2afaf6f5-fe54-4380-ad8c-0ae18f487cdd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.377053 Aug 23 11:00:59.109256 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2686/5398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:58 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:00:59.768467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:00:59.769546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:00:59.778677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:59.779550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:59.780395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:59.782197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:00:59.782918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:00:59.783725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:00:59.997102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:00.013840 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31fb13cd-eda6-42a4-af53-578796237c3b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.251213 Aug 23 11:01:00.014550 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2713/5399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:00:59 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:00.133264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:00.134245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:00.142508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:00.143017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:00.143462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:00.145910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:00.146391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:00.147091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:00.178515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:00.353457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1856021134", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "29d55b3d-b5a3-4e73-8706-798abf24e0f2"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:00.425304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:00.450184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfc203db-0afa-4997-aa61-1bef0f9982e9 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.320449 Aug 23 11:01:00.453561 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2714/5400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:00 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:00.470217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:00.470735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:00.480053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:00.481357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:00.482249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:00.483161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:00.483789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:00.484400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:00.492594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] validate_networks() for [('29d55b3d-b5a3-4e73-8706-798abf24e0f2', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:01:00.516465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:00.671279 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-177217a4-11ad-462d-8c48-2c674f13b6db tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 204 len: 0 microversion: 2.1 time: 0.213627 Aug 23 11:01:00.673630 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2715/5401] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:00 2022] DELETE /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:01:00.686563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:00.689014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:00.704346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:00.704875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:00.705321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:00.709615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:00.710152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:00.710608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:00.962511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:00.982182 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b409cacd-a4f4-49bc-af77-eac39188c582 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1515 microversion: 2.1 time: 0.302674 Aug 23 11:01:00.985581 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2716/5402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:00 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:01.036070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:01.036985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:01.049428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:01.050156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:01.050779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:01.051881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:01.053943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:01.057795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:01.110029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:01:01.111366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:01:01.111855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:01:01.112271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:01:01.117742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:01:01.140189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:01.140697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:01.142301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:01.144151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:01.145402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:01.147880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:01.196383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Getting quotas for project 52efc373c25541418bba046b7b8478a6. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:01.209191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Getting quotas for user 9c2b9cf5e2be4912b2e5f51e818f2507 and project 52efc373c25541418bba046b7b8478a6. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:01.231788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:01:01.234912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:01:01.289233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9c26dfe5-f655-4fa8-8d52-6a28a0457051 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363203 Aug 23 11:01:01.300505 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2687/5403] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:01:01.306786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dde9863a-b322-4d69-8591-f809b84d5c8d tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:01.307992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dde9863a-b322-4d69-8591-f809b84d5c8d tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:01.414763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:01.427058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-927c37a4-c73f-46c3-998b-a4b0bf52598d tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.394985 Aug 23 11:01:01.428531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dde9863a-b322-4d69-8591-f809b84d5c8d tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:01.436832 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dde9863a-b322-4d69-8591-f809b84d5c8d tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1225 microversion: 2.1 time: 0.134857 Aug 23 11:01:01.439424 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2717/5404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:01 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:01.450419 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2688/5405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:01 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1225 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:01.475852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:01.476727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:01.484705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:01.485692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:01.486286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:01.487174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:01.488067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:01.488663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:01.878679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:01.890779 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-789e3036-1314-4eb5-a655-9f67c366778f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.419422 Aug 23 11:01:01.913272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2718/5406] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:01 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:02.019909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:02.022097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:02.037468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.051041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.054627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.057149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.057966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.062370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.353484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:02.374171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18b639ce-6b5d-462a-9b3f-62ffe0809fd8 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1515 microversion: 2.1 time: 0.363904 Aug 23 11:01:02.377067 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2689/5407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:02 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1515 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:02.448016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:02.450225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:02.461825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.466293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.467087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.468108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.469735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.471648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.472182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:02.472902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:02.493370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.495398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.497607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.499746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.501639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.505654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.635409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:02.649495 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-386723a2-c9a4-4c7f-b57e-7201320923ad tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1221 microversion: 2.1 time: 0.187336 Aug 23 11:01:02.654762 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2690/5408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:02 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:02.852687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:02.879800 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4df8a65d-e4ec-4b73-a2e7-ffc215732612 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.435634 Aug 23 11:01:02.894247 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2719/5409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:02 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:02.922071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:02.922935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:02.939404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.940091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.940696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:02.941597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:02.942221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:02.942899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:03.213113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1030704171", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a72aec3a-aecf-4d8a-90a7-415281b4d7ef"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:03.295113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] validate_networks() for [('a72aec3a-aecf-4d8a-90a7-415281b4d7ef', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:01:03.339146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:03.383672 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab4a6f08-21d7-4070-b630-9978bd57e88c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.463724 Aug 23 11:01:03.388997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2691/5410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:02 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:03.407770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:03.408547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:03.422376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:03.422893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:03.426680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:03.427468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:03.427958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:03.428662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:03.891411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:03.900807 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc8ce280-4654-4b88-ab64-30db315fd8d0 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1515 microversion: 2.1 time: 0.498218 Aug 23 11:01:03.901559 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2692/5411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:03 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1515 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:03.911735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:03.912670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:03.920279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:03.921481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:03.922320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:03.923463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:03.924476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:03.925121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:04.130412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:04.144476 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4629f05-06a9-4ad7-ab3d-1d22c18111da tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1277 microversion: 2.1 time: 0.240533 Aug 23 11:01:04.146883 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2693/5412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:03 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:04.158084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:04.161308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:04.173721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:04.174787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:04.175799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:04.176826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:04.177468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:04.178072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:04.183003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:04.331303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:01:04.332230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:01:04.333100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:01:04.333903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:01:04.334661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:01:04.349113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:04.349926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:04.350571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:04.351728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:04.352362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:04.353249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:04.389142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Getting quotas for project 8c7f19e3b57141cb80a30ffde5b6fb89. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:04.396522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Getting quotas for user 76717cbfddf04587ab21618bc303c8c6 and project 8c7f19e3b57141cb80a30ffde5b6fb89. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:04.417770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:01:04.424121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:01:04.504213 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dabbbf5c-4f4f-472c-82a1-188086786af3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531634 Aug 23 11:01:04.506905 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2720/5413] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:01:04.534879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:04.537772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:04.568876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:04.569469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:04.569927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:04.572478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:04.573701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:04.576832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:05.103394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:05.117470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79bf9ad0-53eb-4cba-aeb5-d5f5a99c6b38 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.607935 Aug 23 11:01:05.120830 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2721/5414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:04 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:05.137885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1793586490", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "a72aec3a-aecf-4d8a-90a7-415281b4d7ef"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:05.226337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] validate_networks() for [('a72aec3a-aecf-4d8a-90a7-415281b4d7ef', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:01:05.519922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:05.542530 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06036687-0187-4660-bbc5-c1c1c43aca41 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 1.394248 Aug 23 11:01:05.543896 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2694/5415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:04 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:05.549565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:05.553196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:05.569600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:05.574193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:05.583574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:05.585466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:05.586662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:05.587765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.241954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:06.253808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d771122-e7a9-4260-8f29-a0f1652f351c tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1515 microversion: 2.1 time: 0.708592 Aug 23 11:01:06.254427 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2695/5416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:05 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1515 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:06.276121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:06.276992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:06.288963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.289852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.291563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.295524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.297004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.297799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.301434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:01:06.301987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:01:06.302321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:01:06.302729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:01:06.303141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:01:06.318116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.318914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.322705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.323768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.327462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.328130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.378012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Getting quotas for project 8c7f19e3b57141cb80a30ffde5b6fb89. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:06.384091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Getting quotas for user 76717cbfddf04587ab21618bc303c8c6 and project 8c7f19e3b57141cb80a30ffde5b6fb89. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:06.435997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:01:06.438107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:01:06.599115 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ab0d4f8-c52c-416b-b0b8-6759f91b2786 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473515 Aug 23 11:01:06.600319 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2722/5417] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:01:06.620257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:06.621603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:06.648548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.657684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.662114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:06.663190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.664083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.664682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.677392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.689266 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da073b01-83f4-4602-a712-511b344f2640 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1283 microversion: 2.1 time: 0.421604 Aug 23 11:01:06.715402 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2696/5418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:06 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1283 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:06.735060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:06.737631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:06.763189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.764812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.765290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:06.766567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:06.769527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:06.770281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:07.510772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:07.526450 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2519983c-6bf5-476f-be4d-c922270744a2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.807908 Aug 23 11:01:07.551861 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2697/5419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:06 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:07.563508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1487578286", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "451", "networks": [{"uuid": "a72aec3a-aecf-4d8a-90a7-415281b4d7ef"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:07.675007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] validate_networks() for [('a72aec3a-aecf-4d8a-90a7-415281b4d7ef', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:01:07.686322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:07.702046 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d057608a-beca-421f-8c64-ad9f414b7727 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 1.100361 Aug 23 11:01:07.702771 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2723/5420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:06 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:07.707910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ace4ab2a-73e6-498d-a85b-4647084744f6 req-04695be4-dccc-4939-b4c0-045dea7bba65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8cc3299-8702-4bf7-8e1c-04760cfb167f", "name": "network-vif-deleted", "tag": "1d3fd3db-f6de-4188-8574-c97b71c94879"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:07.734628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ace4ab2a-73e6-498d-a85b-4647084744f6 req-04695be4-dccc-4939-b4c0-045dea7bba65 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:07.735622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ace4ab2a-73e6-498d-a85b-4647084744f6 req-04695be4-dccc-4939-b4c0-045dea7bba65 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:07.736239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ace4ab2a-73e6-498d-a85b-4647084744f6 req-04695be4-dccc-4939-b4c0-045dea7bba65 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:07.760791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ace4ab2a-73e6-498d-a85b-4647084744f6 req-04695be4-dccc-4939-b4c0-045dea7bba65 service nova] Creating event network-vif-deleted:1d3fd3db-f6de-4188-8574-c97b71c94879 for instance c8cc3299-8702-4bf7-8e1c-04760cfb167f on n-h1-847009-13 Aug 23 11:01:07.779205 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ace4ab2a-73e6-498d-a85b-4647084744f6 req-04695be4-dccc-4939-b4c0-045dea7bba65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075051 Aug 23 11:01:07.780097 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2724/5421] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:07.785907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:07.788240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:07.800873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:07.801497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:07.802037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:07.802857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:07.803421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:07.808859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:07.876649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:07.877529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:07.878145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:07.878802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lazy-loading 'fault' on Instance uuid c8cc3299-8702-4bf7-8e1c-04760cfb167f {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:01:07.952284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233bd6d1cf654ddcaca07760de91d51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50bcfd42fb814f318149a42613b43bc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:07.962717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0690bde5-195c-4bdd-a3b1-a18a145995df tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 200 len: 1309 microversion: 2.1 time: 0.180958 Aug 23 11:01:07.978633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2725/5422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:07 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:07.997818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ed566ca9-8773-4742-b207-ee8a102f94e7 req-923cbcc6-3f9e-41b8-b033-bca476159ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5320568f-a2fa-4b66-b228-9bac15be25a7", "name": "network-vif-plugged", "status": "completed", "tag": "0cffb984-b3aa-4061-8d9d-476bf29ad485"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:08.016008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed566ca9-8773-4742-b207-ee8a102f94e7 req-923cbcc6-3f9e-41b8-b033-bca476159ade service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.016571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed566ca9-8773-4742-b207-ee8a102f94e7 req-923cbcc6-3f9e-41b8-b033-bca476159ade service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.018193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ed566ca9-8773-4742-b207-ee8a102f94e7 req-923cbcc6-3f9e-41b8-b033-bca476159ade service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.036419 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ed566ca9-8773-4742-b207-ee8a102f94e7 req-923cbcc6-3f9e-41b8-b033-bca476159ade service nova] Creating event network-vif-plugged:0cffb984-b3aa-4061-8d9d-476bf29ad485 for instance 5320568f-a2fa-4b66-b228-9bac15be25a7 on n-h1-847009-13 Aug 23 11:01:08.046259 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ed566ca9-8773-4742-b207-ee8a102f94e7 req-923cbcc6-3f9e-41b8-b033-bca476159ade service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065943 Aug 23 11:01:08.047515 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2726/5423] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:08.054205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:08.055607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:08.065512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.066589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.067046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.068176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.069133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.069807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.503648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:08.516844 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89dba136-94e0-42b8-8e76-9c32876e94dd tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 0.467836 Aug 23 11:01:08.525777 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2727/5424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:08 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:08.562949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:08.563566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:08.571635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.572131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.572567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.573529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.585600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.586211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.788365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:01:08.788939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:01:08.789286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:01:08.789930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:01:08.790537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:01:08.806627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.808835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.809485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.812135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:08.813773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:08.814398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:08.858460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:08.880071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Getting quotas for project 8c7f19e3b57141cb80a30ffde5b6fb89. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:08.906370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Getting quotas for user 76717cbfddf04587ab21618bc303c8c6 and project 8c7f19e3b57141cb80a30ffde5b6fb89. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:08.953255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:01:08.958991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:01:09.023590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:09.033950 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89a052ab-ad29-4dfb-81c6-3eef419623df tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.477958 Aug 23 11:01:09.053824 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2728/5425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:08 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:09.053824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:09.053824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:09.057107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:09.057274 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-162c36d4-ce64-457e-8a7e-c119b12f147f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.501826 Aug 23 11:01:09.058059 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2698/5426] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:01:09.064264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:09.065609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] [instance: c8cc3299-8702-4bf7-8e1c-04760cfb167f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:09.079883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.089666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.091410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.093047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.095263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.097201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.097419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.099600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.101825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.108483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.109221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.111093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.145772 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] HTTP exception thrown: Instance c8cc3299-8702-4bf7-8e1c-04760cfb167f could not be found. Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Request method failure captured: Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f HTTP/1.1 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLI0IvuP612-ARVlWMZXpZsbXMNFwvGjD3hs1-7BHt7L-YIgfUJrNHt4836ZUYZ4I7Mjzux8hJBfOs5gvwMNtOPeoEqPS2i589KYhnA0bbE8iWs0SJzK9KOU6cIGQhha1ADvZvOV4PI3ejfs415-JQltA4u7d9kFBq0s1eGLKWY1-rU Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 50bcfd42fb814f318149a42613b43bc8 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesSnapshotTestJSON-699243733 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/50bcfd42fb814f318149a42613b43bc8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_50bcfd42fb814f318149a42613b43bc8", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50bcfd42fb814f318149a42613b43bc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50bcfd42fb814f318149a42613b43bc8"}]}] Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesSnapshotTestJSON-699243733 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 50bcfd42fb814f318149a42613b43bc8 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-699243733 Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesSnapshotTestJSON-699243733-project Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 233bd6d1cf654ddcaca07760de91d51f Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesSnapshotTestJSON-699243733-project Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance c8cc3299-8702-4bf7-8e1c-04760cfb167f could not be found. Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'c8cc3299-8702-4bf7-8e1c-04760cfb167f'} Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8cc3299-8702-4bf7-8e1c-04760cfb167f could not be found. Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8cc3299-8702-4bf7-8e1c-04760cfb167f could not be found. Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:09.150073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8cc3299-8702-4bf7-8e1c-04760cfb167f could not be found. Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] Returning 404 to user: Instance c8cc3299-8702-4bf7-8e1c-04760cfb167f could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ddac099-78dc-407d-b5fc-6c9844083df6 tempest-VolumesSnapshotTestJSON-699243733 tempest-VolumesSnapshotTestJSON-699243733-project] 10.222.0.78 "GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f" status: 404 len: 111 microversion: 2.1 time: 0.093771 Aug 23 11:01:09.157698 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2699/5427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:09 2022] GET /compute/v2.1/servers/c8cc3299-8702-4bf7-8e1c-04760cfb167f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:09.188164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1af2d8f1-267e-40ef-a1a9-bd2b7c1a0c78 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:09.192394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1af2d8f1-267e-40ef-a1a9-bd2b7c1a0c78 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:09.336122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1af2d8f1-267e-40ef-a1a9-bd2b7c1a0c78 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:09.347666 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1af2d8f1-267e-40ef-a1a9-bd2b7c1a0c78 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1221 microversion: 2.1 time: 0.189740 Aug 23 11:01:09.348170 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2700/5428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:09 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:09.545441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:09.546743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:09.567168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.568048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.568792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.569954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.571039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.571710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.694034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:09.721147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a113845-cb1d-4684-94a8-6336ba4b9e90 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1308 microversion: 2.1 time: 0.668440 Aug 23 11:01:09.722132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2729/5429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:09 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1308 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:09.833044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2249806a-49da-41e5-99c1-2a4e25954f33 req-be348b21-0388-4cd0-8bd6-da1e67db8f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edae5695-bdec-46d9-9a2b-2b361e271b32", "tag": "41143355-7d51-48da-98e3-dbcef8cc7d61"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:09.854507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2249806a-49da-41e5-99c1-2a4e25954f33 req-be348b21-0388-4cd0-8bd6-da1e67db8f6d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:09.856244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2249806a-49da-41e5-99c1-2a4e25954f33 req-be348b21-0388-4cd0-8bd6-da1e67db8f6d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:09.861475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2249806a-49da-41e5-99c1-2a4e25954f33 req-be348b21-0388-4cd0-8bd6-da1e67db8f6d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:09.888296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2249806a-49da-41e5-99c1-2a4e25954f33 req-be348b21-0388-4cd0-8bd6-da1e67db8f6d service nova] Creating event network-changed:41143355-7d51-48da-98e3-dbcef8cc7d61 for instance edae5695-bdec-46d9-9a2b-2b361e271b32 on n-h2-847009-13 Aug 23 11:01:09.901464 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2249806a-49da-41e5-99c1-2a4e25954f33 req-be348b21-0388-4cd0-8bd6-da1e67db8f6d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077968 Aug 23 11:01:09.905232 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2730/5430] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:01:10.014243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:10.046296 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-513314f8-b20e-4105-9219-560c0d8a75ce tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 0.506100 Aug 23 11:01:10.051121 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2701/5431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:09 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:10.067199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:10.068533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:10.091481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:10.092611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:10.093342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:10.095017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:10.095196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:10.096074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:10.375426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:10.375984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:10.399480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:10.401088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:10.411438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:10.414821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:10.416869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:10.418873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:10.602400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:10.618727 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ece3b92-c2e9-4089-8d19-141d69062b05 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1217 microversion: 2.1 time: 0.249496 Aug 23 11:01:10.633921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2702/5432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:10 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1217 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:10.771576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:10.772332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:10.796508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:10.797260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:10.801270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:10.805078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:10.807980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:10.809961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:10.828075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:10.838356 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b237416c-b850-436d-9c73-664bc6ae5e09 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.777134 Aug 23 11:01:10.843096 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2731/5433] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:10 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:11.009493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:11.019174 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-885584a4-cf02-41d9-acd5-53b3c3219c9c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1490 microversion: 2.1 time: 0.276665 Aug 23 11:01:11.020524 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2703/5434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:10 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1490 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:11.041475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-9570589"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:11.044322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:11.051053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.051536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.052441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.053359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.053832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.054264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.067844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:11.068714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:11.072511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:11.084247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.084956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.085503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.086484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.087267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.087944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.154304 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9a514fb3-7693-4668-8ebc-b17a7f8e0439 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "PUT /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1073 microversion: 2.1 time: 0.116746 Aug 23 11:01:11.154881 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2732/5435] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 11:01:11 2022] PUT /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1073 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:11.172547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:11.173480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:11.184925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.185511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.186056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.187095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.187632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.188590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.252971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:11.262628 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ebb275b-1897-4dce-81b4-c5e44fabcfda tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 0.198024 Aug 23 11:01:11.268804 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2704/5436] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:11 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:11.505103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:11.514572 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64a8cd6e-17e7-48b3-8a84-37c666abf74b tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1499 microversion: 2.1 time: 0.346672 Aug 23 11:01:11.515810 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2733/5437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:11 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1499 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:11.539455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:11.541287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:11.552348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.553693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.554356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.556355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.557049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.557679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.643868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:11.645383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:11.655857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.656540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.657243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:11.658302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:11.658920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:11.659682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.146544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:12.163720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa4046dd-0604-4af8-a153-654cf98b1519 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1499 microversion: 2.1 time: 0.628004 Aug 23 11:01:12.165408 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2705/5438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:11 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1499 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:12.174667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:12.175736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:12.203570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.205161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.205778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.206665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.207154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.207647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.385248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:12.407520 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b63732b-6330-4183-8e17-94dcfc3c4034 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1281 microversion: 2.1 time: 0.767561 Aug 23 11:01:12.411456 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2734/5439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:11 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1281 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:12.434209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bb216bd-719b-4146-bc91-6294d89ad4ce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:12.475116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bb216bd-719b-4146-bc91-6294d89ad4ce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.478812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bb216bd-719b-4146-bc91-6294d89ad4ce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.479663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bb216bd-719b-4146-bc91-6294d89ad4ce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.543520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bb216bd-719b-4146-bc91-6294d89ad4ce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Going to try to stop instance {{(pid=128859) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 11:01:12.584238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:12.615108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55885ddd-948a-4316-9fb6-92f50c19d183 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.447262 Aug 23 11:01:12.618262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2706/5440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:12 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:12.639945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:12.640600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:12.663172 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bb216bd-719b-4146-bc91-6294d89ad4ce tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "POST /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7/action" status: 202 len: 0 microversion: 2.1 time: 0.250197 Aug 23 11:01:12.668388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.669147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.672955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2735/5441] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:01:12 2022] POST /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:01:12.677005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.685700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.686680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.688975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.697937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:12.704227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:12.727868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.734448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.734951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:12.735955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:12.736421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:12.740475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:13.450622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:13.459775 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c31fff7-b979-4370-9638-73460db5f068 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.785280 Aug 23 11:01:13.460376 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2736/5442] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:12 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:13.475959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:13.476764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:13.487550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:13.488103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:13.488599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:13.489362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:13.489845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:13.496641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:13.622058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:13.644938 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88ffa89e-7284-4688-bf4b-4efb038ec164 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 1.025324 Aug 23 11:01:13.654041 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2707/5443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:12 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:13.669715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:13.687934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:13.755422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:13.755942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:13.756386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:13.771874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:13.774552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:13.775042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:14.296145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:14.310861 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23af89a1-c606-44e6-8d2f-46255262eae5 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.654738 Aug 23 11:01:14.313409 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2708/5444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:13 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:14.487338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:14.488495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:14.497564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:14.498461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:14.499915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:14.501195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:14.502051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:14.503596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:14.802368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:14.830662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c96a3d16-bcaa-4f4d-a9d9-114588dd432a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 1.367056 Aug 23 11:01:14.832087 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2737/5445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:13 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:14.844495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:14.848549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:14.863172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:14.863677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:14.864239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:14.868126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:14.873092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:14.873746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:15.284822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:15.311349 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91f22a90-7629-48c9-8474-83e4b42fc911 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.830291 Aug 23 11:01:15.311965 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2709/5446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:14 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:15.342568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b444a551-c679-453a-97eb-b711b6611434 req-c7016dbf-9611-481d-aa7c-315b35f46e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052c252b-ccac-43d2-9bef-61b5eebdd91b", "tag": "80b2ca12-103b-4bfb-8117-0dc71511abac"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:15.357412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b444a551-c679-453a-97eb-b711b6611434 req-c7016dbf-9611-481d-aa7c-315b35f46e56 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:15.357896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b444a551-c679-453a-97eb-b711b6611434 req-c7016dbf-9611-481d-aa7c-315b35f46e56 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:15.358337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b444a551-c679-453a-97eb-b711b6611434 req-c7016dbf-9611-481d-aa7c-315b35f46e56 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:15.393988 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b444a551-c679-453a-97eb-b711b6611434 req-c7016dbf-9611-481d-aa7c-315b35f46e56 service nova] Creating event network-changed:80b2ca12-103b-4bfb-8117-0dc71511abac for instance 052c252b-ccac-43d2-9bef-61b5eebdd91b on n-h1-847009-13 Aug 23 11:01:15.399216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b444a551-c679-453a-97eb-b711b6611434 req-c7016dbf-9611-481d-aa7c-315b35f46e56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066339 Aug 23 11:01:15.400513 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2710/5447] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:15.412685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9fdb6470-9c80-4f9b-9312-855200ed6c10 req-05f333bc-24fb-44b6-991d-059c823a30d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edae5695-bdec-46d9-9a2b-2b361e271b32", "name": "network-vif-plugged", "status": "completed", "tag": "41143355-7d51-48da-98e3-dbcef8cc7d61"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:15.435468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9fdb6470-9c80-4f9b-9312-855200ed6c10 req-05f333bc-24fb-44b6-991d-059c823a30d1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:15.435961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9fdb6470-9c80-4f9b-9312-855200ed6c10 req-05f333bc-24fb-44b6-991d-059c823a30d1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:15.436439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9fdb6470-9c80-4f9b-9312-855200ed6c10 req-05f333bc-24fb-44b6-991d-059c823a30d1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:15.467529 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9fdb6470-9c80-4f9b-9312-855200ed6c10 req-05f333bc-24fb-44b6-991d-059c823a30d1 service nova] Creating event network-vif-plugged:41143355-7d51-48da-98e3-dbcef8cc7d61 for instance edae5695-bdec-46d9-9a2b-2b361e271b32 on n-h2-847009-13 Aug 23 11:01:15.479298 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9fdb6470-9c80-4f9b-9312-855200ed6c10 req-05f333bc-24fb-44b6-991d-059c823a30d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077141 Aug 23 11:01:15.481125 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2711/5448] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:15.486848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:15.487518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:15.509579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:15.510420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:15.514463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:15.515610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:15.518449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:15.519108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:15.683744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:15.696287 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98e3b0b3-c6e3-44d3-8451-cad61d7e18b8 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 0.862823 Aug 23 11:01:15.697388 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2738/5449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:14 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:15.871256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:15.871861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:15.880137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:15.880630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:15.881095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:15.883150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:15.883150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:15.883150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.254107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:16.264408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7183e642-0aa2-495e-bc4e-3a9902873817 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.781930 Aug 23 11:01:16.272830 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2712/5450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:15 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:16.282217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-48e8e0b5-daa5-4888-a251-6784afbb6e2c req-9874cb6b-2e56-4464-a897-fdce67d3fba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da89b360-6cee-4251-a02d-8b784aeb4343", "tag": "80332d3d-63d7-4170-b037-f77cb55dc287"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:16.293160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48e8e0b5-daa5-4888-a251-6784afbb6e2c req-9874cb6b-2e56-4464-a897-fdce67d3fba4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.293795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48e8e0b5-daa5-4888-a251-6784afbb6e2c req-9874cb6b-2e56-4464-a897-fdce67d3fba4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.294074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48e8e0b5-daa5-4888-a251-6784afbb6e2c req-9874cb6b-2e56-4464-a897-fdce67d3fba4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.311795 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-48e8e0b5-daa5-4888-a251-6784afbb6e2c req-9874cb6b-2e56-4464-a897-fdce67d3fba4 service nova] Creating event network-changed:80332d3d-63d7-4170-b037-f77cb55dc287 for instance da89b360-6cee-4251-a02d-8b784aeb4343 on n-h1-847009-13 Aug 23 11:01:16.318179 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-48e8e0b5-daa5-4888-a251-6784afbb6e2c req-9874cb6b-2e56-4464-a897-fdce67d3fba4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044046 Aug 23 11:01:16.319259 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2713/5451] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:16.328226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:16.329133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:16.336174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.336898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.337497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.338497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.339111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.339734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.353066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:16.383986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-404d707c-66b8-4b11-95fd-78917d5e8351 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/ips" status: 200 len: 150 microversion: 2.1 time: 0.062267 Aug 23 11:01:16.388768 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2714/5452] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:01:16 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/ips => generated 150 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:16.404569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:16.407203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:16.408064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:16.409840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:16.422325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.423013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.424767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.427651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.429235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.432184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.434932 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0fc014eb-7201-4d28-a49a-742bd24f7445 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.566622 Aug 23 11:01:16.436091 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2739/5453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:15 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:16.473768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:16.723040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:16.723670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:16.746338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.746846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.747307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.748063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:16.748539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:16.749025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:16.772198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:16.785478 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36fb9b49-9095-48f3-bd34-054d372c4ef2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.389202 Aug 23 11:01:16.797976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2715/5454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:16 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:17.285761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:17.286398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:17.297979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.298662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.298925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.308156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.309147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.309623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.335388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:17.345138 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0862bdaf-6da8-4cb6-8299-1c7a3a6eba3f tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 0.627184 Aug 23 11:01:17.348480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2740/5455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:16 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:17.446834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-2b560fb2-ed9d-45b6-956d-fb7290b85b8c req-1ede1aee-b8a1-458c-b290-45922d9dded8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b1c352-6831-449c-bb70-ec3b016cdef4", "tag": "a72e5e80-b0b2-4162-a96c-fb9954599d02"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:17.467510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2b560fb2-ed9d-45b6-956d-fb7290b85b8c req-1ede1aee-b8a1-458c-b290-45922d9dded8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.475411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2b560fb2-ed9d-45b6-956d-fb7290b85b8c req-1ede1aee-b8a1-458c-b290-45922d9dded8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.476271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-2b560fb2-ed9d-45b6-956d-fb7290b85b8c req-1ede1aee-b8a1-458c-b290-45922d9dded8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.509730 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-2b560fb2-ed9d-45b6-956d-fb7290b85b8c req-1ede1aee-b8a1-458c-b290-45922d9dded8 service nova] Creating event network-changed:a72e5e80-b0b2-4162-a96c-fb9954599d02 for instance 36b1c352-6831-449c-bb70-ec3b016cdef4 on n-h2-847009-13 Aug 23 11:01:17.529182 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-2b560fb2-ed9d-45b6-956d-fb7290b85b8c req-1ede1aee-b8a1-458c-b290-45922d9dded8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086753 Aug 23 11:01:17.535803 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2741/5456] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:01:17.553608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:17.558992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:17.572903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.573604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.574302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.576408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.579963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.580729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.603001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:17.619506 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa42cbb6-3fdb-4611-b919-a783fc886b5b tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.337714 Aug 23 11:01:17.622422 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2716/5457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:17 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:17.807516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:17.809931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:17.824348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:17.828163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.831399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.832439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.834749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:17.835011 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6302f52-ef65-4136-b607-6d8c1a581ed6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.297554 Aug 23 11:01:17.835677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:17.836551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:17.860836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2742/5458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:17 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:18.127722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:18.145828 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-307c37c5-8d9a-4dc3-9377-da5cb1e98763 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.342177 Aug 23 11:01:18.146438 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2717/5459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:17 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:18.371875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:18.372706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:18.383629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:18.385570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:18.387249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:18.389012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:18.389721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:18.390415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:18.645983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:18.647155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:18.659962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:18.671072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:18.671743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:18.672517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:18.673023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:18.673457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:18.729077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:18.768647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65173392-6389-423a-a280-388a49f46c35 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1325 microversion: 2.1 time: 0.393591 Aug 23 11:01:18.769942 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2743/5460] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:18 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:18.821868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:18.856961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:18.857698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:18.868342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:18.873802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:18.874477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:18.875959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:18.880989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:18.881769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:19.279646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:19.296555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-df6861cd-986f-445c-a682-212671f2f627 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.656831 Aug 23 11:01:19.297180 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2718/5461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:18 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:19.326726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:19.327378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:19.364201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:19.378169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:19.378782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:19.379276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:19.380048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:19.380521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:19.380990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:19.785776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:19.802637 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0d9d997-6c91-4aec-a69c-deb272b67e99 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.504301 Aug 23 11:01:19.804240 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2719/5462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:19 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:19.811919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:19.817610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6cb6817-ddee-4c84-b059-e85983233657"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:19.821400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:19.821842 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0bb21c7a-524c-4a7d-92bf-73321e08dad1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.968581 Aug 23 11:01:19.834256 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2744/5463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:18 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:19.838564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:19.839328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:19.840774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:19.845712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:19.846966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:19.847654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:19.850584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:19.852558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:19.864548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:19.869257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:19.869835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:19.870815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:19.871447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:19.872013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.129533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:20.141652 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65f54fdf-9b15-4d7b-8e1d-59e8d357d926 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1522 microversion: 2.1 time: 0.305918 Aug 23 11:01:20.144068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2745/5464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:19 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:20.178162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:20.179066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:20.190115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.197199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.197761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.198792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.200264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.200727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.279654 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] HTTP exception thrown: Action 999 not found Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Request method failure captured: Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32/os-instance-actions/999 HTTP/1.1 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLNrF5xUDgViKVELgSxEAwsadFG1Pwwzq3MNjZi7s_IoLFwSi0111zPKBKxMB4ICj4QN4PFinNG6wA738qgIdv6EFTA1JuA9N3WVFNlhMpitwuD8aruHbM2Y0YKVtAVdnEF3zBJrSNxKlUyacaGL1TC_GaWBhPyH4-VbOjDcEV7dl8g Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 52efc373c25541418bba046b7b8478a6 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/52efc373c25541418bba046b7b8478a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_52efc373c25541418bba046b7b8478a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/52efc373c25541418bba046b7b8478a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/52efc373c25541418bba046b7b8478a6"}]}] Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 52efc373c25541418bba046b7b8478a6 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceActionsNegativeTestJSON-1139806720-project Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9c2b9cf5e2be4912b2e5f51e818f2507 Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1139806720-project Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: exception: Action 999 not found Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': 'edae5695-bdec-46d9-9a2b-2b361e271b32', 'id': '999'} Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 23 11:01:20.297178 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.301007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Returning 404 to user: Action 999 not found {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:20.301007 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79afbe2f-af87-4574-8fe8-247c0bef44f1 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.125933 Aug 23 11:01:20.302559 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2746/5465] 10.222.0.78 () {58 vars in 1308 bytes} [Tue Aug 23 11:01:20 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32/os-instance-actions/999 => generated 66 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 11:01:20.318816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dba845c5-8a5a-490f-bfca-090fa3fa79f5 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '.version_select at 0x7fdc9d2eac10>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:20.319834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dba845c5-8a5a-490f-bfca-090fa3fa79f5 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: 45611028-f6e9-41f9-871d-6c926d04c4da] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:20.346894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcadfc7a-dce3-4972-ad33-b0234affcd32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539400 Aug 23 11:01:20.351705 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2720/5466] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:01:19 2022] POST /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:20.366967 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-dba845c5-8a5a-490f-bfca-090fa3fa79f5 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] HTTP exception thrown: Instance 45611028-f6e9-41f9-871d-6c926d04c4da could not be found. Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dba845c5-8a5a-490f-bfca-090fa3fa79f5 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Request method failure captured: Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/45611028-f6e9-41f9-871d-6c926d04c4da/os-instance-actions HTTP/1.1 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLNrF5xUDgViKVELgSxEAwsadFG1Pwwzq3MNjZi7s_IoLFwSi0111zPKBKxMB4ICj4QN4PFinNG6wA738qgIdv6EFTA1JuA9N3WVFNlhMpitwuD8aruHbM2Y0YKVtAVdnEF3zBJrSNxKlUyacaGL1TC_GaWBhPyH4-VbOjDcEV7dl8g Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 52efc373c25541418bba046b7b8478a6 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/52efc373c25541418bba046b7b8478a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_52efc373c25541418bba046b7b8478a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/52efc373c25541418bba046b7b8478a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/52efc373c25541418bba046b7b8478a6"}]}] Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 52efc373c25541418bba046b7b8478a6 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceActionsNegativeTestJSON-1139806720-project Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9c2b9cf5e2be4912b2e5f51e818f2507 Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1139806720-project Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 45611028-f6e9-41f9-871d-6c926d04c4da could not be found. Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '45611028-f6e9-41f9-871d-6c926d04c4da'} Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45611028-f6e9-41f9-871d-6c926d04c4da could not be found. Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:20.370223 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45611028-f6e9-41f9-871d-6c926d04c4da could not be found. Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45611028-f6e9-41f9-871d-6c926d04c4da could not be found. Aug 23 11:01:20.375469 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:20.382494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dba845c5-8a5a-490f-bfca-090fa3fa79f5 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Returning 404 to user: Instance 45611028-f6e9-41f9-871d-6c926d04c4da could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:20.385645 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dba845c5-8a5a-490f-bfca-090fa3fa79f5 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/45611028-f6e9-41f9-871d-6c926d04c4da/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.074829 Aug 23 11:01:20.390657 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2747/5467] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Aug 23 11:01:20 2022] GET /compute/v2.1/servers/45611028-f6e9-41f9-871d-6c926d04c4da/os-instance-actions => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:20.392190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:20.395188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:20.406667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:20.407158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:20.415720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.423306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.424015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.424966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.425105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.425631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.428025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.428832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.429892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.430267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.431072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.434761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.492204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:20.576617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:20.677289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-523a4b57-0fc8-44e7-95a3-a9212c18096a tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "DELETE /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 204 len: 0 microversion: 2.1 time: 0.281578 Aug 23 11:01:20.681991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2748/5468] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:20 2022] DELETE /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 11:01:20.690884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:20.691677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:20.704253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.704778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.708002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.708788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.709276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.709718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.831637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:20.842985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83c17fe9-3a40-4787-ad60-029b7b619291 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.490107 Aug 23 11:01:20.852884 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2721/5469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:20 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:20.864775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:20.865869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:20.875539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.877106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.878963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:20.880371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:20.882116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:20.884732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:21.026109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:21.041857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-112c7521-cd82-4154-96ac-aeb82734d18e tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1528 microversion: 2.1 time: 0.357012 Aug 23 11:01:21.046089 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2749/5470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:20 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1528 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:21.069570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:21.071705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:21.100400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:21.101996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:21.102804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:21.112712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:21.113771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:21.116698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:21.208623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:21.232558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1536da4b-5374-482f-96f4-3689c634f31a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.375843 Aug 23 11:01:21.246628 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2722/5471] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:20 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:21.446054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:21.459275 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-babcf33b-2990-46af-9d43-07f9c1b8e257 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.411764 Aug 23 11:01:21.460002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2750/5472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:21 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:21.880896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:21.881646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:21.901145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:21.902581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:21.906989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:21.908040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:21.908666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:21.912837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.084779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:22.085395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:22.098495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:22.112865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:22.113585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.114530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:22.115177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:22.115792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.422228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:22.436015 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bef26e77-1797-4f93-b9b9-d201a6f01e5e tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.559224 Aug 23 11:01:22.436860 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2723/5473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:21 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:22.450692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:22.451353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:22.463765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:22.466497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:22.466983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.467726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:22.468209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:22.468649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.500512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:22.511888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ed6946f-5c6d-42c9-9fdf-c1c1e197049b tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1528 microversion: 2.1 time: 0.433631 Aug 23 11:01:22.513242 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2751/5474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:22 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1528 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:22.526360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:22.527288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:22.535863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:22.538963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:22.539753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.541303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:22.542145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:22.543377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:22.723019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:22.733449 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5af045b4-9465-4ef8-a6a4-9ed291b1bc4e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.216956 Aug 23 11:01:22.734309 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2752/5475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:22 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:23.031406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:23.048707 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b93c0d2d-9019-4f5d-bbf0-4cf81e153cbd tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.607826 Aug 23 11:01:23.053901 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2724/5476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:22 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:23.458791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:23.459993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:23.471179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:23.476569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:23.477223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:23.478298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:23.478923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:23.479514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:23.493352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7a379015-5e95-4c2c-9421-394b767b5d11 req-ea7d4a78-4344-4756-816b-3f4945c35842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b1c352-6831-449c-bb70-ec3b016cdef4", "name": "network-vif-plugged", "status": "completed", "tag": "a72e5e80-b0b2-4162-a96c-fb9954599d02"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:23.538894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7a379015-5e95-4c2c-9421-394b767b5d11 req-ea7d4a78-4344-4756-816b-3f4945c35842 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:23.543747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7a379015-5e95-4c2c-9421-394b767b5d11 req-ea7d4a78-4344-4756-816b-3f4945c35842 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:23.546452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7a379015-5e95-4c2c-9421-394b767b5d11 req-ea7d4a78-4344-4756-816b-3f4945c35842 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:23.609209 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7a379015-5e95-4c2c-9421-394b767b5d11 req-ea7d4a78-4344-4756-816b-3f4945c35842 service nova] Creating event network-vif-plugged:a72e5e80-b0b2-4162-a96c-fb9954599d02 for instance 36b1c352-6831-449c-bb70-ec3b016cdef4 on n-h2-847009-13 Aug 23 11:01:23.624970 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7a379015-5e95-4c2c-9421-394b767b5d11 req-ea7d4a78-4344-4756-816b-3f4945c35842 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136434 Aug 23 11:01:23.630362 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2725/5477] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:23.666380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:23.668041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:23.688228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:23.689215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:23.691857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:23.692912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:23.693634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:23.695201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:23.955525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:23.968812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-145902e7-6653-4939-835f-1db0e081f137 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.514259 Aug 23 11:01:23.984533 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2753/5478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:23 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:23.990357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:23.992188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:24.006282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:24.006989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:24.007617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:24.008773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:24.009400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:24.010011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:24.304355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:24.319014 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07059b83-4164-49ca-925d-fc942ba87db3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1528 microversion: 2.1 time: 0.687090 Aug 23 11:01:24.320204 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2726/5479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:23 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1528 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:24.337242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:24.339035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:24.362690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:24.363495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:24.364109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:24.364239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:24.365151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:24.365789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:24.366380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:24.373853 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a63bc599-5e1d-4155-a930-47e69abed123 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.387480 Aug 23 11:01:24.376112 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2754/5480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:23 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:24.991548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:24.992104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:25.001852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.004862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.006646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.008246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.013002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.013769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.301698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:25.312952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ea86ae8-e582-4365-bde9-f5d3a212ada2 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.325570 Aug 23 11:01:25.314527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2755/5481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:24 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:25.344610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:25.345271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:25.358010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.358525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.358972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.364075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.364716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.365204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.763425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:25.775030 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61e82cbb-4aa1-4ca8-8fe2-f8098148eaee tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 1.453375 Aug 23 11:01:25.792424 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2727/5482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:24 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:25.805335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:25.806678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:25.821989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.824050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.825489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.827614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.828287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.830597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.845003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:25.861881 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-612cd107-657a-4e2a-acfb-1619837d7ce0 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1528 microversion: 2.1 time: 0.521402 Aug 23 11:01:25.867024 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2756/5483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:25 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1528 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:25.892285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5905375f-9fdb-4a5f-9bbb-eccf198badfa req-3fa4abca-17f1-4cd2-8c4b-fa0feea06167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052c252b-ccac-43d2-9bef-61b5eebdd91b", "name": "network-vif-plugged", "status": "completed", "tag": "80b2ca12-103b-4bfb-8117-0dc71511abac"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:25.922609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5905375f-9fdb-4a5f-9bbb-eccf198badfa req-3fa4abca-17f1-4cd2-8c4b-fa0feea06167 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:25.923150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5905375f-9fdb-4a5f-9bbb-eccf198badfa req-3fa4abca-17f1-4cd2-8c4b-fa0feea06167 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:25.923602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5905375f-9fdb-4a5f-9bbb-eccf198badfa req-3fa4abca-17f1-4cd2-8c4b-fa0feea06167 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:25.984647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5905375f-9fdb-4a5f-9bbb-eccf198badfa req-3fa4abca-17f1-4cd2-8c4b-fa0feea06167 service nova] Creating event network-vif-plugged:80b2ca12-103b-4bfb-8117-0dc71511abac for instance 052c252b-ccac-43d2-9bef-61b5eebdd91b on n-h1-847009-13 Aug 23 11:01:25.994406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5905375f-9fdb-4a5f-9bbb-eccf198badfa req-3fa4abca-17f1-4cd2-8c4b-fa0feea06167 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126060 Aug 23 11:01:25.997086 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2757/5484] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:26.341042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:26.342125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:26.354258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:26.371747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:26.372621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:26.376198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:26.380449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:26.381312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:27.178410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:27.194682 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04cc7855-08af-4767-879e-0d7ff0bde625 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 1.400698 Aug 23 11:01:27.197185 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2728/5485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:25 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:27.218791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:27.225913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:27.244799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:27.245642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:27.262336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:27.263241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:27.263747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:27.264206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:27.437126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:27.498307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6909127e-fbfa-4754-bd1d-e2468798d160 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 1.155408 Aug 23 11:01:27.499131 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2758/5486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:26 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:27.506522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:27.512730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:27.526373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:27.527489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:27.528196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:27.528820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:27.533413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:27.534086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:27.766642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:27.795700 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebb3839c-bafb-4696-90fc-6b815a4c187c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.597157 Aug 23 11:01:27.797387 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2729/5487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:27 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:27.822178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2554482f-f2f8-4312-a399-a1cb1175e56b req-82297aad-8e70-44b0-9b68-490e30af37eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edae5695-bdec-46d9-9a2b-2b361e271b32", "name": "network-vif-deleted", "tag": "41143355-7d51-48da-98e3-dbcef8cc7d61"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:27.844720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2554482f-f2f8-4312-a399-a1cb1175e56b req-82297aad-8e70-44b0-9b68-490e30af37eb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:27.870409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2554482f-f2f8-4312-a399-a1cb1175e56b req-82297aad-8e70-44b0-9b68-490e30af37eb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:27.871311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2554482f-f2f8-4312-a399-a1cb1175e56b req-82297aad-8e70-44b0-9b68-490e30af37eb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:27.928320 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2554482f-f2f8-4312-a399-a1cb1175e56b req-82297aad-8e70-44b0-9b68-490e30af37eb service nova] Creating event network-vif-deleted:41143355-7d51-48da-98e3-dbcef8cc7d61 for instance edae5695-bdec-46d9-9a2b-2b361e271b32 on n-h2-847009-13 Aug 23 11:01:27.944341 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2554482f-f2f8-4312-a399-a1cb1175e56b req-82297aad-8e70-44b0-9b68-490e30af37eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145358 Aug 23 11:01:27.948660 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2730/5488] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:28.199145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:28.224906 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-07353c60-a8a1-4351-b4c9-18a578f96b90 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1310 microversion: 2.1 time: 0.724353 Aug 23 11:01:28.228984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:28.232091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:28.241501 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2759/5489] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:27 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1310 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:28.250331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:28.251569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:28.252430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:28.254106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:28.254885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:28.255640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:28.525211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:28.526574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:28.554677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:28.560826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:28.563213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:28.568568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:28.570261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:28.572327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:28.600206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:28.610691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e49d082c-99c6-4e31-9e76-462d9752e6e3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.387176 Aug 23 11:01:28.629483 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2731/5490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:28 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:28.818283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:28.819218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:28.838560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:28.839558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:28.845080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:28.846065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:28.847937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:28.848604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:28.856208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:29.057947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:29.077088 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a85ea8e7-d1d8-41b7-8515-b9f427fb3777 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.556192 Aug 23 11:01:29.078718 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2760/5491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:28 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:29.155496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:29.169323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78dbc283-b436-42e6-8706-36704d7a83d4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.355742 Aug 23 11:01:29.175904 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2732/5492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:28 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:29.254391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:29.255022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:29.266083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:29.266911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:29.269378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:29.270344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:29.270997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:29.273448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:29.378852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:29.379340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:29.379792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:29.380256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lazy-loading 'fault' on Instance uuid edae5695-bdec-46d9-9a2b-2b361e271b32 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:01:29.485450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b9cf5e2be4912b2e5f51e818f2507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52efc373c25541418bba046b7b8478a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:29.508235 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43f3c72c-cadb-49cc-a608-12912ef62eb3 tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 200 len: 1315 microversion: 2.1 time: 0.257562 Aug 23 11:01:29.515308 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2761/5493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:29 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:29.642233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:29.642962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:29.652538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:29.659820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:29.660347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:29.661170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:29.661640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:29.662373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.105540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:30.106003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:30.107397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:30.116296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.117207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.118017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.119183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.120111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.122172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.126689 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74e26d50-4bb4-4701-b40d-c261e936f7e9 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.488039 Aug 23 11:01:30.127322 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2733/5494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:29 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:30.198424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:30.199573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:30.216368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.220406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.221376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.222308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.223689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.225935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.304791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:30.339219 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58203070-b321-4bdc-8204-6965490a6023 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1483 microversion: 2.1 time: 0.238644 Aug 23 11:01:30.357991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2762/5495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:30 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1483 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:30.368909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:30.369564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:30.385910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.388331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.390795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.391805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.393303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.394794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.515335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:30.566141 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-659068e0-7c42-489f-8921-d5c07cd27824 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "POST /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c/action" status: 202 len: 0 microversion: 2.1 time: 0.203871 Aug 23 11:01:30.567321 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2763/5496] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:01:30 2022] POST /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:01:30.578674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:30.579569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] [instance: edae5695-bdec-46d9-9a2b-2b361e271b32] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:30.596111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.596979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.597601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.598692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.602464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.603168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.639023 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] HTTP exception thrown: Instance edae5695-bdec-46d9-9a2b-2b361e271b32 could not be found. Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Request method failure captured: Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 HTTP/1.1 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLNrF5xUDgViKVELgSxEAwsadFG1Pwwzq3MNjZi7s_IoLFwSi0111zPKBKxMB4ICj4QN4PFinNG6wA738qgIdv6EFTA1JuA9N3WVFNlhMpitwuD8aruHbM2Y0YKVtAVdnEF3zBJrSNxKlUyacaGL1TC_GaWBhPyH4-VbOjDcEV7dl8g Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 52efc373c25541418bba046b7b8478a6 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/52efc373c25541418bba046b7b8478a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_52efc373c25541418bba046b7b8478a6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/52efc373c25541418bba046b7b8478a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/52efc373c25541418bba046b7b8478a6"}]}] Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 52efc373c25541418bba046b7b8478a6 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1139806720 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-InstanceActionsNegativeTestJSON-1139806720-project Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9c2b9cf5e2be4912b2e5f51e818f2507 Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1139806720-project Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance edae5695-bdec-46d9-9a2b-2b361e271b32 could not be found. Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'edae5695-bdec-46d9-9a2b-2b361e271b32'} Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edae5695-bdec-46d9-9a2b-2b361e271b32 could not be found. Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edae5695-bdec-46d9-9a2b-2b361e271b32 could not be found. Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:30.641074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edae5695-bdec-46d9-9a2b-2b361e271b32 could not be found. Aug 23 11:01:30.647426 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:30.649513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] Returning 404 to user: Instance edae5695-bdec-46d9-9a2b-2b361e271b32 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:30.650616 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ed07c2e4-e9ef-4029-ba05-32391d38e8af tempest-InstanceActionsNegativeTestJSON-1139806720 tempest-InstanceActionsNegativeTestJSON-1139806720-project] 10.222.0.78 "GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32" status: 404 len: 111 microversion: 2.1 time: 0.082042 Aug 23 11:01:30.656600 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2764/5497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:30 2022] GET /compute/v2.1/servers/edae5695-bdec-46d9-9a2b-2b361e271b32 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:30.662022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:30.665942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:30.674860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:30.692852 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-128d10b0-3b70-4f42-93a5-20574e22b0fb tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.490972 Aug 23 11:01:30.709382 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2734/5498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:30 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:30.718882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.723880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.726737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:30.728242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:30.735328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:30.738901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:31.148460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:31.149283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:31.161826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:31.164308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:31.164959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:31.173906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:31.176055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:31.185467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:31.446695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:31.455039 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c92fdb90-2728-42b2-b9f3-0fd873d783b5 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.310960 Aug 23 11:01:31.458558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2735/5499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:31 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:31.470107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-31c4481e-3250-45dc-a612-79fdf8100f8e req-20b96943-c82b-49ae-a759-c18418dc8fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89b360-6cee-4251-a02d-8b784aeb4343", "name": "network-vif-plugged", "status": "completed", "tag": "80332d3d-63d7-4170-b037-f77cb55dc287"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:31.499969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-31c4481e-3250-45dc-a612-79fdf8100f8e req-20b96943-c82b-49ae-a759-c18418dc8fad service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:31.500476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-31c4481e-3250-45dc-a612-79fdf8100f8e req-20b96943-c82b-49ae-a759-c18418dc8fad service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:31.503104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-31c4481e-3250-45dc-a612-79fdf8100f8e req-20b96943-c82b-49ae-a759-c18418dc8fad service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:31.525182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:31.532285 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-31c4481e-3250-45dc-a612-79fdf8100f8e req-20b96943-c82b-49ae-a759-c18418dc8fad service nova] Creating event network-vif-plugged:80332d3d-63d7-4170-b037-f77cb55dc287 for instance da89b360-6cee-4251-a02d-8b784aeb4343 on n-h1-847009-13 Aug 23 11:01:31.539305 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7627216-be3f-47a8-9d1b-020718fcfa59 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1491 microversion: 2.1 time: 0.881230 Aug 23 11:01:31.540525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2765/5500] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:30 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1491 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:31.542260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-31c4481e-3250-45dc-a612-79fdf8100f8e req-20b96943-c82b-49ae-a759-c18418dc8fad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082367 Aug 23 11:01:31.548848 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2736/5501] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:31.715885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:31.716868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:31.728157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:31.728653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:31.729140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:31.730391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:31.730854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:31.731299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:32.465291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:32.478996 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4de27e3d-51a7-4fab-b04a-601adb039f15 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.764973 Aug 23 11:01:32.481117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:32.481836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:32.493401 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2766/5502] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:31 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:32.499301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:32.500037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:32.500658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:32.501593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:32.502737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:32.505359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:32.561642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:32.562924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:32.576395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:32.577196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:32.577815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:32.578718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:32.579359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:32.580150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:33.246593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:33.254734 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3a4d971-b074-4f0f-b989-8604475ea56e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1321 microversion: 2.1 time: 0.778288 Aug 23 11:01:33.255285 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2737/5503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:32 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1321 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:33.508472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:33.509539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:33.527686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:33.528336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:33.528834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:33.530341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:33.530817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:33.533529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:33.695436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:33.713678 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59464160-2af9-4b72-80b8-6c35bac76c8f tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1491 microversion: 2.1 time: 1.156032 Aug 23 11:01:33.714870 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2767/5504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:32 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1491 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:34.020702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:34.034133 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f2e24fc-86d8-46f6-8d6d-d414f16558c5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.533878 Aug 23 11:01:34.035370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2738/5505] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:33 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:34.276967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:34.277985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:34.289617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:34.292792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:34.293605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:34.294518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:34.295193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:34.295783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:34.739482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:34.740859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:34.758590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:34.759241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:34.759796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:34.765757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:34.766837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:34.767521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:34.892946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:34.914150 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7e62b79-78d1-4590-82df-50bdcd7ddf36 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1512 microversion: 2.1 time: 0.642378 Aug 23 11:01:34.917842 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2768/5506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:34 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1512 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:34.971190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:34.973449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:34.994451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:34.997590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:34.998073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:34.999525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.001075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.001978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:35.209991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:35.222349 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbc435fc-6868-4322-abe0-0836fc0c69a1 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1491 microversion: 2.1 time: 0.487324 Aug 23 11:01:35.223548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2739/5507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:34 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1491 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:35.228574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:35.229225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:35.236967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.237466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.238100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:35.238997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.239717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.240320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:35.432130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:35.440618 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0693962a-9584-4d43-8d8b-6820f8f1fdc5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.215792 Aug 23 11:01:35.441275 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2740/5508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:35 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:35.507988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:35.525526 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db09547c-632e-4ee6-acba-0214ec9f514d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1512 microversion: 2.1 time: 0.579536 Aug 23 11:01:35.526128 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2769/5509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:34 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1512 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:35.553673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:35.554256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:35.563275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.563748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.564200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:35.569085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.569821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.570492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:35.803663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:35.816583 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d98088b-f37e-432c-98c8-4cbc69b2402a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 200 len: 1512 microversion: 2.1 time: 0.267129 Aug 23 11:01:35.817782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2741/5510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:35 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:35.844351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:35.855558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:35.858050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:35.889294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.891707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.893706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:35.895262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:35.897339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:35.900608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.161659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:36.243508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:36.244640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:36.247327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:36.266997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.267834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.269494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.292554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:36.295273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.295273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.297815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.301571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.302083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.302792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.516256 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e8b4064-5454-472e-be1a-252833414565 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.677808 Aug 23 11:01:36.517280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2770/5511] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 23 11:01:35 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:36.533222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:36.533925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:36.543163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.546115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.546847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.549021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.549818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.552095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.736185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:36.748872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7e124b9b-dd1e-4b8d-8ee5-6c965ec80b8a tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.230230 Aug 23 11:01:36.750477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2771/5512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:36 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:36.762924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:36.774349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:36.781340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1030704171', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:36.797992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.800193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.802670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.804140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.805241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:36.811202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.813202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.815982 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f89a42ec-4b6b-4736-9a78-16746cf22447 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1497 microversion: 2.1 time: 0.576341 Aug 23 11:01:36.831125 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2742/5513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:36 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1497 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:36.859210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:36.860149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:36.867564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.868214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.869645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.871754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:36.872485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:36.873191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:36.912552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:37.049709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:37.129601 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1e42746-d906-487c-8800-2e97dc2dda53 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 204 len: 0 microversion: 2.1 time: 0.276516 Aug 23 11:01:37.133115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2743/5514] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:36 2022] DELETE /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:01:37.145951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:37.148382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:37.163083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.165245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.166415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.174371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.176221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.178136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.213738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:37.243158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:37.248106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.250034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.251537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.528628 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a56afd36-1923-4040-b10b-98402fc51307 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1030704171" status: 200 len: 1515 microversion: 2.1 time: 0.776826 Aug 23 11:01:37.547823 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2772/5515] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 11:01:36 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1030704171 => generated 1515 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:37.556641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:37.567717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:37.568719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:37.591270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.591773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.592267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.593683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.593970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.594452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.692461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:37.710529 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a362939-0797-464f-bd49-8f953af994af tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.571557 Aug 23 11:01:37.711125 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2744/5516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:37 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:37.733326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:37.772566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:37.773219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:37.791863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.792564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.793037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.796079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.796567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.797035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:37.886870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:37.899375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:37.899871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:37.900369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.153197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:38.161986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8792dc47-7d0b-4615-8c1b-0529a1beaa14 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.394343 Aug 23 11:01:38.162579 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2745/5517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:37 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:38.256264 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47bcc9a1-ae91-4d7e-bac9-9785a9834474 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.703951 Aug 23 11:01:38.257075 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2773/5518] 10.222.0.78 () {58 vars in 1173 bytes} [Tue Aug 23 11:01:37 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:38.288012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:38.294743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:38.295573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.compute.servers [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Removing options 'limit' from query {{(pid=128860) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 11:01:38.296564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:38.327622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.329216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.330810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.331636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.332118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.332557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.409993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:38.420674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.421787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.422595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.735710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:38.736337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:38.769668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.774256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.775677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.788283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.793676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.794975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.833302 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ab03ea9-01c0-43ca-8ccc-25c291c68c4f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.550704 Aug 23 11:01:38.835496 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2746/5519] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 11:01:38 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:38.869669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:38.880832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:38.882003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:38.898512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.899415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.900136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:38.901205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:38.903426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:38.904889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.161640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:39.199573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:39.217247 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d23d7e6-d82d-4d64-8421-6fa778278434 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.486052 Aug 23 11:01:39.221945 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2774/5520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:38 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:39.238884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:39.239836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:39.251892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:39.260120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.261797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.265414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.266104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.266784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.267406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.363305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fd5e570-36b0-4527-9fdf-c55c214f40d2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.501284 Aug 23 11:01:39.373060 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2747/5521] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 11:01:38 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:39.387236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:39.397104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:39.403666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.compute.servers [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Removing options 'limit' from query {{(pid=128860) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 11:01:39.404686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:39.420367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.421305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.422034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.429392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.430289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.430983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.480049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:39.559337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a61fedc-a655-4b8c-aeee-7e7e58368f06 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.176569 Aug 23 11:01:39.561716 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2748/5522] 10.222.0.78 () {58 vars in 1150 bytes} [Tue Aug 23 11:01:39 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:39.632226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:39.654434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-740ee045-5bbd-49e2-9d59-6d20d6c168c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.422670 Aug 23 11:01:39.656817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:39.667830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:39.670247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:39.672720 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2775/5523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:39 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:39.688261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.691665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.692867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.697208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.698208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.699455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.757797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:39.794525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27202c2e-31ef-4a4c-8e15-589b768585a4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.204185 Aug 23 11:01:39.795257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2749/5524] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 11:01:39 2022] GET /compute/v2.1/servers => generated 1012 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:39.815515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:39.821045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:39.826566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:39.860672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.863291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.864455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:39.866194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:39.866686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:39.867128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.175375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:40.265666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:40.266757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:40.287412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.305206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.320258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.328398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.331156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.352838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.536713 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0bd01a4b-d040-40ee-8bca-12e3ddeafc8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.723911 Aug 23 11:01:40.560134 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2776/5525] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 11:01:39 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:40.571515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:40.586026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:40.589221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.servers [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Removing options 'limit' from query {{(pid=128859) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 11:01:40.592299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:40.610610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.611832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.614960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.615715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.618645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.619758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.675288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e7b5e5b-1ed3-462c-a8de-198330bb64f6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.113491 Aug 23 11:01:40.688183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2777/5526] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 23 11:01:40 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:40.697938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:40.698872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:40.739001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.741971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.749289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.755114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.761669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.762854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.804642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:40.817397 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6453eccc-d6ec-416b-bc31-a464b1c092d4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 0.565504 Aug 23 11:01:40.818892 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2750/5527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:40 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:40.828340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:40.857341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:40.859518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1030704171', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:01:40.876443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.878518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.879586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:40.881916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:40.883725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:40.884498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:41.071895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:41.076835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:41.084313 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06bb7736-b05e-40ec-8efc-0c6a9d9893f8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.394470 Aug 23 11:01:41.086416 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2778/5528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:40 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:41.129027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-317f8787-54d2-4770-9dd3-68ceedbf0bfa tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: .version_select at 0x7fdc9c520280>, body: {"keypair": {"name": "tempest-keypair-1292278941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNWyYqt/Pj1He2vxx1LDboy1L+OSC9yNi6VwFII/pNgTsvzyMEsF97TbSTmRdSbzSZXUANzQVGUq5W+irHeC0EZqJ35/o6wjNuq9g8RgFeoge7vJbT3jHERV+pxpavLdA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:41.151065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:01:41.188450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-317f8787-54d2-4770-9dd3-68ceedbf0bfa tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:41.195370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-317f8787-54d2-4770-9dd3-68ceedbf0bfa tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:41.237839 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-317f8787-54d2-4770-9dd3-68ceedbf0bfa tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121830 Aug 23 11:01:41.244144 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2779/5529] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:01:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:41.295534 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec4cae46-814a-4fc5-ab80-b3b7405c8378 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1030704171" status: 200 len: 346 microversion: 2.1 time: 0.475342 Aug 23 11:01:41.297961 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2751/5530] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 11:01:40 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1030704171 => generated 346 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:01:41.322058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b9d7d60-9c14-4681-8c84-3b5bd02f8d3f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:41.354480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9d7d60-9c14-4681-8c84-3b5bd02f8d3f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:41.357667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9d7d60-9c14-4681-8c84-3b5bd02f8d3f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:41.359059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b9d7d60-9c14-4681-8c84-3b5bd02f8d3f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:41.447780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b9d7d60-9c14-4681-8c84-3b5bd02f8d3f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Going to try to stop instance {{(pid=128859) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 11:01:41.547350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b9d7d60-9c14-4681-8c84-3b5bd02f8d3f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "POST /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b/action" status: 202 len: 0 microversion: 2.1 time: 0.234591 Aug 23 11:01:41.548779 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2780/5531] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:01:41 2022] POST /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:01:41.559446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:41.560699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:41.570466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:41.581510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:41.585537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:41.586729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:41.588570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:41.592353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:41.858117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:41.861396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:41.890045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:41.892012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:41.893241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:41.895981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:41.901710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:41.903521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:41.994218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:42.005594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76d16a75-f2b1-4796-9c45-fcc28d6a4a14 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.452602 Aug 23 11:01:42.006730 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2752/5532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:41 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:42.122259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:42.123181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:42.131097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:42.131814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:42.132361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:42.133262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:42.133928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:42.134465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:42.993712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:43.003371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a745efca-d81c-4417-b7a9-1125d8e629c6 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1509 microversion: 2.1 time: 0.887043 Aug 23 11:01:43.003974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2753/5533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:42 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1509 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:43.035349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:43.036481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:43.050466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:43.051342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:43.054258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:43.055279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:43.055950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:43.060845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:43.260029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:43.273151 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e1cac8c-df64-40be-ad2e-698f81a913b6 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.243174 Aug 23 11:01:43.275279 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2754/5534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:43 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:43.305057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:43.318404 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1dff448e-a372-428b-a175-8e6850176654 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1503 microversion: 2.1 time: 1.474073 Aug 23 11:01:43.320200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2781/5535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:41 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1503 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:43.748192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-da4d9645-d0e5-4277-9195-d0bc0806204c req-c143926f-be91-46dd-b4e8-21ada8ff417b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2096c70-7238-4e4a-a815-30d7027bc19c", "name": "network-vif-deleted", "tag": "cc38e667-35c2-47e6-9667-491102f12cbf"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:43.782846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-da4d9645-d0e5-4277-9195-d0bc0806204c req-c143926f-be91-46dd-b4e8-21ada8ff417b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:43.791602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-da4d9645-d0e5-4277-9195-d0bc0806204c req-c143926f-be91-46dd-b4e8-21ada8ff417b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:43.792925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-da4d9645-d0e5-4277-9195-d0bc0806204c req-c143926f-be91-46dd-b4e8-21ada8ff417b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:43.878173 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-da4d9645-d0e5-4277-9195-d0bc0806204c req-c143926f-be91-46dd-b4e8-21ada8ff417b service nova] Creating event network-vif-deleted:cc38e667-35c2-47e6-9667-491102f12cbf for instance b2096c70-7238-4e4a-a815-30d7027bc19c on n-h2-847009-13 Aug 23 11:01:43.888940 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-da4d9645-d0e5-4277-9195-d0bc0806204c req-c143926f-be91-46dd-b4e8-21ada8ff417b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146116 Aug 23 11:01:43.894991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2782/5536] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:01:43.921478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-624139548", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": "none"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:44.026917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:44.027871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:44.048549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:01:44.050284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:01:44.050797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:01:44.051221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:01:44.053021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.053223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:01:44.054819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.055932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.059051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.060102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.061527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.082967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.087217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.091055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.091919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.094315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.097026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.174373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Getting quotas for project 148577c89b48446ab771deb06e79e1e2. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:44.186384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Getting quotas for user 5cfe1be060c74a39885bd887bfcbc858 and project 148577c89b48446ab771deb06e79e1e2. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:44.216221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:01:44.224294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:01:44.335045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b304b594-06b2-43ea-9e93-347140bcb0ab tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.058357 Aug 23 11:01:44.336031 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2755/5537] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 11:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 11:01:44.348812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:44.363105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:44.372120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.372910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.373609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.374528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.378143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.378838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.546107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:44.554955 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5703a580-0550-4e3b-a3ae-e50fb87476a1 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1486 microversion: 2.1 time: 0.532362 Aug 23 11:01:44.558873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2783/5538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:44 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1486 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:44.570739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ea6e7f3-cb5a-4ff2-b371-edc4426e3222 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:44.571365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ea6e7f3-cb5a-4ff2-b371-edc4426e3222 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:44.748018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:44.764847 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7a1ba9c-1ff7-4b24-9334-2b09f329cba3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.420008 Aug 23 11:01:44.767049 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2756/5539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:44 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:44.782017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:44.783672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:44.803918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.806354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.810684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.811389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.812550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.815875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.849245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ea6e7f3-cb5a-4ff2-b371-edc4426e3222 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:44.864611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ea6e7f3-cb5a-4ff2-b371-edc4426e3222 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:44.874452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ea6e7f3-cb5a-4ff2-b371-edc4426e3222 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:44.877312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.877968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ea6e7f3-cb5a-4ff2-b371-edc4426e3222 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1280 microversion: 2.47 time: 0.315990 Aug 23 11:01:44.878539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.879241 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2784/5540] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:44 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1280 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:44.879505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.880219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lazy-loading 'fault' on Instance uuid b2096c70-7238-4e4a-a815-30d7027bc19c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:01:44.890082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1932993393"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:44.896670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:44.919578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.920420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.922451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:44.923395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:44.926212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:44.926875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:45.038271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:45.055294 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fc9102b-27ba-42c4-a4c3-30eb5e2bcdac tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 200 len: 1303 microversion: 2.1 time: 0.283746 Aug 23 11:01:45.056086 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2757/5541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:44 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 1303 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:45.096521 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3dd438bc-1fdd-4e14-98f5-603cffea29b8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "PUT /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1062 microversion: 2.1 time: 0.214811 Aug 23 11:01:45.099599 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2785/5542] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 11:01:44 2022] PUT /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1062 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:45.121166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:45.122016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:45.134266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:45.134837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:45.136134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:45.142143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:45.142804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:45.147173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:45.569035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:45.579517 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1ef93b1-fae5-458c-b5f0-cd2bde2246d5 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1489 microversion: 2.1 time: 0.463525 Aug 23 11:01:45.582672 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2758/5543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:45 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1489 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:45.612804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:45.614773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:45.635306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:45.636075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:45.637310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:45.638383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:45.639112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:45.640565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:45.797561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:45.798362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:45.827775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:45.828358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:45.829013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:45.832023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:45.833673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:45.836336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.038311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:46.076528 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03867dfb-b04e-4d10-8a54-fbb31a8c1624 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1489 microversion: 2.1 time: 0.475935 Aug 23 11:01:46.082526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2786/5544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:45 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1489 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:46.090950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:46.091761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:46.119621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:46.121352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:46.122950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.123702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:46.126004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:46.128042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.303468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:46.313731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:46.316669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:46.318356 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b17b9150-bce7-414e-8463-6b2372e68f75 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1332 microversion: 2.47 time: 0.232862 Aug 23 11:01:46.319435 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2787/5545] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:46 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1332 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:46.334440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1873630428", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f55c759-5d12-4910-a3ab-34c9a1a8a48c"}], "security_groups": [{"name": "tempest-securitygroup--354630017"}], "key_name": "tempest-keypair-1292278941", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:46.449217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:46.461166 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-535f409c-8934-4de4-881e-21f3a0a6e0a2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.673211 Aug 23 11:01:46.464377 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2759/5546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:45 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:46.467385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] validate_networks() for [('3f55c759-5d12-4910-a3ab-34c9a1a8a48c', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:01:46.494441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:46.495599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: b2096c70-7238-4e4a-a815-30d7027bc19c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:46.530245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:46.533069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:46.534567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.535331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:46.535800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:46.544499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.617408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] HTTP exception thrown: Instance b2096c70-7238-4e4a-a815-30d7027bc19c could not be found. Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Request method failure captured: Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c HTTP/1.1 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMUzyNmnoX_UXM6wOJ_vhYPlC3eYjfuZ095qJ2ZT1OeO1G0-lMeB2F_Y4q1fBqJNKS8Og7Sma2DXS1iZNkxnGq9qpp9PKZ3Hlhp1s2nv1bL3Tbp6_D3uPyZ_D5Gufu6bJj-F0usrrq7KTVXtT7oc_U725u45odNGYOAFsYHMHSWK3c Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 98b3358e35ea4237be958bf13d333edd Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerRescueTestJSON-918607056 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98b3358e35ea4237be958bf13d333edd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98b3358e35ea4237be958bf13d333edd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98b3358e35ea4237be958bf13d333edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98b3358e35ea4237be958bf13d333edd"}]}] Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerRescueTestJSON-918607056 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 98b3358e35ea4237be958bf13d333edd Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerRescueTestJSON-918607056 Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerRescueTestJSON-918607056-project Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 39013f6c37ef4490bfee4efec898a6ce Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerRescueTestJSON-918607056-project Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance b2096c70-7238-4e4a-a815-30d7027bc19c could not be found. Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b2096c70-7238-4e4a-a815-30d7027bc19c'} Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2096c70-7238-4e4a-a815-30d7027bc19c could not be found. Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2096c70-7238-4e4a-a815-30d7027bc19c could not be found. Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:46.619267 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2096c70-7238-4e4a-a815-30d7027bc19c could not be found. Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:46.624488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Returning 404 to user: Instance b2096c70-7238-4e4a-a815-30d7027bc19c could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:46.640256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff4b887e-bc98-4d64-8563-5029f4716391 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c" status: 404 len: 111 microversion: 2.1 time: 0.138576 Aug 23 11:01:46.641136 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2760/5547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:46 2022] GET /compute/v2.1/servers/b2096c70-7238-4e4a-a815-30d7027bc19c => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:46.654928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:46.656435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:46.675169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:46.678648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:46.679415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.680382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:46.684572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:46.685650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:46.776835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:47.033137 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-81735497-5667-4023-ac0c-db1e7403dbd0 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 204 len: 0 microversion: 2.1 time: 0.389494 Aug 23 11:01:47.036283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2761/5548] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:46 2022] DELETE /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:01:47.058254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:47.059252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:47.085819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.088673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.089325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.093211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.095097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.095663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.176962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:47.191777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:47.290239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:01:47.290770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:01:47.291160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:01:47.291585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:01:47.292649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:01:47.297200 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:01:47.298151 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 (ip 10.222.0.78) !!! Aug 23 11:01:47.319145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.320160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.321012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.321943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.322603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.323267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.337189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c8a3963-a8b7-4b46-b0dd-3e58e7a131a9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "DELETE /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 204 len: 0 microversion: 2.1 time: 0.297101 Aug 23 11:01:47.342054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2762/5549] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:47 2022] DELETE /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:01:47.349363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:47.350542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:47.359196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.360248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.360992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.362438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.363144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.363828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.366458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:01:47.380200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:01:47.422918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:01:47.426044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:01:47.487451 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e881e90-affe-4563-887f-bb298c68211c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.166721 Aug 23 11:01:47.496599 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2788/5550] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:01:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:01:47.503547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:47.504584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:47.512508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.513422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.514042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.514968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.515608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.516212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.644882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:47.658928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:47.663045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:47.668704 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-875af3d3-430c-48b9-ad92-1e6d3f612237 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1338 microversion: 2.47 time: 0.170469 Aug 23 11:01:47.672873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2789/5551] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:47 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1338 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:47.679390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:47.685277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:47.699233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.700225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.702079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.702177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:47.703754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.704619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.710896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.712923 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebe2ccd3-d0f4-4493-956b-fa897eb96c20 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1495 microversion: 2.1 time: 0.368913 Aug 23 11:01:47.727482 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2763/5552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:47 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1495 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:47.733239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:47.733866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:47.745496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.746342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.746951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:47.748244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:47.749190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:47.762806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:48.020696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:48.036426 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78f52676-5c4b-4ed7-bcbe-1bb35000b0d8 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1490 microversion: 2.1 time: 0.358425 Aug 23 11:01:48.037097 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2790/5553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:47 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1490 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:48.049607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e768aff-6c1d-4328-98c1-816c0e7e1445 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:48.052550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e768aff-6c1d-4328-98c1-816c0e7e1445 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:48.130650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:48.146194 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db83439a-8dd0-4108-b43e-da755e43d957 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.417511 Aug 23 11:01:48.148148 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2764/5554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:47 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:48.200429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e768aff-6c1d-4328-98c1-816c0e7e1445 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:48.212478 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e768aff-6c1d-4328-98c1-816c0e7e1445 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1242 microversion: 2.1 time: 0.171027 Aug 23 11:01:48.214545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2791/5555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:48 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1242 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:48.705402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:48.706300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:48.717537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:48.719202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:48.721864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:48.723822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:48.724713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:48.727621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:48.758492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:48.760826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:48.783454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:48.783978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:48.784431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:48.785198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:48.785942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:48.786550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:48.904598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:48.913097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:48.914630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:48.916128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-800227a5-f2cc-49da-9af8-6b0bfe46deca tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1338 microversion: 2.47 time: 0.219634 Aug 23 11:01:48.922160 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2765/5556] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:48 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1338 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:49.060009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:49.061004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:49.071321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.078976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.081034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.085953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.092994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.096924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.196633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:49.223903 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-63d5b517-3c1d-4fa2-9479-a802707097b4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1495 microversion: 2.1 time: 0.489375 Aug 23 11:01:49.224684 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2792/5557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:48 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1495 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:49.265165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:49.272456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:49.287043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.289023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.289558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.294413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.294413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.296984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.701631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:49.716696 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d77bfe63-c2de-46dd-812b-193c972f71e4 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1490 microversion: 2.1 time: 0.658179 Aug 23 11:01:49.733620 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2766/5558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:49 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1490 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:49.737106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:49.748505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:49.749172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:49.755929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29fb5d53-a22d-4537-bdf8-c993f9fb68be tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.525200 Aug 23 11:01:49.756636 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2793/5559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:49 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:49.781899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.782605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.783221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.784118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.784757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.785458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.925585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:49.946448 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb981ef8-d17f-4f7c-bbdf-ac865e7d0f52 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1246 microversion: 2.1 time: 0.211299 Aug 23 11:01:49.947657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2767/5560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:49 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1246 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:49.952511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:49.953283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:49.969451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.970473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.971173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:49.972152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:49.975765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:49.976554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.258508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:50.259141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:50.260846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:50.272204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.273561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.277195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.278164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.278808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.279439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.286401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:50.288195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:50.307464 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cbe808e7-b820-4682-a51f-59547a3f004f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1338 microversion: 2.47 time: 0.345829 Aug 23 11:01:50.334283 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2794/5561] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:49 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1338 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:01:50.410493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-35d6aecd-ce35-433f-b5c7-368223a9c6a7 req-eb299451-1128-457e-bc1c-59c2d97424d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5320568f-a2fa-4b66-b228-9bac15be25a7", "name": "network-vif-deleted", "tag": "0cffb984-b3aa-4061-8d9d-476bf29ad485"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:50.410737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:50.421431 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f289ce8f-7732-4f36-bb9b-7e6acee09c48 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1453 microversion: 2.1 time: 0.176437 Aug 23 11:01:50.437384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35d6aecd-ce35-433f-b5c7-368223a9c6a7 req-eb299451-1128-457e-bc1c-59c2d97424d8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.440336 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2768/5562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:50 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:50.440770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35d6aecd-ce35-433f-b5c7-368223a9c6a7 req-eb299451-1128-457e-bc1c-59c2d97424d8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.441229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-35d6aecd-ce35-433f-b5c7-368223a9c6a7 req-eb299451-1128-457e-bc1c-59c2d97424d8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.489125 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-35d6aecd-ce35-433f-b5c7-368223a9c6a7 req-eb299451-1128-457e-bc1c-59c2d97424d8 service nova] Creating event network-vif-deleted:0cffb984-b3aa-4061-8d9d-476bf29ad485 for instance 5320568f-a2fa-4b66-b228-9bac15be25a7 on n-h1-847009-13 Aug 23 11:01:50.505220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-35d6aecd-ce35-433f-b5c7-368223a9c6a7 req-eb299451-1128-457e-bc1c-59c2d97424d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098397 Aug 23 11:01:50.512215 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2795/5563] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:01:50.742419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:50.743068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:50.754456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.754999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.755517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.756193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.760231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.760965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.779247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:50.780282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:50.804682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.809693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.810402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:50.811485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:50.813635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:50.815142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.085768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.117516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d05741e-b5be-4e2a-af02-5b5438406790 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1490 microversion: 2.1 time: 0.378874 Aug 23 11:01:51.121504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2769/5564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:50 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1490 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:51.134236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:51.135121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:51.162765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.162966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.164795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.170746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.171953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.172581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.279966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.290338 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adcc4aec-9bfb-4b3d-a77d-d9c80763f31f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1238 microversion: 2.1 time: 0.167129 Aug 23 11:01:51.307212 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2770/5565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:51 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:51.335095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:51.335907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:51.358332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.358846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.359513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.360833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.361474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.362081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.456993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.478282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8cdb84b8-3095-4f15-b57c-e8d8ba6ae29e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.703782 Aug 23 11:01:51.479007 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2796/5566] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:50 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:51.492922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:51.493553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:51.502032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.502535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.505156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.505933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.506487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.506849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.553124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.584860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.591049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:51.595225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:51.600212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:51.600725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.601394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lazy-loading 'fault' on Instance uuid 5320568f-a2fa-4b66-b228-9bac15be25a7 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:01:51.606036 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6aa91cbf-16e1-4c9c-aff9-7e9d4afaf069 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1338 microversion: 2.47 time: 0.274814 Aug 23 11:01:51.617796 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2771/5567] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:51 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1338 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:51.738556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:51.751884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33040883-8a8d-4d91-b917-baaae799b5d3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 200 len: 1310 microversion: 2.1 time: 0.270994 Aug 23 11:01:51.775099 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2797/5568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:51 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:52.148666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:52.149335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:52.171435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.172262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.172934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.174963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.175605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.176450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.381065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:52.383419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:52.402092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.402839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.403447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.404351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.411281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.412025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.443506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:52.591437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:52.602446 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6607dcd4-a8ff-4946-bc17-e7834eec4b66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1294 microversion: 2.1 time: 0.277161 Aug 23 11:01:52.603927 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2798/5569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:52 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1294 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:52.610282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:52.611111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:52.621421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.622546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.623211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.624391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.625333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.625784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.674273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:52.684122 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d0b2891-9412-4742-bd73-4160ca3b0009 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1490 microversion: 2.1 time: 0.542198 Aug 23 11:01:52.700835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2772/5570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:52 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1490 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:52.700835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:52.700835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:52.712426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.714463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.714706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.717593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.719052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.720302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.879697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:52.897317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:52.902922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:52.905082 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ac27ac4-6020-481e-9e45-fa480be68b6f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1338 microversion: 2.47 time: 0.212597 Aug 23 11:01:52.910144 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2773/5571] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:52 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1338 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:52.920730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:52.921532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:52.932099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:52.949552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.949820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.950414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.951338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:52.953493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:52.953493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:52.975627 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 HTTP/1.1 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5320568f-a2fa-4b66-b228-9bac15be25a7'} Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:52.991477 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4971d22b-4078-44e5-bfb3-cfed23d1a1a2 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 404 len: 111 microversion: 2.1 time: 0.082106 Aug 23 11:01:53.000491 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2774/5572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:52 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.015507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.016649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.028608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.029305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.029940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.030845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.037102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.037767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.072331 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 HTTP/1.1 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5320568f-a2fa-4b66-b228-9bac15be25a7'} Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.074606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.079532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6038277-266b-435e-b275-c0e12ba5439f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 404 len: 111 microversion: 2.1 time: 0.064469 Aug 23 11:01:53.083684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:53.094168 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d98cbe1-a6b4-4d81-93cb-75dc910e20c7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.488041 Aug 23 11:01:53.100470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2775/5573] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:53 2022] DELETE /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.103045 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2799/5574] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:52 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:53.118056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.118741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 5320568f-a2fa-4b66-b228-9bac15be25a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.136757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.137423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.137887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.138655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.139116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.139544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.164830 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 HTTP/1.1 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5320568f-a2fa-4b66-b228-9bac15be25a7'} Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.173544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.178860 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.178860 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.178860 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.178860 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.178860 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. Aug 23 11:01:53.178860 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.179814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 5320568f-a2fa-4b66-b228-9bac15be25a7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.184142 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21198ba3-5961-4c35-94a8-3540370b1643 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7" status: 404 len: 111 microversion: 2.1 time: 0.085057 Aug 23 11:01:53.188080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2776/5575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:53 2022] GET /compute/v2.1/servers/5320568f-a2fa-4b66-b228-9bac15be25a7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.198970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.199709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.220935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.222399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.222864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.230489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.231316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.234532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.289341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-dee2ef3f-7338-466f-8b55-ea296aa833a2 req-de0fe529-707f-4be6-bdf4-6a5cadca4cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409cf04c-59c9-43cf-af87-736745569767", "name": "network-vif-deleted", "tag": "ae7c98b4-a682-4dbb-af57-65f8b592eb4b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:53.292893 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e HTTP/1.1 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '52715ac7-849b-41ae-8041-357cb34c253e'} Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.298733 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e5e9c253-7326-4fb1-a07c-a546e0adce54 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 404 len: 111 microversion: 2.1 time: 0.111300 Aug 23 11:01:53.303704 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2800/5576] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:53 2022] DELETE /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.310144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dee2ef3f-7338-466f-8b55-ea296aa833a2 req-de0fe529-707f-4be6-bdf4-6a5cadca4cf8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.310956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dee2ef3f-7338-466f-8b55-ea296aa833a2 req-de0fe529-707f-4be6-bdf4-6a5cadca4cf8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.316363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dee2ef3f-7338-466f-8b55-ea296aa833a2 req-de0fe529-707f-4be6-bdf4-6a5cadca4cf8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.324263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.325088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 52715ac7-849b-41ae-8041-357cb34c253e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.354816 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-dee2ef3f-7338-466f-8b55-ea296aa833a2 req-de0fe529-707f-4be6-bdf4-6a5cadca4cf8 service nova] Creating event network-vif-deleted:ae7c98b4-a682-4dbb-af57-65f8b592eb4b for instance 409cf04c-59c9-43cf-af87-736745569767 on n-h2-847009-13 Aug 23 11:01:53.355641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.359531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.360355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.362516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.363773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.364655 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-dee2ef3f-7338-466f-8b55-ea296aa833a2 req-de0fe529-707f-4be6-bdf4-6a5cadca4cf8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078709 Aug 23 11:01:53.367205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.381027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2777/5577] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:01:53.409374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e HTTP/1.1 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '52715ac7-849b-41ae-8041-357cb34c253e'} Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.412443 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.422718 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.422718 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.422718 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.422718 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.422718 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. Aug 23 11:01:53.422718 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.429049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 52715ac7-849b-41ae-8041-357cb34c253e could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.430134 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-414c3795-2d35-4082-af23-5d1b0ea45bda tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e" status: 404 len: 111 microversion: 2.1 time: 0.123825 Aug 23 11:01:53.430545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2801/5578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:53 2022] GET /compute/v2.1/servers/52715ac7-849b-41ae-8041-357cb34c253e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.441250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.441844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.457862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.458412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.459611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.468098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.472795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.474768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.549379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de HTTP/1.1 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'b026e639-e285-49e8-90d2-c580dec527de'} Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.552862 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.559175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.563050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.565065 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e18eebc-8709-45ee-8f82-21093e80a3c4 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 404 len: 111 microversion: 2.1 time: 0.129104 Aug 23 11:01:53.565891 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2778/5579] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:53 2022] DELETE /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.587252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.588506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: b026e639-e285-49e8-90d2-c580dec527de] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.596000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.597288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.597967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.599039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.599915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.600525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.634243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.634928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.642715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.643994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.644637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.645560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.646196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.646805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.651727 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de HTTP/1.1 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'b026e639-e285-49e8-90d2-c580dec527de'} Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.654798 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance b026e639-e285-49e8-90d2-c580dec527de could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef71ff24-a8a7-4d18-bd92-545cc95f8559 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de" status: 404 len: 111 microversion: 2.1 time: 0.084731 Aug 23 11:01:53.661705 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2802/5580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:53 2022] GET /compute/v2.1/servers/b026e639-e285-49e8-90d2-c580dec527de => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:53.687241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.705729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.732144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.738462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.744539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.746696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.748614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.749368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.776483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:53.787836 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80eb3056-a4b6-4683-a673-e524734780e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1302 microversion: 2.1 time: 0.161983 Aug 23 11:01:53.802072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2779/5581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:53 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1302 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:53.802663 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd HTTP/1.1 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9d83c63c-97d7-4a2c-865d-e423bdaa0bdd'} Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:53.804396 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:53.809728 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:53.817850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:53.819066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1cb6539e-4254-4414-8051-f5546a13e500 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 404 len: 111 microversion: 2.1 time: 0.136927 Aug 23 11:01:53.824677 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2803/5582] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:53 2022] DELETE /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:01:53.827263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.828044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.849582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:53.857254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.857770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.858221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.858952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.860910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.862731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:53.864886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.873963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:53.903125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.905249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.905901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.909498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.909669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:53.910068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.910752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:53.912718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.913407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lazy-loading 'fault' on Instance uuid 409cf04c-59c9-43cf-af87-736745569767 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:01:53.919496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:53.991806 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:53.992015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39013f6c37ef4490bfee4efec898a6ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98b3358e35ea4237be958bf13d333edd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:54.003254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd HTTP/1.1 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9d83c63c-97d7-4a2c-865d-e423bdaa0bdd'} Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.005663 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 9d83c63c-97d7-4a2c-865d-e423bdaa0bdd could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02c351ce-d997-476f-86fe-febd4374e756 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd" status: 404 len: 111 microversion: 2.1 time: 0.181599 Aug 23 11:01:54.011710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2804/5583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:53 2022] GET /compute/v2.1/servers/9d83c63c-97d7-4a2c-865d-e423bdaa0bdd => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:54.020514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:54.024440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:54.027857 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0f7c22d-f154-4e07-9c5a-497bf2fdc2d9 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 200 len: 1303 microversion: 2.1 time: 0.214475 Aug 23 11:01:54.035477 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2780/5584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:53 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:54.056846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.057878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.058256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:54.058641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.059388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.059853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.060286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.060625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:54.081814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.086363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.092415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.095584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.096270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.096755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.132916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 HTTP/1.1 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'fa73bec0-5d72-46ff-b247-6c5ca8b0e339'} Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:54.134528 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:54.140019 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0fdf4b50-434a-43d8-a2dc-cc15b129eaef tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 404 len: 111 microversion: 2.1 time: 0.095541 Aug 23 11:01:54.143982 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2781/5585] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:54 2022] DELETE /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:54.146471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:54.156492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:54.162327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:54.168889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.170142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.171552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.172447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.173188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.173770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.188206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:54.206263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:54.211575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:54.213089 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-76ba41e0-dd66-49db-a569-60b18ba1d08e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1359 microversion: 2.47 time: 0.199975 Aug 23 11:01:54.214414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2805/5586] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:54 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:54.240561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:54.251629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:54.252502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: fa73bec0-5d72-46ff-b247-6c5ca8b0e339] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:54.258987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.259681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.260336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.261644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.262296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.262887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.282405 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 HTTP/1.1 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fa73bec0-5d72-46ff-b247-6c5ca8b0e339'} Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.292269 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:54.307779 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:54.307779 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:54.307779 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:54.307779 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:54.307779 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. Aug 23 11:01:54.307779 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:54.313854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance fa73bec0-5d72-46ff-b247-6c5ca8b0e339 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:54.323660 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5e073a0-e94c-4a4c-ad9d-a2f50a537419 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339" status: 404 len: 111 microversion: 2.1 time: 0.100055 Aug 23 11:01:54.331222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2806/5587] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:54 2022] GET /compute/v2.1/servers/fa73bec0-5d72-46ff-b247-6c5ca8b0e339 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:54.342012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-70841384"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:01:54.344877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:54.357426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.358191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.358914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.360119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.361542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.362209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.863085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:54.877941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79f2f395-4bef-477e-9c52-c1435a9f1d84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.735316 Aug 23 11:01:54.890413 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2782/5588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:54 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:54.916083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:54.917305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:54.941769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e68963a-3d9b-4cc2-9a30-9a459cad5a3f tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "POST /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe/action" status: 202 len: 52 microversion: 2.47 time: 0.606205 Aug 23 11:01:54.952096 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2807/5589] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 11:01:54 2022] POST /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe/action => generated 52 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 23 11:01:54.961091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.975839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.975839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.976770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:54.977230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:54.977424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:54.990189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:54.990919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.035539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.036454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.039549 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe HTTP/1.1 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f2f16184-eb9b-48fa-ba29-38039b238afe'} Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:55.041345 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.045924 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.046886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.046981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:55.046981 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b15e487b-0517-4845-a7e0-2e01825cc374 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 404 len: 111 microversion: 2.1 time: 0.148453 Aug 23 11:01:55.047407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.049765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.053592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.073686 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2783/5590] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:54 2022] DELETE /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:55.085461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.085980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.117505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.122172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.126959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.129780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.130446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.132294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.277510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:55.560323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a594becf-ef4a-4919-8c42-f6d7eda9796b tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 204 len: 0 microversion: 2.47 time: 0.484956 Aug 23 11:01:55.560964 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2784/5591] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:01:55 2022] DELETE /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:01:55.590990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:55.600173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.601570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: f2f16184-eb9b-48fa-ba29-38039b238afe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.607633 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-933c3c4d-fc3c-454c-b656-52efc8551a98 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1300 microversion: 2.1 time: 0.636707 Aug 23 11:01:55.608527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2808/5592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:54 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1300 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:55.635017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.639725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] [instance: 409cf04c-59c9-43cf-af87-736745569767] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.641874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.646916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.647383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.652028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.653986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.654756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.656568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.657365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.658956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.659949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.660681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.663488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.707879 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] HTTP exception thrown: Instance 409cf04c-59c9-43cf-af87-736745569767 could not be found. Aug 23 11:01:55.716691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Request method failure captured: Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 HTTP/1.1 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMUzyNmnoX_UXM6wOJ_vhYPlC3eYjfuZ095qJ2ZT1OeO1G0-lMeB2F_Y4q1fBqJNKS8Og7Sma2DXS1iZNkxnGq9qpp9PKZ3Hlhp1s2nv1bL3Tbp6_D3uPyZ_D5Gufu6bJj-F0usrrq7KTVXtT7oc_U725u45odNGYOAFsYHMHSWK3c Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 98b3358e35ea4237be958bf13d333edd Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerRescueTestJSON-918607056 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/98b3358e35ea4237be958bf13d333edd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_98b3358e35ea4237be958bf13d333edd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98b3358e35ea4237be958bf13d333edd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/98b3358e35ea4237be958bf13d333edd"}]}] Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerRescueTestJSON-918607056 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 98b3358e35ea4237be958bf13d333edd Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerRescueTestJSON-918607056 Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerRescueTestJSON-918607056-project Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 39013f6c37ef4490bfee4efec898a6ce Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerRescueTestJSON-918607056-project Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 409cf04c-59c9-43cf-af87-736745569767 could not be found. Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '409cf04c-59c9-43cf-af87-736745569767'} Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 409cf04c-59c9-43cf-af87-736745569767 could not be found. Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 409cf04c-59c9-43cf-af87-736745569767 could not be found. Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.717033 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 409cf04c-59c9-43cf-af87-736745569767 could not be found. Aug 23 11:01:55.725280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe HTTP/1.1 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f2f16184-eb9b-48fa-ba29-38039b238afe'} Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.725770 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance f2f16184-eb9b-48fa-ba29-38039b238afe could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e437168-d4b2-4b24-88ee-ee04fc3a5d29 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe" status: 404 len: 111 microversion: 2.1 time: 0.154992 Aug 23 11:01:55.735254 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2785/5593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:55 2022] GET /compute/v2.1/servers/f2f16184-eb9b-48fa-ba29-38039b238afe => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:55.738225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] Returning 404 to user: Instance 409cf04c-59c9-43cf-af87-736745569767 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:55.739403 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea6ad8de-e5a9-41b7-9e87-585908ea8b61 tempest-ServerRescueTestJSON-918607056 tempest-ServerRescueTestJSON-918607056-project] 10.222.0.78 "GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767" status: 404 len: 111 microversion: 2.1 time: 0.115456 Aug 23 11:01:55.740196 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2809/5594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:55 2022] GET /compute/v2.1/servers/409cf04c-59c9-43cf-af87-736745569767 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:55.747826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00fd6289-8654-4d0d-a74f-674552047590 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.755658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00fd6289-8654-4d0d-a74f-674552047590 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.757369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.761343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.773060 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-00fd6289-8654-4d0d-a74f-674552047590 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00fd6289-8654-4d0d-a74f-674552047590 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 HTTP/1.1 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '0f5b5d3a-c79d-404c-8f19-1bf42b1959c5'} Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.774640 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00fd6289-8654-4d0d-a74f-674552047590 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:55.781935 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00fd6289-8654-4d0d-a74f-674552047590 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5" status: 404 len: 111 microversion: 2.1 time: 0.034090 Aug 23 11:01:55.785631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.785631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.786460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.803691 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2810/5595] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:55 2022] DELETE /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:55.811009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.812471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.814837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91e1b523-a912-4261-b34b-27ec35f3408f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.815616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91e1b523-a912-4261-b34b-27ec35f3408f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.817199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.837631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-91e1b523-a912-4261-b34b-27ec35f3408f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91e1b523-a912-4261-b34b-27ec35f3408f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 HTTP/1.1 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '0f5b5d3a-c79d-404c-8f19-1bf42b1959c5'} Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:01:55.861626 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:01:55.866601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:01:55.866601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:01:55.866601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. Aug 23 11:01:55.866601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:01:55.873644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91e1b523-a912-4261-b34b-27ec35f3408f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:01:55.880452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91e1b523-a912-4261-b34b-27ec35f3408f tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5" status: 404 len: 111 microversion: 2.1 time: 0.067080 Aug 23 11:01:55.885106 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2811/5596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:55 2022] GET /compute/v2.1/servers/0f5b5d3a-c79d-404c-8f19-1bf42b1959c5 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:01:55.894146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:55.928971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:55.950063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.955462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.956178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:55.957173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:55.957903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:55.958561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:56.034032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:01:56.278434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d18fe4dc-b8a7-4d3a-affb-41c27be59bf8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 204 len: 0 microversion: 2.1 time: 0.387900 Aug 23 11:01:56.290368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2812/5597] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:01:55 2022] DELETE /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:01:56.304619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:56.311189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:56.326803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:56.327405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:56.327921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:56.328725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:56.330392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:56.330913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:56.861225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:56.890670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:56.897867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:56.903503 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4606456d-94b7-49f2-9173-a459b882330a tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1365 microversion: 2.47 time: 1.179824 Aug 23 11:01:56.918398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2786/5598] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:55 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1365 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:56.933027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:56.934381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:56.950658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:56.951511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:56.952179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:56.958553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:56.972498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:56.972498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:57.333202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:57.343393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:57.351352 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-856c5a52-d1ba-49aa-b5d8-c0099a2da10f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 1.056379 Aug 23 11:01:57.365023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2813/5599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:56 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:57.370524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:57.371539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:57.376272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:57.383446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:57.386724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:57.387208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:57.387952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:57.389990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:57.390968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:57.397233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a64bc9d-35b2-4697-a543-964ddb052bc8 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1479 microversion: 2.1 time: 0.477528 Aug 23 11:01:57.421032 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2787/5600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:56 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1479 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:57.932265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:57.932949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:57.942335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:57.942838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:57.944862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:57.951464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:57.951969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:57.952417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:58.151619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:58.159817 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2fed96b6-ac71-4c68-b509-5b8e43246c6c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 0.795487 Aug 23 11:01:58.160410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2814/5601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:57 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:58.242893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:58.256644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:58.259420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:58.262388 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-489e2392-01f8-4455-bd5e-86b0e932a8c6 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1365 microversion: 2.47 time: 0.333010 Aug 23 11:01:58.267488 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2788/5602] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:57 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:58.379884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:58.382910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:58.387594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=20 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:01:58.400273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:58.402466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:58.403765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:58.409731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:58.410714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:58.414337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:58.423167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:58.423790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:58.434990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:58.435487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:58.435923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:58.436629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:58.437114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:58.437538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:58.737860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:58.752457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48b431b0-b9d4-4dd4-b0cb-ffe5d41e85af tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.378100 Aug 23 11:01:58.766468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2815/5603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:58 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:59.149006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:59.159124 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21891b8d-9dc4-40a1-b0db-159c5586cf4c tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1479 microversion: 2.1 time: 0.739883 Aug 23 11:01:59.175930 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2789/5604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:58 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1479 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:01:59.183493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:59.183947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:59.191383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:59.191881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:59.192323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:59.199020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:59.199569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:59.200020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:59.294553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:59.295174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:59.307906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:59.308517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:59.309011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:59.316397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:59.316943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:59.317648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:59.598479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:59.610224 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-12703b46-2c25-4bb0-a35d-f808667b0031 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 0.431862 Aug 23 11:01:59.610819 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2816/5605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:59 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:01:59.763263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:59.775775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:59.777106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:01:59.777672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:01:59.787213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5cfe1be060c74a39885bd887bfcbc858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '148577c89b48446ab771deb06e79e1e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:01:59.789167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0b000e4-b800-454c-9d99-f9162743359e tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 200 len: 1365 microversion: 2.47 time: 0.499027 Aug 23 11:01:59.790571 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2790/5606] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:01:59 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:01:59.791982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:59.792525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:59.795400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:01:59.796193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:01:59.797275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:01:59.797714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.184152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:00.184990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:00.196073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.199590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.200341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.201574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.203564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.205387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.297770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:00.331626 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca4b9f3d-7288-4510-ae8d-33689dc9767f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.558375 Aug 23 11:02:00.338557 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2817/5607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:01:59 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:00.352997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cc486d77-ba7a-4e65-aa9b-2564a9f1475c req-72b918a2-d18a-4341-ae6f-b9cc6eb2ed25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bf100a6-4ed0-4adf-b696-4bbb30cd822d", "name": "network-vif-deleted", "tag": "fb3baace-0297-48d1-ab48-ba512112d05e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:00.392375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cc486d77-ba7a-4e65-aa9b-2564a9f1475c req-72b918a2-d18a-4341-ae6f-b9cc6eb2ed25 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.395290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cc486d77-ba7a-4e65-aa9b-2564a9f1475c req-72b918a2-d18a-4341-ae6f-b9cc6eb2ed25 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.397507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cc486d77-ba7a-4e65-aa9b-2564a9f1475c req-72b918a2-d18a-4341-ae6f-b9cc6eb2ed25 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.399969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21400f211b740a191c116777a9f414f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6e1b0e86f243309763b50022e1a480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:00.441891 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3d75fb1-b641-48a5-af01-966975708308 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 200 len: 1437 microversion: 2.1 time: 0.262059 Aug 23 11:02:00.443645 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cc486d77-ba7a-4e65-aa9b-2564a9f1475c req-72b918a2-d18a-4341-ae6f-b9cc6eb2ed25 service nova] Creating event network-vif-deleted:fb3baace-0297-48d1-ab48-ba512112d05e for instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d on n-h1-847009-13 Aug 23 11:02:00.460707 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cc486d77-ba7a-4e65-aa9b-2564a9f1475c req-72b918a2-d18a-4341-ae6f-b9cc6eb2ed25 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120616 Aug 23 11:02:00.462008 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2791/5608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:00 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 1437 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:00.468933 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2818/5609] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:00.632189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:00.633176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:00.655464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.660067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.660579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.663266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.663763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.667606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.818359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:00.819073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] [instance: fd2a3486-d52d-42d7-9149-f37132021bbe] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:00.835639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.839928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.842690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.843714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:00.845131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:00.845745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:00.878259 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] HTTP exception thrown: Instance fd2a3486-d52d-42d7-9149-f37132021bbe could not be found. Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Request method failure captured: Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe HTTP/1.1 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLOW0gpiUvKWqLpFKVKWAtbIx8YOYM2QMRWCKzsfv6XOCX30wp9rnbuyIpUviPVtw6Osd1Ft_8z6yWwh8r95iISlFdyI7wQlIgjdxW7p7kmaY18VEaevPTcWMYWyvTv_aIbCPGvyR571y-_3Pp-pVbqSnXWY0sFek3ukzeTO5jz26Xc Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.47 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 148577c89b48446ab771deb06e79e1e2 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAaction247Test-1472643043 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/148577c89b48446ab771deb06e79e1e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_148577c89b48446ab771deb06e79e1e2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148577c89b48446ab771deb06e79e1e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/148577c89b48446ab771deb06e79e1e2"}]}] Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAaction247Test-1472643043 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 148577c89b48446ab771deb06e79e1e2 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAaction247Test-1472643043 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAaction247Test-1472643043-project Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 5cfe1be060c74a39885bd887bfcbc858 Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAaction247Test-1472643043-project Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fd2a3486-d52d-42d7-9149-f37132021bbe could not be found. Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fd2a3486-d52d-42d7-9149-f37132021bbe'} Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd2a3486-d52d-42d7-9149-f37132021bbe could not be found. Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd2a3486-d52d-42d7-9149-f37132021bbe could not be found. Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:00.880208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd2a3486-d52d-42d7-9149-f37132021bbe could not be found. Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] Returning 404 to user: Instance fd2a3486-d52d-42d7-9149-f37132021bbe could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:00.888336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f58f6ee9-3f09-44d0-89b4-64b698190393 tempest-ServersAaction247Test-1472643043 tempest-ServersAaction247Test-1472643043-project] 10.222.0.78 "GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe" status: 404 len: 111 microversion: 2.47 time: 0.071110 Aug 23 11:02:00.897565 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2819/5610] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:02:00 2022] GET /compute/v2.1/servers/fd2a3486-d52d-42d7-9149-f37132021bbe => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:02:01.337446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:01.356499 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f9989a4-693b-4f58-be40-aef668af4d5c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 0.721406 Aug 23 11:02:01.360099 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2792/5611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:00 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:01.372129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:01.373065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:01.388234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:01.391212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:01.392049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:01.393668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:01.397772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:01.398416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:01.418259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:01.469233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:01.470049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] [instance: 7bf100a6-4ed0-4adf-b696-4bbb30cd822d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:01.497166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:01.497958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:01.498520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:01.501712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:01.506875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:01.507473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:01.605664 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] HTTP exception thrown: Instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d could not be found. Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Request method failure captured: Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d HTTP/1.1 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLKjv7JZiRKWvjvdZbpeJB_ovaUA9EdClrlF8LJKESWHeb8xfy46I4mz2woxnmLKpEm0_jjAJrNIx_56n0m6SBKb2Hv5SmXaGGiiZNKKrqvGgu-fOYtjNTGfz4pLgasq29WUShDWcM7pxsgS6ga0pq8aWixxk3jUWBYlP4PKi71cSjE Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersTestJSON-388261724 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c6e1b0e86f243309763b50022e1a480", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c6e1b0e86f243309763b50022e1a480"}]}] Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersTestJSON-388261724 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6c6e1b0e86f243309763b50022e1a480 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersTestJSON-388261724 Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersTestJSON-388261724-project Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a21400f211b740a191c116777a9f414f Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersTestJSON-388261724-project Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d could not be found. Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7bf100a6-4ed0-4adf-b696-4bbb30cd822d'} Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d could not be found. Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d could not be found. Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:01.612606 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:01.617845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:01.617845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:01.617845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:01.617845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:01.617845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d could not be found. Aug 23 11:02:01.617845 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:01.618343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] Returning 404 to user: Instance 7bf100a6-4ed0-4adf-b696-4bbb30cd822d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:01.619455 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00d14b4d-e378-4a53-9bea-9f0f31adedd3 tempest-ServersTestJSON-388261724 tempest-ServersTestJSON-388261724-project] 10.222.0.78 "GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d" status: 404 len: 111 microversion: 2.1 time: 0.154359 Aug 23 11:02:01.620528 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2793/5612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:01 2022] GET /compute/v2.1/servers/7bf100a6-4ed0-4adf-b696-4bbb30cd822d => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:02:01.816240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:01.828413 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1b77338-8d0d-4df2-800d-5606c4d0465b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1522 microversion: 2.1 time: 0.461335 Aug 23 11:02:01.830157 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2820/5613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:01 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:02.384881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:02.386800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:02.400873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:02.408315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:02.415366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:02.417001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:02.418149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:02.418606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:02.529073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-05dee602-1eea-4d40-a46b-38e3236bad1b req-ef03e89d-5a17-40c8-bb29-f1dff1b1c33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc", "tag": "1d945058-11a0-4ffb-9d0e-8e871f7546eb"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:02.580340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-05dee602-1eea-4d40-a46b-38e3236bad1b req-ef03e89d-5a17-40c8-bb29-f1dff1b1c33d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:02.582265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-05dee602-1eea-4d40-a46b-38e3236bad1b req-ef03e89d-5a17-40c8-bb29-f1dff1b1c33d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:02.583498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-05dee602-1eea-4d40-a46b-38e3236bad1b req-ef03e89d-5a17-40c8-bb29-f1dff1b1c33d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:02.616989 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-05dee602-1eea-4d40-a46b-38e3236bad1b req-ef03e89d-5a17-40c8-bb29-f1dff1b1c33d service nova] Creating event network-changed:1d945058-11a0-4ffb-9d0e-8e871f7546eb for instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc on n-h2-847009-13 Aug 23 11:02:02.628387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-05dee602-1eea-4d40-a46b-38e3236bad1b req-ef03e89d-5a17-40c8-bb29-f1dff1b1c33d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106010 Aug 23 11:02:02.631129 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2821/5614] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:02:02.854642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:02.855539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:02.872053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:02.878374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:02.880073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:02.881150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:02.881911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:02.883208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:03.161482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:03.187411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f8987c33-6bec-4925-b16e-c8acf2f45776 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1499 microversion: 2.1 time: 0.337336 Aug 23 11:02:03.188841 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2822/5615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:02 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1499 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:03.215195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:03.227080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:03.230116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:03.241540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:03.242020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:03.242449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:03.243167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:03.245390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:03.245999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:03.298903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:03.341975 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e2225ec-364f-4ec0-bf3e-7ad322c20dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.133539 Aug 23 11:02:03.343192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2823/5616] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Aug 23 11:02:03 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:03.360487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8113972-a54e-47c6-a8c8-74bbfc731fe1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:03.367590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8113972-a54e-47c6-a8c8-74bbfc731fe1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:03.368494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8113972-a54e-47c6-a8c8-74bbfc731fe1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:03.369159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8113972-a54e-47c6-a8c8-74bbfc731fe1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:03.397983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a8113972-a54e-47c6-a8c8-74bbfc731fe1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Going to try to start instance {{(pid=128859) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 11:02:03.495605 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a8113972-a54e-47c6-a8c8-74bbfc731fe1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "POST /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b/action" status: 202 len: 0 microversion: 2.1 time: 0.141336 Aug 23 11:02:03.496913 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2824/5617] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:02:03 2022] POST /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:02:03.507059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:03.509470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:03.523253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:03.523991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:03.525508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:03.529069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:03.529851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:03.530476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:03.746182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:03.754345 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-292c211b-fc48-47b5-bbbb-892548b6bace tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1508 microversion: 2.1 time: 0.253111 Aug 23 11:02:03.763965 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2825/5618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:03 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:03.768293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:03.777696 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5793eedb-64f1-4970-b46f-46dd9abaee94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 1.397192 Aug 23 11:02:03.778289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2794/5619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:02 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:04.777816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:04.779069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:04.792838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:04.793682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:04.798918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:04.799539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:04.804879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:04.813143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:04.815907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:04.816159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:04.816833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:04.820548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:04.821185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:04.822110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:04.832683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:04.833465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:05.384502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:05.397986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f37ea01f-5ead-4045-913e-a3be31c944c1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1508 microversion: 2.1 time: 0.619960 Aug 23 11:02:05.398646 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2826/5620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:04 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1508 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:05.596268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:05.605838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7f14f95-42fd-4f26-af07-709cf9e64a51 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 0.810771 Aug 23 11:02:05.606416 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2795/5621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:04 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:06.423042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:06.423673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:06.480369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:06.481976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:06.482129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:06.483373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:06.484164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:06.485196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:06.631596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:06.632483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:06.666619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:06.668239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:06.668982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:06.672863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:06.673836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:06.674538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:07.081581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:07.093374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60a018fc-b7d3-4642-a9b1-589a319f50e1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1508 microversion: 2.1 time: 0.674891 Aug 23 11:02:07.098946 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2827/5622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:06 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1508 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:07.987981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:08.012157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03a26aa7-5e55-42de-b403-d1c266bd6aa9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 1.388305 Aug 23 11:02:08.015702 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2796/5623] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:06 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:08.118424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:08.119119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:08.131541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:08.132923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:08.133657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:08.137657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:08.138562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:08.139244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.033908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:09.034526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:09.047420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.052178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.052898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.053818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.054469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.055066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.222774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:09.231148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-134359d9-85cd-488f-8541-d8f72a3a1087 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1512 microversion: 2.1 time: 1.117228 Aug 23 11:02:09.235482 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2828/5624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:08 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1512 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:09.269510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:09.284064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:09.293743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.servers [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Removing options 'limit' from query {{(pid=128859) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 11:02:09.295274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:09.297443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.299915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.300570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.301590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.306701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.307554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.315086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-42b6daac-86b8-4ba1-a13f-534aa5c55a77 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.044000 Aug 23 11:02:09.316135 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2829/5625] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 23 11:02:09 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:02:09.329445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:09.330043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:09.343249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.344824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.352753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.353855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.354647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.355341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.668783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:09.685961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb522996-447e-4e18-bd7b-d8f8697a9551 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 0.655705 Aug 23 11:02:09.688644 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2797/5626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:09 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:09.695811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-98e06865-01ae-4b3a-bf1c-77bfa52c80b7 req-f054eee2-3bac-474a-97e8-d47b63c26459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc", "name": "network-vif-plugged", "status": "completed", "tag": "1d945058-11a0-4ffb-9d0e-8e871f7546eb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:09.709667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-98e06865-01ae-4b3a-bf1c-77bfa52c80b7 req-f054eee2-3bac-474a-97e8-d47b63c26459 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.710995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-98e06865-01ae-4b3a-bf1c-77bfa52c80b7 req-f054eee2-3bac-474a-97e8-d47b63c26459 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.711746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-98e06865-01ae-4b3a-bf1c-77bfa52c80b7 req-f054eee2-3bac-474a-97e8-d47b63c26459 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.726021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-98e06865-01ae-4b3a-bf1c-77bfa52c80b7 req-f054eee2-3bac-474a-97e8-d47b63c26459 service nova] Creating event network-vif-plugged:1d945058-11a0-4ffb-9d0e-8e871f7546eb for instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc on n-h2-847009-13 Aug 23 11:02:09.735853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-98e06865-01ae-4b3a-bf1c-77bfa52c80b7 req-f054eee2-3bac-474a-97e8-d47b63c26459 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044020 Aug 23 11:02:09.743287 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2798/5627] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:09.880578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:09.901769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7022b1be-d808-401a-b5d1-f9357b3dfb34 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1512 microversion: 2.1 time: 0.575414 Aug 23 11:02:09.903269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2830/5628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:09 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1512 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:09.928918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:09.930152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:09.941757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.942652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.943445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.945704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:09.946494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:09.950185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:09.983061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:10.327946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:10.359023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5481e77-f424-4eba-8f06-047eac2d4dc3 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 200 len: 1512 microversion: 2.1 time: 0.437210 Aug 23 11:02:10.365137 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2799/5629] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:09 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:10.384886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:10.386705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:10.415671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:10.416941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:10.418338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:10.419307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:10.420304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:10.421067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:10.714126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:10.714695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:10.732888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:10.733844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:10.734717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:10.735428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:10.736064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:10.736649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:11.066312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:11.084710 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a51e0735-8d9b-4347-986d-4ea45268a8db tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1367 microversion: 2.1 time: 0.375144 Aug 23 11:02:11.086745 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2800/5630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:10 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:11.098956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:11.124716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28307495-9ab8-4792-b739-6fbe260cd07f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1512 microversion: 2.1 time: 0.742166 Aug 23 11:02:11.126748 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2831/5631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:10 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1512 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:11.147464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:11.153942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:11.154971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:11.361171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:11.361782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:11.362115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:11.362853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:11.363344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:11.363731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:11.610499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:11.762226 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7af4813-817a-4400-bf32-ab7b0f471c8e tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.616759 Aug 23 11:02:11.777169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:11.778694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:11.784514 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2801/5632] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Aug 23 11:02:11 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:11.799035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:11.799565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:11.801434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:11.804679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:11.808514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:11.809376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:12.121799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:12.124361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:12.133301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:12.134237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:12.135466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:12.136560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:12.137268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:12.137872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:12.481763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:12.495822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6433979d-89fc-4944-a55d-7e693d8f55d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1556 microversion: 2.1 time: 0.389792 Aug 23 11:02:12.497793 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2802/5633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:12 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1556 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:12.519115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:12.519842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:12.528555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:12.529583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:12.530192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:12.531257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:12.532915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:12.533579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:12.657171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a85abd8b-6a2c-4b10-86d5-17addd634dec tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142140 Aug 23 11:02:12.659136 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2803/5634] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:02:12 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:02:12.703748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:12.721853 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e81a0a3-d41b-41e6-b7a9-c3e5181b5c21 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1512 microversion: 2.1 time: 0.947788 Aug 23 11:02:12.747774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2832/5635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:11 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1512 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:12.770364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:12.772490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:12.813451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:12.814224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:12.816228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:12.819253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:12.819945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:12.820573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:13.386690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:13.396227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d6d00c7-0f48-4601-84e9-0e975d0561e4 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 200 len: 1512 microversion: 2.1 time: 0.632022 Aug 23 11:02:13.412682 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2804/5636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:12 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:13.424105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:13.425571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:13.430271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:13.455283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:13.455283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:13.455624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:13.456325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:13.456822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:13.457270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:15.238481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:15.254597 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-185a4ce4-9c81-45af-98f8-ea763fe3bad8 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1512 microversion: 2.1 time: 1.834396 Aug 23 11:02:15.256975 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2833/5637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:13 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1512 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:15.289140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:15.312317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:15.317054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:15.376027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:15.376628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:15.377218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:15.378856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:15.386238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:15.387066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:15.452422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:15.580294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:15.609666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:15.614372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:15.616081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:16.157937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c43e568-2c7e-42a9-bffb-4ae57e3ac5c2 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.874827 Aug 23 11:02:16.158881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2805/5638] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 11:02:15 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:16.189788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:16.195643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:16.199755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:16.485171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:16.485704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:16.486613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:16.487452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:16.487996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:16.488511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:16.810159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:17.050428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13b6b02e-7511-4196-b8ab-c5b6b424c067 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1012 microversion: 2.1 time: 0.866529 Aug 23 11:02:17.053462 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2834/5639] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 11:02:16 2022] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1012 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:17.072877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:17.097376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:17.103032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:17.121390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:17.127475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:17.128253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:17.131505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:17.137697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:17.138419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:17.330047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:17.470525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad47f1a2-5199-4396-8b55-a800b9b05517 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.404106 Aug 23 11:02:17.477849 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2806/5640] 10.222.0.78 () {58 vars in 1212 bytes} [Tue Aug 23 11:02:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:17.483596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:17.491858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:17.497639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:17.529316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:17.531783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:17.532358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:17.537301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:17.537966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:17.538858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:17.829167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:18.072469 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8186cbda-c4da-4726-87f6-35d9f92633ff tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.592940 Aug 23 11:02:18.080830 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2835/5641] 10.222.0.78 () {58 vars in 1196 bytes} [Tue Aug 23 11:02:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:18.105256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:18.111497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:18.112207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': '1030704171', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:18.133633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:18.134162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:18.135577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:18.138122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:18.141477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:18.149408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:18.413340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:18.587267 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f41aa5f-af33-4cf5-b6f4-57eacfe7f5a0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?name=1030704171" status: 200 len: 346 microversion: 2.1 time: 0.496730 Aug 23 11:02:18.592700 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2807/5642] 10.222.0.78 () {58 vars in 1156 bytes} [Tue Aug 23 11:02:18 2022] GET /compute/v2.1/servers?name=1030704171 => generated 346 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:18.600438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:18.606045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:18.606756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:18.632158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:18.632583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:18.633089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:18.633899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:18.634406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:18.635455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:18.944925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:18.962404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:19.063036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-db376b0b-7ca2-451f-a51a-cb5cdf8cd2a4 req-7728f87d-d496-4c19-8b55-90d55fcb2c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc", "tag": "1d945058-11a0-4ffb-9d0e-8e871f7546eb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:19.104583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-db376b0b-7ca2-451f-a51a-cb5cdf8cd2a4 req-7728f87d-d496-4c19-8b55-90d55fcb2c44 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:19.105311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-db376b0b-7ca2-451f-a51a-cb5cdf8cd2a4 req-7728f87d-d496-4c19-8b55-90d55fcb2c44 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:19.106337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-db376b0b-7ca2-451f-a51a-cb5cdf8cd2a4 req-7728f87d-d496-4c19-8b55-90d55fcb2c44 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:19.129801 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-db376b0b-7ca2-451f-a51a-cb5cdf8cd2a4 req-7728f87d-d496-4c19-8b55-90d55fcb2c44 service nova] Creating event network-changed:1d945058-11a0-4ffb-9d0e-8e871f7546eb for instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc on n-h2-847009-13 Aug 23 11:02:19.146788 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-db376b0b-7ca2-451f-a51a-cb5cdf8cd2a4 req-7728f87d-d496-4c19-8b55-90d55fcb2c44 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091830 Aug 23 11:02:19.151485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2808/5643] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:19.181332 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58e00b28-86d9-4540-96e8-38e9a63c2c4d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.584756 Aug 23 11:02:19.210504 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2836/5644] 10.222.0.78 () {58 vars in 1154 bytes} [Tue Aug 23 11:02:18 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:19.227879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:19.233422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:19.235057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-103070417', 'deleted': False, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:02:19.283029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:19.283544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:19.283984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:19.292499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:19.293065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:19.312519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:20.052849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:02:20.207205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a05b717-7ddf-4e1a-9990-6c3868c32fca tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-103070417" status: 200 len: 346 microversion: 2.1 time: 0.987979 Aug 23 11:02:20.209855 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2809/5645] 10.222.0.78 () {58 vars in 1228 bytes} [Tue Aug 23 11:02:19 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-103070417 => generated 346 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:20.225158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:20.226277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:20.237079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:20.238264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:20.239476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:20.240928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:20.241741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:20.242730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:20.282619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:02:20.513454 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9ac0414-d93b-4f1b-a87d-cce19fe6580c tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 204 len: 0 microversion: 2.1 time: 0.293805 Aug 23 11:02:20.514079 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2837/5646] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:02:20 2022] DELETE /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:02:20.528240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:20.529878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:20.554688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:20.557563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:20.559619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:20.563522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:20.564961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:20.566254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:21.483731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:21.499159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efe1e65e-0c26-42f3-8127-9670643b5e2a tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1518 microversion: 2.1 time: 0.979950 Aug 23 11:02:21.505161 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2810/5647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:20 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1518 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:22.532360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:22.532999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:22.541955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:22.542491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:22.542898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:22.543983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:22.544077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:22.544507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:23.045800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:23.069766 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-153f5a02-cc8b-45d4-b377-faaf2af4fbb0 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1518 microversion: 2.1 time: 0.546861 Aug 23 11:02:23.071346 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2838/5648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:22 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1518 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:24.096639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:24.097345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:24.101689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:24.124197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:24.124716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:24.125200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:24.130637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:24.133456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:24.137546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:24.819499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:24.829719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1b857aa-dcfc-4683-8dc1-c8f774186f59 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1518 microversion: 2.1 time: 0.739663 Aug 23 11:02:24.830321 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2811/5649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:24 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1518 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:25.548882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1190317587", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "08284140-2ee0-4674-af28-4d2e487b492b"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:25.566771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:25.685371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] validate_networks() for [('08284140-2ee0-4674-af28-4d2e487b492b', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:02:25.853420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:25.854577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:25.865208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:25.869386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:25.871879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:25.873176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:25.876239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:25.877256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:25.878856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:26.894569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:26.906858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 200 len: 1476 microversion: 2.1 time: 1.058775 Aug 23 11:02:26.909430 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2812/5650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:25 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 1476 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:26.924445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:26.931933 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d53a2135-b19e-4db5-8594-b8321645da84 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006135 Aug 23 11:02:26.932828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2813/5651] 10.222.0.78 () {56 vars in 886 bytes} [Tue Aug 23 11:02:26 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 11:02:26.948827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1151bb23-e2d3-4cb8-ae22-7cafc07c450f req-9895e255-eca8-4f1c-ae99-efe24f2d297c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da89b360-6cee-4251-a02d-8b784aeb4343", "name": "network-vif-deleted", "tag": "80332d3d-63d7-4170-b037-f77cb55dc287"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:26.987904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1151bb23-e2d3-4cb8-ae22-7cafc07c450f req-9895e255-eca8-4f1c-ae99-efe24f2d297c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:26.989055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1151bb23-e2d3-4cb8-ae22-7cafc07c450f req-9895e255-eca8-4f1c-ae99-efe24f2d297c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:26.992468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1151bb23-e2d3-4cb8-ae22-7cafc07c450f req-9895e255-eca8-4f1c-ae99-efe24f2d297c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:27.031601 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1151bb23-e2d3-4cb8-ae22-7cafc07c450f req-9895e255-eca8-4f1c-ae99-efe24f2d297c service nova] Creating event network-vif-deleted:80332d3d-63d7-4170-b037-f77cb55dc287 for instance da89b360-6cee-4251-a02d-8b784aeb4343 on n-h1-847009-13 Aug 23 11:02:27.049565 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1151bb23-e2d3-4cb8-ae22-7cafc07c450f req-9895e255-eca8-4f1c-ae99-efe24f2d297c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106584 Aug 23 11:02:27.053124 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2814/5652] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:27.808911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:02:27.809908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:02:27.810604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:02:27.811377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:02:27.812247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:02:27.831004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:27.834772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:27.836822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:27.841132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:27.842506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:27.846112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:27.888204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Getting quotas for project b87d7e1ba3b94dfa80ee1a80ea643def. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:02:27.894537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Getting quotas for user df2e7627274b4086be532a0b4a9f28bc and project b87d7e1ba3b94dfa80ee1a80ea643def. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:02:27.915784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:02:27.921488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:02:27.940842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:27.944815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: da89b360-6cee-4251-a02d-8b784aeb4343] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:27.966156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:27.971999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:27.974062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:27.976419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:27.977644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:27.978680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:28.019118 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] HTTP exception thrown: Instance da89b360-6cee-4251-a02d-8b784aeb4343 could not be found. Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Request method failure captured: Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 HTTP/1.1 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLNut0UUbnZWdp_sU4SxnhO1zv4LMCyCs3DAfC7on1dsOTJ3if-q7ZK8VmrlC3YzrlwErf49xjbN1L2QLaGI4fcLCHRAcbeXp7EJWp-07rmnIf5hNOPNqy_7oVZDlIajU7p_B0OVslbdCphHOeJhHrP_-HyEpI0yezHUEehVmd9742s Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c7f19e3b57141cb80a30ffde5b6fb89 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7f19e3b57141cb80a30ffde5b6fb89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7f19e3b57141cb80a30ffde5b6fb89", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7f19e3b57141cb80a30ffde5b6fb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7f19e3b57141cb80a30ffde5b6fb89"}]}] Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c7f19e3b57141cb80a30ffde5b6fb89 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListServerFiltersTestJSON-179367363-project Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 76717cbfddf04587ab21618bc303c8c6 Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListServerFiltersTestJSON-179367363-project Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance da89b360-6cee-4251-a02d-8b784aeb4343 could not be found. Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'da89b360-6cee-4251-a02d-8b784aeb4343'} Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da89b360-6cee-4251-a02d-8b784aeb4343 could not be found. Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da89b360-6cee-4251-a02d-8b784aeb4343 could not be found. Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:28.027793 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da89b360-6cee-4251-a02d-8b784aeb4343 could not be found. Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:28.033456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Returning 404 to user: Instance da89b360-6cee-4251-a02d-8b784aeb4343 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:28.036399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4b58591-0aba-4a7e-8fb6-f3276bf5c6fc tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343" status: 404 len: 111 microversion: 2.1 time: 0.105030 Aug 23 11:02:28.041648 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2815/5653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:27 2022] GET /compute/v2.1/servers/da89b360-6cee-4251-a02d-8b784aeb4343 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:02:28.043836 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa7dcdf5-a859-445f-9548-b0499303e002 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.924517 Aug 23 11:02:28.046328 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2839/5654] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:02:28.051449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:28.052225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:28.064228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:28.067609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:28.068347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:28.069340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:28.073670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:28.074434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:28.076795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8119784-c365-41ac-9b09-b9dab2a14103 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:28.078710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a8119784-c365-41ac-9b09-b9dab2a14103 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:28.137936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:02:28.193455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:28.347083 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-680a0fbf-eac3-4089-96fc-b3a4caa2242d tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "DELETE /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 204 len: 0 microversion: 2.1 time: 0.299299 Aug 23 11:02:28.351961 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2816/5655] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:02:28 2022] DELETE /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:02:28.374803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:28.377541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:28.399298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:28.402314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:28.403429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:28.410209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:28.410927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:28.412161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:28.500648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a8119784-c365-41ac-9b09-b9dab2a14103 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:28.519268 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a8119784-c365-41ac-9b09-b9dab2a14103 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1216 microversion: 2.1 time: 0.466605 Aug 23 11:02:28.519884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2840/5656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:28 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1216 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:29.046986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:29.055797 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ea99e80-38b5-4ce7-a2d6-b94203f0289b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 200 len: 1518 microversion: 2.1 time: 0.699628 Aug 23 11:02:29.057950 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2817/5657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:28 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 1518 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:29.540043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:29.542946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:29.555079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:29.562884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:29.563919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:29.564969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:29.565668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:29.567495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:29.780093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:29.790181 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1929aa6-b5d7-4bc9-b42e-34a654e2bfd4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1212 microversion: 2.1 time: 0.254366 Aug 23 11:02:29.814205 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2841/5658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:29 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1212 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:30.080424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:30.084201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:30.091095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:30.111065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:30.112185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:30.112937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:30.113906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:30.114609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:30.115281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:30.733852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:30.748329 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f2b89b1-8157-4a47-b0ac-738c0daf7374 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 200 len: 1518 microversion: 2.1 time: 0.671868 Aug 23 11:02:30.769988 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2818/5659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:30 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 1518 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:30.814072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:30.815362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:30.833888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:30.836958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:30.840367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:30.843552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:30.845986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:30.846669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:31.110195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:31.128368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dac90aa9-27fd-48af-a870-eff941d4032e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1274 microversion: 2.1 time: 0.320135 Aug 23 11:02:31.151112 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2842/5660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:30 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1274 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:31.473037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5657f9f9-8f13-4a14-bb19-109bc3f0e4ca tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] Calling method '.version_select at 0x7fdc9c040550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:31.617406 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5657f9f9-8f13-4a14-bb19-109bc3f0e4ca tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.447271 Aug 23 11:02:31.620768 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2819/5661] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 11:02:31 2022] GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8/defaults => generated 371 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:31.633876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89f5c533-4eb4-4448-af43-ace58fb878af tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] Calling method '.version_select at 0x7fdc9d272e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:31.790187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:31.792264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:31.804159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:31.804647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:31.805187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:31.805939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:31.807672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:31.808134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:31.833087 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89f5c533-4eb4-4448-af43-ace58fb878af tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8" status: 200 len: 371 microversion: 2.1 time: 0.204880 Aug 23 11:02:31.849408 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2843/5662] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 11:02:31 2022] GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8 => generated 371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:31.870948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-545b3479-28d4-439e-a36d-8760ebae8e86 tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] Calling method '.version_select at 0x7fdc9cc4eb80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:32.015061 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-545b3479-28d4-439e-a36d-8760ebae8e86 tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.159799 Aug 23 11:02:32.016335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2844/5663] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 11:02:31 2022] GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8/defaults => generated 371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:32.033000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-391af4ac-ffac-46e6-bd66-0f37a38670bc tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] Calling method '.version_select at 0x7fdc9cc4e550>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:32.328394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:32.357414 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a6fd9c4-7096-4762-817d-08a5fd6d7b90 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 200 len: 1476 microversion: 2.1 time: 0.570932 Aug 23 11:02:32.361015 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2820/5664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:31 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 1476 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:32.374051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1a049a0e-ccc7-44a0-a72b-f14fe55c6837 req-ef7c864b-671f-4732-b8cc-9d2897abba2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b1c352-6831-449c-bb70-ec3b016cdef4", "name": "network-vif-deleted", "tag": "a72e5e80-b0b2-4162-a96c-fb9954599d02"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:32.421809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1a049a0e-ccc7-44a0-a72b-f14fe55c6837 req-ef7c864b-671f-4732-b8cc-9d2897abba2d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:32.426484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1a049a0e-ccc7-44a0-a72b-f14fe55c6837 req-ef7c864b-671f-4732-b8cc-9d2897abba2d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:32.428524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1a049a0e-ccc7-44a0-a72b-f14fe55c6837 req-ef7c864b-671f-4732-b8cc-9d2897abba2d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:32.441019 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-391af4ac-ffac-46e6-bd66-0f37a38670bc tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8" status: 200 len: 371 microversion: 2.1 time: 0.413420 Aug 23 11:02:32.442518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2845/5665] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 11:02:32 2022] GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8 => generated 371 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:02:32.470879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:32.472936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:32.482679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:32.484132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:32.485996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:32.487089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:32.487218 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1a049a0e-ccc7-44a0-a72b-f14fe55c6837 req-ef7c864b-671f-4732-b8cc-9d2897abba2d service nova] Creating event network-vif-deleted:a72e5e80-b0b2-4162-a96c-fb9954599d02 for instance 36b1c352-6831-449c-bb70-ec3b016cdef4 on n-h2-847009-13 Aug 23 11:02:32.488336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:32.489217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:32.519020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1a049a0e-ccc7-44a0-a72b-f14fe55c6837 req-ef7c864b-671f-4732-b8cc-9d2897abba2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156469 Aug 23 11:02:32.519641 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2821/5666] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:32.548876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b8309b7-4274-46e8-b78a-851d42090bfb tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] Calling method '.version_select at 0x7fdc9c2d7160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:32.649949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:32.661231 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcec8064-aa16-4744-aaad-fc79614118bf tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1274 microversion: 2.1 time: 0.215517 Aug 23 11:02:32.665073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2846/5667] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:32 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:33.207912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b8309b7-4274-46e8-b78a-851d42090bfb tempest-QuotasTestJSON-639126117 tempest-QuotasTestJSON-639126117-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8?user_id=b4115f44d76648ef9eb1fc0f780a969c" status: 200 len: 371 microversion: 2.1 time: 0.676847 Aug 23 11:02:33.208437 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2822/5668] 10.222.0.78 () {58 vars in 1323 bytes} [Tue Aug 23 11:02:32 2022] GET /compute/v2.1/os-quota-sets/f7391bd03b6d4d3e8ed709f88a3dd6a8?user_id=b4115f44d76648ef9eb1fc0f780a969c => generated 371 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:33.387390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:33.389801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 36b1c352-6831-449c-bb70-ec3b016cdef4] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:33.410836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.412453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.413653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.415023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.417494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.418147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.448344 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] HTTP exception thrown: Instance 36b1c352-6831-449c-bb70-ec3b016cdef4 could not be found. Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Request method failure captured: Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 HTTP/1.1 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLNut0UUbnZWdp_sU4SxnhO1zv4LMCyCs3DAfC7on1dsOTJ3if-q7ZK8VmrlC3YzrlwErf49xjbN1L2QLaGI4fcLCHRAcbeXp7EJWp-07rmnIf5hNOPNqy_7oVZDlIajU7p_B0OVslbdCphHOeJhHrP_-HyEpI0yezHUEehVmd9742s Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8c7f19e3b57141cb80a30ffde5b6fb89 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7f19e3b57141cb80a30ffde5b6fb89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7f19e3b57141cb80a30ffde5b6fb89", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7f19e3b57141cb80a30ffde5b6fb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7f19e3b57141cb80a30ffde5b6fb89"}]}] Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8c7f19e3b57141cb80a30ffde5b6fb89 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ListServerFiltersTestJSON-179367363-project Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 76717cbfddf04587ab21618bc303c8c6 Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ListServerFiltersTestJSON-179367363-project Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 36b1c352-6831-449c-bb70-ec3b016cdef4 could not be found. Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '36b1c352-6831-449c-bb70-ec3b016cdef4'} Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b1c352-6831-449c-bb70-ec3b016cdef4 could not be found. Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b1c352-6831-449c-bb70-ec3b016cdef4 could not be found. Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:33.453556 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b1c352-6831-449c-bb70-ec3b016cdef4 could not be found. Aug 23 11:02:33.458883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:33.461238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Returning 404 to user: Instance 36b1c352-6831-449c-bb70-ec3b016cdef4 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:33.466448 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1298196-7918-461c-810e-048f4bdbd7cd tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4" status: 404 len: 111 microversion: 2.1 time: 0.092015 Aug 23 11:02:33.471814 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2847/5669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:33 2022] GET /compute/v2.1/servers/36b1c352-6831-449c-bb70-ec3b016cdef4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:02:33.478943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:33.479831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:33.495028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.497715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.498311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.501407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.506225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.506758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.591027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:02:33.684602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:33.685246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:33.691617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.692108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.692546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.693288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.693745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.694575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.851993 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7a9754ec-041c-40e4-a57f-e513af9e01ac tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "DELETE /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 204 len: 0 microversion: 2.1 time: 0.375678 Aug 23 11:02:33.856373 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2823/5670] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:02:33 2022] DELETE /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:02:33.867688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:33.870657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:33.902161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.903012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.903703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:33.904720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:33.905527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:33.906574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:34.378932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:34.395318 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6c01dd8c-fb80-4fc6-adb7-b2803e8057d7 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1518 microversion: 2.1 time: 0.533643 Aug 23 11:02:34.407355 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2824/5671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:33 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1518 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:34.783648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:34.800444 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e514673-5832-448f-a8b2-0b0140864ec4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 1.120078 Aug 23 11:02:34.801391 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2848/5672] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:33 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:35.425047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:35.425663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:35.439988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:35.440450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:35.450787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:35.451730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:35.452234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:35.452693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:35.825979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:35.827582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:35.846645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:35.847433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:35.848133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:35.849212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:35.850885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:35.850885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:36.187511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:36.208436 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6f935d3-2ad5-400e-baa3-cc896d09caf1 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1518 microversion: 2.1 time: 0.787881 Aug 23 11:02:36.210540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2825/5673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:35 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1518 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:36.890924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:36.906519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68f34500-2792-4fea-9d0e-0dc3b47bc406 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 1.080914 Aug 23 11:02:36.907483 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2849/5674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:35 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:37.235911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:37.236446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:37.262364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:37.262746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:37.263193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:37.263921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:37.264386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:37.284976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:37.931993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:37.932781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:37.935183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:37.952284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:37.958611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:37.959274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:37.960127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:37.960679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:37.961198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:38.260864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:38.293412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-481fdb89-d5b3-476d-a38f-d1fc62dcb09f tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1518 microversion: 2.1 time: 1.056630 Aug 23 11:02:38.297338 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2826/5675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:37 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1518 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:38.892983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c3a8402b-6976-412e-b8c7-1d109a24b99e req-b32cbc09-0b9e-4811-8289-3925d02568f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052c252b-ccac-43d2-9bef-61b5eebdd91b", "name": "network-vif-deleted", "tag": "80b2ca12-103b-4bfb-8117-0dc71511abac"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:38.908128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c3a8402b-6976-412e-b8c7-1d109a24b99e req-b32cbc09-0b9e-4811-8289-3925d02568f1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:38.909098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c3a8402b-6976-412e-b8c7-1d109a24b99e req-b32cbc09-0b9e-4811-8289-3925d02568f1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:38.909923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c3a8402b-6976-412e-b8c7-1d109a24b99e req-b32cbc09-0b9e-4811-8289-3925d02568f1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:38.940675 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c3a8402b-6976-412e-b8c7-1d109a24b99e req-b32cbc09-0b9e-4811-8289-3925d02568f1 service nova] Creating event network-vif-deleted:80b2ca12-103b-4bfb-8117-0dc71511abac for instance 052c252b-ccac-43d2-9bef-61b5eebdd91b on n-h1-847009-13 Aug 23 11:02:38.979312 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c3a8402b-6976-412e-b8c7-1d109a24b99e req-b32cbc09-0b9e-4811-8289-3925d02568f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067627 Aug 23 11:02:38.980972 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2827/5676] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:39.084797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:39.107136 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa59606a-3852-481f-9b66-e7984fa70e4e tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 1.177603 Aug 23 11:02:39.126451 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2850/5677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:37 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:39.326167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:39.330532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:39.377728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:39.378757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:39.380130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:39.382264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:39.385066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:39.387716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:39.463505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:39.464022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:39.465418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:39.465418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lazy-loading 'fault' on Instance uuid 052c252b-ccac-43d2-9bef-61b5eebdd91b {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:02:39.543753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76717cbfddf04587ab21618bc303c8c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7f19e3b57141cb80a30ffde5b6fb89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:39.558379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7cddd58-7fb7-4e6d-bf86-0e902913bc39 tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 200 len: 1311 microversion: 2.1 time: 0.244175 Aug 23 11:02:39.563657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2828/5678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:39 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:40.135724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:40.137334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:40.152093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:40.153074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:40.160890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:40.165279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:40.166465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:40.167299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:40.588367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:40.589065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] [instance: 052c252b-ccac-43d2-9bef-61b5eebdd91b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:40.599738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:40.600259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:40.600706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:40.606232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:40.610031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:40.610523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:40.648103 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] HTTP exception thrown: Instance 052c252b-ccac-43d2-9bef-61b5eebdd91b could not be found. Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Request method failure captured: Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b HTTP/1.1 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLNut0UUbnZWdp_sU4SxnhO1zv4LMCyCs3DAfC7on1dsOTJ3if-q7ZK8VmrlC3YzrlwErf49xjbN1L2QLaGI4fcLCHRAcbeXp7EJWp-07rmnIf5hNOPNqy_7oVZDlIajU7p_B0OVslbdCphHOeJhHrP_-HyEpI0yezHUEehVmd9742s Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8c7f19e3b57141cb80a30ffde5b6fb89 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c7f19e3b57141cb80a30ffde5b6fb89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c7f19e3b57141cb80a30ffde5b6fb89", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7f19e3b57141cb80a30ffde5b6fb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c7f19e3b57141cb80a30ffde5b6fb89"}]}] Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8c7f19e3b57141cb80a30ffde5b6fb89 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-179367363 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ListServerFiltersTestJSON-179367363-project Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 76717cbfddf04587ab21618bc303c8c6 Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ListServerFiltersTestJSON-179367363-project Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 052c252b-ccac-43d2-9bef-61b5eebdd91b could not be found. Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '052c252b-ccac-43d2-9bef-61b5eebdd91b'} Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052c252b-ccac-43d2-9bef-61b5eebdd91b could not be found. Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052c252b-ccac-43d2-9bef-61b5eebdd91b could not be found. Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:40.659874 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052c252b-ccac-43d2-9bef-61b5eebdd91b could not be found. Aug 23 11:02:40.665042 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:40.667495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] Returning 404 to user: Instance 052c252b-ccac-43d2-9bef-61b5eebdd91b could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:40.669182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-07f8d37c-ead8-432f-bf82-8ce1ca8ab43b tempest-ListServerFiltersTestJSON-179367363 tempest-ListServerFiltersTestJSON-179367363-project] 10.222.0.78 "GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b" status: 404 len: 111 microversion: 2.1 time: 0.084211 Aug 23 11:02:40.675001 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2829/5679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:40 2022] GET /compute/v2.1/servers/052c252b-ccac-43d2-9bef-61b5eebdd91b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:02:40.724169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:40.733652 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20fbade2-bfb7-44bb-81fd-693a5c93822d tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 0.602683 Aug 23 11:02:40.737958 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2851/5680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:40 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:41.063301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-089ee8fb-c12b-48d1-a4bd-54ca1b96a957 req-04b046fc-95b6-48b3-90f7-eabee0c05d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25f9b352-a877-47e1-8712-48bbb652d64e", "tag": "11de54b0-65b6-4055-a961-bb04ab373dd4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:41.093458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-089ee8fb-c12b-48d1-a4bd-54ca1b96a957 req-04b046fc-95b6-48b3-90f7-eabee0c05d05 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:41.094002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-089ee8fb-c12b-48d1-a4bd-54ca1b96a957 req-04b046fc-95b6-48b3-90f7-eabee0c05d05 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:41.094475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-089ee8fb-c12b-48d1-a4bd-54ca1b96a957 req-04b046fc-95b6-48b3-90f7-eabee0c05d05 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:41.114292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-089ee8fb-c12b-48d1-a4bd-54ca1b96a957 req-04b046fc-95b6-48b3-90f7-eabee0c05d05 service nova] Creating event network-changed:11de54b0-65b6-4055-a961-bb04ab373dd4 for instance 25f9b352-a877-47e1-8712-48bbb652d64e on n-h1-847009-13 Aug 23 11:02:41.122070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-089ee8fb-c12b-48d1-a4bd-54ca1b96a957 req-04b046fc-95b6-48b3-90f7-eabee0c05d05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063872 Aug 23 11:02:41.125327 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2830/5681] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:41.449132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f258a87-ea53-4839-adc0-32823dfb5507 tempest-ComputeTenantNetworksTest-1196134781 tempest-ComputeTenantNetworksTest-1196134781-project] Calling method '.version_select at 0x7fdc9d33e700>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:41.763476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:41.765271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:41.791264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:41.793031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:41.794741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:41.798851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:41.801174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:41.801654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:41.955607 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f258a87-ea53-4839-adc0-32823dfb5507 tempest-ComputeTenantNetworksTest-1196134781 tempest-ComputeTenantNetworksTest-1196134781-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.837565 Aug 23 11:02:41.957059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2852/5682] 10.222.0.78 () {58 vars in 1158 bytes} [Tue Aug 23 11:02:41 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:41.968316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-106b2171-a37d-4880-adae-5a79984d8064 tempest-ComputeTenantNetworksTest-1196134781 tempest-ComputeTenantNetworksTest-1196134781-project] Calling method '.version_select at 0x7fdc9c099940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:42.178236 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-106b2171-a37d-4880-adae-5a79984d8064 tempest-ComputeTenantNetworksTest-1196134781 tempest-ComputeTenantNetworksTest-1196134781-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks/18e4cf59-7edb-479c-8945-87c0a07a3147" status: 200 len: 140 microversion: 2.1 time: 0.213645 Aug 23 11:02:42.186311 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2853/5683] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 11:02:41 2022] GET /compute/v2.1/os-tenant-networks/18e4cf59-7edb-479c-8945-87c0a07a3147 => generated 140 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:02:42.326521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:42.335708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d1b38c7-f8a7-4f4e-b982-45b47cbd7043 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 0.583618 Aug 23 11:02:42.347750 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2831/5684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:41 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:42.465418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:42.470284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-50aa630a-6d92-4746-bfe4-6bf15354dd8c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'create', calling method: .version_select at 0x7fdc9c52c700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1090719220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4/PFBPRuKajZsSx+6HANllyoebTHeEicKPeNCwAXUY5MhmY7+X9MuzQfLuZIq+cdp8l3o2AIrD6cX5/rAhQR1aWpas3HELqy4QqLGEE1aWXMB1+/662yKGFRXQKa1pDw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:42.507216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-50aa630a-6d92-4746-bfe4-6bf15354dd8c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for project ae502704266349bab5642ad154ea1085. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:02:42.526977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-50aa630a-6d92-4746-bfe4-6bf15354dd8c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for user 4bb6e7d862d84e1c9f5d129b0c41bc37 and project ae502704266349bab5642ad154ea1085. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:02:42.577070 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-50aa630a-6d92-4746-bfe4-6bf15354dd8c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.112396 Aug 23 11:02:42.577693 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2854/5685] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:02:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:43.371831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:43.373039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:43.380848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:43.389216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:43.394692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:43.396483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:43.401127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:43.402707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:43.404144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:43.900348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:43.914332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cc353fc-f2df-4ea4-b9eb-4e4024bee1ba tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 0.555508 Aug 23 11:02:43.930665 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2832/5686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:43 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:44.942206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:44.943195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:44.983911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:44.984705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:44.985221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:44.986171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:44.992219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:44.992691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.233812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:45.244710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db301f72-5631-4494-a73c-9868c811c8fc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 0.310374 Aug 23 11:02:45.246019 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2855/5687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:44 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:45.252922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:45.255033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:45.273080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.273589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.274621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.275824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.276587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.277336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.326352 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d81933ab-9811-4479-b855-ce5517cd9a62 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/ips" status: 200 len: 149 microversion: 2.1 time: 0.078648 Aug 23 11:02:45.327399 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2856/5688] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:02:45 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/ips => generated 149 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:45.347820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6cb6817-ddee-4c84-b059-e85983233657"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:45.356246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:45.374372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.378755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.382296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.385460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.390662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.391312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.592146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Invalid volume: volume b6cb6817-ddee-4c84-b059-e85983233657 is already attached to instances: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/os-volume_attachments HTTP/1.1 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 74 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: {"volumeAttachment": {"volumeId": "b6cb6817-ddee-4c84-b059-e85983233657"}} Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid volume: volume b6cb6817-ddee-4c84-b059-e85983233657 is already attached to instances: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc', 'body': {'volumeAttachment': {'volumeId': 'b6cb6817-ddee-4c84-b059-e85983233657'}}} Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b6cb6817-ddee-4c84-b059-e85983233657 is already attached to instances: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:45.595399 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b6cb6817-ddee-4c84-b059-e85983233657 is already attached to instances: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b6cb6817-ddee-4c84-b059-e85983233657 is already attached to instances: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 Aug 23 11:02:45.600495 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:02:45.606420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 400 to user: Invalid volume: volume b6cb6817-ddee-4c84-b059-e85983233657 is already attached to instances: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:45.607694 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd5429dd-6a2d-46c1-9e72-da2621d7db7d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270877 Aug 23 11:02:45.609430 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2857/5689] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:02:45 2022] POST /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc/os-volume_attachments => generated 174 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:02:45.618851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:45.619791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:45.627219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.628097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.628809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.629778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.630653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.631504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.662881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:02:45.750957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:45.809632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a863c13-9199-4e66-91fa-b9ef4033fd31 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: .version_select at 0x7fdc9d0c2af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-577587505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF69KZQbJ7cUE6VYvEyExdKo0zJr+OwkbvoXnTJ1/2qUtjLLXnEE3zZUAD8OS40iYJeeF6MDXja93qN3kQUHdlhWkaeY3yyiCyYKsfg/yugT6hhQB+vgFtoFkLZQYPmTBA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:45.855291 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-40dc0a67-c687-4dee-9a10-3ee8971f04a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 204 len: 0 microversion: 2.1 time: 0.241122 Aug 23 11:02:45.859495 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2858/5690] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:02:45 2022] DELETE /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:02:45.859939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9a863c13-9199-4e66-91fa-b9ef4033fd31 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:02:45.866120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:45.866973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:45.876098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-9a863c13-9199-4e66-91fa-b9ef4033fd31 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:02:45.879191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.879748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.881919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.882919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:45.884350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:45.894127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:45.931907 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a863c13-9199-4e66-91fa-b9ef4033fd31 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.842147 Aug 23 11:02:45.941305 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2833/5691] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:02:45 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:46.271748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:46.272394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:46.292075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:46.292612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:46.298716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:46.301262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:46.301818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:46.302281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:46.487233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:46.501004 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-033ae8e2-c147-49b6-9a8b-7977af418d66 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1681 microversion: 2.1 time: 0.639565 Aug 23 11:02:46.504558 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2859/5692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:45 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1681 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:46.525266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1729639165", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "70726c21-307d-4887-807e-90e9ce28dcc2"}], "key_name": "tempest-TestNetworkBasicOps-1090719220", "security_groups": [{"name": "tempest-secgroup-smoke-563495518"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:46.937659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] validate_networks() for [('70726c21-307d-4887-807e-90e9ce28dcc2', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:02:47.528873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:47.542453 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62c8241c-828b-4bba-9e92-f736063e5ed4 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 1.272309 Aug 23 11:02:47.543619 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2834/5693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:46 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:47.554617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:47.555474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:47.571084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:47.572646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:47.574857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:47.576065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:47.578537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:47.582739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:48.183225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:02:48.184521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:02:48.185258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:02:48.185943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:02:48.186525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:02:48.199973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:48.200810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:48.201527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:48.202635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:48.203446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:48.204087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:48.230940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for project ae502704266349bab5642ad154ea1085. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:02:48.239336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for user 4bb6e7d862d84e1c9f5d129b0c41bc37 and project ae502704266349bab5642ad154ea1085. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:02:48.240948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:48.252909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:48.256310 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0337efa3-df61-4cbd-a83c-7bac3517104b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1681 microversion: 2.1 time: 0.710740 Aug 23 11:02:48.258502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:02:48.261215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:02:48.269890 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2835/5694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:47 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1681 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:48.380063 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0995914e-d6db-4816-80a0-22160d2f0724 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.874146 Aug 23 11:02:48.389057 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2860/5695] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:02:48.394422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a52f6dfb-c90e-4528-99c0-fda5fb33d043 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:48.395300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a52f6dfb-c90e-4528-99c0-fda5fb33d043 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:48.520248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a52f6dfb-c90e-4528-99c0-fda5fb33d043 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:48.533172 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a52f6dfb-c90e-4528-99c0-fda5fb33d043 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1249 microversion: 2.1 time: 0.141320 Aug 23 11:02:48.543580 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2861/5696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:48 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1249 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:48.558297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e7acfe4a-7bec-4701-a12a-718ee017a614 req-8b7b3b44-9ac0-4487-b063-9dea6e07270b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f9b352-a877-47e1-8712-48bbb652d64e", "name": "network-vif-plugged", "status": "completed", "tag": "11de54b0-65b6-4055-a961-bb04ab373dd4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:48.580558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e7acfe4a-7bec-4701-a12a-718ee017a614 req-8b7b3b44-9ac0-4487-b063-9dea6e07270b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:48.581652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e7acfe4a-7bec-4701-a12a-718ee017a614 req-8b7b3b44-9ac0-4487-b063-9dea6e07270b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:48.583655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e7acfe4a-7bec-4701-a12a-718ee017a614 req-8b7b3b44-9ac0-4487-b063-9dea6e07270b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:48.601342 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e7acfe4a-7bec-4701-a12a-718ee017a614 req-8b7b3b44-9ac0-4487-b063-9dea6e07270b service nova] Creating event network-vif-plugged:11de54b0-65b6-4055-a961-bb04ab373dd4 for instance 25f9b352-a877-47e1-8712-48bbb652d64e on n-h1-847009-13 Aug 23 11:02:48.608116 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e7acfe4a-7bec-4701-a12a-718ee017a614 req-8b7b3b44-9ac0-4487-b063-9dea6e07270b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062721 Aug 23 11:02:48.610683 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2862/5697] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:48.620605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:48.621734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:48.630526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:48.631391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:48.632183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:48.635180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:48.635863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:48.636467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:48.846079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96b135bd-bfe3-4aff-928c-5a06d4ca7848 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-895159452", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:48.850226 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-96b135bd-bfe3-4aff-928c-5a06d4ca7848 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] HTTP exception thrown: min_count must be <= max_count Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96b135bd-bfe3-4aff-928c-5a06d4ca7848 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Request method failure captured: Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 183 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPXn_ZZWUZNpGY9DEq6MquDIVv4UOCfrQNdAUhyD150wiOca37902WnbRVCNgFEf_aQMWHVuFNS5t1cZnn1JRgZfdmAKdgBwBNb4Q3c8ICxnvJXnOdiOUiIL3YRoNnXswgHUCfrSYOU8UQr8yg6OqYDm4Rz_OP6l6dHpsvKVK6ilLs Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ffeaf52599442acb107a533113055bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ffeaf52599442acb107a533113055bd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}] Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 23d78a767e864fe68d2eaa000afba778 Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-895159452", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: exception: min_count must be <= max_count Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-895159452', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 23 11:02:48.852163 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:48.859728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96b135bd-bfe3-4aff-928c-5a06d4ca7848 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Returning 400 to user: min_count must be <= max_count {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:48.863997 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96b135bd-bfe3-4aff-928c-5a06d4ca7848 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.592914 Aug 23 11:02:48.871394 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2836/5698] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:48 2022] POST /compute/v2.1/servers => generated 74 bytes in 601 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 11:02:48.989226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00146ec9-972d-45c2-854b-c3ddfc448c80 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1527054282", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "max_count": 0}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00146ec9-972d-45c2-854b-c3ddfc448c80 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Request method failure captured: Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 168 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPXn_ZZWUZNpGY9DEq6MquDIVv4UOCfrQNdAUhyD150wiOca37902WnbRVCNgFEf_aQMWHVuFNS5t1cZnn1JRgZfdmAKdgBwBNb4Q3c8ICxnvJXnOdiOUiIL3YRoNnXswgHUCfrSYOU8UQr8yg6OqYDm4Rz_OP6l6dHpsvKVK6ilLs Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ffeaf52599442acb107a533113055bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ffeaf52599442acb107a533113055bd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}] Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 23d78a767e864fe68d2eaa000afba778 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1527054282", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "max_count": 0}} Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1527054282', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'max_count': 0}}} Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 0 Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:02:49.003124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 23 11:02:49.011385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.017769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00146ec9-972d-45c2-854b-c3ddfc448c80 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:49.017769 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00146ec9-972d-45c2-854b-c3ddfc448c80 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031732 Aug 23 11:02:49.021069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2837/5699] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:48 2022] POST /compute/v2.1/servers => generated 130 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:02:49.206185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:49.226571 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1f30d50-cf5f-458a-84f4-280da399968b tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 0.610904 Aug 23 11:02:49.228848 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2863/5700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:48 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:49.247635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86433cf0-4016-4ab4-8b38-32a5d9e3d1c2 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1253014180", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "max_count": 2.5}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86433cf0-4016-4ab4-8b38-32a5d9e3d1c2 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Request method failure captured: Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 170 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPXn_ZZWUZNpGY9DEq6MquDIVv4UOCfrQNdAUhyD150wiOca37902WnbRVCNgFEf_aQMWHVuFNS5t1cZnn1JRgZfdmAKdgBwBNb4Q3c8ICxnvJXnOdiOUiIL3YRoNnXswgHUCfrSYOU8UQr8yg6OqYDm4Rz_OP6l6dHpsvKVK6ilLs Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ffeaf52599442acb107a533113055bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ffeaf52599442acb107a533113055bd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}] Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 23d78a767e864fe68d2eaa000afba778 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1253014180", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "max_count": 2.5}} Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1253014180', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'max_count': 2.5}}} Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 2.5 Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:02:49.252088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86433cf0-4016-4ab4-8b38-32a5d9e3d1c2 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:49.264683 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86433cf0-4016-4ab4-8b38-32a5d9e3d1c2 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015661 Aug 23 11:02:49.275546 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2838/5701] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:02:49.289696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:49.290634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:49.293464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:49.312848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:49.313563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:49.314324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:49.317819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:49.318577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:49.319844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:49.384504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f7af6c2-11b8-492a-8ba4-f42d73c153b8 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1458162657", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 0}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f7af6c2-11b8-492a-8ba4-f42d73c153b8 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Request method failure captured: Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 168 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPXn_ZZWUZNpGY9DEq6MquDIVv4UOCfrQNdAUhyD150wiOca37902WnbRVCNgFEf_aQMWHVuFNS5t1cZnn1JRgZfdmAKdgBwBNb4Q3c8ICxnvJXnOdiOUiIL3YRoNnXswgHUCfrSYOU8UQr8yg6OqYDm4Rz_OP6l6dHpsvKVK6ilLs Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ffeaf52599442acb107a533113055bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ffeaf52599442acb107a533113055bd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}] Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 23d78a767e864fe68d2eaa000afba778 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1458162657", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 0}} Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1458162657', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'min_count': 0}}} Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 0 Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:02:49.388539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f7af6c2-11b8-492a-8ba4-f42d73c153b8 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:49.393919 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f7af6c2-11b8-492a-8ba4-f42d73c153b8 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012358 Aug 23 11:02:49.407908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2839/5702] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:49 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:02:49.476771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c66d28e-05f2-4416-9516-4cc591bd68d6 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1309784359", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 2.5}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c66d28e-05f2-4416-9516-4cc591bd68d6 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Request method failure captured: Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 170 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPXn_ZZWUZNpGY9DEq6MquDIVv4UOCfrQNdAUhyD150wiOca37902WnbRVCNgFEf_aQMWHVuFNS5t1cZnn1JRgZfdmAKdgBwBNb4Q3c8ICxnvJXnOdiOUiIL3YRoNnXswgHUCfrSYOU8UQr8yg6OqYDm4Rz_OP6l6dHpsvKVK6ilLs Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ffeaf52599442acb107a533113055bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ffeaf52599442acb107a533113055bd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ffeaf52599442acb107a533113055bd"}]}] Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8ffeaf52599442acb107a533113055bd Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1712720307 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 23d78a767e864fe68d2eaa000afba778 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1712720307-project Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1309784359", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "min_count": 2.5}} Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1309784359', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'min_count': 2.5}}} Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 2.5 Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:02:49.484773 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c66d28e-05f2-4416-9516-4cc591bd68d6 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:49.492086 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c66d28e-05f2-4416-9516-4cc591bd68d6 tempest-MultipleCreateNegativeTestJSON-1712720307 tempest-MultipleCreateNegativeTestJSON-1712720307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013749 Aug 23 11:02:49.496997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2840/5703] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:02:49 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:02:49.557844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4687e8c4-9f3f-4478-85ac-388f9fee4ad3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:49.558581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4687e8c4-9f3f-4478-85ac-388f9fee4ad3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:49.682884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:49.693144 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db55b1d5-3252-4a7e-bbb3-7cc84090b5ce tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1614 microversion: 2.1 time: 0.407323 Aug 23 11:02:49.695190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4687e8c4-9f3f-4478-85ac-388f9fee4ad3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:49.696536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2864/5704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:49 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1614 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:49.708401 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4687e8c4-9f3f-4478-85ac-388f9fee4ad3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1249 microversion: 2.1 time: 0.157656 Aug 23 11:02:49.721396 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2841/5705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:49 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1249 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:50.252846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:50.258820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:50.272335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.273781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.277377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.279088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.279834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.280792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.475983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4df7460f-2fdd-46d5-9caa-37134ea3852c req-cf6c5d74-cf44-42bd-bc9a-cc6a586d6bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc", "name": "network-vif-deleted", "tag": "1d945058-11a0-4ffb-9d0e-8e871f7546eb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:50.523955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4df7460f-2fdd-46d5-9caa-37134ea3852c req-cf6c5d74-cf44-42bd-bc9a-cc6a586d6bd2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.527904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4df7460f-2fdd-46d5-9caa-37134ea3852c req-cf6c5d74-cf44-42bd-bc9a-cc6a586d6bd2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.529081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4df7460f-2fdd-46d5-9caa-37134ea3852c req-cf6c5d74-cf44-42bd-bc9a-cc6a586d6bd2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.597339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4df7460f-2fdd-46d5-9caa-37134ea3852c req-cf6c5d74-cf44-42bd-bc9a-cc6a586d6bd2 service nova] Creating event network-vif-deleted:1d945058-11a0-4ffb-9d0e-8e871f7546eb for instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc on n-h2-847009-13 Aug 23 11:02:50.605046 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4df7460f-2fdd-46d5-9caa-37134ea3852c req-cf6c5d74-cf44-42bd-bc9a-cc6a586d6bd2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136230 Aug 23 11:02:50.607094 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2842/5706] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:50.703911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:50.718862 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61315188-1f5d-4c09-b02c-ec1a04f98eb8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1316 microversion: 2.1 time: 0.470830 Aug 23 11:02:50.723970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:50.724697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:50.735543 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2865/5707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:50 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:50.741655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:50.743358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:50.746790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.747265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.747714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.748446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.748949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.749385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.751750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.752516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.753240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.754258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:50.754940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:50.755884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:50.947996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:50.971019 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b06d021-3c5a-4a42-851a-7d5e3ca7c9da tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1301 microversion: 2.1 time: 0.233237 Aug 23 11:02:50.990586 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2866/5708] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:50 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1301 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:51.173773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:51.183873 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0acd7cc-e44e-4b19-984c-c831702b7554 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 200 len: 1327 microversion: 2.1 time: 0.466748 Aug 23 11:02:51.191451 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2843/5709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:50 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 1327 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:51.748834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:51.749449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:51.768446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:51.769416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:51.770064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:51.770972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:51.775035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:51.775522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.005247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.006007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:52.019365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.019876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.020327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.021083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.021632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.022041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.112994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:52.127123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a9333e1-d98e-4d8f-a8de-ea33fd9670af tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1503 microversion: 2.1 time: 0.382068 Aug 23 11:02:52.131984 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2867/5710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:51 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:52.158995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.159520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:52.175025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.177961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.181283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.184381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.188080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.189054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.257390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:52.269428 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3bdeab82-4c57-4309-adca-12c996afa06f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1307 microversion: 2.1 time: 0.272061 Aug 23 11:02:52.272972 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2844/5711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:51 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:52.318834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.319603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:52.340903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.345428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.349109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.350562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.359521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.360244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.412927 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:02:52.419351 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34016a8d-3044-4487-9b05-52bf0c095edc tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "DELETE /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.266870 Aug 23 11:02:52.420001 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2868/5712] 10.222.0.78 () {58 vars in 1296 bytes} [Tue Aug 23 11:02:52 2022] DELETE /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e/os-server-password => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc HTTP/1.1 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc'} Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:02:52.422088 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:02:52.427925 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:02:52.432335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:02:52.433961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64e9a586-7d06-4927-9729-49ceff5055dc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 404 len: 111 microversion: 2.1 time: 0.159976 Aug 23 11:02:52.435410 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2845/5713] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:52 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:02:52.448956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.449969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:52.452791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2136247f-79cd-47d1-850c-b877335e018c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '.version_select at 0x7fdc8fe56c10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.469225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.470710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.472552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.474182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.475955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.477803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.508197 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2136247f-79cd-47d1-850c-b877335e018c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292278941" status: 202 len: 0 microversion: 2.1 time: 0.067818 Aug 23 11:02:52.512705 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2846/5714] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 11:02:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292278941 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:02:52.541275 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-783410d4-5252-4f9d-a616-b73290c0f1d6 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.111453 Aug 23 11:02:52.542673 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2869/5715] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Aug 23 11:02:52 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e/os-server-password => generated 16 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:02:52.557399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.557929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:52.580701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.582683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.583580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.585735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.586830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.588043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.650869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:02:52.893391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f1d13fc-6b4f-440d-8e95-cc63615d61b8 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "DELETE /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 204 len: 0 microversion: 2.1 time: 0.342924 Aug 23 11:02:52.897347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2847/5716] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:02:52 2022] DELETE /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:02:52.903928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:52.905561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:52.926216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.930107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.931288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:52.933498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:52.934940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:52.937291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:53.300698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:53.302133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:53.307663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:53.342691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:53.342691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:53.342913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:53.343505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:53.346288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:53.346737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:53.542098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:53.546526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:53.554002 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7985135-baf4-4850-8779-fcda3514a254 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1509 microversion: 2.1 time: 0.654948 Aug 23 11:02:53.555022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2870/5717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:52 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1509 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:53.568389 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14c6f0ba-7d49-4b26-834e-7888792a57c3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1307 microversion: 2.1 time: 0.274216 Aug 23 11:02:53.569491 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2848/5718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:53 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:54.611581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:54.612375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:54.613143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:54.617672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:54.633524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:54.635967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:54.636467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:54.638438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:54.639368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:54.640084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:54.642227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:54.645326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:54.645611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:54.646325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:54.646971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:54.647657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:55.301420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:55.315059 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8904762f-50b0-437f-819f-eea987d247ba tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 0.715930 Aug 23 11:02:55.315860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2871/5719] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:54 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:55.496564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:55.519004 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d96cb36-862f-4731-bf4c-3c12753d6c0c tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1509 microversion: 2.1 time: 0.916126 Aug 23 11:02:55.519931 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2849/5720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:54 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1509 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:56.068665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:56.069290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:56.089996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.090522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.090990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.091723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.101618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.102087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.319563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lazy-loading 'services' on Instance uuid 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:02:56.335622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:56.336317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:56.350062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.350578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.351024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.358193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.358716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.359425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.471553 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b2be51a-db3e-4177-b594-09fb71df1f8a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments/b6cb6817-ddee-4c84-b059-e85983233657" status: 202 len: 0 microversion: 2.1 time: 0.406742 Aug 23 11:02:56.474634 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2872/5721] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:02:56 2022] DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments/b6cb6817-ddee-4c84-b059-e85983233657 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:02:56.486278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:56.493510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:56.507040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.510593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.511394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.514143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.517968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.518705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.608510 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ab92115f-8d01-499b-82ee-cbf0828a3be5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130696 Aug 23 11:02:56.613437 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2873/5722] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:02:56 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:56.629342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:56.633113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:56.655863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.656028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.658371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:56.661009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:56.664366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:56.665702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:57.265070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:57.275687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bcd8337-4f74-4fb9-85e2-ee7959625c43 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1509 microversion: 2.1 time: 0.659214 Aug 23 11:02:57.279885 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2874/5723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:56 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:57.630041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:57.636904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:57.651978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:57.653583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:57.660405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:57.661680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:57.662345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:57.663975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:57.730823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=6,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:57.763128 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6cfa79d2-862c-481a-81c3-19a4906910d1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140827 Aug 23 11:02:57.765222 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2875/5724] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:02:57 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:58.038043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:58.046925 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fd7e536-c6f2-48fc-a7d5-a3bc873e9951 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 1.715236 Aug 23 11:02:58.047512 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2850/5725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:56 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:02:58.302687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:58.303311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:58.306973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:58.345982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:58.346611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:58.348357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:58.350306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:58.352542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:58.354587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:58.530718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:58.778962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:58.781519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:58.807345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:58.807853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:58.808296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:58.809105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:58.809510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:58.809940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:58.956653 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72e79f3f-1b43-421e-8eae-999c4a2bbc3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183317 Aug 23 11:02:58.978082 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2851/5726] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:02:58 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:02:59.053321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df2e7627274b4086be532a0b4a9f28bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87d7e1ba3b94dfa80ee1a80ea643def', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:02:59.067770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:59.068391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:02:59.090175 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e0d533b-36cd-47cb-95a7-229a9ccc90d7 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 200 len: 1509 microversion: 2.1 time: 0.793130 Aug 23 11:02:59.090779 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2876/5727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:58 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 1509 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:02:59.110868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:59.113461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b48cca6f-bc4c-4069-8028-c454685b9afd req-be1b8cd8-1f16-467c-877d-35863495fffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25f9b352-a877-47e1-8712-48bbb652d64e", "name": "network-vif-deleted", "tag": "11de54b0-65b6-4055-a961-bb04ab373dd4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:02:59.116259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:59.119168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:59.120147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:59.120956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:59.124848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:59.162328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b48cca6f-bc4c-4069-8028-c454685b9afd req-be1b8cd8-1f16-467c-877d-35863495fffd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:02:59.162838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b48cca6f-bc4c-4069-8028-c454685b9afd req-be1b8cd8-1f16-467c-877d-35863495fffd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:02:59.163278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b48cca6f-bc4c-4069-8028-c454685b9afd req-be1b8cd8-1f16-467c-877d-35863495fffd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:02:59.209807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b48cca6f-bc4c-4069-8028-c454685b9afd req-be1b8cd8-1f16-467c-877d-35863495fffd service nova] Creating event network-vif-deleted:11de54b0-65b6-4055-a961-bb04ab373dd4 for instance 25f9b352-a877-47e1-8712-48bbb652d64e on n-h1-847009-13 Aug 23 11:02:59.231362 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b48cca6f-bc4c-4069-8028-c454685b9afd req-be1b8cd8-1f16-467c-877d-35863495fffd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123497 Aug 23 11:02:59.234899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2877/5728] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:02:59.701069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:02:59.991286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:02:59.994113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:00.018645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:00.019433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:00.029081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:00.030157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:00.031904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:00.033548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:00.096690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0cbfde72-48d9-4375-9cf9-a6224cbb57a9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110297 Aug 23 11:03:00.099564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2878/5729] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:02:59 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:00.112155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:00.114974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] [instance: 25f9b352-a877-47e1-8712-48bbb652d64e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:00.126920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:00.129849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:00.130870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:00.134504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:00.135281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:00.135959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:00.175387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] HTTP exception thrown: Instance 25f9b352-a877-47e1-8712-48bbb652d64e could not be found. Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Request method failure captured: Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e HTTP/1.1 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLPAZ48J18Hu-W28ZAK67RI83dk9B8LCdMuT2xHvzHfOiRhXCGnNCOrr2WMNQfFCnVQOvQ24zqNXrqqxloLE_1bTDB137Ewb0AmroGV_CsyqXF-REllZDpXWNxS4X18HCXDIPwP2FR46ANGOB-qsjcgCZ8BjAoFD9vz4pK5XiQI0D4A Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b87d7e1ba3b94dfa80ee1a80ea643def Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerPasswordTestJSON-1473706555 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b87d7e1ba3b94dfa80ee1a80ea643def"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b87d7e1ba3b94dfa80ee1a80ea643def", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b87d7e1ba3b94dfa80ee1a80ea643def"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b87d7e1ba3b94dfa80ee1a80ea643def"}]}] Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerPasswordTestJSON-1473706555 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b87d7e1ba3b94dfa80ee1a80ea643def Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1473706555 Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerPasswordTestJSON-1473706555-project Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: df2e7627274b4086be532a0b4a9f28bc Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerPasswordTestJSON-1473706555-project Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 25f9b352-a877-47e1-8712-48bbb652d64e could not be found. Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '25f9b352-a877-47e1-8712-48bbb652d64e'} Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25f9b352-a877-47e1-8712-48bbb652d64e could not be found. Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25f9b352-a877-47e1-8712-48bbb652d64e could not be found. Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:00.178738 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25f9b352-a877-47e1-8712-48bbb652d64e could not be found. Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] Returning 404 to user: Instance 25f9b352-a877-47e1-8712-48bbb652d64e could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:00.186514 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66f7d3a3-c811-402e-a921-f5e8f3c6c090 tempest-ServerPasswordTestJSON-1473706555 tempest-ServerPasswordTestJSON-1473706555-project] 10.222.0.78 "GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e" status: 404 len: 111 microversion: 2.1 time: 0.076994 Aug 23 11:03:00.189895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2879/5730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:00 2022] GET /compute/v2.1/servers/25f9b352-a877-47e1-8712-48bbb652d64e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:03:00.814444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:00.829196 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46842e29-1040-40ca-b220-ea1d09a568e3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 1.765259 Aug 23 11:03:00.830369 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2852/5731] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:02:59 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:01.110401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:01.113542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:01.130702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:01.131404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:01.131970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:01.136308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:01.136979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:01.137561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:01.211233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5824c2fa-ee7f-4b75-b3ab-f14964a3f815 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101825 Aug 23 11:03:01.218827 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2880/5732] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:03:01 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:01.292687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2707b523-0618-46de-8384-96ba34c30500 req-5f94a469-a513-484a-929d-701794e74d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1061bf-b1bf-4476-93fc-cc6f7e628566", "tag": "4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:01.307201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2707b523-0618-46de-8384-96ba34c30500 req-5f94a469-a513-484a-929d-701794e74d29 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:01.308396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2707b523-0618-46de-8384-96ba34c30500 req-5f94a469-a513-484a-929d-701794e74d29 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:01.309083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2707b523-0618-46de-8384-96ba34c30500 req-5f94a469-a513-484a-929d-701794e74d29 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:01.328813 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2707b523-0618-46de-8384-96ba34c30500 req-5f94a469-a513-484a-929d-701794e74d29 service nova] Creating event network-changed:4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace for instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 on n-h2-847009-13 Aug 23 11:03:01.336244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2707b523-0618-46de-8384-96ba34c30500 req-5f94a469-a513-484a-929d-701794e74d29 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055492 Aug 23 11:03:01.338438 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2853/5733] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:01.853115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:01.854407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:01.885431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:01.887206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:01.888052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:01.889607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:01.890330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:01.891051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:02.228608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:02.231390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:02.246866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:02.247320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:02.256275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:02.257201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:02.257700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:02.258147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:02.353058 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17e8d80c-2a29-4517-b3c2-165ca1dd353e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129083 Aug 23 11:03:02.356068 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2854/5734] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:03:02 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:03.287125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:03.299572 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dff0f857-4790-409b-9e72-d7df5344fceb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 1.451821 Aug 23 11:03:03.303547 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2881/5735] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:01 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:03.366153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:03.369590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:03.386644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:03.387389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:03.388011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:03.388963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:03.390170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:03.398303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:03.443756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94d44c28-d634-4f60-b176-5748940a2a80 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082630 Aug 23 11:03:03.451159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2855/5736] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:03:03 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:04.331366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:04.331966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:04.357074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:04.357582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:04.358031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:04.361555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:04.362324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:04.367650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:04.459379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:04.463192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:04.495339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:04.496308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:04.499044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:04.500895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:04.501582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:04.502200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:04.573634 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a65cd0c1-6849-45af-8587-3d7db2801d31 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118923 Aug 23 11:03:04.595586 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2856/5737] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:03:04 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:04.911995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:04.940625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e816ac0-b890-49bc-996d-00ea15d3601e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 0.603570 Aug 23 11:03:04.943283 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2882/5738] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:04 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:05.601503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:05.605186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:05.622972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:05.626133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:05.630626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:05.632569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:05.635490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:05.636415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:05.725654 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e8e4e862-150f-4eba-a015-d8680f948edc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141770 Aug 23 11:03:05.734088 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2857/5739] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:03:05 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:05.969344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:05.972848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:06.016252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:06.019831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:06.020581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:06.021694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:06.023361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:06.026065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:06.521952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:06.533792 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24ddd2a0-ab17-49d4-a5d3-eab652d2a789 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 0.572593 Aug 23 11:03:06.547513 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2883/5740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:05 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:06.742313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:06.745682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:06.764086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:06.765562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:06.767586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:06.769833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:06.770594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:06.771921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:06.825586 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4cbf07c8-0612-4132-89f1-1ee2cfc35fd5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089226 Aug 23 11:03:06.826854 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2858/5741] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:03:06 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:03:06.944297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:06.947414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:06.956236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:06.956669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:06.957148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:06.957926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:06.958595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:06.959216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:06.996959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:03:07.154568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c8c9968c-f30f-46c7-8b12-667e49da52a6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 204 len: 0 microversion: 2.1 time: 0.213524 Aug 23 11:03:07.157474 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2884/5742] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:03:06 2022] DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:03:07.169445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:07.171458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:07.180876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:07.182210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:07.183017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:07.185032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:07.186159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:07.188370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:07.559164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:07.560892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:07.589559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:07.590147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:07.592271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:07.596574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:07.597125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:07.599850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:08.348093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:08.350708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:08.366258 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97582a44-0b59-451d-b9c1-8d0d20cb60fd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1681 microversion: 2.1 time: 1.202332 Aug 23 11:03:08.366875 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2859/5743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:07 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1681 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:08.523575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:08.537558 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c6ae5f9c-1b8e-4a51-86b1-93d274ef3824 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 0.985812 Aug 23 11:03:08.538485 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2885/5744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:07 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:09.395425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:09.398141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:09.413491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:09.416686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:09.417459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:09.419659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:09.420712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:09.422659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:09.569534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:09.570162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:09.586923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:09.593334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:09.593902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:09.595528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:09.596025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:09.596473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:09.932301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:09.943644 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-53b9c9e7-b700-45ad-87c7-684f9bce4a13 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1681 microversion: 2.1 time: 0.559148 Aug 23 11:03:09.944243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2860/5745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:09 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1681 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:10.175045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:10.201621 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ec6c9c9-8245-497c-9585-7f211dd31478 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 0.635138 Aug 23 11:03:10.203951 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2886/5746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:09 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:10.587093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e42dd458-5aa6-4012-8f58-aff1f4d379fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'create', calling method: .version_select at 0x7fdc8fe2cc10>, body: {"keypair": {"name": "tempest-keypair-1384415811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzmipXD8f6bKF94N0uo5LKdMeEFziMj9JpFCII5eNRca60G6cNUjJWjYXqkw9Sk9dvf7qTYV+8oqMj06DRGlcGw0ngqiUN3IO4ltG0bd+Pzuqk+R3nN6kYy06LMdazPbQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:10.609038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e42dd458-5aa6-4012-8f58-aff1f4d379fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for project 7bc56160173245b48e2299234369f3ca. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:10.616017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e42dd458-5aa6-4012-8f58-aff1f4d379fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for user a3e6281c3d024d9b8c9a27bb5144860b and project 7bc56160173245b48e2299234369f3ca. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:10.647466 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e42dd458-5aa6-4012-8f58-aff1f4d379fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.699773 Aug 23 11:03:10.648518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2861/5747] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 11:03:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 701 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 11:03:10.974379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:10.981813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:11.018272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:11.021935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:11.029765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:11.033729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:11.037102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:11.040143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:11.229169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:11.230144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:11.263701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:11.274690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:11.276452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:11.279888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:11.283744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:11.292223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:11.884303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:11.913599 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff52d11c-7c69-4514-9c19-3d32347757ba tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1681 microversion: 2.1 time: 0.944663 Aug 23 11:03:11.916589 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2887/5748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:10 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1681 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:11.941329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1299322496", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "33fa07f0-71ba-47ac-afae-5d8c5383aa16"}], "key_name": "tempest-TestNetworkAdvancedServerOps-577587505", "security_groups": [{"name": "tempest-secgroup-smoke-166574481"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:12.171859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:12.185870 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-745df309-f52e-450f-9f33-c827051fed2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 0.963429 Aug 23 11:03:12.200864 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2862/5749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:11 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:12.371483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] validate_networks() for [('33fa07f0-71ba-47ac-afae-5d8c5383aa16', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:03:12.677403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d1800416-1907-4f95-9be8-d13294f796a4 req-1994c6c9-073c-42dc-9dfd-e46ef79ddcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1061bf-b1bf-4476-93fc-cc6f7e628566", "name": "network-vif-plugged", "status": "completed", "tag": "4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:12.704136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1800416-1907-4f95-9be8-d13294f796a4 req-1994c6c9-073c-42dc-9dfd-e46ef79ddcbe service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:12.706780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1800416-1907-4f95-9be8-d13294f796a4 req-1994c6c9-073c-42dc-9dfd-e46ef79ddcbe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:12.708179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d1800416-1907-4f95-9be8-d13294f796a4 req-1994c6c9-073c-42dc-9dfd-e46ef79ddcbe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:12.739015 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d1800416-1907-4f95-9be8-d13294f796a4 req-1994c6c9-073c-42dc-9dfd-e46ef79ddcbe service nova] Creating event network-vif-plugged:4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace for instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 on n-h2-847009-13 Aug 23 11:03:12.753534 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d1800416-1907-4f95-9be8-d13294f796a4 req-1994c6c9-073c-42dc-9dfd-e46ef79ddcbe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.547355 Aug 23 11:03:12.755446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2863/5750] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:12.936687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:12.937477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:12.958209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:12.958760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:12.959217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:12.959980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:12.960451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:12.966104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:13.543150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:13.557402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90fc24f5-f8e5-4e0e-b775-d07592c03a76 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1613 microversion: 2.1 time: 0.625590 Aug 23 11:03:13.558019 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2864/5751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:12 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1613 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:13.580257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:13.581292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:13.607207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:13.607731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:13.608193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:13.609292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:13.618219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:13.618891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:14.984716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:15.011076 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-120517ca-e0fb-4c9a-b0f8-128569aa1afd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1374 microversion: 2.1 time: 1.440047 Aug 23 11:03:15.012175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2865/5752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:13 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1374 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:15.033080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:15.033723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:15.067235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:15.067837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:15.076509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:15.077409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:15.077905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:15.079951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:15.433892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:15.455977 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3bc6c10-9428-4a0c-8f27-f8328e792826 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1613 microversion: 2.1 time: 0.428785 Aug 23 11:03:15.457000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2866/5753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:15 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1613 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:16.043219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:16.044723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:16.054441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:16.055669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:16.057039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:16.058321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:16.059450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:16.060153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:16.121558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:03:16.123110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:03:16.123727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:03:16.124306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:03:16.125418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:03:16.166878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:16.167712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:16.168289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:16.169763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:16.170235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:16.170801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:16.219837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:16.229286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:16.254165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:03:16.257093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:03:16.381518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0ab96114-0a31-4fb5-96f1-0b7004e4544c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.458942 Aug 23 11:03:16.382194 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2888/5754] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:03:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 4465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:03:16.396071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-faed1573-966e-445e-b607-40ab7d08d410 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:16.398102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-faed1573-966e-445e-b607-40ab7d08d410 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:16.670233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-faed1573-966e-445e-b607-40ab7d08d410 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:16.679173 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-faed1573-966e-445e-b607-40ab7d08d410 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1266 microversion: 2.1 time: 0.287375 Aug 23 11:03:16.683625 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2889/5755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:16 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:16.688258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:16.697223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:16.715030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:16.715542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:16.715992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:16.716714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:16.717204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:16.720888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:17.251194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:17.282450 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d899ebf-cf9e-488e-be60-56268e79c6b3 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1546 microversion: 2.1 time: 1.249263 Aug 23 11:03:17.285718 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2867/5756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:16 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1546 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:17.313394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ae16e8af-fedb-4224-998f-a5eb1e69dcf6 req-61d927c1-6a8e-43d5-8edb-74facf7c225f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7", "name": "network-vif-deleted", "tag": "0bf1932a-8dea-4b17-8c39-6ac30d081cdc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:17.344987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ae16e8af-fedb-4224-998f-a5eb1e69dcf6 req-61d927c1-6a8e-43d5-8edb-74facf7c225f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:17.350944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ae16e8af-fedb-4224-998f-a5eb1e69dcf6 req-61d927c1-6a8e-43d5-8edb-74facf7c225f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:17.352538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ae16e8af-fedb-4224-998f-a5eb1e69dcf6 req-61d927c1-6a8e-43d5-8edb-74facf7c225f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:17.393286 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ae16e8af-fedb-4224-998f-a5eb1e69dcf6 req-61d927c1-6a8e-43d5-8edb-74facf7c225f service nova] Creating event network-vif-deleted:0bf1932a-8dea-4b17-8c39-6ac30d081cdc for instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 on n-h1-847009-13 Aug 23 11:03:17.411434 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ae16e8af-fedb-4224-998f-a5eb1e69dcf6 req-61d927c1-6a8e-43d5-8edb-74facf7c225f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122330 Aug 23 11:03:17.419679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2868/5757] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:17.432504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:17.438437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:17.471578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:17.472096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:17.479367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:17.483288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:17.490432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:17.491218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:18.153749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:18.162795 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e779ecb-058f-4d3c-b76e-8bd87a200e3a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 200 len: 1613 microversion: 2.1 time: 1.478257 Aug 23 11:03:18.163390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2890/5758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:16 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 1613 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:18.177375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:18.185911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:18.202761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:18.203551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:18.204323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:18.206949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:18.207659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:18.208435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:18.303787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:18.326466 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fe722daf-3c34-4f98-95ee-1919afc83a3b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1546 microversion: 2.1 time: 0.900475 Aug 23 11:03:18.328408 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2869/5759] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:17 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1546 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:18.379841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:18.398541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b457852-aa20-417c-9951-ff5f97d09b06 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1318 microversion: 2.1 time: 0.220744 Aug 23 11:03:18.400424 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2891/5760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:18 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:19.191716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:19.194377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:19.217101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:19.221052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:19.221555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:19.224220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:19.232381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:19.233608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:19.304834 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 HTTP/1.1 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7'} Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:19.312803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:19.318586 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71f01e74-78b3-44b8-8448-bc2b767826c4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 404 len: 111 microversion: 2.1 time: 0.132899 Aug 23 11:03:19.323909 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2870/5761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:19 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:03:19.332548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ca56e16-8697-47e5-9a6e-eb19c506d4f0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '.version_select at 0x7fdca1e91ca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:19.379408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:19.406140 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ca56e16-8697-47e5-9a6e-eb19c506d4f0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851050213" status: 202 len: 0 microversion: 2.1 time: 0.082517 Aug 23 11:03:19.408442 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2892/5762] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 11:03:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851050213 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:03:19.423582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:19.427937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:19.443765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:19.446208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:19.450134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:19.451743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:19.455194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:19.458623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:19.599301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-331706352", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7904eec5-c643-4bed-81b4-8d45cd129858"}], "security_groups": [{"name": "tempest-securitygroup--1488622059"}], "key_name": "tempest-keypair-1384415811", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:19.968459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] validate_networks() for [('7904eec5-c643-4bed-81b4-8d45cd129858', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:03:20.130359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:20.146736 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e06c7d2-9fd4-49ab-a2ff-0ffba01a2b0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1324 microversion: 2.1 time: 0.728433 Aug 23 11:03:20.155313 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2871/5763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:19 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1324 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:20.916166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:21.212452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-813434717", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "28e7aafa-4c93-46ba-af89-26e5bb1ad0fa"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:21.363992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:03:21.369595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:03:21.371948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:03:21.372627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:03:21.373996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:03:21.384025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] validate_networks() for [('28e7aafa-4c93-46ba-af89-26e5bb1ad0fa', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:03:21.397136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:21.397940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:21.402719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:21.405582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:21.406834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:21.408537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:21.460867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for project 7bc56160173245b48e2299234369f3ca. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:21.475418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for user a3e6281c3d024d9b8c9a27bb5144860b and project 7bc56160173245b48e2299234369f3ca. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:21.510196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:03:21.514425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:03:21.661687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-288839bc-abd4-45e6-9235-ab260e79398b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.060951 Aug 23 11:03:21.683941 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2893/5764] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 11:03:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 11:03:21.702351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:21.703536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:21.725910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:21.730444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:21.731214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:21.732500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:21.733546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:21.736072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:21.903093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:21.922477 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ce285b3-6206-42ce-b886-b95d0c660f72 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1324 microversion: 2.1 time: 0.239196 Aug 23 11:03:21.924570 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2894/5765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:21 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:21.985677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fef5978-b3a5-4c85-8288-e93608ec54de tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:21.988806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0fef5978-b3a5-4c85-8288-e93608ec54de tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:22.166017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0fef5978-b3a5-4c85-8288-e93608ec54de tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:22.181346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0fef5978-b3a5-4c85-8288-e93608ec54de tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:22.185439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0fef5978-b3a5-4c85-8288-e93608ec54de tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:22.189698 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0fef5978-b3a5-4c85-8288-e93608ec54de tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1281 microversion: 2.20 time: 0.263566 Aug 23 11:03:22.191796 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2895/5766] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:21 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:22.948451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:22.950521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:22.994081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:22.995365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:22.998448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:23.001564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:23.005750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:23.006949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:23.026467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:23.761310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:23.775684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47689ebd-6b96-4ebc-be99-969ad096479d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.832741 Aug 23 11:03:23.778660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2896/5767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:22 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:23.794701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b4b644a-1d29-40b1-847f-a7adc3c54dda tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: .version_select at 0x7fdc9cc423a0>, body: {"keypair": {"name": "tempest-keypair-219460688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ6jwK5F3lbC2WN/nG4N2rDDlm3Dwl07zhhWw6DENal693pwr+vmDbM4OaCufuX6g7ERSluyusQT/6uYxwb/OkI1S+h8RilzPD93a/be5CGBgmydFTobVcJfscM84leNA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:23.829486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5b4b644a-1d29-40b1-847f-a7adc3c54dda tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:23.835856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5b4b644a-1d29-40b1-847f-a7adc3c54dda tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:23.876067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b4b644a-1d29-40b1-847f-a7adc3c54dda tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095431 Aug 23 11:03:23.879412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2897/5768] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:03:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:23.916641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:23.917642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:23.933222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:23.935746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:23.938033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:23.940369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:23.941211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:23.943155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:24.171633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:24.201140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:24.204465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:24.206238 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb3385ea-f008-4c01-ab7f-e71fd35b52eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1333 microversion: 2.20 time: 0.325187 Aug 23 11:03:24.207941 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2898/5769] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:23 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:24.800250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:24.801149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:24.812820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:24.814761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:24.816471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:24.817479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:24.819091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:24.821922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:25.108152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:25.120714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0204e2ce-e7c4-4e33-be63-555ffb1257e6 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.321442 Aug 23 11:03:25.121385 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2899/5770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:24 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:25.392985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:03:25.394367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:03:25.395483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:03:25.396168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:03:25.397863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:03:25.401279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:25.422031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:25.422542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:25.422992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:25.423741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:25.424210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:25.430298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:25.469476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Getting quotas for project 16cb52db86b841a0b4c6f1b72defc881. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:25.476049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Getting quotas for user c00f0329c54f48f38cea51a846e863cc and project 16cb52db86b841a0b4c6f1b72defc881. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:25.498836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:03:25.501581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:03:25.587875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9dc6b4f-0bb9-4fca-b01c-e57dbb376fe8 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.677093 Aug 23 11:03:25.589112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2872/5771] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:03:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:03:25.607464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:25.609834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:25.638699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd4d80c0-90c7-453d-b274-a7468307ae40 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Action: 'create', calling method: .version_select at 0x7fdc9cc4e940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037714195", "metadata": {"Type": "work"}}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd4d80c0-90c7-453d-b274-a7468307ae40 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Request method failure captured: Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 122 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLP8X29-gPvBR5do02V2fXguUmig5jdqHigSf63Mqm8ykeiuYXQyOOvdgByZ5XA7oqgy-iWTlxGDQk8sOa-kb23LVGZ6U4b-dLjk_c4fpYjNFMwVqN5asI1l7RR1aL4h6V7BBINeuZE0AOvJMmUSpgmt99OnRW5NBmNUCNibfQxwRc4 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9239cd7913304060a30e52d98a12bf6d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}] Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cb21a71477c241b6b8cdfcca2ea96d90 Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037714195", "metadata": {"Type": "work"}}} Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037714195', 'metadata': {'Type': 'work'}}}} Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:03:25.647923 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 11:03:25.658409 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.660072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:25.660072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:25.660457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd4d80c0-90c7-453d-b274-a7468307ae40 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:25.660690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:25.660690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:25.661059 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd4d80c0-90c7-453d-b274-a7468307ae40 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.532246 Aug 23 11:03:25.661059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2900/5772] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 23 11:03:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 536 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:03:25.663835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:25.665266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:25.668537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a699ef1c-cf0b-4016-9333-86f403e4e011 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:25.677436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a699ef1c-cf0b-4016-9333-86f403e4e011 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:25.839007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a699ef1c-cf0b-4016-9333-86f403e4e011 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:25.862945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a699ef1c-cf0b-4016-9333-86f403e4e011 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1216 microversion: 2.1 time: 0.198491 Aug 23 11:03:25.872910 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2901/5773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:25 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:25.885367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c22ff24e-c9c1-4d57-bd06-4270898156cd tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Action: 'create', calling method: .version_select at 0x7fdc9cdf5550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-274194393", "metadata": {"Type": "work"}}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c22ff24e-c9c1-4d57-bd06-4270898156cd tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Request method failure captured: Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 119 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLP8X29-gPvBR5do02V2fXguUmig5jdqHigSf63Mqm8ykeiuYXQyOOvdgByZ5XA7oqgy-iWTlxGDQk8sOa-kb23LVGZ6U4b-dLjk_c4fpYjNFMwVqN5asI1l7RR1aL4h6V7BBINeuZE0AOvJMmUSpgmt99OnRW5NBmNUCNibfQxwRc4 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9239cd7913304060a30e52d98a12bf6d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}] Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cb21a71477c241b6b8cdfcca2ea96d90 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-274194393", "metadata": {"Type": "work"}}} Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-274194393', 'metadata': {'Type': 'work'}}}} Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '0' Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:03:25.891404 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 11:03:25.897125 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.902138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c22ff24e-c9c1-4d57-bd06-4270898156cd tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:25.902138 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c22ff24e-c9c1-4d57-bd06-4270898156cd tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026874 Aug 23 11:03:25.904915 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2902/5774] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 23 11:03:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:03:25.922510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5642f3d6-271b-4a21-a1bf-5dd6256fca2e tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Action: 'create', calling method: .version_select at 0x7fdc9d33e550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2126237152", "metadata": {"Type": "work"}}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5642f3d6-271b-4a21-a1bf-5dd6256fca2e tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Request method failure captured: Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 119 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLP8X29-gPvBR5do02V2fXguUmig5jdqHigSf63Mqm8ykeiuYXQyOOvdgByZ5XA7oqgy-iWTlxGDQk8sOa-kb23LVGZ6U4b-dLjk_c4fpYjNFMwVqN5asI1l7RR1aL4h6V7BBINeuZE0AOvJMmUSpgmt99OnRW5NBmNUCNibfQxwRc4 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9239cd7913304060a30e52d98a12bf6d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}] Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cb21a71477c241b6b8cdfcca2ea96d90 Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2126237152", "metadata": {"Type": "work"}}} Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2126237152', 'metadata': {'Type': 'work'}}}} Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '' Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:03:25.926765 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 11:03:25.933381 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:25.936435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5642f3d6-271b-4a21-a1bf-5dd6256fca2e tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:25.937035 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5642f3d6-271b-4a21-a1bf-5dd6256fca2e tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027248 Aug 23 11:03:25.938342 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2903/5775] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 23 11:03:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:03:25.942588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:25.959519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:25.964221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e4093ee-7a3b-4179-a0c3-d5e78a422eb4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Calling method '.version_select at 0x7fdc9c5988b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:25.964856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:25.969702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-458aff08-fa4e-4f7b-98b8-808c0108f782 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1339 microversion: 2.20 time: 0.376550 Aug 23 11:03:25.970980 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2873/5776] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:25 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1339 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:26.013081 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-9e4093ee-7a3b-4179-a0c3-d5e78a422eb4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] HTTP exception thrown: Volume tempest-invalid-736800637 could not be found. Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e4093ee-7a3b-4179-a0c3-d5e78a422eb4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Request method failure captured: Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-736800637 HTTP/1.1 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLP8X29-gPvBR5do02V2fXguUmig5jdqHigSf63Mqm8ykeiuYXQyOOvdgByZ5XA7oqgy-iWTlxGDQk8sOa-kb23LVGZ6U4b-dLjk_c4fpYjNFMwVqN5asI1l7RR1aL4h6V7BBINeuZE0AOvJMmUSpgmt99OnRW5NBmNUCNibfQxwRc4 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9239cd7913304060a30e52d98a12bf6d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}] Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: cb21a71477c241b6b8cdfcca2ea96d90 Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: exception: Volume tempest-invalid-736800637 could not be found. Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'tempest-invalid-736800637'} Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-736800637 could not be found. (HTTP 404) (Request-ID: req-ee7d6ed1-3486-4b49-82f9-cabaabaa6f3f) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:03:26.015458 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-736800637 could not be found. Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-736800637 could not be found. Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-736800637 could not be found. Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e4093ee-7a3b-4179-a0c3-d5e78a422eb4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Returning 404 to user: Volume tempest-invalid-736800637 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e4093ee-7a3b-4179-a0c3-d5e78a422eb4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-736800637" status: 404 len: 98 microversion: 2.1 time: 0.066538 Aug 23 11:03:26.020257 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2904/5777] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Aug 23 11:03:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-736800637 => generated 98 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 11:03:26.038022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b32b2e1-b0be-4ceb-98dd-9632a345422e tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010491 Aug 23 11:03:26.039257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2874/5778] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 23 11:03:26 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 11:03:26.051038 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd5aa6d8-0664-4bfb-9752-3c41e9a5551f tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004152 Aug 23 11:03:26.052099 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2905/5779] 10.222.0.78 () {58 vars in 1137 bytes} [Tue Aug 23 11:03:26 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 11:03:26.063996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97e26832-52d0-4e9e-a1d8-028e65579ac4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Calling method '.version_select at 0x7fdc9cd21430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:26.121172 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-97e26832-52d0-4e9e-a1d8-028e65579ac4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] HTTP exception thrown: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97e26832-52d0-4e9e-a1d8-028e65579ac4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Request method failure captured: Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/os-volumes/ed172acb-a0ac-43be-bbe8-4780e9ea5288 HTTP/1.1 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLP8X29-gPvBR5do02V2fXguUmig5jdqHigSf63Mqm8ykeiuYXQyOOvdgByZ5XA7oqgy-iWTlxGDQk8sOa-kb23LVGZ6U4b-dLjk_c4fpYjNFMwVqN5asI1l7RR1aL4h6V7BBINeuZE0AOvJMmUSpgmt99OnRW5NBmNUCNibfQxwRc4 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9239cd7913304060a30e52d98a12bf6d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}] Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: cb21a71477c241b6b8cdfcca2ea96d90 Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: exception: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ed172acb-a0ac-43be-bbe8-4780e9ea5288'} Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. (HTTP 404) (Request-ID: req-906b955b-2144-4ad0-ae96-2c6c66c41a9d) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:03:26.126472 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. Aug 23 11:03:26.131634 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.138733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97e26832-52d0-4e9e-a1d8-028e65579ac4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Returning 404 to user: Volume ed172acb-a0ac-43be-bbe8-4780e9ea5288 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:26.138733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97e26832-52d0-4e9e-a1d8-028e65579ac4 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ed172acb-a0ac-43be-bbe8-4780e9ea5288" status: 404 len: 109 microversion: 2.1 time: 0.077201 Aug 23 11:03:26.140659 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2875/5780] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:03:26 2022] DELETE /compute/v2.1/os-volumes/ed172acb-a0ac-43be-bbe8-4780e9ea5288 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:03:26.159216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:26.159452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:26.181268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef550d4f-4145-4c99-a362-5ac1eabcb0c9 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Calling method '.version_select at 0x7fdc9cb2f160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:26.186922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:26.189388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:26.190315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:26.193574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:26.195963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:26.198462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:26.249118 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ef550d4f-4145-4c99-a362-5ac1eabcb0c9 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] HTTP exception thrown: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef550d4f-4145-4c99-a362-5ac1eabcb0c9 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Request method failure captured: Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-volumes/0ca85a8e-4dcc-4e59-b88f-0844bae69ddf HTTP/1.1 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLP8X29-gPvBR5do02V2fXguUmig5jdqHigSf63Mqm8ykeiuYXQyOOvdgByZ5XA7oqgy-iWTlxGDQk8sOa-kb23LVGZ6U4b-dLjk_c4fpYjNFMwVqN5asI1l7RR1aL4h6V7BBINeuZE0AOvJMmUSpgmt99OnRW5NBmNUCNibfQxwRc4 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9239cd7913304060a30e52d98a12bf6d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9239cd7913304060a30e52d98a12bf6d"}]}] Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 9239cd7913304060a30e52d98a12bf6d Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesNegativeTest-860201324 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: cb21a71477c241b6b8cdfcca2ea96d90 Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesNegativeTest-860201324-project Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: exception: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0ca85a8e-4dcc-4e59-b88f-0844bae69ddf'} Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. (HTTP 404) (Request-ID: req-69ac7920-c31d-4a40-b789-50041406f380) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:03:26.252182 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. Aug 23 11:03:26.257539 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:03:26.267861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef550d4f-4145-4c99-a362-5ac1eabcb0c9 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] Returning 404 to user: Volume 0ca85a8e-4dcc-4e59-b88f-0844bae69ddf could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:26.269765 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef550d4f-4145-4c99-a362-5ac1eabcb0c9 tempest-VolumesNegativeTest-860201324 tempest-VolumesNegativeTest-860201324-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/0ca85a8e-4dcc-4e59-b88f-0844bae69ddf" status: 404 len: 109 microversion: 2.1 time: 0.104249 Aug 23 11:03:26.271419 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2876/5781] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:03:26 2022] GET /compute/v2.1/os-volumes/0ca85a8e-4dcc-4e59-b88f-0844bae69ddf => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:03:26.888375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:26.890321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:26.909387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:26.913328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:26.915211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:26.918761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:27.003802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:27.003802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:27.294399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:27.314753 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5eee0383-62e6-4b2a-b1c4-15c02c5ecf96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1212 microversion: 2.1 time: 0.429849 Aug 23 11:03:27.315860 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2877/5782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:26 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1212 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:27.327255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:27.343267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:27.346778 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bf43360e-eaad-4352-aa75-b2168951ae47 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 1.204213 Aug 23 11:03:27.346908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2906/5783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:26 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:27.349825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:27.374998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:27.377175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:27.379173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:27.384280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:27.384280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:27.384280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:27.603696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:27.614989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:27.616787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:27.618443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-42cbac04-4897-4a46-bc51-493b16fca637 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1339 microversion: 2.20 time: 0.301239 Aug 23 11:03:27.619797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2878/5784] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:27 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:28.345165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:28.347411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:28.365202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:28.365971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:28.367394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:28.368913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:28.369663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:28.370542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:28.372175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:28.373219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:28.387698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:28.388219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:28.388682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:28.390858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:28.391883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:28.394435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:28.499940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:28.513282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a43d1d5e-bcbf-4c22-bc1d-2a98919f158d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1274 microversion: 2.1 time: 0.173829 Aug 23 11:03:28.527833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2907/5785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:28 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:28.643268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:28.645751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:28.653200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:28.653996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:28.655222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:28.656140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:28.657271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:28.657909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:28.803495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:28.833170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:28.838545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:28.842084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2cbedb41-7aea-4c05-8174-9ec8cf18d990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1339 microversion: 2.20 time: 0.201975 Aug 23 11:03:28.845163 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2908/5786] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:28 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1339 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:03:29.093822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:29.106509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5f32ffb-c98a-451b-8c81-bab132f160ff tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.741209 Aug 23 11:03:29.107959 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2879/5787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:28 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:29.456827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d4271ca2-8c22-44e0-ad2d-013a1ffabb7b req-75d61477-9b15-4f86-a70f-bd83bff00582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:29.471602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4271ca2-8c22-44e0-ad2d-013a1ffabb7b req-75d61477-9b15-4f86-a70f-bd83bff00582 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:29.472238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4271ca2-8c22-44e0-ad2d-013a1ffabb7b req-75d61477-9b15-4f86-a70f-bd83bff00582 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:29.472687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4271ca2-8c22-44e0-ad2d-013a1ffabb7b req-75d61477-9b15-4f86-a70f-bd83bff00582 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:29.491470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d4271ca2-8c22-44e0-ad2d-013a1ffabb7b req-75d61477-9b15-4f86-a70f-bd83bff00582 service nova] Creating event network-changed:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h1-847009-13 Aug 23 11:03:29.502150 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d4271ca2-8c22-44e0-ad2d-013a1ffabb7b req-75d61477-9b15-4f86-a70f-bd83bff00582 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225684 Aug 23 11:03:29.503618 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2909/5788] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:29.537701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:29.540197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:29.551322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:29.552131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:29.552872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:29.553900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:29.554636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:29.555949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:29.845734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:29.854936 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cae086a3-5427-43cf-a840-91a166f7ad96 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1274 microversion: 2.1 time: 0.322625 Aug 23 11:03:29.856103 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2880/5789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:29 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:29.866647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:29.868204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:29.878816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:29.879726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:29.881942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:29.884640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:29.886516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:29.887194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:30.132434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:30.134218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:30.145438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:30.147799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:30.149247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:30.151214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:30.153947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:30.154553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:30.638988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:30.655675 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0098691b-fbd1-4761-9da0-9f594652d77a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.527294 Aug 23 11:03:30.673546 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2881/5790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:30 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:30.678099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:30.705210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:30.707707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:30.714496 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2de4189e-4fe1-462a-a0a5-370d112589b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.852173 Aug 23 11:03:30.716281 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2910/5791] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:29 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:30.784296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-344924541", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f55c759-5d12-4910-a3ab-34c9a1a8a48c"}], "security_groups": [{"name": "tempest-securitygroup--1642895537"}], "key_name": "tempest-keypair-219460688", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:30.879067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:30.879696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:30.890128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:30.895164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:30.895901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:30.896869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:30.897640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:30.898311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:31.058855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:31.074142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1e1ac67d-46ec-401e-9099-e4e479a200b5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1274 microversion: 2.1 time: 0.200133 Aug 23 11:03:31.076170 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2911/5792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:30 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:31.599829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3c0a7356-ee11-46a9-9d4f-e37530bc53b4 req-f5174cf5-5a91-406f-947b-da9c81e324fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1061bf-b1bf-4476-93fc-cc6f7e628566", "tag": "4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:31.620639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:31.643462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c0a7356-ee11-46a9-9d4f-e37530bc53b4 req-f5174cf5-5a91-406f-947b-da9c81e324fe service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:31.643983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c0a7356-ee11-46a9-9d4f-e37530bc53b4 req-f5174cf5-5a91-406f-947b-da9c81e324fe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:31.644421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c0a7356-ee11-46a9-9d4f-e37530bc53b4 req-f5174cf5-5a91-406f-947b-da9c81e324fe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:31.672354 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3c0a7356-ee11-46a9-9d4f-e37530bc53b4 req-f5174cf5-5a91-406f-947b-da9c81e324fe service nova] Creating event network-changed:4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace for instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 on n-h2-847009-13 Aug 23 11:03:31.690568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3c0a7356-ee11-46a9-9d4f-e37530bc53b4 req-f5174cf5-5a91-406f-947b-da9c81e324fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097337 Aug 23 11:03:31.691924 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2912/5793] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:31.704639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:31.705413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:31.719825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:31.720217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:31.720860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:31.721884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:31.722485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:31.723050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:31.800714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] validate_networks() for [('3f55c759-5d12-4910-a3ab-34c9a1a8a48c', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:03:32.177900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:32.189309 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-324b4068-f7fe-45a9-8d55-802804fce912 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.496134 Aug 23 11:03:32.192813 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2913/5794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:31 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:32.215818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:32.217740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:32.230821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:32.231524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:32.241393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:32.242569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:32.243389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:32.243961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:32.783433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:32.819874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:32.824858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:32.828868 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a9f70a3-2476-48dc-94f7-ce114e2f1aaf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.627802 Aug 23 11:03:32.832070 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2914/5795] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:32 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:32.843442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:32.844404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:32.860176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:32.862162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:32.862784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:32.863730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:32.864783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:32.865514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.320360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:33.332862 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d17476d5-a86c-4449-94ab-9584676e930a tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.498811 Aug 23 11:03:33.344766 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2915/5796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:32 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:33.345130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:03:33.346071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:03:33.346700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:03:33.347260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:03:33.347896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:03:33.367804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.368958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.369405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.370152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.371125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.371706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.375158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:33.376567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:33.392966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.393821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.394003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:33.395425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.396686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.397411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.398367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.400446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:33.418430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:03:33.420786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:03:33.516079 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d891597-9603-411f-95cd-963884ae2564 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.736271 Aug 23 11:03:33.522567 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2882/5797] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:03:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:03:33.527934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41aeb015-bc5d-4dd0-91ad-fdc539725865 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:33.531206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41aeb015-bc5d-4dd0-91ad-fdc539725865 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:33.628576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:33.638572 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8231c232-3ebf-4d8f-b162-56ce4f6dc15f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.298121 Aug 23 11:03:33.639154 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2916/5798] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:33 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:33.654720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41aeb015-bc5d-4dd0-91ad-fdc539725865 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:33.662874 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41aeb015-bc5d-4dd0-91ad-fdc539725865 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1240 microversion: 2.1 time: 0.138777 Aug 23 11:03:33.664119 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2883/5799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:33 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:33.762764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-077b7240-6ae7-472a-9380-2b168e5d6b7b req-911ee8d4-6219-46ea-9e14-61a0459370b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:33.780809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-077b7240-6ae7-472a-9380-2b168e5d6b7b req-911ee8d4-6219-46ea-9e14-61a0459370b8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.782506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-077b7240-6ae7-472a-9380-2b168e5d6b7b req-911ee8d4-6219-46ea-9e14-61a0459370b8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.785337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-077b7240-6ae7-472a-9380-2b168e5d6b7b req-911ee8d4-6219-46ea-9e14-61a0459370b8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.814502 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-077b7240-6ae7-472a-9380-2b168e5d6b7b req-911ee8d4-6219-46ea-9e14-61a0459370b8 service nova] Creating event network-changed:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h2-847009-13 Aug 23 11:03:33.830650 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-077b7240-6ae7-472a-9380-2b168e5d6b7b req-911ee8d4-6219-46ea-9e14-61a0459370b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074706 Aug 23 11:03:33.831769 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2917/5800] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:33.861092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:33.862003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:33.877056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.877881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.878556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:33.879747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:33.880555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:33.882254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:34.355286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:34.356012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:34.374762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:34.375336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:34.375793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:34.376523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:34.377017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:34.377450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:34.581396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:34.584522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:34.599950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:34.604509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:34.607114 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfa9e0bf-e5f9-4c2f-b65d-343ce4800742 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.753482 Aug 23 11:03:34.610779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2884/5801] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:33 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:34.661588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:34.662869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:34.682848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:34.683519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:34.684345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:34.687522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:34.688866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:34.689602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:35.121405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:35.138874 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b59527e-a839-430b-bf9a-ac2be082d2c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.480891 Aug 23 11:03:35.155596 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2885/5802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:34 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:35.172054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:35.173184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:35.181932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:35.182469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:35.183367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:35.184148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:35.184615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:35.185871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:35.272172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:35.283358 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-826339a6-d74e-4f2b-b8b9-440057fe0069 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.932121 Aug 23 11:03:35.294455 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2918/5803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:34 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:35.378713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:35.394699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-741c5215-be6f-42e2-80be-d580e2d78a41 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1292 microversion: 2.1 time: 0.238050 Aug 23 11:03:35.395376 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2886/5804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:35 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1292 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:35.637017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:35.637644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:35.645394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:35.646634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:35.647088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:35.647808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:35.648338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:35.648793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:35.829568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:35.841052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:35.842884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:35.844335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3ff7b48-9b3c-4bce-a32f-93737bdcb2a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.212894 Aug 23 11:03:35.844995 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2919/5805] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:35 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:36.161672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:36.162469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:36.179198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.182721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.183408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.184679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.189058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.189823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.206495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0a53ee4d-76e2-4981-b315-4a74ebac95ad req-5faad15f-de54-4727-b01c-4d6881e128ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70f0e07-9e1d-422c-8416-dd89fad31475", "tag": "c5e92da2-69fe-4645-b1d9-792e10bed327"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:36.217576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=22 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:36.235442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0a53ee4d-76e2-4981-b315-4a74ebac95ad req-5faad15f-de54-4727-b01c-4d6881e128ed service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.238771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0a53ee4d-76e2-4981-b315-4a74ebac95ad req-5faad15f-de54-4727-b01c-4d6881e128ed service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.239442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0a53ee4d-76e2-4981-b315-4a74ebac95ad req-5faad15f-de54-4727-b01c-4d6881e128ed service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.267823 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0a53ee4d-76e2-4981-b315-4a74ebac95ad req-5faad15f-de54-4727-b01c-4d6881e128ed service nova] Creating event network-changed:c5e92da2-69fe-4645-b1d9-792e10bed327 for instance d70f0e07-9e1d-422c-8416-dd89fad31475 on n-h1-847009-13 Aug 23 11:03:36.285839 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0a53ee4d-76e2-4981-b315-4a74ebac95ad req-5faad15f-de54-4727-b01c-4d6881e128ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088301 Aug 23 11:03:36.286504 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2920/5806] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:36.310508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:36.311312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:36.338876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.339767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.340537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.341969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.342549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.343060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.683239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:36.692881 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b5552c5-9ffb-4c4f-9e8c-d0875abb182f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.535372 Aug 23 11:03:36.693763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2887/5807] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:36 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:36.713243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:36.714322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:36.720628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.721095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.721698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.722734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.723456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.723913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.751105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:36.764060 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-689fd419-98f3-4b15-90d2-6ec052ac06db tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.460501 Aug 23 11:03:36.764662 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2921/5808] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:36 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:36.871719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:36.872510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:36.879748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.880362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.881103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.882038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:36.883222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:36.883727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:36.887132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:36.907314 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-696d1dc2-ced4-4a85-9cb6-882271ff0fe5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1298 microversion: 2.1 time: 0.198752 Aug 23 11:03:36.908018 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2888/5809] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:36 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1298 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:36.912952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:37.404912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:37.420279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:37.424688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:37.426483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a657f2ca-9665-454d-a3a9-46f2720820e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.559988 Aug 23 11:03:37.427142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2922/5810] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:36 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:03:37.714980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:37.715610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:37.727977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:37.728727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:37.729507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:37.732278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:37.732942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:37.735071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:37.785402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:37.786039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:37.797132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:37.801428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:37.802076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:37.803010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:37.803648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:37.804284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:38.117844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:38.121644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:38.133364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89f594b3-d499-46b6-8aed-f83be0ae8609 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.351132 Aug 23 11:03:38.134473 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2923/5811] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:37 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:38.139303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:38.140034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:38.140251 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0cc3987-f1ed-4814-b878-af60d379b98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.429111 Aug 23 11:03:38.141661 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2889/5812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:37 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:38.159950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:38.163770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:38.164845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:38.166042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:38.169051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:38.169513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:38.431577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:38.440163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-368a3062-6f2f-4f55-8f3b-eab04b9def00 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1366 microversion: 2.1 time: 0.304617 Aug 23 11:03:38.447034 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2924/5813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:38 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:38.451326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:38.451951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:38.467625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:38.468127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:38.472423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:38.472898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:38.473376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:38.473887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:38.608032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9d8feb74-349d-4e6c-922a-aea0b8f800a6 req-47737008-3699-445b-90b2-c566f4052cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "name": "network-vif-plugged", "status": "completed", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:38.630324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9d8feb74-349d-4e6c-922a-aea0b8f800a6 req-47737008-3699-445b-90b2-c566f4052cc7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:38.633445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9d8feb74-349d-4e6c-922a-aea0b8f800a6 req-47737008-3699-445b-90b2-c566f4052cc7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:38.634177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9d8feb74-349d-4e6c-922a-aea0b8f800a6 req-47737008-3699-445b-90b2-c566f4052cc7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:38.663217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9d8feb74-349d-4e6c-922a-aea0b8f800a6 req-47737008-3699-445b-90b2-c566f4052cc7 service nova] Creating event network-vif-plugged:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h1-847009-13 Aug 23 11:03:38.672273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9d8feb74-349d-4e6c-922a-aea0b8f800a6 req-47737008-3699-445b-90b2-c566f4052cc7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069370 Aug 23 11:03:38.673387 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2925/5814] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:38.784496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:38.801382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:38.814725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:38.817586 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1cfc547b-636d-46b7-87f1-b96fe2f84bb2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.369530 Aug 23 11:03:38.819466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2890/5815] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:38 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:39.154067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:39.154818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:39.168281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.168927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.169387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:39.170182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.170679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.180940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:39.481130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-29db6bd9-f326-4dfd-9fde-153d6aed4747 req-3cbcb171-184b-4758-95f2-721b0db477b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1681f67a-7711-4b1f-a0c9-c7f1da291f3a", "tag": "fba499ac-6bfb-4613-aa50-97aefe81572f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:39.504034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-29db6bd9-f326-4dfd-9fde-153d6aed4747 req-3cbcb171-184b-4758-95f2-721b0db477b3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.505418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-29db6bd9-f326-4dfd-9fde-153d6aed4747 req-3cbcb171-184b-4758-95f2-721b0db477b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.506317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-29db6bd9-f326-4dfd-9fde-153d6aed4747 req-3cbcb171-184b-4758-95f2-721b0db477b3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:39.526069 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-29db6bd9-f326-4dfd-9fde-153d6aed4747 req-3cbcb171-184b-4758-95f2-721b0db477b3 service nova] Creating event network-changed:fba499ac-6bfb-4613-aa50-97aefe81572f for instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a on n-h2-847009-13 Aug 23 11:03:39.536655 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-29db6bd9-f326-4dfd-9fde-153d6aed4747 req-3cbcb171-184b-4758-95f2-721b0db477b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503382 Aug 23 11:03:39.538187 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2926/5816] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:39.545977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:39.546854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:39.555608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.556367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.556997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:39.557873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.558488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.559068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:39.869781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:39.885619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8dc19f03-9fea-4490-99c4-babb2aff7d95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.344836 Aug 23 11:03:39.909888 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2927/5817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:39 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:39.917078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:39.917864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:39.933739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.934245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.934684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:39.936011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:39.943251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:39.943837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:40.189620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:40.200884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34a2eeb7-67ce-4266-86e2-ba96c89d8c6e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1366 microversion: 2.1 time: 0.288909 Aug 23 11:03:40.214715 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2928/5818] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:39 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:40.214715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:40.214715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:40.221158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:40.221989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:40.222444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:40.223352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:40.223828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:40.224319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:40.242435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:40.253264 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e08c3f4b-149a-4ae5-958a-c26ee479c2ad tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 1.103055 Aug 23 11:03:40.256619 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2891/5819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:39 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:40.450410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:40.462641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:40.468222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:40.473752 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a877426f-6f0b-47ab-a052-1ff94b2678d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.270550 Aug 23 11:03:40.476287 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2929/5820] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:40 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:40.701019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4b98e639-90ac-46f0-b850-e4c60132566f req-c972271c-d6e0-4982-a0dd-3a134c077de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "name": "network-vif-plugged", "status": "completed", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:40.715107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4b98e639-90ac-46f0-b850-e4c60132566f req-c972271c-d6e0-4982-a0dd-3a134c077de7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:40.715724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4b98e639-90ac-46f0-b850-e4c60132566f req-c972271c-d6e0-4982-a0dd-3a134c077de7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:40.716238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4b98e639-90ac-46f0-b850-e4c60132566f req-c972271c-d6e0-4982-a0dd-3a134c077de7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:40.735536 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4b98e639-90ac-46f0-b850-e4c60132566f req-c972271c-d6e0-4982-a0dd-3a134c077de7 service nova] Creating event network-vif-plugged:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h2-847009-13 Aug 23 11:03:40.744514 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4b98e639-90ac-46f0-b850-e4c60132566f req-c972271c-d6e0-4982-a0dd-3a134c077de7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047070 Aug 23 11:03:40.745980 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2892/5821] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:40.908952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:40.910013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:40.921348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:40.922189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:40.922927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:40.923663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:40.924130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:40.924647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.174103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:41.185308 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5993f494-eced-460d-969a-1bb940815eec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1391 microversion: 2.1 time: 0.280052 Aug 23 11:03:41.185899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2930/5822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:40 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:41.230646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:41.231410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:41.245979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:41.246660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:41.247131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.250328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:41.250822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:41.251276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.278960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:41.279910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:41.293331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:41.298232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:41.298767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:41.299233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.299972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:41.303846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:41.304330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.642252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:41.651810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cce7fc25-a7a6-4dc1-bfaf-54d0ce2944e2 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.377163 Aug 23 11:03:41.656041 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2931/5823] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:41 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:41.661862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:41.662904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:41.670152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:41.671044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:41.671823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.672880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:41.673819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:41.674495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:41.802011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:41.814230 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-222a2071-638a-4c1d-8ed4-1cdd8e47a64d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1366 microversion: 2.1 time: 0.593707 Aug 23 11:03:41.816175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2893/5824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:41 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:41.988476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:41.998699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:42.000277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:42.016368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fdbdd499-af69-4254-8241-7c0cc273b304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1407 microversion: 2.20 time: 0.358777 Aug 23 11:03:42.017383 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2932/5825] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:41 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:42.207232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:42.208128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:42.215955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.216641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.217129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.217854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.218471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.218920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.449377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:42.459494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b5faef9-ad40-408f-8b2c-7d60f7a53934 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1563 microversion: 2.1 time: 0.256374 Aug 23 11:03:42.460497 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2894/5826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:42 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:42.485065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:42.486962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:42.497568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.498706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.499840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.500790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.501580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.502314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.559255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:42.561479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:42.582258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.582708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.583157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.583882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.584351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.584995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.675254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d091ee77-ccc2-4316-91d8-b2533d417294 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566/action" status: 200 len: 24570 microversion: 2.1 time: 0.120498 Aug 23 11:03:42.686807 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2895/5827] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:03:42 2022] POST /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566/action => generated 24570 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 11:03:42.696006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:42.701787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:42.721474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.722196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.722803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.729953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:42.731948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.733229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.736035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.742447 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d96a85d-1062-4211-aaa5-42ec711d5896 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1563 microversion: 2.1 time: 0.263827 Aug 23 11:03:42.743568 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2933/5828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:42 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1563 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:42.841013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:42.842404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:42.853185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.854534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.855126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:42.856007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:42.857419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:42.858183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:43.039949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:43.059609 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4cb3b00-1ad5-448d-9d1a-316fdd041bbe tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.371282 Aug 23 11:03:43.063121 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2896/5829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:42 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:43.069310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:43.075189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:43.089730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:43.094207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:43.094759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:43.095894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:43.097516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:43.098138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:43.173541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:43.185547 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a22d623-77d9-44fb-b30d-fabffc47033c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1366 microversion: 2.1 time: 0.350246 Aug 23 11:03:43.187519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2934/5830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:42 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:43.383742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:43.414851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:43.433444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:43.435574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:43.437555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6eb400f7-bf19-40f8-a305-c6a3d64700d5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1598 microversion: 2.20 time: 0.372020 Aug 23 11:03:43.438758 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2897/5831] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:03:43 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1598 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:03:43.465748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:43.466248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:43.472363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:43.473091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:43.474116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:43.474987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:43.475592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:43.477008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:43.681078 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d81610f8-feca-4d98-9332-c87aa6fa8558 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.220052 Aug 23 11:03:43.689536 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2935/5832] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 11:03:43 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-interface => generated 284 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:03:43.988589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a61b51bc-aa87-42c2-9290-adbfbfed1a5c req-98eb05b4-e540-40ac-bf26-8e3f85473e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1681f67a-7711-4b1f-a0c9-c7f1da291f3a", "name": "network-vif-plugged", "status": "completed", "tag": "fba499ac-6bfb-4613-aa50-97aefe81572f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:44.004562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=14 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:44.009303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a61b51bc-aa87-42c2-9290-adbfbfed1a5c req-98eb05b4-e540-40ac-bf26-8e3f85473e75 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:44.010042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a61b51bc-aa87-42c2-9290-adbfbfed1a5c req-98eb05b4-e540-40ac-bf26-8e3f85473e75 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:44.010726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a61b51bc-aa87-42c2-9290-adbfbfed1a5c req-98eb05b4-e540-40ac-bf26-8e3f85473e75 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:44.034187 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a61b51bc-aa87-42c2-9290-adbfbfed1a5c req-98eb05b4-e540-40ac-bf26-8e3f85473e75 service nova] Creating event network-vif-plugged:fba499ac-6bfb-4613-aa50-97aefe81572f for instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a on n-h2-847009-13 Aug 23 11:03:44.041094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a61b51bc-aa87-42c2-9290-adbfbfed1a5c req-98eb05b4-e540-40ac-bf26-8e3f85473e75 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056057 Aug 23 11:03:44.041918 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2898/5833] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:44.084921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:44.086644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:44.094236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:44.094898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:44.095526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:44.096914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:44.097537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:44.098126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:44.209281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:44.210012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:44.224812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:44.225677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:44.227065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:44.227959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:44.228453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:44.229738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:44.496998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:44.512908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1901297-aa3c-4997-86fb-11ee33e9029d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1366 microversion: 2.1 time: 0.307866 Aug 23 11:03:44.514168 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2899/5834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:44 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:44.939838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:44.948863 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21efeec1-9692-4071-b793-62ff2bee168e tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.868898 Aug 23 11:03:44.949792 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2936/5835] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:44 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:45.537872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:45.539474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:45.547762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:45.548601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:45.549332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:45.550262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:45.550930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:45.551560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:45.713594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a88836fe-e208-4342-b754-166ccb1206b3 req-2f94c0cd-338b-4075-b2b8-19f3b0a709cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:45.724964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a88836fe-e208-4342-b754-166ccb1206b3 req-2f94c0cd-338b-4075-b2b8-19f3b0a709cc service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:45.726707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a88836fe-e208-4342-b754-166ccb1206b3 req-2f94c0cd-338b-4075-b2b8-19f3b0a709cc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:45.727678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a88836fe-e208-4342-b754-166ccb1206b3 req-2f94c0cd-338b-4075-b2b8-19f3b0a709cc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:45.740315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a88836fe-e208-4342-b754-166ccb1206b3 req-2f94c0cd-338b-4075-b2b8-19f3b0a709cc service nova] Creating event network-changed:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h2-847009-13 Aug 23 11:03:45.748931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a88836fe-e208-4342-b754-166ccb1206b3 req-2f94c0cd-338b-4075-b2b8-19f3b0a709cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039856 Aug 23 11:03:45.750029 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2937/5836] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:03:45.972644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:45.973398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:45.984274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:45.984800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:45.985252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:45.985974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:45.986451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:45.986876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:45.991282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:46.001911 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8096f322-973e-4de5-9208-12ffac4e9932 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1366 microversion: 2.1 time: 0.467860 Aug 23 11:03:46.003423 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2900/5837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:45 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:46.079390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3e8388c9-834c-4fcc-9c60-3fa349ca2e04 req-f26759c2-c638-4ef2-9160-f2f2d1e8dfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70f0e07-9e1d-422c-8416-dd89fad31475", "name": "network-vif-plugged", "status": "completed", "tag": "c5e92da2-69fe-4645-b1d9-792e10bed327"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:46.097945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3e8388c9-834c-4fcc-9c60-3fa349ca2e04 req-f26759c2-c638-4ef2-9160-f2f2d1e8dfb9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:46.118083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3e8388c9-834c-4fcc-9c60-3fa349ca2e04 req-f26759c2-c638-4ef2-9160-f2f2d1e8dfb9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:46.118695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3e8388c9-834c-4fcc-9c60-3fa349ca2e04 req-f26759c2-c638-4ef2-9160-f2f2d1e8dfb9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:46.163273 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3e8388c9-834c-4fcc-9c60-3fa349ca2e04 req-f26759c2-c638-4ef2-9160-f2f2d1e8dfb9 service nova] Creating event network-vif-plugged:c5e92da2-69fe-4645-b1d9-792e10bed327 for instance d70f0e07-9e1d-422c-8416-dd89fad31475 on n-h1-847009-13 Aug 23 11:03:46.182557 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3e8388c9-834c-4fcc-9c60-3fa349ca2e04 req-f26759c2-c638-4ef2-9160-f2f2d1e8dfb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107340 Aug 23 11:03:46.183334 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2901/5838] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:03:46.419235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:46.420024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:46.434995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:46.435498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:46.436205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:46.437142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:46.437787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:46.438396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:46.485071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:46.500170 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3732e46b-2dca-499c-a122-c7d17ad6d798 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.530129 Aug 23 11:03:46.501059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2938/5839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:45 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:03:46.510812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c10ac9d0-9853-472a-b6aa-c359c2d9fb55 req-e93d2bdb-7cb5-4df4-a3de-87dba5eacea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:46.543582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c10ac9d0-9853-472a-b6aa-c359c2d9fb55 req-e93d2bdb-7cb5-4df4-a3de-87dba5eacea0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:46.545030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c10ac9d0-9853-472a-b6aa-c359c2d9fb55 req-e93d2bdb-7cb5-4df4-a3de-87dba5eacea0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:46.548911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c10ac9d0-9853-472a-b6aa-c359c2d9fb55 req-e93d2bdb-7cb5-4df4-a3de-87dba5eacea0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:46.594237 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c10ac9d0-9853-472a-b6aa-c359c2d9fb55 req-e93d2bdb-7cb5-4df4-a3de-87dba5eacea0 service nova] Creating event network-changed:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h1-847009-13 Aug 23 11:03:46.615622 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c10ac9d0-9853-472a-b6aa-c359c2d9fb55 req-e93d2bdb-7cb5-4df4-a3de-87dba5eacea0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111751 Aug 23 11:03:46.620261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2939/5840] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:46.745686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:46.765620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55be8d62-28ca-4834-916b-e83bc008aded tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1563 microversion: 2.1 time: 0.351666 Aug 23 11:03:46.785166 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2902/5841] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:46 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1563 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:47.025814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:47.026539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:47.053644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:47.058067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:47.061244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:47.063914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:47.065833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:47.068146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:47.422703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:47.432184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-83bc4f96-d6e9-4e84-9be2-530174ae22fe tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1555 microversion: 2.1 time: 0.411942 Aug 23 11:03:47.446602 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2940/5842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:47 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1555 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:47.459365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:47.459906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:47.474997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:47.475545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:47.476708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:47.479628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:47.480128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:47.480582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:47.522814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:47.523551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:47.531609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:47.532312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:47.535438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:47.536381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:47.537257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:47.539346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:47.772570 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-860e209b-1fe4-4483-a464-a955a40f1616 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.317466 Aug 23 11:03:47.775356 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2903/5843] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:03:47 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-interface => generated 284 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:47.879721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:47.892065 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bf8ca363-b50c-417c-8a8a-c3878c7243d7 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1316 microversion: 2.1 time: 0.373863 Aug 23 11:03:47.894821 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2941/5844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:47 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1316 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:48.917347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:48.918279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:48.928587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:48.929293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:48.930288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:48.931454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:48.932696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:48.933378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:48.941120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:49.130546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-71e60eea-a11e-4147-88db-476f0c25c2d1 req-fd2e7f8f-8cd4-40c5-a4b3-687d586b6287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1681f67a-7711-4b1f-a0c9-c7f1da291f3a", "tag": "fba499ac-6bfb-4613-aa50-97aefe81572f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:49.147643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-71e60eea-a11e-4147-88db-476f0c25c2d1 req-fd2e7f8f-8cd4-40c5-a4b3-687d586b6287 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.149062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-71e60eea-a11e-4147-88db-476f0c25c2d1 req-fd2e7f8f-8cd4-40c5-a4b3-687d586b6287 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.149750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-71e60eea-a11e-4147-88db-476f0c25c2d1 req-fd2e7f8f-8cd4-40c5-a4b3-687d586b6287 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.155689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:49.166457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-71e60eea-a11e-4147-88db-476f0c25c2d1 req-fd2e7f8f-8cd4-40c5-a4b3-687d586b6287 service nova] Creating event network-changed:fba499ac-6bfb-4613-aa50-97aefe81572f for instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a on n-h2-847009-13 Aug 23 11:03:49.173500 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-71e60eea-a11e-4147-88db-476f0c25c2d1 req-fd2e7f8f-8cd4-40c5-a4b3-687d586b6287 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048374 Aug 23 11:03:49.174959 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2942/5845] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:03:49.180948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:49.196677 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e41497e-3368-4eb8-8b82-ecdfac8c9592 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1505 microversion: 2.1 time: 0.284562 Aug 23 11:03:49.201333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2904/5846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:48 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:49.224774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:49.225367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:49.239839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.240716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.243651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.245693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.246330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.248100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.323569 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4216483d-33da-49ed-afcc-d3ca864555e0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475/ips" status: 200 len: 109 microversion: 2.1 time: 0.093332 Aug 23 11:03:49.330358 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2943/5847] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:03:49 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475/ips => generated 109 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:03:49.347762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:49.348578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:49.362100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.362687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.368015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.369149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.377304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.378433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.441157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a1815db-d073-4fc1-8322-caa998ce440f tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475/ips" status: 200 len: 109 microversion: 2.1 time: 0.097910 Aug 23 11:03:49.441874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2905/5848] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:03:49 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475/ips => generated 109 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:49.455983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:49.456586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:49.481387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.481917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.482380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.483128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.483859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.484298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.528809 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-415dbf4e-a0e8-428f-ba52-8594602cabd5 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475/ips/tempest-ServerAddressesTestJSON-1139644898-network" status: 200 len: 94 microversion: 2.1 time: 0.077173 Aug 23 11:03:49.537214 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2944/5849] 10.222.0.78 () {58 vars in 1401 bytes} [Tue Aug 23 11:03:49 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475/ips/tempest-ServerAddressesTestJSON-1139644898-network => generated 94 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:03:49.543852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:49.544713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:49.552063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.552859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.553458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.554609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.555285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.555875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.593886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:03:49.736065 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80fdf628-8fad-42d9-bc1d-88f93cedbf80 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 204 len: 0 microversion: 2.1 time: 0.196811 Aug 23 11:03:49.741145 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2906/5850] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:03:49 2022] DELETE /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:03:49.749720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:49.750565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:49.764918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.765441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.765896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:49.767307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:49.767786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:49.768225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:50.016978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:50.029823 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd742988-114a-41aa-96d4-92c6bd905d4d tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1511 microversion: 2.1 time: 0.283634 Aug 23 11:03:50.030671 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2945/5851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:49 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:51.053804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:51.056595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:51.063248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:03:51.065523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:51.066185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:51.066627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:51.067498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:51.067956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:51.069289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:51.255801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:51.266379 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f5912e5-d5b0-417a-bd5c-7432d44aec3c tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1511 microversion: 2.1 time: 0.218813 Aug 23 11:03:51.266973 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2907/5852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:51 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:51.988128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a76571e0-c074-4b1d-b2fb-0c255d6d42a4 req-a0896abe-2381-4351-b79b-52c1d4769fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70f0e07-9e1d-422c-8416-dd89fad31475", "name": "network-vif-deleted", "tag": "c5e92da2-69fe-4645-b1d9-792e10bed327"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:52.013096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a76571e0-c074-4b1d-b2fb-0c255d6d42a4 req-a0896abe-2381-4351-b79b-52c1d4769fbd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:52.018627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a76571e0-c074-4b1d-b2fb-0c255d6d42a4 req-a0896abe-2381-4351-b79b-52c1d4769fbd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:52.020358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a76571e0-c074-4b1d-b2fb-0c255d6d42a4 req-a0896abe-2381-4351-b79b-52c1d4769fbd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:52.043221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a76571e0-c074-4b1d-b2fb-0c255d6d42a4 req-a0896abe-2381-4351-b79b-52c1d4769fbd service nova] Creating event network-vif-deleted:c5e92da2-69fe-4645-b1d9-792e10bed327 for instance d70f0e07-9e1d-422c-8416-dd89fad31475 on n-h1-847009-13 Aug 23 11:03:52.052480 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a76571e0-c074-4b1d-b2fb-0c255d6d42a4 req-a0896abe-2381-4351-b79b-52c1d4769fbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068261 Aug 23 11:03:52.054753 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2946/5853] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:03:52.291831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:52.293230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:52.300445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:52.300968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:52.301418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:52.302148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:52.302627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:52.303088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:52.344461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:52.344461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:52.344461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:52.344461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lazy-loading 'fault' on Instance uuid d70f0e07-9e1d-422c-8416-dd89fad31475 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:03:52.404650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c00f0329c54f48f38cea51a846e863cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cb52db86b841a0b4c6f1b72defc881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:03:52.414252 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e8b53d12-9511-4e7c-bfdd-92725c201b20 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 200 len: 1306 microversion: 2.1 time: 0.128085 Aug 23 11:03:52.415008 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2908/5854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:52 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 1306 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:03:53.439006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:03:53.439770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] [instance: d70f0e07-9e1d-422c-8416-dd89fad31475] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:03:53.448127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:53.448622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:53.449907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:53.451050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:03:53.451551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:03:53.451954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:03:53.475094 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] HTTP exception thrown: Instance d70f0e07-9e1d-422c-8416-dd89fad31475 could not be found. Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Request method failure captured: Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 HTTP/1.1 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLP4x98GNWKJh_B9jWZg3y-jTGP-FYeRGIylGeR_BPTv2Pb3o2Qvd_sbLVsJkyNP5sevWl_tqhhhNvmIhnyZojHubOToU3Vj_yf_1NFxvaYb1cCJb5MwJfrWYrECYBJlRqU6HVJR8sQCSBmC599w_4gz53908lJ7nOJJp-pOJrys7vA Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 16cb52db86b841a0b4c6f1b72defc881 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerAddressesTestJSON-678631690 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/16cb52db86b841a0b4c6f1b72defc881"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_16cb52db86b841a0b4c6f1b72defc881", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16cb52db86b841a0b4c6f1b72defc881"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/16cb52db86b841a0b4c6f1b72defc881"}]}] Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerAddressesTestJSON-678631690 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 16cb52db86b841a0b4c6f1b72defc881 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerAddressesTestJSON-678631690 Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerAddressesTestJSON-678631690-project Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c00f0329c54f48f38cea51a846e863cc Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerAddressesTestJSON-678631690-project Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d70f0e07-9e1d-422c-8416-dd89fad31475 could not be found. Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd70f0e07-9e1d-422c-8416-dd89fad31475'} Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70f0e07-9e1d-422c-8416-dd89fad31475 could not be found. Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70f0e07-9e1d-422c-8416-dd89fad31475 could not be found. Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:03:53.477315 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70f0e07-9e1d-422c-8416-dd89fad31475 could not be found. Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] Returning 404 to user: Instance d70f0e07-9e1d-422c-8416-dd89fad31475 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b09f4981-3fe8-425d-8400-7e3e71593ad0 tempest-ServerAddressesTestJSON-678631690 tempest-ServerAddressesTestJSON-678631690-project] 10.222.0.78 "GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475" status: 404 len: 111 microversion: 2.1 time: 0.043978 Aug 23 11:03:53.481804 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2947/5855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:03:53 2022] GET /compute/v2.1/servers/d70f0e07-9e1d-422c-8416-dd89fad31475 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:03:58.858802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d60760ce-4bca-469f-8095-6f44cd78c83f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'create', calling method: .version_select at 0x7fdc9cd21310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-960479629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiPg8St5iCEdc8nQz2BqvrdN1bsbsjM4Ps82rPU+aD1mEwMwnsU+yTxP2wtyPc5isWMUA0K+MXJouB8npJxQjfqHaH5vNN4D4Gwt+RKETDdCvv8wKfKMs/dPKj9q/7JQg=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:03:58.889748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d60760ce-4bca-469f-8095-6f44cd78c83f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for project ae502704266349bab5642ad154ea1085. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:03:58.895655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-d60760ce-4bca-469f-8095-6f44cd78c83f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for user 4bb6e7d862d84e1c9f5d129b0c41bc37 and project ae502704266349bab5642ad154ea1085. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:03:58.931689 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d60760ce-4bca-469f-8095-6f44cd78c83f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.078297 Aug 23 11:03:58.932569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2909/5856] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:03:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:01.514491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-907931015", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "88c7b6b8-c86b-484f-980a-d531595bfead"}], "key_name": "tempest-TestNetworkBasicOps-960479629", "security_groups": [{"name": "tempest-secgroup-smoke-500794331"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:01.736707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] validate_networks() for [('88c7b6b8-c86b-484f-980a-d531595bfead', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:04:02.502785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:04:02.505487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:04:02.507705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:04:02.509274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:04:02.509749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:04:02.529553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:02.530949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:02.531606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:02.532964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:02.535585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:02.536299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:02.567245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for project ae502704266349bab5642ad154ea1085. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:04:02.573634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for user 4bb6e7d862d84e1c9f5d129b0c41bc37 and project ae502704266349bab5642ad154ea1085. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:04:02.589705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:04:02.592581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:04:02.791508 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e731c573-7c1d-46b5-9000-9cbcd1501bb9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.292713 Aug 23 11:04:02.801183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2948/5857] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:04:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:04:02.813597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-612d9d07-003e-4342-885f-bccd4fed60d0 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:02.815527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-612d9d07-003e-4342-885f-bccd4fed60d0 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:02.834706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:02.957582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-612d9d07-003e-4342-885f-bccd4fed60d0 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:02.965636 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-612d9d07-003e-4342-885f-bccd4fed60d0 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1247 microversion: 2.1 time: 0.165764 Aug 23 11:04:02.969353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2910/5858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:02 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1247 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:03.998629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:04.000153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:04.013864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:04.014862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:04.015498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:04.017187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:04.021387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:04.022087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:04.191870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:04.201505 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae13ae23-122e-4ce1-bcb5-3e8aff665d08 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1243 microversion: 2.1 time: 0.208653 Aug 23 11:04:04.203038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2949/5859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:03 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1243 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:05.224908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:05.226289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:05.242509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:05.243404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:05.243928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:05.244804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:05.245287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:05.245730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:05.375100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:05.391662 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d42dd443-8cfd-476b-9b61-1faf92b9cf36 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1305 microversion: 2.1 time: 0.171060 Aug 23 11:04:05.392281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2911/5860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:05 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:06.418982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:06.419616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:06.431524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:06.432365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:06.432990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:06.434271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:06.437611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:06.440833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:06.950510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:06.970762 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d25ef9d-84a7-4196-bd56-73a2fbe433fe tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.554889 Aug 23 11:04:06.987701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2950/5861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:06 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:07.995301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:07.996077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:08.026332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:08.026837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:08.036041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:08.038415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:08.039100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:08.039559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:08.435347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:08.448452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-352742a9-22f3-4c06-ac28-3a648dac787a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.458335 Aug 23 11:04:08.450473 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2912/5862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:07 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:09.089360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f10033df-6075-48fa-a5d1-a290b0a70920 req-590d63e0-ce0d-4561-bf50-6cbefb1135fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7376b9f2-4048-4540-bca2-b4be8bc321cc", "tag": "67b5cfae-caa4-4796-b2a8-fabe7cd338a8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:09.135264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f10033df-6075-48fa-a5d1-a290b0a70920 req-590d63e0-ce0d-4561-bf50-6cbefb1135fb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:09.135954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f10033df-6075-48fa-a5d1-a290b0a70920 req-590d63e0-ce0d-4561-bf50-6cbefb1135fb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:09.138097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f10033df-6075-48fa-a5d1-a290b0a70920 req-590d63e0-ce0d-4561-bf50-6cbefb1135fb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:09.159071 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f10033df-6075-48fa-a5d1-a290b0a70920 req-590d63e0-ce0d-4561-bf50-6cbefb1135fb service nova] Creating event network-changed:67b5cfae-caa4-4796-b2a8-fabe7cd338a8 for instance 7376b9f2-4048-4540-bca2-b4be8bc321cc on n-h1-847009-13 Aug 23 11:04:09.167178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f10033df-6075-48fa-a5d1-a290b0a70920 req-590d63e0-ce0d-4561-bf50-6cbefb1135fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082736 Aug 23 11:04:09.169012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2951/5863] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:09.473122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:09.473745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:09.492628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:09.493208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:09.493748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:09.494481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:09.494944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:09.495377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:10.005962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:10.015752 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6400ed79-ad88-4937-9ad4-cafc12b513e7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.546175 Aug 23 11:04:10.032112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2913/5864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:09 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:11.038958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:11.039680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:11.050786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:11.051500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:11.052147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:11.054609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:11.055389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:11.055848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:11.483572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:11.498622 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f99c6067-c4cf-4ae6-b852-6e2994c0333b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.463595 Aug 23 11:04:11.514164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2952/5865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:11 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:12.520524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:12.531024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:12.547334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:12.550603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:12.551280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:12.555006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:12.555675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:12.561504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:12.938797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:12.950287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d75f02e4-8b9f-4f23-8e8b-058a8ccd9ef5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.434482 Aug 23 11:04:12.968206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2914/5866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:12 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:13.992651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:13.993672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:13.999487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:14.004021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:14.008419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:14.031001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:14.031801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:14.033760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:14.035723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:14.036508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:14.037145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:14.059755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:14.293457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-688655966", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:14.360899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] validate_networks() for [('14e23546-1412-4fd6-8c7e-47bc2d88a89d', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:04:14.463659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:14.476431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da06b3ca-58a6-46a8-a01b-2786f658c809 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.488916 Aug 23 11:04:14.493805 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2953/5867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:13 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:15.505953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:15.507913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:15.524632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:15.525422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:15.526013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:15.526965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:15.527570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:15.528144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:15.762961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:04:15.764370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:04:15.767401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:04:15.768303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:04:15.774532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:04:15.783198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:15.783708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:15.784216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:15.785018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:15.785730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:15.786332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:15.817035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Getting quotas for project c059cd3e97ac4382a1db81be10347241. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:04:15.845641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Getting quotas for user c67e824e125e4eb9a412794df8f98a41 and project c059cd3e97ac4382a1db81be10347241. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:04:15.877353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:04:15.880662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:04:15.939750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:15.953451 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6b68e0c-3a03-4a39-8776-052dd52cb55b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901340 Aug 23 11:04:15.954730 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2915/5868] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:04:15.958452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80957d64-9912-420d-9d76-d4cb3166d3df tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.451552 Aug 23 11:04:15.959058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2954/5869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:15 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:04:15.978921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-78c938ff-3625-44f5-91ca-d313a0b511f5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:15.980011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-78c938ff-3625-44f5-91ca-d313a0b511f5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:16.150067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-78c938ff-3625-44f5-91ca-d313a0b511f5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:16.157433 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-78c938ff-3625-44f5-91ca-d313a0b511f5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1223 microversion: 2.1 time: 0.183559 Aug 23 11:04:16.161510 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2916/5870] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:15 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1223 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:16.989310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:16.990924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:17.006660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:17.007529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:17.008133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:17.013331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:17.014137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:17.014749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:17.179177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:17.179714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:17.197271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:17.197550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:17.198007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:17.203961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:17.204552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:17.214217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:17.357411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:17.370502 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-558d245c-af60-4bcb-8d5d-d5ecf05f2149 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1219 microversion: 2.1 time: 0.195370 Aug 23 11:04:17.372275 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2917/5871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:17 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:17.550508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:17.577703 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82a7bb84-f251-424c-a9b4-810c6fef23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.590665 Aug 23 11:04:17.579976 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2955/5872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:16 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:18.395663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:18.396457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:18.416337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:18.420386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:18.420896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:18.424130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:18.424666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:18.425141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:18.599341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:18.599961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:18.634913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:18.635437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:18.635843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:18.636569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:18.640180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:18.640677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:18.653859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:18.671341 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6048b064-ab69-4b1c-9e7e-3a5b406dd286 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1275 microversion: 2.1 time: 0.280024 Aug 23 11:04:18.679003 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2918/5873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:18 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:19.167423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:19.172085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=63 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:19.203957 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d6634b3-79f0-4f76-9237-2f9cc7b197d9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.607617 Aug 23 11:04:19.205724 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2956/5874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:18 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:19.617045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d26d9ac7-6215-4197-a184-93a41164307e req-b8acf422-a731-49c4-a8bc-913a66d9990b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7376b9f2-4048-4540-bca2-b4be8bc321cc", "name": "network-vif-plugged", "status": "completed", "tag": "67b5cfae-caa4-4796-b2a8-fabe7cd338a8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:19.639091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d26d9ac7-6215-4197-a184-93a41164307e req-b8acf422-a731-49c4-a8bc-913a66d9990b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:19.650492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d26d9ac7-6215-4197-a184-93a41164307e req-b8acf422-a731-49c4-a8bc-913a66d9990b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:19.651926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d26d9ac7-6215-4197-a184-93a41164307e req-b8acf422-a731-49c4-a8bc-913a66d9990b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:19.683192 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d26d9ac7-6215-4197-a184-93a41164307e req-b8acf422-a731-49c4-a8bc-913a66d9990b service nova] Creating event network-vif-plugged:67b5cfae-caa4-4796-b2a8-fabe7cd338a8 for instance 7376b9f2-4048-4540-bca2-b4be8bc321cc on n-h1-847009-13 Aug 23 11:04:19.696650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:19.697609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:19.712658 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d26d9ac7-6215-4197-a184-93a41164307e req-b8acf422-a731-49c4-a8bc-913a66d9990b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097631 Aug 23 11:04:19.714258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:19.716300 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2919/5875] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:19.718414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:19.719142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:19.720707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:19.721981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:19.722838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:19.908427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:19.927343 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-27023908-c561-4273-9cd2-3e4acbed456c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1281 microversion: 2.1 time: 0.234315 Aug 23 11:04:19.930318 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2957/5876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:19 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:04:20.226699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:20.227414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:20.234661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:20.235160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:20.235598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:20.236305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:20.236784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:20.237216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:20.372432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:20.375781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:20.383180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:20.383853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:20.384439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:20.385589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:20.386325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:20.386897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:20.429077 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46235a02-687a-48b8-b4f6-a710b9b036f7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/ips" status: 200 len: 151 microversion: 2.20 time: 0.059347 Aug 23 11:04:20.437610 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2958/5877] 10.222.0.78 () {60 vars in 1289 bytes} [Tue Aug 23 11:04:20 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/ips => generated 151 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:04:20.929867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:20.937771 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e886fce-9cd6-4c3a-a8e4-f4f9f0656e3f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.715965 Aug 23 11:04:20.938364 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2920/5878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:20 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:20.950660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:20.951891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:20.960540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:20.961160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:20.961788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:20.962507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:20.963139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:20.963574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:21.101078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:21.114892 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-25ad4e91-7870-4c34-8c46-fd7949ef79a0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1281 microversion: 2.1 time: 0.169216 Aug 23 11:04:21.118794 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2959/5879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:20 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:21.489241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:21.492637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:21.494739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:21.512791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:21.513527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:21.514163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:21.520139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:21.522987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:21.524682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:21.671383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a29e796-c7b8-4b80-b056-7c5c32172016 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action" status: 200 len: 24575 microversion: 2.1 time: 0.185654 Aug 23 11:04:21.672772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2921/5880] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:04:21 2022] POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action => generated 24575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:04:21.964120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:21.964767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:21.974954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:21.978863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:21.983602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:21.984664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:21.985688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:21.986496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:22.138772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:22.140184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:22.149730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:22.150479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:22.151120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:22.152026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:22.152768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:22.153463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:22.405761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:22.418062 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d238c104-6656-43fe-a4c4-a24c103d764c tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1372 microversion: 2.1 time: 0.458320 Aug 23 11:04:22.423109 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2960/5881] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:21 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1372 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:22.726610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:22.759715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd8803cc-8877-4480-b411-cd6eaf62f96b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 0.625216 Aug 23 11:04:22.773285 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2922/5882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:22 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:04:23.450013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:23.451991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:23.466038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:23.466869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:23.469434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:23.473303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:23.473943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:23.474491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:23.749097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:23.749636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:23.771692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:23.771692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:23.771692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:23.771692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:23.771692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:23.772141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:23.805676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lazy-loading 'flavor' on Instance uuid 3d8297fe-7c5a-4258-b795-34e44f552873 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:04:23.927395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:23.943492 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ac09eef-8a5c-443b-af95-45586e69594f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1543 microversion: 2.1 time: 0.497777 Aug 23 11:04:23.960991 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2961/5883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:23 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1543 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:23.966234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:23.967032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:23.974536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:23.975247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:23.975942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:23.976862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:23.977483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:23.978093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:24.110199 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45681f26-901d-43a9-9a0f-43933681a466 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/action" status: 202 len: 0 microversion: 2.20 time: 0.369685 Aug 23 11:04:24.111257 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2923/5884] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 11:04:23 2022] POST /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:04:24.119680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:24.120552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:24.128905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:24.129586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:24.130132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:24.131044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:24.133219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:24.133978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:24.674333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:24.689543 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd830841-fc6a-4627-9f79-5281e82ec81b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1543 microversion: 2.1 time: 0.576307 Aug 23 11:04:24.690159 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2924/5885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:24 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1543 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:24.704390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:24.705050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:24.720580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:24.721430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:24.722105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:24.723001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:24.723367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:24.723812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:24.874075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:24.886888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f810ef6a-6cc5-41a2-9c60-32a15178d015 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 0.924731 Aug 23 11:04:24.893096 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2962/5886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:23 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:25.062316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-27b80f5d-7c03-41a2-bd8e-fb18efa68f0d req-e7d562c5-513d-4d2e-9706-09030af9c18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91", "tag": "a7a22396-a576-4973-ade9-322844fcc997"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:25.080693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:25.082766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27b80f5d-7c03-41a2-bd8e-fb18efa68f0d req-e7d562c5-513d-4d2e-9706-09030af9c18f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:25.083266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27b80f5d-7c03-41a2-bd8e-fb18efa68f0d req-e7d562c5-513d-4d2e-9706-09030af9c18f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:25.083735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27b80f5d-7c03-41a2-bd8e-fb18efa68f0d req-e7d562c5-513d-4d2e-9706-09030af9c18f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:25.090572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:25.101911 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-27b80f5d-7c03-41a2-bd8e-fb18efa68f0d req-e7d562c5-513d-4d2e-9706-09030af9c18f service nova] Creating event network-changed:a7a22396-a576-4973-ade9-322844fcc997 for instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 on n-h1-847009-13 Aug 23 11:04:25.105348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:25.107169 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf4b9149-9c45-48fd-b1aa-69e463950e4e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.415837 Aug 23 11:04:25.107642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-27b80f5d-7c03-41a2-bd8e-fb18efa68f0d req-e7d562c5-513d-4d2e-9706-09030af9c18f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055724 Aug 23 11:04:25.108452 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2925/5887] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:24 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:25.109125 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2963/5888] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:25.908825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:25.909682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:25.913037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:25.925694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:25.926573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:25.927457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:25.928792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:25.929384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:25.929883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:26.157134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:26.280208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:26.293539 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-528e52f6-b0d1-495c-af5e-a0f2c2ef7b1c tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 0.388566 Aug 23 11:04:26.294596 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2926/5889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:25 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:26.312290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:26.313117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:26.320669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:26.320936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:26.321648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:26.322830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:26.324598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:26.325556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:26.394184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:26.395794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:26.409598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:26.410103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:26.410599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:26.411325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:26.411787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:26.412311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:26.454268 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68c9b7f8-2851-4a35-be42-243c4f4dc2d9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/ips" status: 200 len: 149 microversion: 2.1 time: 0.492023 Aug 23 11:04:26.454845 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2964/5890] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:04:25 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/ips => generated 149 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:04:26.881783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:26.894255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:26.899721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:26.903799 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2ad9208-6cf9-4d2c-9aa4-17d57a95e794 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.608042 Aug 23 11:04:26.904569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2927/5891] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:26 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:27.320958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:27.325056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:27.336932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:27.337430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:27.337869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:27.338650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:27.339104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:27.339736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:27.700115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:27.712337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-94ad110f-54ca-4138-b236-d85ccd620c5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 0.398793 Aug 23 11:04:27.717237 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2965/5892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:27 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:27.934660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:27.935900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:27.950652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:27.951025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:27.951479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:27.954548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:27.956168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:27.956642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:27.968201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:28.393083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:28.425569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:28.429810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:28.431495 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-460cd458-2e57-429f-bd35-cb38523ef036 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.502178 Aug 23 11:04:28.444957 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2928/5893] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:27 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:28.743380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:28.743878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:28.762260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:28.768640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:28.773066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:28.774074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:28.776569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:28.777103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:29.133755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02f00dc1-2702-4f79-b519-f49743b07ca2"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:29.136230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:29.142725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:29.143489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:29.144086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:29.144985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:29.145603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:29.146184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:29.649635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38418c70-866d-4096-9c5e-3c0bb565e2d6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525440 Aug 23 11:04:29.650281 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2929/5894] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:04:29 2022] POST /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:29.660803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:29.664881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:29.678320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:29.680316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:29.680801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:29.684169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:29.684678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:29.685751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:29.744285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:29.769776 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cee095eb-66eb-4528-be4d-50534e884ab1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 1.031861 Aug 23 11:04:29.773296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2966/5895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:28 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:30.152221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:30.164023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:30.167982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:30.172402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2aea0357-77fc-4330-8d92-64e4539b84a6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.518639 Aug 23 11:04:30.173380 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2930/5896] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:29 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:30.794020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:30.795679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:30.818888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:30.819523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:30.821319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:30.826841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:30.827378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:30.827844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:31.203752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:31.208678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:31.226470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:31.227355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:31.229516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:31.231977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:31.233225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:31.233421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:31.335612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:31.349437 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1a4f62c-7dac-42e5-a73c-1be41c9ea80e tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 0.560470 Aug 23 11:04:31.352015 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2967/5897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:30 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:31.571067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:31.582460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:31.584853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:31.587723 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7839e12-a6e6-4444-89d8-d2be69a17445 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.395433 Aug 23 11:04:31.588698 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2931/5898] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:31 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:32.375363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:32.375987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:32.383844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:32.384346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:32.384815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:32.385527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:32.385978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:32.386590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:32.619744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:32.621093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:32.628964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:32.630401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:32.636294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:32.637222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:32.637807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:32.638358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:32.901763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:32.921242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:32.923451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:32.924678 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-821ce060-c099-4170-96c2-eb7a8edc9145 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.317050 Aug 23 11:04:32.925305 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2932/5899] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:32 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:33.206279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-579ea568-272a-4fcd-8d0b-f8b01932eb59 req-26ba4ef7-969c-44c3-af01-ef2a70efe18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91", "name": "network-vif-plugged", "status": "completed", "tag": "a7a22396-a576-4973-ade9-322844fcc997"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:33.225438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-579ea568-272a-4fcd-8d0b-f8b01932eb59 req-26ba4ef7-969c-44c3-af01-ef2a70efe18f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:33.225980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-579ea568-272a-4fcd-8d0b-f8b01932eb59 req-26ba4ef7-969c-44c3-af01-ef2a70efe18f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:33.226424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-579ea568-272a-4fcd-8d0b-f8b01932eb59 req-26ba4ef7-969c-44c3-af01-ef2a70efe18f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:33.250717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-579ea568-272a-4fcd-8d0b-f8b01932eb59 req-26ba4ef7-969c-44c3-af01-ef2a70efe18f service nova] Creating event network-vif-plugged:a7a22396-a576-4973-ade9-322844fcc997 for instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 on n-h1-847009-13 Aug 23 11:04:33.261912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-579ea568-272a-4fcd-8d0b-f8b01932eb59 req-26ba4ef7-969c-44c3-af01-ef2a70efe18f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058703 Aug 23 11:04:33.263009 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2933/5900] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:04:33.478837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:33.501749 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e08bf29d-2d06-4f3d-893f-e1f5e4c30daa tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 1.133361 Aug 23 11:04:33.504891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2968/5901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:32 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:33.955983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:33.957424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:33.987399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:33.988249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:33.989416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:33.990469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:33.991157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:33.991893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:34.364890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:34.382375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:34.390182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:34.392315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ec45153-222c-4bac-8134-b33b0a609da6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.443383 Aug 23 11:04:34.406011 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2934/5902] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:33 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:34.525667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:34.527055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:34.536664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:34.546270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:34.547053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:34.548227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:34.548945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:34.549967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:34.929723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:34.939498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c69f899-ded9-4b93-8966-6a5ef41a3304 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1323 microversion: 2.1 time: 0.417704 Aug 23 11:04:34.955230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2969/5903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:34 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:35.424842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:35.425679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:35.440649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:35.441171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:35.441625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:35.460446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:35.461313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:35.463287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:35.965676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:35.971316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:35.984636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:35.985563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:35.986229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:35.987684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:35.989366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:35.990050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:36.314129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:36.336849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:36.352662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f7e9df2-42ca-4c11-be90-4ba5a1cd2f5f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1519 microversion: 2.1 time: 0.391609 Aug 23 11:04:36.356519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:36.358350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:36.359567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e2994f8-57be-400b-be50-a19fb278a2fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.938964 Aug 23 11:04:36.360131 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2935/5904] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:35 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:36.391139 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2970/5905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:35 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1519 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:36.635847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f1a711e-9c3d-4608-a3b5-25e8be9fb3e5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1278212846", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f1a711e-9c3d-4608-a3b5-25e8be9fb3e5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 243 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1278212846", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1278212846', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '14e23546-1412-4fd6-8c7e-47bc2d88a89d'}]}}} Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:36.640073 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f1a711e-9c3d-4608-a3b5-25e8be9fb3e5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:36.643736 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f1a711e-9c3d-4608-a3b5-25e8be9fb3e5 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012865 Aug 23 11:04:36.646110 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2936/5906] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:04:36 2022] POST /compute/v2.1/servers => generated 175 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:04:36.656539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69c8cef2-822b-49f9-8abb-7282f4933c68 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:36.657487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-69c8cef2-822b-49f9-8abb-7282f4933c68 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: 125ed2c9-8810-4097-a0da-b6571a20aafd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:36.677122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-69c8cef2-822b-49f9-8abb-7282f4933c68 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] HTTP exception thrown: Instance 125ed2c9-8810-4097-a0da-b6571a20aafd could not be found. Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69c8cef2-822b-49f9-8abb-7282f4933c68 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/125ed2c9-8810-4097-a0da-b6571a20aafd/metadata HTTP/1.1 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 125ed2c9-8810-4097-a0da-b6571a20aafd could not be found. Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '125ed2c9-8810-4097-a0da-b6571a20aafd'} Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125ed2c9-8810-4097-a0da-b6571a20aafd could not be found. Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125ed2c9-8810-4097-a0da-b6571a20aafd could not be found. Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:36.695604 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:36.699844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:04:36.699844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:04:36.699844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125ed2c9-8810-4097-a0da-b6571a20aafd could not be found. Aug 23 11:04:36.699844 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.701557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69c8cef2-822b-49f9-8abb-7282f4933c68 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 404 to user: Instance 125ed2c9-8810-4097-a0da-b6571a20aafd could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:36.705404 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69c8cef2-822b-49f9-8abb-7282f4933c68 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/125ed2c9-8810-4097-a0da-b6571a20aafd/metadata" status: 404 len: 111 microversion: 2.1 time: 0.054311 Aug 23 11:04:36.706486 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2971/5907] 10.222.0.78 () {58 vars in 1263 bytes} [Tue Aug 23 11:04:36 2022] GET /compute/v2.1/servers/125ed2c9-8810-4097-a0da-b6571a20aafd/metadata => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:04:36.794086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbc5a199-09ba-445d-8431-c584406a8945 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-769827321", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbc5a199-09ba-445d-8431-c584406a8945 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 498 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-769827321", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-769827321', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '14e23546-1412-4fd6-8c7e-47bc2d88a89d'}]}}} Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 11:04:36.799912 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:36.803009 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:36.806256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbc5a199-09ba-445d-8431-c584406a8945 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:36.807665 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dbc5a199-09ba-445d-8431-c584406a8945 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018275 Aug 23 11:04:36.812474 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2937/5908] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:04:36 2022] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:04:37.075765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da8900e4-8977-4078-8fbb-7829ba1df8e0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1993625507", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da8900e4-8977-4078-8fbb-7829ba1df8e0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 500 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1993625507", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1993625507', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '14e23546-1412-4fd6-8c7e-47bc2d88a89d'}]}}} Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 11:04:37.099254 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da8900e4-8977-4078-8fbb-7829ba1df8e0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da8900e4-8977-4078-8fbb-7829ba1df8e0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.038561 Aug 23 11:04:37.102885 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2972/5909] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:04:37 2022] POST /compute/v2.1/servers => generated 689 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:04:37.205914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-578fcfb9-a863-40a8-8a2e-50ecffaa94cc tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-220903639", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-578fcfb9-a863-40a8-8a2e-50ecffaa94cc tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 753 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-220903639", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-220903639', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '14e23546-1412-4fd6-8c7e-47bc2d88a89d'}]}}} Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:04:37.213799 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:04:37.216187 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:04:37.222002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.222002 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.228284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-578fcfb9-a863-40a8-8a2e-50ecffaa94cc tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:37.229510 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-578fcfb9-a863-40a8-8a2e-50ecffaa94cc tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.028169 Aug 23 11:04:37.233269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2938/5910] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:04:37 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 23 11:04:37.347541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3cadac-98d3-4fe7-8143-ff3b7a3ddc84 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1380444354", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3cadac-98d3-4fe7-8143-ff3b7a3ddc84 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 1266 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1380444354", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "14e23546-1412-4fd6-8c7e-47bc2d88a89d"}]}} Aug 23 11:04:37.386717 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1380444354', 'imageRef': 'b4ffccc2-7c96-4941-8a42-0d5d5e6236b8', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '14e23546-1412-4fd6-8c7e-47bc2d88a89d'}]}}} Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.388972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:04:37.390121 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:04:37.392140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 11:04:37.392140 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.392140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3cadac-98d3-4fe7-8143-ff3b7a3ddc84 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:37.392413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:37.392637 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe3cadac-98d3-4fe7-8143-ff3b7a3ddc84 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.048982 Aug 23 11:04:37.398929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2973/5911] 10.222.0.78 () {60 vars in 1148 bytes} [Tue Aug 23 11:04:37 2022] POST /compute/v2.1/servers => generated 2221 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 23 11:04:37.399115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:37.416386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:37.416931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:37.417381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:37.421796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:37.421796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:37.421989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f501e792-7ef8-453f-b655-c80714839de0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:37.422092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:37.425018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f501e792-7ef8-453f-b655-c80714839de0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: 73d7a350-c693-4284-98e9-810468e4c15d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:37.438604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f501e792-7ef8-453f-b655-c80714839de0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] HTTP exception thrown: Instance 73d7a350-c693-4284-98e9-810468e4c15d could not be found. Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f501e792-7ef8-453f-b655-c80714839de0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/73d7a350-c693-4284-98e9-810468e4c15d/metadata/test2 HTTP/1.1 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 73d7a350-c693-4284-98e9-810468e4c15d could not be found. Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '73d7a350-c693-4284-98e9-810468e4c15d', 'id': 'test2'} Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d7a350-c693-4284-98e9-810468e4c15d could not be found. Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d7a350-c693-4284-98e9-810468e4c15d could not be found. Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:37.451675 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:37.456041 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:04:37.456041 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:04:37.456041 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d7a350-c693-4284-98e9-810468e4c15d could not be found. Aug 23 11:04:37.456041 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:37.456041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f501e792-7ef8-453f-b655-c80714839de0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 404 to user: Instance 73d7a350-c693-4284-98e9-810468e4c15d could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:37.461283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f501e792-7ef8-453f-b655-c80714839de0 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/73d7a350-c693-4284-98e9-810468e4c15d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.050797 Aug 23 11:04:37.474627 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2974/5912] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 11:04:37 2022] GET /compute/v2.1/servers/73d7a350-c693-4284-98e9-810468e4c15d/metadata/test2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:04:37.486111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:37.486854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:37.497146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:37.497675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:37.498160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:37.508284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:37.509639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:37.510358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:37.546509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:04:37.662522 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-18f74545-bb18-4cc0-a43c-ebfcea2c73a1 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 204 len: 0 microversion: 2.1 time: 0.185787 Aug 23 11:04:37.663662 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2975/5913] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:04:37 2022] DELETE /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:04:37.673205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:37.674172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:37.681040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:37.681977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:37.682616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:37.683809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:37.684446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:37.685199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:37.806990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:37.829546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:37.839909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:37.843360 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a428977d-4a2a-4c60-8b0c-8ba2e4f92762 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.459604 Aug 23 11:04:37.845763 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2939/5914] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:37 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:37.908827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:37.923274 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f2581626-bdfe-4cb5-a9a7-1d1b0fd3112b tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1525 microversion: 2.1 time: 0.255264 Aug 23 11:04:37.924771 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2976/5915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:37 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1525 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:04:38.870654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:38.871822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:38.885097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:38.892042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:38.892667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:38.893629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:38.894251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:38.894839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:38.945851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:38.946474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:38.972189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:38.977395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:38.983992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:38.986494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:38.989408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:38.989966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:38.996418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:39.320630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:39.329647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a8696e42-d61e-47a9-b711-db33c3dd820f tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1525 microversion: 2.1 time: 0.388966 Aug 23 11:04:39.344678 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2977/5916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:38 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1525 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:39.620663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:39.660665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:39.673159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:39.687374 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-734b7732-07ae-4d16-a642-4e11f6d51c48 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.820598 Aug 23 11:04:39.689785 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2940/5917] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:38 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:40.351720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:40.352457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:40.362720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:40.363876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:40.364683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:40.366352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:40.367863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:40.369174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:40.624888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4e7141e3-ea89-4de4-8717-bebae6b3bece req-625c0126-a0ce-47a5-98cd-1d2e42710bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91", "name": "network-vif-deleted", "tag": "a7a22396-a576-4973-ade9-322844fcc997"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:40.659228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4e7141e3-ea89-4de4-8717-bebae6b3bece req-625c0126-a0ce-47a5-98cd-1d2e42710bb7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:40.659935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4e7141e3-ea89-4de4-8717-bebae6b3bece req-625c0126-a0ce-47a5-98cd-1d2e42710bb7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:40.660391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4e7141e3-ea89-4de4-8717-bebae6b3bece req-625c0126-a0ce-47a5-98cd-1d2e42710bb7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:40.687896 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4e7141e3-ea89-4de4-8717-bebae6b3bece req-625c0126-a0ce-47a5-98cd-1d2e42710bb7 service nova] Creating event network-vif-deleted:a7a22396-a576-4973-ade9-322844fcc997 for instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 on n-h1-847009-13 Aug 23 11:04:40.697677 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4e7141e3-ea89-4de4-8717-bebae6b3bece req-625c0126-a0ce-47a5-98cd-1d2e42710bb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076448 Aug 23 11:04:40.702781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2941/5918] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:04:40.719735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:40.736089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:40.755394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:40.756342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:40.757281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:40.758178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:40.758906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:40.759849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:41.042554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:41.054256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:41.058558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:41.060309 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50536225-ba75-4193-affb-1777f7d84f26 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1744 microversion: 2.20 time: 0.347795 Aug 23 11:04:41.061626 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2942/5919] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:40 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1744 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:41.477917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67e824e125e4eb9a412794df8f98a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059cd3e97ac4382a1db81be10347241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:41.488360 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ae0a9e9-85df-4bdb-b8d0-f589e182d6d7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 200 len: 1525 microversion: 2.1 time: 1.140498 Aug 23 11:04:41.489465 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2978/5920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:40 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 1525 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:42.086805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:42.088066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:42.101750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:42.102551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:42.103006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:42.105824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:42.109406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:42.110150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:42.512251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:42.513196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] [instance: fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:42.528247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:42.535661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:42.536721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:42.542228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:42.543414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:42.544099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:42.545878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:42.566358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:42.568789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:42.570419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f98d950-59e4-43c3-b0d4-b9596634eb21 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.490421 Aug 23 11:04:42.571431 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2943/5921] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:42 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:42.585639 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] HTTP exception thrown: Instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 could not be found. Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Request method failure captured: Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 HTTP/1.1 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLQt0AMe-rQDs5BaTHFFR_4R6q2pD-mqqpY6TccscljSu8hSlw82sNidUyVXtKHGoQF1iOWxapGpzch8hgf6anKi0ucV3NErPUDny2dM3yIEiwqKyjklSKMtB5Rj8nuUncQ8nVkSTU8aR-78swFKBx1jzlQkNPzpGMOB_PfeX1utceM Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c059cd3e97ac4382a1db81be10347241", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c059cd3e97ac4382a1db81be10347241"}]}] Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: c059cd3e97ac4382a1db81be10347241 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-818993465 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: c67e824e125e4eb9a412794df8f98a41 Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-818993465-project Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 could not be found. Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91'} Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 could not be found. Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 could not be found. Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:42.591378 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 could not be found. Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] Returning 404 to user: Instance fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:42.595222 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8b7ae61-f150-4cc9-972f-b47b88ce8ec7 tempest-ServerMetadataNegativeTestJSON-818993465 tempest-ServerMetadataNegativeTestJSON-818993465-project] 10.222.0.78 "GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91" status: 404 len: 111 microversion: 2.1 time: 0.087775 Aug 23 11:04:42.598399 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2979/5922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:42 2022] GET /compute/v2.1/servers/fabf7c88-43bc-4e9d-9bcd-5d9bbce83f91 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:04:43.608246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:43.609170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:43.629483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:43.630848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:43.631534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:43.633205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:43.633838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:43.634429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:44.146939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:44.159289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:44.160849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:44.173329 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0de08abe-c6cc-4710-8734-ffa9db2a2d24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.577816 Aug 23 11:04:44.189466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2944/5923] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:43 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:44.484903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02f00dc1-2702-4f79-b519-f49743b07ca2"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:44.487963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:44.495812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:44.510715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:44.511603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:44.512248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:44.513218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:44.513883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:44.514517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:44.539936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-286897e5-ba84-481c-b1ab-71c5612a473d req-a0e88e70-7caa-488c-9feb-0fea742667b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "name": "network-vif-plugged", "status": "completed", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:04:44.558814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-286897e5-ba84-481c-b1ab-71c5612a473d req-a0e88e70-7caa-488c-9feb-0fea742667b5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:44.559545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-286897e5-ba84-481c-b1ab-71c5612a473d req-a0e88e70-7caa-488c-9feb-0fea742667b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:44.560351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-286897e5-ba84-481c-b1ab-71c5612a473d req-a0e88e70-7caa-488c-9feb-0fea742667b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:44.593166 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-286897e5-ba84-481c-b1ab-71c5612a473d req-a0e88e70-7caa-488c-9feb-0fea742667b5 service nova] Creating event network-vif-plugged:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h2-847009-13 Aug 23 11:04:44.599202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-286897e5-ba84-481c-b1ab-71c5612a473d req-a0e88e70-7caa-488c-9feb-0fea742667b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063938 Aug 23 11:04:44.602234 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2945/5924] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:44.735790 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Invalid volume: volume 02f00dc1-2702-4f79-b519-f49743b07ca2 is already attached to instances: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments HTTP/1.1 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 74 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: {"volumeAttachment": {"volumeId": "02f00dc1-2702-4f79-b519-f49743b07ca2"}} Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid volume: volume 02f00dc1-2702-4f79-b519-f49743b07ca2 is already attached to instances: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '1681f67a-7711-4b1f-a0c9-c7f1da291f3a', 'body': {'volumeAttachment': {'volumeId': '02f00dc1-2702-4f79-b519-f49743b07ca2'}}} Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 02f00dc1-2702-4f79-b519-f49743b07ca2 is already attached to instances: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:44.737717 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 02f00dc1-2702-4f79-b519-f49743b07ca2 is already attached to instances: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 02f00dc1-2702-4f79-b519-f49743b07ca2 is already attached to instances: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a Aug 23 11:04:44.741990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:04:44.746663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 400 to user: Invalid volume: volume 02f00dc1-2702-4f79-b519-f49743b07ca2 is already attached to instances: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:04:44.749814 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a81d3686-701a-4bc9-8df1-ddef4daf8d3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.269147 Aug 23 11:04:44.754865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2980/5925] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:04:44 2022] POST /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 174 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:04:44.885602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:44.886355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:44.897193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:44.901079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:44.902810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:44.906174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:44.906813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:44.907384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:45.116462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lazy-loading 'services' on Instance uuid 1681f67a-7711-4b1f-a0c9-c7f1da291f3a {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:04:45.196079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:45.196703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:45.218269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:45.218779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:45.219234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:45.219973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:45.220449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:45.220925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:45.294576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c3898876-d7b7-4912-b9e9-d19f470d1b3c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments/02f00dc1-2702-4f79-b519-f49743b07ca2" status: 202 len: 0 microversion: 2.1 time: 0.414096 Aug 23 11:04:45.295283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2946/5926] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:04:44 2022] DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments/02f00dc1-2702-4f79-b519-f49743b07ca2 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:04:45.308026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:45.310585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:45.340088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:45.340609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:45.341095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:45.341824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:45.344392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:45.346959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:45.420456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:45.432131 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b85ea59-399e-4068-a368-2f8dbaa67f91 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132141 Aug 23 11:04:45.435241 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2947/5927] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:45 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:45.750042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:45.765996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:45.767568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:45.783855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73bd53c2-fa1c-4a93-b8e1-d0b7d49ba58e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.592042 Aug 23 11:04:45.785697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2981/5928] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:45 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:04:46.448297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:46.450476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:46.471524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:46.472045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:46.472494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:46.492429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:46.494300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:46.496001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:46.619743 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c40699e-0650-465b-97ed-fab3b539fa32 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176258 Aug 23 11:04:46.622161 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2948/5929] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:46 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:46.819434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:46.820602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:46.835555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:46.836304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:46.836945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:46.848874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:46.850929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:46.851545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:47.273446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:47.293041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:47.294822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:47.296184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7272958e-0792-477e-8900-219f0e40aab0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.481481 Aug 23 11:04:47.305104 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2982/5930] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:46 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:47.635877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:47.636636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:47.664878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:47.665395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:47.665852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:47.679674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:47.680679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:47.681186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:47.817029 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06514350-d144-490a-ad14-70515e2835eb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186208 Aug 23 11:04:47.818622 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2949/5931] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:47 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:48.324905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:48.326748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:48.341118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:48.342240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:48.342937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:48.343912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:48.345333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:48.346009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:48.829793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:48.833033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:48.848343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:48.856646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:48.857857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:48.858774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:48.859398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:48.860012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:48.949642 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8d421ee-c921-40e4-a0d5-38f932066779 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123976 Aug 23 11:04:48.955073 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2950/5932] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:48 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:49.188208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:49.213173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:49.221015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:49.231668 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13a8de4d-f23b-4808-9572-ffc77dd0f91d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.906161 Aug 23 11:04:49.253794 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2983/5933] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:48 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:49.987121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:49.989559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:50.001746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:50.002247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:50.002693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:50.012403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:50.012960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:50.015154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:50.116627 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d0731646-254a-4afb-9e83-19435074bdbb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147698 Aug 23 11:04:50.123809 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2951/5934] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:49 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:50.261200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:50.261968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:50.282494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:50.284763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:50.287804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:50.288609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:50.289133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:50.289580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:50.725999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:50.749652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:50.757454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:50.758991 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb8d71cb-e84f-4c2a-8358-fe3bc857e85f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.502102 Aug 23 11:04:50.759592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2984/5935] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:50 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:04:51.137123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:51.139377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:51.155827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:51.206855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:51.206855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:51.206855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:51.206855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:51.206855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:51.291091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b0a1372-08cc-4042-8625-cf2d66dc946d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158706 Aug 23 11:04:51.295633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2952/5936] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:51 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:51.783488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:51.784650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:51.798008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:51.798667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:51.799262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:51.800136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:51.803628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:51.804303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:52.268470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:52.281590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:52.283559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:52.289706 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29d1fcd4-54ca-4f32-b2d6-bc068cf8a80e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.509483 Aug 23 11:04:52.291207 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2985/5937] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:51 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:04:52.305042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:52.307925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:52.321664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=58 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:04:52.323972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:52.327029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:52.330947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:52.333882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:52.335276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:52.336656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:52.418177 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb0ee9fe-e048-4bd5-9e24-782217f568a3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118446 Aug 23 11:04:52.418785 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2953/5938] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:52 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:53.316858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:53.317493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:53.328083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:53.328464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:53.335888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:53.337227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:53.337868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:53.338779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:53.431794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:53.435078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:53.459371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:53.460275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:53.460919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:53.461845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:53.462979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:53.466279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:53.545629 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5be49ffd-a1a1-4a17-b284-9cf806d5448f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118788 Aug 23 11:04:53.568996 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2954/5939] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:53 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:04:53.852199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:53.876238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:53.880059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:53.885254 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be723e30-345a-4ecb-830d-3a3b3aa9e80f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.573382 Aug 23 11:04:53.892582 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2986/5940] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:53 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:54.575649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:54.583278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:54.606915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:54.619664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:54.622237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:54.623131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:54.631235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:54.638583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:54.739292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a11f6493-f8f1-42d6-a0b7-70b729d6fba9 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171687 Aug 23 11:04:54.740518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2955/5941] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:54 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:54.920221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:54.920903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:54.945233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:54.945985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:54.946586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:54.947646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:54.948262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:54.948868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:55.295150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:55.308465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:55.313268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:55.318326 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33de8541-2be2-4c99-ab7a-0561ee55db07 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.401228 Aug 23 11:04:55.320231 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2987/5942] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:54 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:55.753031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:55.760363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:55.778428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:55.779217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:55.781185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:55.782337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:55.784251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:55.785520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:55.902178 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94a9adc7-b3d3-492f-b22f-404132fb6199 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148283 Aug 23 11:04:55.902867 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2956/5943] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:55 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:04:56.347632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:56.348508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:56.368256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:56.369095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:56.371575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:56.374779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:56.375269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:56.389084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:56.915546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:56.918122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:56.924764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:56.939240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:56.940587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:56.941365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:56.942032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:56.942378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:56.943693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:56.944386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:56.945061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:56.945173 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b50f0f23-0371-4b9f-801a-bad1eea83ba8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.602214 Aug 23 11:04:56.948251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2988/5944] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:56 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:57.045715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-013fc631-441b-4889-a511-b1c0c60bbeed tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129528 Aug 23 11:04:57.049357 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2957/5945] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:04:56 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:04:57.151227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:57.153631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:57.162983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:57.163746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:57.164877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:57.166293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:57.166949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:57.167571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:57.223093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:04:57.428915 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4494be4-243a-48ab-afda-caf6dd7a171e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 204 len: 0 microversion: 2.1 time: 0.284167 Aug 23 11:04:57.429829 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2989/5946] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:04:57 2022] DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:04:57.443492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:57.444475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:57.460428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:57.472072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:57.472984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:57.478221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:57.483609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:57.484179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:57.869870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:57.884897 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-536437b4-9c00-4b69-b44b-b40ca390e156 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1680 microversion: 2.1 time: 0.450357 Aug 23 11:04:57.886790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2958/5947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:57 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1680 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:57.986816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:57.987539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:57.994546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:57.995264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:57.995876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:57.996851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:57.997489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:57.998075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:58.604807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:58.623243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:58.630824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:58.632080 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a939b68c-84ed-429c-9c2b-93015ca127d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.650574 Aug 23 11:04:58.639729 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2990/5948] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:57 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:04:58.915858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:58.917395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:58.964965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:58.969221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:58.969790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:58.970630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:58.978527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:58.980101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:59.598451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:04:59.612878 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4fa4c42b-be2b-4c40-a9fe-0a0f318e3ac8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1680 microversion: 2.1 time: 0.703077 Aug 23 11:04:59.615514 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2959/5949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:04:58 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1680 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:04:59.666250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:04:59.667622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:04:59.682086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:59.682833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:59.683440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:04:59.686378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:04:59.687070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:04:59.689343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:00.468022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:00.469328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:00.483461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:00.484917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:00.486586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:00.488563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:00.493458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:00.494272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:00.904244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:00.920397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:00.922900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:00.924764 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5107581a-984c-4a8b-ad89-90092fabdee8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 1.263450 Aug 23 11:05:00.938086 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2991/5950] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:04:59 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:00.943991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:00.944819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:00.983982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:00.984840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:00.986910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:00.988878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:00.990082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:00.992942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:01.535547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dd55b60-10f1-42dc-92ea-8a14ed8ebfa8 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1835 microversion: 2.1 time: 1.073901 Aug 23 11:05:01.538840 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2960/5951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:00 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1835 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:01.561083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:01.561704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:01.577878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:01.578689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:01.579347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:01.580256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:01.583609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:01.584807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:01.940311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:01.952384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adc8e4e1-656f-4816-bb31-b7da0e28e12a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1682 microversion: 2.1 time: 0.395572 Aug 23 11:05:01.990150 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2961/5952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:01 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1682 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:01.996318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:01.996991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:02.006885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:02.007592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:02.008015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:02.009019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:02.009497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:02.010218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:02.358000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:02.364047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:02.407581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c921bf80-71c6-47e8-ae25-7f390f20c67d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1680 microversion: 2.1 time: 1.468078 Aug 23 11:05:02.411648 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2992/5953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:00 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1680 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:02.420613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:02.433656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:02.468515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:02.469786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:02.471602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:02.471767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:02.472716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:02.473658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:02.474802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:02.486601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:02.493579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:02.497753 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa03a07c-3b48-498a-89a5-c2c5b45e0c13 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.506343 Aug 23 11:05:02.500577 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2962/5954] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:01 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:02.592330 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c987c90-9698-4fd9-9de5-a73f5183007a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action" status: 200 len: 32644 microversion: 2.1 time: 0.179026 Aug 23 11:05:02.593043 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2993/5955] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:05:02 2022] POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action => generated 32644 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:05:02.742949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:02.743696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:02.755423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:02.755845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:02.756295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:02.758961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:02.761168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:02.761829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.022403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0403d0b67c3f48a39ce78ddd87609360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583559b4ceaa42ae88fdd5e2e47f57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:03.023083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] flavor_id is None. Assuming migration. {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 11:05:03.023541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:05:03.370778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:03.432952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:03.433664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:03.445245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:03.446042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:03.446642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.447529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:03.449337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:03.450367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.450823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72878392-6933-4ac3-b699-4ca4db47037f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action" status: 202 len: 0 microversion: 2.1 time: 0.712307 Aug 23 11:05:03.455466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2963/5956] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:05:02 2022] POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:05:03.461926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:03.464243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:03.471433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:03.472178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:03.473117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.476133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:03.476917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:03.477511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.628079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:03.647962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb1df541-9382-4592-a121-e00c3c657e94 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1612 microversion: 2.1 time: 0.219257 Aug 23 11:05:03.649851 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2994/5957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:03 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1612 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:03.667545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:03.670569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:03.683410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:03.684527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:03.685746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.688479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:03.689444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:03.690184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:03.823667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:03.839873 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-375b2fc9-dad1-4d99-a383-ba42cc8265f7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1691 microversion: 2.1 time: 0.383277 Aug 23 11:05:03.840684 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2964/5958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:03 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1691 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:04.272123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:04.299332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:04.301259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:04.304675 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c1b08ca-7c4b-4017-b63a-db715ed6a864 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.651568 Aug 23 11:05:04.308480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2995/5959] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:03 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:04.674210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:04.674842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:04.687943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:04.688460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:04.688987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:04.691348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:04.694840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:04.696670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:04.837771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d42d8a1f-996a-4ebd-b973-83dd46adf5a3 req-b9f5b39e-da80-47b2-93d9-fa3a6e0a4fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1681f67a-7711-4b1f-a0c9-c7f1da291f3a", "name": "network-vif-deleted", "tag": "fba499ac-6bfb-4613-aa50-97aefe81572f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:04.867422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d42d8a1f-996a-4ebd-b973-83dd46adf5a3 req-b9f5b39e-da80-47b2-93d9-fa3a6e0a4fb7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:04.868586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d42d8a1f-996a-4ebd-b973-83dd46adf5a3 req-b9f5b39e-da80-47b2-93d9-fa3a6e0a4fb7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:04.869073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d42d8a1f-996a-4ebd-b973-83dd46adf5a3 req-b9f5b39e-da80-47b2-93d9-fa3a6e0a4fb7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:04.910297 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d42d8a1f-996a-4ebd-b973-83dd46adf5a3 req-b9f5b39e-da80-47b2-93d9-fa3a6e0a4fb7 service nova] Creating event network-vif-deleted:fba499ac-6bfb-4613-aa50-97aefe81572f for instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a on n-h2-847009-13 Aug 23 11:05:04.925409 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d42d8a1f-996a-4ebd-b973-83dd46adf5a3 req-b9f5b39e-da80-47b2-93d9-fa3a6e0a4fb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091511 Aug 23 11:05:04.931125 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2996/5960] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:05:04.953056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:04.954091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:04.956519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:04.970631 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3055f8a7-fe7d-451a-85c6-d816050d07a1 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 200 len: 1612 microversion: 2.1 time: 0.300565 Aug 23 11:05:04.971268 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2965/5961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:04 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 1612 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:04.980601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:04.981312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:04.981769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:04.982758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:04.983751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:04.983751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:05.335109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:05.336058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:05.352943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:05.354998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:05.355675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:05.356896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:05.357953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:05.358589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:05.813523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:05.885896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:05.887750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:05.889023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80c88088-c8bd-4027-b822-51f918705140 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.560652 Aug 23 11:05:05.905724 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2966/5962] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:05 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:05.993945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:05.995904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:06.018335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:06.037979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:06.050771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:06.051895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:06.052409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:06.052911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:06.141879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a HTTP/1.1 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1681f67a-7711-4b1f-a0c9-c7f1da291f3a'} Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:06.143639 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6bb5e8c-c42a-4aef-95ea-1ea068b4102d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 404 len: 111 microversion: 2.1 time: 0.156829 Aug 23 11:05:06.150198 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2967/5963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:05 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:05:06.193406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:06.196195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d09f6d21-35bf-4ace-bbd7-14f2f9dbd370 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '.version_select at 0x7fdc8fe731f0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:06.217664 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6c53182-7d64-43ed-94a8-ae795686c220 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1691 microversion: 2.1 time: 1.282657 Aug 23 11:05:06.220511 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2997/5964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:04 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1691 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:06.279466 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d09f6d21-35bf-4ace-bbd7-14f2f9dbd370 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219460688" status: 202 len: 0 microversion: 2.1 time: 0.100418 Aug 23 11:05:06.280508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2968/5965] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 11:05:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219460688 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:05:06.930320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:06.930946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:06.956124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:06.956665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:06.957198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:06.958014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:06.961425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:06.963702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:07.245057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:07.246779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:07.269322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:07.270108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:07.270775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:07.271747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:07.272371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:07.273021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:07.341760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:07.351590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:07.368599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:07.370147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34ad9d1d-bed1-4d05-bc48-e458a9d0fa76 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 0.443956 Aug 23 11:05:07.371213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2998/5966] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:06 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:08.101112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:08.118604 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3ef9ae32-e2a1-466d-95e2-e56beafa7e89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1691 microversion: 2.1 time: 0.879635 Aug 23 11:05:08.120755 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2969/5967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:07 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1691 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:08.394833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:08.396465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:08.415058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:08.415857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:08.416463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:08.417394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:08.418147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:08.418822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:09.145377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:09.148153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:09.158739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:09.159537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:09.160158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:09.160941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:09.162750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:09.163458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:09.527535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:09.540422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:09.543441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:09.546950 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-895ad93e-e305-4eae-8c6f-2d3c78c9cc2d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1739 microversion: 2.20 time: 1.156057 Aug 23 11:05:09.566425 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 2999/5968] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:08 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1739 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:09.636113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:09.654565 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2bdd2aed-3eca-4903-b20a-a30db110dc86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1691 microversion: 2.1 time: 0.512912 Aug 23 11:05:09.658058 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2970/5969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:09 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1691 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:09.884771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-239f82a4-2961-472a-b2e5-feae11dd78cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: .version_select at 0x7fdca1e540d0>, body: {"keypair": {"name": "tempest-keypair-924297916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLujiy+eNgaZ3anVWzSuDubhcW7Dp5QsL/cnIyW/h7Zl0ZwX8fv81C4csXtFaASRYMM9sMR3bku1xoCmzjz2j02ebD1H5XMkXPAwvtoBklUZgOxDp8xQoUuph410HWkhWA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:09.904423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-239f82a4-2961-472a-b2e5-feae11dd78cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:05:09.912587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-239f82a4-2961-472a-b2e5-feae11dd78cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:05:09.948938 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-239f82a4-2961-472a-b2e5-feae11dd78cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069490 Aug 23 11:05:09.950259 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3000/5970] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:05:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:10.579892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:10.586262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:10.599312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:10.600169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:10.600844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:10.602007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:10.602828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:10.603526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:10.681660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:10.683623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:10.710330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:10.711219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:10.713350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:10.721217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:10.721926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:10.725017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:11.551356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:11.588386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:11.590785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:11.592531 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b93f2b7-e583-48f3-92ff-ca4aae12b5e2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1721 microversion: 2.20 time: 1.025314 Aug 23 11:05:11.593679 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2971/5971] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:10 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1721 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:11.784054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:11.803000 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11303496-891a-491c-897b-297834e7db0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1696 microversion: 2.1 time: 1.125396 Aug 23 11:05:11.805974 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3001/5972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:10 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1696 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:11.959533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:11.960234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:11.973060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:11.981824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:11.982771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:11.983643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:11.984225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:11.984798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:12.032405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:05:12.336370 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b80c49e-c8e7-4e73-8afe-adbf5c7009dd tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 204 len: 0 microversion: 2.1 time: 0.378475 Aug 23 11:05:12.337985 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2972/5973] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:05:11 2022] DELETE /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:05:12.346084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:12.346708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:12.372460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:12.373095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:12.373727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:12.374719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:12.375339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:12.375954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:12.619250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:12.619978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:12.634675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:12.635192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:12.635639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:12.636379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:12.636870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:12.637308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:13.437098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:13.451587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:13.454446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:13.456583 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25f1e791-429e-48f2-ae8d-0f5b52e87268 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1721 microversion: 2.20 time: 0.842560 Aug 23 11:05:13.477096 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2973/5974] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:12 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1721 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:13.487696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-525598d0-b366-4fee-911b-077e929327b1 req-fc9aa47c-b9b8-4530-821c-2bf3a0ab24d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "name": "network-vif-unplugged", "status": "completed", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:13.502939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-525598d0-b366-4fee-911b-077e929327b1 req-fc9aa47c-b9b8-4530-821c-2bf3a0ab24d7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:13.503827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-525598d0-b366-4fee-911b-077e929327b1 req-fc9aa47c-b9b8-4530-821c-2bf3a0ab24d7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:13.504533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-525598d0-b366-4fee-911b-077e929327b1 req-fc9aa47c-b9b8-4530-821c-2bf3a0ab24d7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:13.529944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-525598d0-b366-4fee-911b-077e929327b1 req-fc9aa47c-b9b8-4530-821c-2bf3a0ab24d7 service nova] Creating event network-vif-unplugged:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h2-847009-13 Aug 23 11:05:13.540977 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-525598d0-b366-4fee-911b-077e929327b1 req-fc9aa47c-b9b8-4530-821c-2bf3a0ab24d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062438 Aug 23 11:05:13.543867 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2974/5975] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:13.557019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:13.561524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:13.573932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:13.574668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:13.575371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:13.577390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:13.579572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:13.580725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:13.642887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:13.656729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5dad8dd-9395-42bb-8e32-379e8cf58bbb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1549 microversion: 2.1 time: 1.314489 Aug 23 11:05:13.666117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3002/5976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:12 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1549 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:13.815419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-391593118", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "603bf1d0-2cdf-4b9e-8412-ea0191c6dec5"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:13.894570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] validate_networks() for [('603bf1d0-2cdf-4b9e-8412-ea0191c6dec5', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:05:14.473834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:14.492533 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74d6eaa1-1606-4e95-a479-9f914b8212b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1696 microversion: 2.1 time: 0.945815 Aug 23 11:05:14.521698 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2975/5977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:13 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1696 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:14.531205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:14.537657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:14.582006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:14.587101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:14.587602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:14.600190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:14.600768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:14.601580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:15.215624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:05:15.216766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:05:15.218136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:05:15.219074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:05:15.219713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:05:15.235661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:15.250978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:15.251782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:15.253655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:15.258454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:15.259262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:15.259882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:15.311090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Getting quotas for project 6106abc214e0455e9e77687089cc7602. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:05:15.339196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Getting quotas for user 90b881e698b84813938b3956fa5d774c and project 6106abc214e0455e9e77687089cc7602. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:05:15.349626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:15.371305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:05:15.373539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:15.375322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:15.378498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54abed95-41e4-4ccc-9cf9-0a77d18fb9a8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1724 microversion: 2.20 time: 0.855230 Aug 23 11:05:15.379600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:05:15.381086 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2976/5978] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:14 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1724 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:15.398344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:15.398344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:15.407487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:15.416210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:15.419768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:15.420824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:15.422761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:15.423496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:15.551644 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d002a8f4-d73a-48c4-898f-6c34db9c3895 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.884081 Aug 23 11:05:15.553195 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3003/5979] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 11:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 11:05:15.558753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10fb829a-ac92-4b51-8dcd-e3b61329b01c"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:15.561693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:15.568780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:15.569661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:15.570335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:15.571295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:15.571973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:15.572621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:16.275750 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b3dc0fb7-93d0-4c9a-8421-96c3af486664 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.721045 Aug 23 11:05:16.276402 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3004/5980] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Aug 23 11:05:15 2022] POST /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 188 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:05:16.287984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:16.289009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:16.303531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:16.304229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:16.304715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:16.312425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:16.313001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:16.313642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:16.832293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:16.845310 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5208edba-735d-4acd-b23e-691cb89a5362 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1549 microversion: 2.1 time: 1.462854 Aug 23 11:05:16.846548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2977/5981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:15 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1549 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:16.859285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:16.860140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:16.877998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:16.878858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:16.879523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:16.881040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:16.881723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:16.882312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:16.935768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:16.947092 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24c7a4be-217e-4a5e-9b03-4d81d8c27a5b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1696 microversion: 2.1 time: 0.667226 Aug 23 11:05:16.948957 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3005/5982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:16 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1696 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:16.954075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:16.955543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:16.973000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:16.974755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:16.985029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:16.985859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:16.986525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:16.986967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:17.061414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:17.076958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:17.082022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:17.088308 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36b3f8ff-1b2c-4ee1-9c24-990f93d56413 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1257 microversion: 2.26 time: 0.228705 Aug 23 11:05:17.089381 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2978/5983] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:16 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1257 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:17.109728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-970045852", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f55c759-5d12-4910-a3ab-34c9a1a8a48c"}], "security_groups": [{"name": "tempest-securitygroup--890227833"}], "key_name": "tempest-keypair-924297916", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:17.113923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128859) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 11:05:17.318404 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b754e1c6-b199-4d2f-8f88-8108109251a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/action" status: 202 len: 0 microversion: 2.20 time: 0.368095 Aug 23 11:05:17.319044 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3006/5984] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 11:05:16 2022] POST /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:05:17.331233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:17.332069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:17.342906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:17.343957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:17.346206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:17.347480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:17.349655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:17.350614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:17.593355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:17.609221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:17.612858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] validate_networks() for [('3f55c759-5d12-4910-a3ab-34c9a1a8a48c', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:05:17.616776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:17.621129 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5c4b303f-0f6e-461a-a35e-21915abffd0e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1750 microversion: 2.20 time: 0.294896 Aug 23 11:05:17.622325 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3007/5985] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:17 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1750 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:17.635826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e06d49e9-08cc-42c8-ad9e-8cec876484dc req-f70ee663-9dad-4fc8-8348-510679e4269e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7376b9f2-4048-4540-bca2-b4be8bc321cc", "name": "network-vif-deleted", "tag": "67b5cfae-caa4-4796-b2a8-fabe7cd338a8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:17.660076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e06d49e9-08cc-42c8-ad9e-8cec876484dc req-f70ee663-9dad-4fc8-8348-510679e4269e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:17.660574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e06d49e9-08cc-42c8-ad9e-8cec876484dc req-f70ee663-9dad-4fc8-8348-510679e4269e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:17.664910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e06d49e9-08cc-42c8-ad9e-8cec876484dc req-f70ee663-9dad-4fc8-8348-510679e4269e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:17.696918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e06d49e9-08cc-42c8-ad9e-8cec876484dc req-f70ee663-9dad-4fc8-8348-510679e4269e service nova] Creating event network-vif-deleted:67b5cfae-caa4-4796-b2a8-fabe7cd338a8 for instance 7376b9f2-4048-4540-bca2-b4be8bc321cc on n-h1-847009-13 Aug 23 11:05:17.727319 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e06d49e9-08cc-42c8-ad9e-8cec876484dc req-f70ee663-9dad-4fc8-8348-510679e4269e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103358 Aug 23 11:05:17.731562 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3008/5986] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:17.872249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:17.873072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:17.891568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:17.892156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:17.892674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:17.893449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:17.894329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:17.896360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:17.902996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:18.039598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:18.039927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:18.040554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:18.041342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lazy-loading 'fault' on Instance uuid 7376b9f2-4048-4540-bca2-b4be8bc321cc {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:18.172932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:18.200145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f518269f-343b-40c7-8aca-3e79f06bf529 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 200 len: 1337 microversion: 2.1 time: 0.331995 Aug 23 11:05:18.201808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3009/5987] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:17 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 1337 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:18.214522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:18.215895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:18.236069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:18.236953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:18.237660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:18.239137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:18.240302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:18.241071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:18.621033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:18.632496 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-76a0d53f-c9d6-4eeb-9c67-b437ee53393b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1696 microversion: 2.1 time: 0.426873 Aug 23 11:05:18.633834 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3010/5988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:18 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1696 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:18.644142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:18.646481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:18.655198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:18.656249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:18.672773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:18.673669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:18.674225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:18.674681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.074457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:19.083767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:19.096331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:19.097675 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1af09c6a-d976-4a98-8506-b5917a07f767 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1319 microversion: 2.26 time: 0.460668 Aug 23 11:05:19.099052 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3011/5989] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:18 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:19.104462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:19.113609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:19.134058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.135498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.136159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.137571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.139255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.143514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.529849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:05:19.530305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:05:19.530914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:05:19.531503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:05:19.532132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:05:19.549968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.552799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.553566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.556464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.557290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.558557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.613584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:05:19.622226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Getting quotas for user 6081acd297624c4886ff96b386660e2b and project 1b88ec95895e4b2ab072bbb410a75f0c. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:05:19.640452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:05:19.642134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:19.643751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:05:19.655842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:19.657561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:19.658894 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba14f11a-ba8c-43ab-afad-782fe95d9d92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1750 microversion: 2.20 time: 0.558577 Aug 23 11:05:19.661422 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3012/5990] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:19 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1750 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:19.670899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:19.672143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 7376b9f2-4048-4540-bca2-b4be8bc321cc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:19.706477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.711851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.712597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.718727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.719651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.720112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.763086 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97b9eb7a-9503-4a1f-9118-b12e4d15b040 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.671790 Aug 23 11:05:19.775165 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] HTTP exception thrown: Instance 7376b9f2-4048-4540-bca2-b4be8bc321cc could not be found. Aug 23 11:05:19.775436 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2979/5991] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:05:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Request method failure captured: Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc HTTP/1.1 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLO7JkE-RbwT1jRuNPIfkNHOjxrrXwLYrT4BQ1ZRGnlXoDOljlqPmD8xhhaIM7JgK95_9UXJFtO_vLqV87nfl4mRcZh7sO-RfIG5hFqbnOayJttMJklmFpKnCjA4xXAIi65iGTfa-kKRME0-XWbIxAGpvCLPu7zuQqE1-I4oRKIMSrg Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ae502704266349bab5642ad154ea1085 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ae502704266349bab5642ad154ea1085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ae502704266349bab5642ad154ea1085", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ae502704266349bab5642ad154ea1085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ae502704266349bab5642ad154ea1085"}]}] Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ae502704266349bab5642ad154ea1085 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestNetworkBasicOps-1990801935-project Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4bb6e7d862d84e1c9f5d129b0c41bc37 Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestNetworkBasicOps-1990801935-project Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 7376b9f2-4048-4540-bca2-b4be8bc321cc could not be found. Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '7376b9f2-4048-4540-bca2-b4be8bc321cc'} Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7376b9f2-4048-4540-bca2-b4be8bc321cc could not be found. Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7376b9f2-4048-4540-bca2-b4be8bc321cc could not be found. Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:19.779023 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7376b9f2-4048-4540-bca2-b4be8bc321cc could not be found. Aug 23 11:05:19.783282 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:19.787774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Returning 404 to user: Instance 7376b9f2-4048-4540-bca2-b4be8bc321cc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:05:19.788857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3eff1300-96b2-48c5-a7c0-dee33593dc60 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc" status: 404 len: 111 microversion: 2.1 time: 0.125469 Aug 23 11:05:19.795092 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3013/5992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:19 2022] GET /compute/v2.1/servers/7376b9f2-4048-4540-bca2-b4be8bc321cc => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:05:19.800908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b4a17e8-f41d-461c-845b-7b719087672c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:19.803019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b4a17e8-f41d-461c-845b-7b719087672c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:19.807235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:19.813413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:19.832199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.847321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.848419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:19.849975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:19.852524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:19.853155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:20.327347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:20.331262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:20.338199 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-083d0a6e-7d33-4cd2-91fb-16d92565947f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1696 microversion: 2.1 time: 0.561287 Aug 23 11:05:20.344783 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2980/5993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:19 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1696 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:20.351466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:20.352672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:20.367919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:20.368858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:20.369526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:20.370754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:20.381105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:20.381912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:20.506021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:20.528139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:20.530114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:20.531349 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e0e2633-4ea1-4e3d-ae70-49ccd53f258c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1319 microversion: 2.26 time: 0.185169 Aug 23 11:05:20.538052 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2981/5994] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:20 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:20.686186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:20.686813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:20.698417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:20.699488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:20.699978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:20.702980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:20.703479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:20.703926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:20.930609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b4a17e8-f41d-461c-845b-7b719087672c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:20.953627 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b4a17e8-f41d-461c-845b-7b719087672c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1240 microversion: 2.1 time: 1.153040 Aug 23 11:05:20.973089 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3014/5995] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:19 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1240 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:21.250329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:21.262568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:21.264447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:21.266140 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7a70fd6-27f4-4fb7-b833-4a26fd8e719f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1752 microversion: 2.20 time: 0.584749 Aug 23 11:05:21.281436 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2982/5996] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:20 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1752 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:21.375625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:21.377077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:21.408428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:21.409205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:21.413317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:21.416471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:21.417281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:21.437151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:21.565281 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:21.568543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:21.583945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:21.590677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:21.591444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:21.592428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:21.593128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:21.601567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:22.133439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:22.155842 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-905f273d-af26-4e12-9b66-dbd9016da0f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1696 microversion: 2.1 time: 0.786436 Aug 23 11:05:22.177873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3015/5997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:21 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1696 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:22.193026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:22.197110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:22.221296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:22.221964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:22.229389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:22.230305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:22.231087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:22.241221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:22.434812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:22.444652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:22.451913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:22.466292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91f00970-78d5-4f54-91bc-45231d7b7b5f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.904779 Aug 23 11:05:22.467365 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2983/5998] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:21 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:22.472380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-904812a4-7985-4ded-b7fb-14342031a5db tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '.version_select at 0x7fdc9ccf3940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:22.509511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:22.550970 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-904812a4-7985-4ded-b7fb-14342031a5db tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-960479629" status: 202 len: 0 microversion: 2.1 time: 0.082365 Aug 23 11:05:22.552768 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2984/5999] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Aug 23 11:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-960479629 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:05:22.558243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:22.559194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:22.580318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:22.580944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:22.589455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:22.590362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:22.591075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:22.591754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:22.628464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:22.637832 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4579200a-8dc8-436a-ad6f-c8219a9ba055 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1292 microversion: 2.1 time: 0.458072 Aug 23 11:05:22.661412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3016/6000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:22 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1292 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:23.185061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:23.186541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:23.203732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:23.205295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:23.217596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:23.221406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:23.226256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:23.229167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:23.779059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:23.794092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:23.795723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:23.799319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7a0114c-7459-4684-b429-69cfdbb9ce79 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1752 microversion: 2.20 time: 1.245191 Aug 23 11:05:23.803689 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2985/6001] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:22 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1752 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:23.813634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:23.814387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:23.829894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:23.831776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:23.832250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:23.845489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:23.846029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:23.846496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:23.892571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:23.908312 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a32e886c-ba53-442e-a882-91b52ddbbe2f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1695 microversion: 2.1 time: 0.727918 Aug 23 11:05:23.923701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3017/6002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:23 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1695 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:23.940510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:23.946313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:23.956589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:23.965991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:23.969701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:23.970664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:23.971318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:23.971926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:24.412607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:24.432366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34bbe53a-248a-4dc9-a332-884ce48f63e5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1298 microversion: 2.1 time: 0.502608 Aug 23 11:05:24.434121 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3018/6003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:23 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1298 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:24.482684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:24.496915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:24.501591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:24.503163 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34c2cad3-52ec-4c39-bb31-5f3b72d7956a tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.698409 Aug 23 11:05:24.509869 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2986/6004] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:23 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:24.829712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:24.830724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:24.843227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:24.844670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:24.847136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:24.850123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:24.851873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:24.854006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:24.949272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:24.951654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:24.961194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:24.963903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:24.967287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:24.968846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:24.979002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:24.979701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:25.279753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:25.452942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:25.464573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12667fec-9f97-408c-ad2f-c1fe50cfb667 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1695 microversion: 2.1 time: 0.519147 Aug 23 11:05:25.465747 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2987/6005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:24 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1695 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:25.472288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "name": "network-vif-unplugged", "status": "completed", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:25.485939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:25.486885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:25.487577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:25.506515 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] Creating event network-vif-unplugged:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h2-847009-13 Aug 23 11:05:25.513551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:05:25.527770 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2b391e74-4ef9-484e-9d67-67622bcea463 req-bbad5f22-6119-4eb3-b47e-d0af5c5d19ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060486 Aug 23 11:05:25.529403 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2988/6006] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:25.536775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:25.539496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:25.547835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:25.548588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:25.549536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:25.550412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:25.552215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:25.553555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:25.736147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:25.756839 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2bf924e1-4c19-44d0-8b95-47c84f81c563 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1298 microversion: 2.1 time: 0.225795 Aug 23 11:05:25.760889 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2989/6007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:25 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:25.780954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:25.785064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:25.808107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:25.809037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:25.811413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:25.822623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:25.831810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:25.835210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:26.052514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:26.072321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:26.074151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:26.090509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f754dec6-d256-4bbe-828e-64ce30d6931a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1752 microversion: 2.20 time: 1.251695 Aug 23 11:05:26.106680 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3019/6008] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:24 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1752 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:26.217462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:26.235230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:26.236878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:26.237955 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a103fee-9817-46c8-ba95-507000c28dd1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.475671 Aug 23 11:05:26.239842 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2990/6009] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:25 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:26.487682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:26.488049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:26.495134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:26.495820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:26.496267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:26.496998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:26.497456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:26.497883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:26.782422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:26.783257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:26.793668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:26.795520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:26.797059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:26.800467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:26.801053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:26.801601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:27.276449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:27.294028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6de7f4c-fe8b-4ffb-8924-0566fb139153 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1695 microversion: 2.1 time: 0.810371 Aug 23 11:05:27.295255 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3020/6010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:26 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1695 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:27.302697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:27.303592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:27.318595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:27.320360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:27.321160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:27.322562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:27.324016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:27.325449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:27.744497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:27.756855 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-00e5b801-67dd-4ea1-8aa9-b4097474c16a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.978212 Aug 23 11:05:27.757741 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2991/6011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:26 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:27.762923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:27.763998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:27.771881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:27.772550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:27.773163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:27.774231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:27.775049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:27.775676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:27.980709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:27.993052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:27.999696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:28.001002 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48d2f899-a7d7-4d09-b821-3976c60b5baa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1752 microversion: 2.20 time: 0.704164 Aug 23 11:05:28.011329 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3021/6012] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:27 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1752 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:28.021334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-03113a2b-f30f-451d-a635-ff9158774780 req-62d7fcb2-b6e9-4a3e-9b73-f88536072f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a12014-f587-462f-9778-93f38c4ace9c", "tag": "6f17f0dd-5e9e-4fe6-b7d3-8e17fee61e45"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:28.041282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-03113a2b-f30f-451d-a635-ff9158774780 req-62d7fcb2-b6e9-4a3e-9b73-f88536072f28 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:28.051526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-03113a2b-f30f-451d-a635-ff9158774780 req-62d7fcb2-b6e9-4a3e-9b73-f88536072f28 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:28.052272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-03113a2b-f30f-451d-a635-ff9158774780 req-62d7fcb2-b6e9-4a3e-9b73-f88536072f28 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:28.073637 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-03113a2b-f30f-451d-a635-ff9158774780 req-62d7fcb2-b6e9-4a3e-9b73-f88536072f28 service nova] Creating event network-changed:6f17f0dd-5e9e-4fe6-b7d3-8e17fee61e45 for instance 13a12014-f587-462f-9778-93f38c4ace9c on n-h2-847009-13 Aug 23 11:05:28.086073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-03113a2b-f30f-451d-a635-ff9158774780 req-62d7fcb2-b6e9-4a3e-9b73-f88536072f28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073285 Aug 23 11:05:28.088347 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3022/6013] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:28.097663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:28.122347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:28.134800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:28.135489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:28.172208 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] Creating event network-changed:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h2-847009-13 Aug 23 11:05:28.194654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:05:28.221976 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8aacc04e-3ec5-4b19-8294-44eb1daedd96 req-4d6599e9-9b69-4e6c-9166-6bf643d81a55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128675 Aug 23 11:05:28.222908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3023/6014] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:28.316536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:28.318033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:28.336887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:28.337309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:28.337760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:28.338532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:28.338933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:28.339443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:28.456453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:28.471871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:28.475312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:28.498870 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-436a15be-b9ca-458e-b15b-994ee31df64d tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.738214 Aug 23 11:05:28.500629 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2992/6015] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:27 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:28.785525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:28.786969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:28.788635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:28.793833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:28.794815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:28.795768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:28.796688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:28.797550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:28.798146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:28.811409 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c55289d-02c4-43d5-ac6e-38b793aebbee tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1695 microversion: 2.1 time: 0.497593 Aug 23 11:05:28.813421 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3024/6016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:28 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1695 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:29.030745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:29.031442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:29.048316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:29.048858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:29.049997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:29.050745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:29.053345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:29.054093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:29.485485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:29.503512 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7fc15eae-f67c-4439-8a68-eda1346d7c9c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.726787 Aug 23 11:05:29.517216 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2993/6017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:28 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:29.533057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:29.533876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:29.546974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:29.548238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:29.549632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:29.550909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:29.553421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:29.558406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:29.596930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:29.632669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:29.938265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:29.953987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:29.955646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:29.957154 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1be572a7-fe84-4bed-baa0-7088e5862edd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.931397 Aug 23 11:05:29.966381 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3025/6018] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:29 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:29.977361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:29.977987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:29.986104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:29.986614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:29.987052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:29.987770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:29.988341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:29.989204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:30.081499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:30.095833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:30.097363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:30.099061 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-381df9b8-916c-4a43-a0b9-0f47dd1e3eb8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.577373 Aug 23 11:05:30.099624 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2994/6019] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:29 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:30.311526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bd94aadd-eae8-4cf7-9eca-146c2affb120 req-f88d9cd5-b697-47b5-81d7-1424401ac3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c0f34e-dc40-4002-a540-39fae84f6a66", "tag": "5314dc05-ab29-43b2-9974-9ad88be87d53"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:30.323096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd94aadd-eae8-4cf7-9eca-146c2affb120 req-f88d9cd5-b697-47b5-81d7-1424401ac3e1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:30.323591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd94aadd-eae8-4cf7-9eca-146c2affb120 req-f88d9cd5-b697-47b5-81d7-1424401ac3e1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:30.324206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd94aadd-eae8-4cf7-9eca-146c2affb120 req-f88d9cd5-b697-47b5-81d7-1424401ac3e1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:30.338377 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bd94aadd-eae8-4cf7-9eca-146c2affb120 req-f88d9cd5-b697-47b5-81d7-1424401ac3e1 service nova] Creating event network-changed:5314dc05-ab29-43b2-9974-9ad88be87d53 for instance d2c0f34e-dc40-4002-a540-39fae84f6a66 on n-h1-847009-13 Aug 23 11:05:30.343957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bd94aadd-eae8-4cf7-9eca-146c2affb120 req-f88d9cd5-b697-47b5-81d7-1424401ac3e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036524 Aug 23 11:05:30.344825 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2995/6020] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:30.468669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:30.478040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2fa120ed-e578-4d60-b272-aa0b97056e08 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1693 microversion: 2.1 time: 0.510325 Aug 23 11:05:30.478806 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3026/6021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:29 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1693 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:30.525722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:30.526438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:30.532935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:30.533458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:30.533889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:30.534787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:30.535420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:30.535888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:30.981118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:30.982819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:30.986121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:30.993526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:30.994371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:30.995022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:30.995992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:30.996946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:30.997468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:31.451158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:31.471459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:31.474462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:31.475951 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c9b5910-246b-4e4d-9401-a0bfca85cc24 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.498798 Aug 23 11:05:31.477387 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3027/6022] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:30 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:31.482998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:31.483947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:31.494337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:31.496150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:31.496867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:31.498478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:31.499174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:31.499785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:31.525206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:31.540548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:31.549227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dafa33f-5917-4e8f-8036-c281cfa3fa7b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 1.027710 Aug 23 11:05:31.567662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2996/6023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:30 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:31.578693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:31.579408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:31.593534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:31.594397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:31.595253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:31.596196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:31.596924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:31.597630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.277898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.290558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-faff6073-527c-41ce-81c5-b3b71574cf22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1693 microversion: 2.1 time: 0.720753 Aug 23 11:05:32.291289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2997/6024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:31 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1693 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:32.310693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e98ea963-e7ee-425f-95a4-4ad5d8a0d2b5 req-d5ed2654-3c11-41f8-b463-701b4167faf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:32.330993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e98ea963-e7ee-425f-95a4-4ad5d8a0d2b5 req-d5ed2654-3c11-41f8-b463-701b4167faf2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.330993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e98ea963-e7ee-425f-95a4-4ad5d8a0d2b5 req-d5ed2654-3c11-41f8-b463-701b4167faf2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.330993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e98ea963-e7ee-425f-95a4-4ad5d8a0d2b5 req-d5ed2654-3c11-41f8-b463-701b4167faf2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.366393 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e98ea963-e7ee-425f-95a4-4ad5d8a0d2b5 req-d5ed2654-3c11-41f8-b463-701b4167faf2 service nova] Creating event network-changed:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h1-847009-13 Aug 23 11:05:32.375397 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e98ea963-e7ee-425f-95a4-4ad5d8a0d2b5 req-d5ed2654-3c11-41f8-b463-701b4167faf2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082628 Aug 23 11:05:32.377344 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2998/6025] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:32.384526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:32.385322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:32.394327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.395875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.396570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.397015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.397807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.398409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.434821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:05:32.460341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:32.580182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d09687a-139b-4e1b-b648-b62aa024ac2a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 204 len: 0 microversion: 2.1 time: 0.200778 Aug 23 11:05:32.585050 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 2999/6026] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:05:32 2022] DELETE /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:05:32.590299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-48bafc33-4c5c-4bb3-a03c-937d605cbc08 req-84fdaa88-f195-4c79-9f88-e392bc1d8ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1061bf-b1bf-4476-93fc-cc6f7e628566", "tag": "4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:32.608322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48bafc33-4c5c-4bb3-a03c-937d605cbc08 req-84fdaa88-f195-4c79-9f88-e392bc1d8ef0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.609516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48bafc33-4c5c-4bb3-a03c-937d605cbc08 req-84fdaa88-f195-4c79-9f88-e392bc1d8ef0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.610020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-48bafc33-4c5c-4bb3-a03c-937d605cbc08 req-84fdaa88-f195-4c79-9f88-e392bc1d8ef0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.631463 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-48bafc33-4c5c-4bb3-a03c-937d605cbc08 req-84fdaa88-f195-4c79-9f88-e392bc1d8ef0 service nova] Creating event network-changed:4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace for instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 on n-h2-847009-13 Aug 23 11:05:32.638394 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-48bafc33-4c5c-4bb3-a03c-937d605cbc08 req-84fdaa88-f195-4c79-9f88-e392bc1d8ef0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054491 Aug 23 11:05:32.640202 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3000/6027] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:32.648623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:32.651717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:32.658061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.658610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.659111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.660217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.662031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.662503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.674812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.695843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.697923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.699159 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e315c0a0-ca74-410d-8ba1-ec0e5d9ae2e6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 1.220573 Aug 23 11:05:32.700203 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3028/6028] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:31 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:32.717957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:32.720172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:32.738341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.739561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.740183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.740957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.741430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.741865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.940881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.952655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.954391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:32.955715 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f59cd74b-a639-4634-93a0-8e3691130e4f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.313976 Aug 23 11:05:32.956200 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3001/6029] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:32 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:32.961162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:32.961816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:32.968776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.969122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.969573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:32.970852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:32.971332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:32.971775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.179714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:33.181412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:33.189862 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af0e4e8a-fc51-4466-b84f-10b718e4f2a9 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1671 microversion: 2.1 time: 0.232614 Aug 23 11:05:33.191108 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3002/6030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:32 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1671 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:33.203376 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e394c62b-4db0-4f76-892f-d4ae3f5c8795 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.489840 Aug 23 11:05:33.206070 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3029/6031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:32 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:33.315336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:33.315967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:33.323790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.324671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.325097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.325881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.326409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.326900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.591329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:33.611843 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5927661f-2437-493b-8f7b-61f67ae992da tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1690 microversion: 2.1 time: 0.303069 Aug 23 11:05:33.625010 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3003/6032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:33 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1690 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:33.639798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:33.640296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:33.652387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.653045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.654171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.670815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.673245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.675662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.725723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:33.726422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:33.737316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.737827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.738278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.739265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.739742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.740181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.901410 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5253f671-8e89-423e-a5b6-537b8e46ce61 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action" status: 204 len: 0 microversion: 2.1 time: 0.265931 Aug 23 11:05:33.910207 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3030/6033] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:05:33 2022] POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 11:05:33.927115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:33.929707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:33.946743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.947304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.949066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:33.951472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:33.959334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:33.959916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:34.057462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.069537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.071725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.072941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e86889ee-91f6-446d-80a8-80ac147fce84 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.353190 Aug 23 11:05:34.073828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3004/6034] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:33 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:34.078792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:34.079418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:34.088126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:34.088769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:34.089258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:34.093676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:34.094390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:34.094827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:34.768165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.778472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.780019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.781423 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5eba5f04-93fc-4c54-80a6-08934b30806e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.706489 Aug 23 11:05:34.782000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3005/6035] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:34 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:34.789672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:34.791923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:34.807571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:34.808194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:34.808714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:34.811604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:34.811769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:34.813808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:34.833365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:34.846487 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f982d66-234e-42eb-809d-35350c2cad89 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1690 microversion: 2.1 time: 0.934542 Aug 23 11:05:34.847182 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3031/6036] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:33 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1690 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:34.865606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:34.866335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:34.879725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:34.880404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:34.881047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:34.882061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:34.882742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:34.883389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:35.500250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:35.525186 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02cc2788-a204-4408-867a-c4aea8bed7d2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.669085 Aug 23 11:05:35.525186 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3032/6037] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:34 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:35.525186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:35.525730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:35.539054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:35.539551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:35.540197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:35.541115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:35.541730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:35.542298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:35.590756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:35.607722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f90edab-8c6e-49b6-a85b-f3b8151fac1a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1671 microversion: 2.1 time: 0.824119 Aug 23 11:05:35.625489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3006/6038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:34 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1671 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:35.806155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:35.807903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:35.824455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:35.825326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:35.826000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:35.827195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:35.827886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:35.828578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:36.448367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:36.466751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:36.468596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:36.470490 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dbb4ea60-ee35-4a67-b44c-5f5e15601bb6 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 0.950404 Aug 23 11:05:36.471445 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3033/6039] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:35 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:36.476635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:36.477586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:36.494121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:36.494625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:36.495074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:36.495806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:36.496269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:36.505649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:36.727610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:36.753043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:36.756362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:36.765308 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29e6461e-230a-4b80-9918-07e739974caf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.961216 Aug 23 11:05:36.767243 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3007/6040] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:35 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:36.775717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:36.782016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:36.799127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:36.799831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:36.805540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:36.806806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:36.807917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:36.808371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.075367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:37.092306 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b7172bd-07e6-4952-b726-47eda7cbec10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1690 microversion: 2.1 time: 0.619507 Aug 23 11:05:37.105561 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3034/6041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:36 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1690 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:37.118679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:37.127768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:37.142956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.145437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.147718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.149149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.149914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.151363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.514401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:37.523797 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35879d80-299f-4ee6-a5a6-736367fcc0ff tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 200 len: 1604 microversion: 2.1 time: 0.416954 Aug 23 11:05:37.528812 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3035/6042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:37 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 1604 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:37.541278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-406ec1f3-7aa5-4dba-beae-782d77e96f9f req-05e5c28b-e606-43af-acc2-c5719705b623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a12014-f587-462f-9778-93f38c4ace9c", "name": "network-vif-plugged", "status": "completed", "tag": "6f17f0dd-5e9e-4fe6-b7d3-8e17fee61e45"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:37.594103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-406ec1f3-7aa5-4dba-beae-782d77e96f9f req-05e5c28b-e606-43af-acc2-c5719705b623 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.594618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-406ec1f3-7aa5-4dba-beae-782d77e96f9f req-05e5c28b-e606-43af-acc2-c5719705b623 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.595064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-406ec1f3-7aa5-4dba-beae-782d77e96f9f req-05e5c28b-e606-43af-acc2-c5719705b623 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.631853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:37.633516 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-406ec1f3-7aa5-4dba-beae-782d77e96f9f req-05e5c28b-e606-43af-acc2-c5719705b623 service nova] Creating event network-vif-plugged:6f17f0dd-5e9e-4fe6-b7d3-8e17fee61e45 for instance 13a12014-f587-462f-9778-93f38c4ace9c on n-h2-847009-13 Aug 23 11:05:37.653256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edb246e5-1d71-4155-a094-5178b9e4f537 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.872630 Aug 23 11:05:37.663394 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-406ec1f3-7aa5-4dba-beae-782d77e96f9f req-05e5c28b-e606-43af-acc2-c5719705b623 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132972 Aug 23 11:05:37.665095 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3036/6044] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:37.665262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3008/6044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:36 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:37.670503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6fb06c1a-bf48-4d9e-b634-b907d99bbedd req-73912477-6fd8-4ccd-bc4e-a3e1fc7e900a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1061bf-b1bf-4476-93fc-cc6f7e628566", "name": "network-vif-deleted", "tag": "4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:37.674576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:37.675563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:37.684294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.684803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.692828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.693934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.694440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.694913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.718929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6fb06c1a-bf48-4d9e-b634-b907d99bbedd req-73912477-6fd8-4ccd-bc4e-a3e1fc7e900a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.729065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6fb06c1a-bf48-4d9e-b634-b907d99bbedd req-73912477-6fd8-4ccd-bc4e-a3e1fc7e900a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.729917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6fb06c1a-bf48-4d9e-b634-b907d99bbedd req-73912477-6fd8-4ccd-bc4e-a3e1fc7e900a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.764147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6fb06c1a-bf48-4d9e-b634-b907d99bbedd req-73912477-6fd8-4ccd-bc4e-a3e1fc7e900a service nova] Creating event network-vif-deleted:4fa935ea-2380-4dcd-b6cd-ee24dbdf7ace for instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 on n-h2-847009-13 Aug 23 11:05:37.781122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6fb06c1a-bf48-4d9e-b634-b907d99bbedd req-73912477-6fd8-4ccd-bc4e-a3e1fc7e900a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114219 Aug 23 11:05:37.782660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3037/6045] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:37.796168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:37.797472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:37.808499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.812901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.813655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:37.814900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:37.815634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:37.816285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:38.326906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:38.344311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:38.346916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:38.361799 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e82726b2-8f40-465c-b599-8abf21a77b58 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.561624 Aug 23 11:05:38.381055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3038/6046] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:37 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:38.389771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:38.396447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:38.416644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:38.417453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:38.418119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:38.419765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:38.420444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:38.421278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:38.850200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:38.881741 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8738ee06-3976-46fb-80ae-7753c3f8ac75 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1690 microversion: 2.1 time: 0.499000 Aug 23 11:05:38.882329 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3039/6047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:38 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1690 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:38.909312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:38.909964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 1b1061bf-b1bf-4476-93fc-cc6f7e628566] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:38.946213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:38.946795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:38.947263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:38.950586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:38.952919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:38.954369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:38.987999 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] HTTP exception thrown: Instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 could not be found. Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Request method failure captured: Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 HTTP/1.1 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLO7JkE-RbwT1jRuNPIfkNHOjxrrXwLYrT4BQ1ZRGnlXoDOljlqPmD8xhhaIM7JgK95_9UXJFtO_vLqV87nfl4mRcZh7sO-RfIG5hFqbnOayJttMJklmFpKnCjA4xXAIi65iGTfa-kKRME0-XWbIxAGpvCLPu7zuQqE1-I4oRKIMSrg Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ae502704266349bab5642ad154ea1085 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ae502704266349bab5642ad154ea1085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ae502704266349bab5642ad154ea1085", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ae502704266349bab5642ad154ea1085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ae502704266349bab5642ad154ea1085"}]}] Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ae502704266349bab5642ad154ea1085 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestNetworkBasicOps-1990801935-project Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4bb6e7d862d84e1c9f5d129b0c41bc37 Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestNetworkBasicOps-1990801935-project Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 could not be found. Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1b1061bf-b1bf-4476-93fc-cc6f7e628566'} Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 could not be found. Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 could not be found. Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:39.013472 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 could not be found. Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Returning 404 to user: Instance 1b1061bf-b1bf-4476-93fc-cc6f7e628566 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:05:39.018018 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f7f9c39-a528-45fe-9543-6272d562ab7d tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566" status: 404 len: 111 microversion: 2.1 time: 0.131671 Aug 23 11:05:39.024422 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3040/6048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:38 2022] GET /compute/v2.1/servers/1b1061bf-b1bf-4476-93fc-cc6f7e628566 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:05:39.029589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:39.030214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:39.061093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:39.070189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:39.071003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:39.071983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:39.072940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:39.074165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:39.671708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:39.688541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-065ce3b0-f82e-4a34-a3dd-ac4bd79cfc8f tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.662817 Aug 23 11:05:39.689371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3041/6049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:39 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:39.704515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:39.705159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:39.713404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:39.716782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:39.717282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:39.717679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:39.718616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:39.718907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:39.719809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:39.822287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:39.871942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:39.874730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:39.876966 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4da73d26-c4d0-4764-93bf-0c00309ed53c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1361 microversion: 2.26 time: 2.210418 Aug 23 11:05:39.883603 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3009/6050] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:37 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1361 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:39.897761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "name": "network-vif-plugged", "status": "completed", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:39.915119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:39.916203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:39.922283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:39.944969 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] Creating event network-vif-plugged:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h2-847009-13 Aug 23 11:05:39.953597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:05:39.992021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-94068979-7efb-4301-9340-e535a3c513dd req-74df46a4-a64d-4a11-af09-e986d2a145af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103847 Aug 23 11:05:39.994056 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3010/6051] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:40.016230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:40.022673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:40.046935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:40.048259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:40.051658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:40.057848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:40.058714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:40.061153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:40.323918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:40.341531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:40.345405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:40.352371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-787843d7-798c-4d18-aed8-690b50ae1649 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.657987 Aug 23 11:05:40.353622 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3042/6052] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:39 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:40.364380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ab26701-1cb8-4f07-80b6-b4b55c5b2947 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '.version_select at 0x7fdc8fb6c9d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:40.415519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ab26701-1cb8-4f07-80b6-b4b55c5b2947 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1090719220" status: 202 len: 0 microversion: 2.1 time: 0.059959 Aug 23 11:05:40.416725 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3043/6053] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 11:05:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1090719220 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:05:40.715538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:40.716520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:40.726504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:40.727390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:40.728805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:40.729816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:40.731390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:40.745887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:41.452410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:41.463720 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52ba1321-a21f-407d-b027-2d5267d24b50 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1690 microversion: 2.1 time: 1.466562 Aug 23 11:05:41.466469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3011/6054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:39 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1690 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:41.474420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:41.475501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:41.494624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:41.495178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:41.495788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:41.496566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:41.497103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:41.497974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:41.698934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:41.709661 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3218bbe5-67a8-4442-8ccb-74d224dea7f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.997692 Aug 23 11:05:41.714941 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3044/6055] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:40 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:41.727155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:41.728007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:41.750153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:41.750966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:41.751747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:41.752702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:41.753462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:41.754158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:41.976393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:42.009836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:42.012262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:42.013784 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-14c6d78a-f516-45b7-bdc4-2a87f84033f5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.297606 Aug 23 11:05:42.014480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3045/6056] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:41 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:42.092557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3852a4fe-4bbe-482a-9dab-07b40b206aaf req-3189828d-3343-4898-9882-b314f2611223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f34e-dc40-4002-a540-39fae84f6a66", "name": "network-vif-plugged", "status": "completed", "tag": "5314dc05-ab29-43b2-9974-9ad88be87d53"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:42.113243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3852a4fe-4bbe-482a-9dab-07b40b206aaf req-3189828d-3343-4898-9882-b314f2611223 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.114261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3852a4fe-4bbe-482a-9dab-07b40b206aaf req-3189828d-3343-4898-9882-b314f2611223 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.114547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3852a4fe-4bbe-482a-9dab-07b40b206aaf req-3189828d-3343-4898-9882-b314f2611223 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.138676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3852a4fe-4bbe-482a-9dab-07b40b206aaf req-3189828d-3343-4898-9882-b314f2611223 service nova] Creating event network-vif-plugged:5314dc05-ab29-43b2-9974-9ad88be87d53 for instance d2c0f34e-dc40-4002-a540-39fae84f6a66 on n-h1-847009-13 Aug 23 11:05:42.144515 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3852a4fe-4bbe-482a-9dab-07b40b206aaf req-3189828d-3343-4898-9882-b314f2611223 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055950 Aug 23 11:05:42.146358 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3046/6057] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:05:42.454170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:42.479753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:42.483194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:42.484924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5d963ea-4f83-4bb8-8942-a2c57e85179f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1545 microversion: 2.26 time: 1.016625 Aug 23 11:05:42.485802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3012/6058] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:41 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1545 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:42.491118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:42.492040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:42.515984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc9c062790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:42.519427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.520230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.531435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.532358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.533193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.533464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.534173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:42.534310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.534814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.535353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.544543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.547931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.549206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.551459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.552333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.553211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.567428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:42.598013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.599288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.600572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.624428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.625354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.626056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.681316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:42.715985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9825626-006c-436c-9e42-9086d2b34e89 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-1679690682" status: 201 len: 0 microversion: 2.26 time: 0.204106 Aug 23 11:05:42.717129 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3013/6059] 10.222.0.78 () {62 vars in 1380 bytes} [Tue Aug 23 11:05:42 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-1679690682 => generated 0 bytes in 206 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 23 11:05:42.740520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8292d409-baa1-4465-998e-8dab35c8409e tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdca1ec9160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:42.793192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8292d409-baa1-4465-998e-8dab35c8409e tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.794275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8292d409-baa1-4465-998e-8dab35c8409e tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.795818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8292d409-baa1-4465-998e-8dab35c8409e tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.817566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:42.821244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8292d409-baa1-4465-998e-8dab35c8409e tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-1679690682" status: 204 len: 0 microversion: 2.26 time: 0.093206 Aug 23 11:05:42.827630 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3014/6060] 10.222.0.78 () {60 vars in 1361 bytes} [Tue Aug 23 11:05:42 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-1679690682 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:42.834395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:42.835201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:42.846334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.848848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.849920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:42.851064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:42.851687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:42.852270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.063271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:43.078592 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56ac3749-35bf-4dde-a988-2ae735110ccf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1690 microversion: 2.1 time: 0.594094 Aug 23 11:05:43.096801 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3047/6061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:42 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1690 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:43.104211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc9c2e0af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:43.132641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.133867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.134598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.135950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:43.155605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.158877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.161072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.162139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.163108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.163816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.217193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.220029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.220886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.258315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:43.322007 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd3f7218-86b3-4f0f-855b-db05896a0032 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.223354 Aug 23 11:05:43.322935 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3048/6062] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Aug 23 11:05:43 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:43.336706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:43.337888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:43.357998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.358717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.359242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.360962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.361559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.363924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.648768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:43.676683 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37d731e5-e664-4afb-85ef-8ddf52d45bb2 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.846641 Aug 23 11:05:43.681700 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3015/6063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:42 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:43.691284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89352fc2-0cdc-4b9a-ae2a-462341ab8d4f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdca1ec9310>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:43.718535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89352fc2-0cdc-4b9a-ae2a-462341ab8d4f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.719602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89352fc2-0cdc-4b9a-ae2a-462341ab8d4f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.722462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89352fc2-0cdc-4b9a-ae2a-462341ab8d4f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.766016 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89352fc2-0cdc-4b9a-ae2a-462341ab8d4f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 200 len: 12 microversion: 2.26 time: 0.081707 Aug 23 11:05:43.768184 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3016/6064] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 11:05:43 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 12 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:43.779218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdca1ed9160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:43.802357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.805837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.808642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.809445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:43.825387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.829182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.829903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.831740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.834210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.835584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.882938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:43.899194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.900932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.901717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:43.914948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:43.919479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:43.931204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:43.931873 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04d67d1a-0b04-4a1d-84a9-55f560f522d6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.595404 Aug 23 11:05:43.932224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:43.944767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3049/6065] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:43 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:43.945777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.011463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:44.078442 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e52b117-229a-498b-a2ce-4e1e22cacda9 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-180952243" status: 201 len: 0 microversion: 2.26 time: 0.303786 Aug 23 11:05:44.085400 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3017/6066] 10.222.0.78 () {62 vars in 1377 bytes} [Tue Aug 23 11:05:43 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-180952243 => generated 0 bytes in 311 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 23 11:05:44.093767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-093d84aa-f65f-4267-a5fd-f543515b5d40 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8ffda040>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.113003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.115148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:44.123480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.124290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.125337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.126383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.127294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.128273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.152529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-093d84aa-f65f-4267-a5fd-f543515b5d40 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.153141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-093d84aa-f65f-4267-a5fd-f543515b5d40 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.156357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-093d84aa-f65f-4267-a5fd-f543515b5d40 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.205092 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-093d84aa-f65f-4267-a5fd-f543515b5d40 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 200 len: 35 microversion: 2.26 time: 0.117515 Aug 23 11:05:44.216277 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3050/6067] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 11:05:44 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 35 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:44.230121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc9c2e0b80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.275178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.275953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.277476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.279897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:44.297785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.298747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.299373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.300287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.301835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.302497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.332487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.333546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.334265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.372464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:44.392070 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52ae4238-db92-4c70-9bab-a509a1cdf2d8 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-180952243" status: 204 len: 0 microversion: 2.26 time: 0.173918 Aug 23 11:05:44.397738 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3051/6068] 10.222.0.78 () {60 vars in 1361 bytes} [Tue Aug 23 11:05:44 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-180952243 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:44.404343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0fe5d73-47cc-4aac-800e-a15cab206cdf tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc9cb41310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.413817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0fe5d73-47cc-4aac-800e-a15cab206cdf tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.414319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0fe5d73-47cc-4aac-800e-a15cab206cdf tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.414767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0fe5d73-47cc-4aac-800e-a15cab206cdf tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.424584 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0fe5d73-47cc-4aac-800e-a15cab206cdf tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 200 len: 12 microversion: 2.26 time: 0.024997 Aug 23 11:05:44.431455 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3052/6069] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 11:05:44 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:44.437326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdca1e91af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.447712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.448548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.449301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.450054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:44.457946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.460731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.462097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.464392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.466314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.467416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.539405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.539919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.540368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.568382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:44.608594 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-608e6d23-1a5f-4628-8d5d-9471cf745909 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.175508 Aug 23 11:05:44.615975 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3053/6070] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Aug 23 11:05:44 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:44.627864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8fda4160>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.646289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.647054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.647661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.648597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:44.665166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.665781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.666396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.667664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.667999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.668381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.713830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.714254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.714710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.742149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.742656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.743108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.793655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:44.831961 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6526aedb-e4b1-4e52-82ef-722607260048 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-1422814345" status: 201 len: 0 microversion: 2.26 time: 0.214108 Aug 23 11:05:44.837838 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3054/6071] 10.222.0.78 () {62 vars in 1380 bytes} [Tue Aug 23 11:05:44 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-1422814345 => generated 0 bytes in 221 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 23 11:05:44.843217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:44.843886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:44.851093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.851609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.852074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:44.853046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:44.853603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:44.854170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.498282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:45.510034 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37bbd02e-e636-4160-a507-e1a901ba3b46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1682 microversion: 2.1 time: 1.401783 Aug 23 11:05:45.511414 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3018/6072] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:44 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1682 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:45.524686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc9ca3f940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:45.539871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.540394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.540846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.541331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:45.559109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:45.565572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.565840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.566280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.571985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.572491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.572992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.584427 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e1bff72-1ad3-4162-b42d-fd56ad31fc8b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.744594 Aug 23 11:05:45.600775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3055/6073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:44 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:45.600775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:45.601079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:45.626562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.626562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.626562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.626562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.626562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.626562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.646740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.647254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.647712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.672105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.672105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.672105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.708769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:45.725796 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc061a08-fc30-48ca-84a3-bb9701fa02ae tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-402680688" status: 201 len: 0 microversion: 2.26 time: 0.213237 Aug 23 11:05:45.726508 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3019/6074] 10.222.0.78 () {62 vars in 1377 bytes} [Tue Aug 23 11:05:45 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-402680688 => generated 0 bytes in 215 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 23 11:05:45.742453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8fc65430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:45.765869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.766422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.766883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.767390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:45.779053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.782089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.782764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.783518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.783981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.784510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.844928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.845760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.846564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:45.873296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:45.932395 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dae98296-3974-4068-accc-2d2e7b5f33a1 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.199804 Aug 23 11:05:45.935518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3020/6075] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Aug 23 11:05:45 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:45.940510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:45.974124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:45.975734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1623ad0-b5ca-4ec5-8d86-80174e787211 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdca1eaf430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:45.979224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:45.980480 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4d38a5c-0ae0-4b84-96b3-bbc1e5f92218 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.386584 Aug 23 11:05:45.996291 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3056/6076] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:45 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:45.996871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1623ad0-b5ca-4ec5-8d86-80174e787211 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:45.996871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1623ad0-b5ca-4ec5-8d86-80174e787211 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:45.996871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1623ad0-b5ca-4ec5-8d86-80174e787211 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.001966 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1623ad0-b5ca-4ec5-8d86-80174e787211 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 200 len: 12 microversion: 2.26 time: 0.045706 Aug 23 11:05:46.008601 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3021/6077] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 11:05:45 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:46.015478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8fc541f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.026321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.038260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.038841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.039354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.045682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.046150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.046657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.047396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.048514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.049167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.077337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.077838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.080214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.093830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:46.113841 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e1f4164-a237-4ced-9da0-ecec011ee66c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.103400 Aug 23 11:05:46.118614 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3057/6078] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Aug 23 11:05:46 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:46.125241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdca1ec9e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.145607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.146205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.146731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.147301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.154806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.155405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.155929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.157716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.158268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.168769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.192579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.193775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.194069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.214107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.221377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.222109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.252292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:46.268937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b71d24b-6642-41f8-8f1e-7172487452c0 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-762685420" status: 201 len: 0 microversion: 2.26 time: 0.148644 Aug 23 11:05:46.270619 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3022/6079] 10.222.0.78 () {62 vars in 1377 bytes} [Tue Aug 23 11:05:46 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-762685420 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 23 11:05:46.279979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8fb6c8b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.289875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.290433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.290950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.291536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.297693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.298156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.298781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.299553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.300097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.300591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.331437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.332068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.332585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.341742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.342230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.342700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.367276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:46.370836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:46.387493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6adb5490-e393-4191-8081-f5baa1311e38 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-691270165" status: 201 len: 0 microversion: 2.26 time: 0.111970 Aug 23 11:05:46.396247 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3058/6080] 10.222.0.78 () {62 vars in 1377 bytes} [Tue Aug 23 11:05:46 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags/tempest-tag-691270165 => generated 0 bytes in 114 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 23 11:05:46.401530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Action: 'update_all', calling method: .version_select at 0x7fdc8fc65af0>, body: {"tags": ["tempest-tag-1150878039", "tempest-tag-35677846"]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:46.411801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.412320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.412766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.413244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.426694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.428233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.428233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.429227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.429758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.430296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.482496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.483077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.483595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.546779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:46.578732 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d28ce337-8348-4788-9a1a-ad68e647290c tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 200 len: 60 microversion: 2.26 time: 0.181857 Aug 23 11:05:46.579619 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3023/6081] 10.222.0.78 () {62 vars in 1312 bytes} [Tue Aug 23 11:05:46 2022] PUT /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 60 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:05:46.592191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-747b7585-d195-4b89-baa0-f9305bea8178 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8fb6ca60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.606012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-747b7585-d195-4b89-baa0-f9305bea8178 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.606893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-747b7585-d195-4b89-baa0-f9305bea8178 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.607783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-747b7585-d195-4b89-baa0-f9305bea8178 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.617721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.618916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.642727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:46.644821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.646369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.647077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.647998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.648628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.649250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.652509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-747b7585-d195-4b89-baa0-f9305bea8178 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 200 len: 60 microversion: 2.26 time: 0.066022 Aug 23 11:05:46.658083 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3059/6082] 10.222.0.78 () {60 vars in 1292 bytes} [Tue Aug 23 11:05:46 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 60 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:46.665838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '.version_select at 0x7fdc8fc8b280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.687236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.687754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.688192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.688682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.709108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.709614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.710051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.719670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.720193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.722157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.763386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.763885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.764439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.798226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lazy-loading 'flavor' on Instance uuid 13a12014-f587-462f-9778-93f38c4ace9c {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:05:46.833527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f463fdca-7a48-480d-a6a5-6a155805c76b tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.171737 Aug 23 11:05:46.839302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3060/6083] 10.222.0.78 () {60 vars in 1295 bytes} [Tue Aug 23 11:05:46 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:46.851244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:46.851761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:46.867546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.868048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.868498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.869310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:46.869873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:46.870344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:46.946323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:05:47.099794 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-954c9786-add7-4a72-b0c9-b3d099264544 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 204 len: 0 microversion: 2.26 time: 0.251714 Aug 23 11:05:47.101564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3061/6084] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:05:46 2022] DELETE /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:05:47.119222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:47.120095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:47.129002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:47.131986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:47.131986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:47.131986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:47.132261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:47.132478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:47.429756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.440695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.450514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.452140 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4f375e5-4b3b-49b2-b7c9-ff4670bb1304 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.343486 Aug 23 11:05:47.456567 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3062/6085] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:47 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:47.462400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:47.470771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:47.484832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:47.485729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:47.486404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:47.487355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:47.488029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:47.492255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:47.501698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.520882 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-037e6a7f-6951-4bde-b5db-d6ce46b158e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.905896 Aug 23 11:05:47.521707 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3024/6086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:46 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:47.783993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.795133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.797167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:47.798725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f64dcf40-b0c8-4d43-b731-0c5bcc73f43f tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1551 microversion: 2.26 time: 0.340113 Aug 23 11:05:47.799835 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3063/6087] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:47 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1551 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:48.477626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:48.478257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:48.494936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:48.495451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:48.495896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:48.496622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:48.497109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:48.497541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:48.543933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:48.544557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:48.560357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:48.560884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:48.561063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:05:48.561322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:48.562046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:48.562726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:48.562895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:49.221200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.238068 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a16ef2f3-18c7-4980-9682-2895808c6cd3 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1365 microversion: 2.1 time: 0.691562 Aug 23 11:05:49.239636 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3064/6088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:48 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1365 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:49.251459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:49.267651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:49.283866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:49.285299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:49.288099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:49.289423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:49.293395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:49.294144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:49.601113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.619249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.620895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.626880 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e4de651-4d65-466c-b67a-8c30a2a501d4 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1551 microversion: 2.26 time: 0.384384 Aug 23 11:05:49.627540 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3065/6089] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:49 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1551 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:49.735685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.750995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.752528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:49.754620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8e07ad37-a2b1-4da8-a8e0-fd71b7ca31b2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 1.280241 Aug 23 11:05:49.755583 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3025/6090] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:48 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:50.259833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:50.260400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:50.278546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.279080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.279731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.280644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.283650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.284308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.655637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:50.656387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:50.662377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:50.671366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8176b6d4-d517-4e87-b4c7-8d48ed9754b0 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1554 microversion: 2.1 time: 0.415500 Aug 23 11:05:50.686135 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3066/6091] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:05:50 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1554 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:05:50.692478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.693361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.693986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.694896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.698658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.699280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.700486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:50.701027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:50.710255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.710763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.711276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.712050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.712796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.713291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.876821 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-750b1dfe-f02c-4d03-ae3a-2ce4d432d167 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180940 Aug 23 11:05:50.887526 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3067/6092] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:05:50 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:05:50.895808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:50.898705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:50.909518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.910755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.911664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:50.912731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:50.913446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:50.914218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:51.436148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:51.453390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:51.456189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:51.458962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92ea8556-308d-40a4-b7a0-88fe57b35ca4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.568896 Aug 23 11:05:51.460295 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3068/6093] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:50 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:51.476173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:51.489701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:51.491581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90b881e698b84813938b3956fa5d774c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6106abc214e0455e9e77687089cc7602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:51.493128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7bc797e6-9ff2-4762-a96a-8539899d8f66 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 200 len: 1551 microversion: 2.26 time: 0.844083 Aug 23 11:05:51.506398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3026/6094] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:50 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 1551 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:05:51.763365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9fcc77f3-5e7d-4742-9ecc-266cc784fe26 req-9330340f-26d0-49b4-8bf5-56b4fddfe8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a12014-f587-462f-9778-93f38c4ace9c", "name": "network-vif-deleted", "tag": "6f17f0dd-5e9e-4fe6-b7d3-8e17fee61e45"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:51.784319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9fcc77f3-5e7d-4742-9ecc-266cc784fe26 req-9330340f-26d0-49b4-8bf5-56b4fddfe8ab service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:51.784879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9fcc77f3-5e7d-4742-9ecc-266cc784fe26 req-9330340f-26d0-49b4-8bf5-56b4fddfe8ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:51.785481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9fcc77f3-5e7d-4742-9ecc-266cc784fe26 req-9330340f-26d0-49b4-8bf5-56b4fddfe8ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:51.812604 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9fcc77f3-5e7d-4742-9ecc-266cc784fe26 req-9330340f-26d0-49b4-8bf5-56b4fddfe8ab service nova] Creating event network-vif-deleted:6f17f0dd-5e9e-4fe6-b7d3-8e17fee61e45 for instance 13a12014-f587-462f-9778-93f38c4ace9c on n-h2-847009-13 Aug 23 11:05:51.825433 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9fcc77f3-5e7d-4742-9ecc-266cc784fe26 req-9330340f-26d0-49b4-8bf5-56b4fddfe8ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072653 Aug 23 11:05:51.828386 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3069/6095] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:05:52.487918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:52.488504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:52.499625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:52.500526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:52.501238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:52.502153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:52.502775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:52.503381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:52.525789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:52.527828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] [instance: 13a12014-f587-462f-9778-93f38c4ace9c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:52.544259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:52.546498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:52.547125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:52.550604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:52.551742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:52.552230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:52.587984 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] HTTP exception thrown: Instance 13a12014-f587-462f-9778-93f38c4ace9c could not be found. Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Request method failure captured: Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c HTTP/1.1 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLRpIol3jlJ-ehxLHZ4lQhdH9w1cp0t_iGuR2G55UZ6kp7cyjFPNroW6hpY4-Mz9-10sJaU14ijqKvg6PzDBXm7mCgXdMmm2gZt3VMImKQTcD8JzbsBywCTD6uk-zjfaP1dem1Fqp9p2LvdhnqRDMAiSzr0OePz2mzzA0M4Nc-jS2so Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.26 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6106abc214e0455e9e77687089cc7602 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerTagsTestJSON-795886831 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6106abc214e0455e9e77687089cc7602"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6106abc214e0455e9e77687089cc7602", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6106abc214e0455e9e77687089cc7602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6106abc214e0455e9e77687089cc7602"}]}] Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerTagsTestJSON-795886831 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6106abc214e0455e9e77687089cc7602 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerTagsTestJSON-795886831 Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerTagsTestJSON-795886831-project Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 90b881e698b84813938b3956fa5d774c Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerTagsTestJSON-795886831-project Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 13a12014-f587-462f-9778-93f38c4ace9c could not be found. Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '13a12014-f587-462f-9778-93f38c4ace9c'} Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a12014-f587-462f-9778-93f38c4ace9c could not be found. Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a12014-f587-462f-9778-93f38c4ace9c could not be found. Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:05:52.591564 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a12014-f587-462f-9778-93f38c4ace9c could not be found. Aug 23 11:05:52.596247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:05:52.598465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] Returning 404 to user: Instance 13a12014-f587-462f-9778-93f38c4ace9c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:05:52.599545 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9125f8b2-be40-41ed-8bf0-866a8e904275 tempest-ServerTagsTestJSON-795886831 tempest-ServerTagsTestJSON-795886831-project] 10.222.0.78 "GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c" status: 404 len: 111 microversion: 2.26 time: 0.082221 Aug 23 11:05:52.600605 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3070/6096] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:52 2022] GET /compute/v2.1/servers/13a12014-f587-462f-9778-93f38c4ace9c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:05:53.212032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:53.223349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:53.226404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:53.228641 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-975534de-2413-46a3-89ee-2dfd87727e35 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.744476 Aug 23 11:05:53.229831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3027/6097] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:52 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:53.735117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-87274d1f-1d7a-43dc-8da9-31837165ff1e req-aacabb5f-6bef-4d15-ac0b-8ba085a3f439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c0f34e-dc40-4002-a540-39fae84f6a66", "tag": "5314dc05-ab29-43b2-9974-9ad88be87d53"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:53.756081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-87274d1f-1d7a-43dc-8da9-31837165ff1e req-aacabb5f-6bef-4d15-ac0b-8ba085a3f439 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:53.767020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-87274d1f-1d7a-43dc-8da9-31837165ff1e req-aacabb5f-6bef-4d15-ac0b-8ba085a3f439 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:53.767642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-87274d1f-1d7a-43dc-8da9-31837165ff1e req-aacabb5f-6bef-4d15-ac0b-8ba085a3f439 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:53.796568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-87274d1f-1d7a-43dc-8da9-31837165ff1e req-aacabb5f-6bef-4d15-ac0b-8ba085a3f439 service nova] Creating event network-changed:5314dc05-ab29-43b2-9974-9ad88be87d53 for instance d2c0f34e-dc40-4002-a540-39fae84f6a66 on n-h1-847009-13 Aug 23 11:05:53.803186 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-87274d1f-1d7a-43dc-8da9-31837165ff1e req-aacabb5f-6bef-4d15-ac0b-8ba085a3f439 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072187 Aug 23 11:05:53.804088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3071/6098] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:05:54.252432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:54.255342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:54.272445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:54.280023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:54.288110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:54.289680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:54.291793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:54.292637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:54.811745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:54.846208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:54.851199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:54.852584 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c94f2c71-f4a1-4109-a3d5-7187ac065a91 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.604881 Aug 23 11:05:54.853208 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3028/6099] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:54 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:55.880940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:55.882448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:55.890707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:55.891549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:55.892281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:55.893284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:55.893968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:55.895164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:56.246796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:56.266415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:56.267924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:56.269424 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-76d6d870-d0e2-4589-9915-34c6628f34ce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.396636 Aug 23 11:05:56.270950 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3072/6100] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:55 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:57.299572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:57.302733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:57.328052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:57.328705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:57.329647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:57.339395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:57.340526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:57.341202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:57.734085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:57.744515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:05:57.746892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:57.761703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:57.762536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:57.763037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:57.763481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:57.764523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:57.766031 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e1bae82-acd7-496a-aa36-7aec906a5447 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.474900 Aug 23 11:05:57.766914 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3029/6101] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:57 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:05:57.780899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:57.780899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:57.780899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:57.871807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7f2077b-46e3-465d-b5f9-6c77f496596f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action" status: 200 len: 24580 microversion: 2.1 time: 0.133440 Aug 23 11:05:57.872468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3073/6102] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:05:57 2022] POST /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982/action => generated 24580 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 11:05:58.801068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:05:58.801717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:05:58.812112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:58.812626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:58.815609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:58.816971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:05:58.820459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:05:58.821264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:05:59.155745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:59.181759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:59.184335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:05:59.190299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56ddb5d9-984c-4c20-819e-b72e6bf67d44 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.401053 Aug 23 11:05:59.191587 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3030/6103] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:05:58 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:00.215454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:00.216349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:00.236871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:00.238670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:00.239094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:00.239932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:00.240501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:00.241402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:00.727427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:00.753745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:00.757173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:00.759219 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d4b7ac08-23ef-4fe0-9f67-d5188d6d7686 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.547999 Aug 23 11:06:00.760474 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3074/6104] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:00 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:01.787357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:01.788813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:01.807321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:01.809284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:01.810543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:01.810543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:01.810946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:01.817635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:02.362466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:02.392203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:02.395535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:02.406938 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5aa5008-75ac-46ef-a64c-0f8b77f5e7a5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.623555 Aug 23 11:06:02.409189 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3031/6105] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:01 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:03.432838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:03.434163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:03.460425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:03.464586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:03.465284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:03.466175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:03.468037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:03.468686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:03.771087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:03.781216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:03.787830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:03.793145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0824b16-839c-4cb4-aca1-083be3fdf75d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.365003 Aug 23 11:06:03.803359 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3075/6106] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:03 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:04.060756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:04.062211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:04.072559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:04.073391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:04.074121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:04.075106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:04.076984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:04.077665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:04.828349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:04.828921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:04.850767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:04.851616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:04.856052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:04.857443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:04.859771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:04.861986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:04.935391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:05.782584 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1835 microversion: 2.1 time: 1.727060 Aug 23 11:06:05.783591 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3032/6107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:04 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1835 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:05.784901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:05.787017 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002345 Aug 23 11:06:05.791485 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3033/6108] 10.222.0.78 () {56 vars in 886 bytes} [Tue Aug 23 11:06:05 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 11:06:05.803427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:05.805400 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002548 Aug 23 11:06:05.812205 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3034/6109] 10.222.0.78 () {54 vars in 1035 bytes} [Tue Aug 23 11:06:05 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 23 11:06:05.812942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:05.813969 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 23 11:06:05.814386 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3035/6110] 10.222.0.78 () {54 vars in 1041 bytes} [Tue Aug 23 11:06:05 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:06:05.836990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:05.839289 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f86effa7-c1bd-4c5f-bfcf-1a42394aa48f tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002628 Aug 23 11:06:05.841339 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3036/6111] 10.222.0.78 () {56 vars in 886 bytes} [Tue Aug 23 11:06:05 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Aug 23 11:06:06.074658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6072dea0-939f-414d-a8ae-c26489f01c92 req-c4a27f75-9e62-436f-a1ef-06fed6d628a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "name": "network-vif-plugged", "status": "completed", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:06.111952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6072dea0-939f-414d-a8ae-c26489f01c92 req-c4a27f75-9e62-436f-a1ef-06fed6d628a0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:06.112896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6072dea0-939f-414d-a8ae-c26489f01c92 req-c4a27f75-9e62-436f-a1ef-06fed6d628a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:06.113573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6072dea0-939f-414d-a8ae-c26489f01c92 req-c4a27f75-9e62-436f-a1ef-06fed6d628a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:06.164924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6072dea0-939f-414d-a8ae-c26489f01c92 req-c4a27f75-9e62-436f-a1ef-06fed6d628a0 service nova] Creating event network-vif-plugged:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h1-847009-13 Aug 23 11:06:06.188545 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6072dea0-939f-414d-a8ae-c26489f01c92 req-c4a27f75-9e62-436f-a1ef-06fed6d628a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111808 Aug 23 11:06:06.194681 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3037/6112] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:06.567777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:06.627207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:06.643655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:06.653132 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-541cd24c-ce29-4765-b623-4ba7a480f0b0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 1.824902 Aug 23 11:06:06.664012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3076/6113] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:04 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:07.724728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:07.727599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:07.763425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:07.766202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:07.766862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:07.770523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:07.772150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:07.774631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:08.618328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:08.637493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:08.643614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:08.659008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:08.660347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:08.672360 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e88599ff-fc85-40c9-8538-8210f76a70fe tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.960023 Aug 23 11:06:08.673934 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3038/6114] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:07 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:08.702335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:08.703047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:08.703650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:08.706064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-654c5ccf-7c2c-44c9-a935-6430888c2892 req-a2d6b92c-f831-44df-99fe-dbf3bb105426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:08.707735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:08.708467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:08.712428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:08.736103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-654c5ccf-7c2c-44c9-a935-6430888c2892 req-a2d6b92c-f831-44df-99fe-dbf3bb105426 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:08.737189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-654c5ccf-7c2c-44c9-a935-6430888c2892 req-a2d6b92c-f831-44df-99fe-dbf3bb105426 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:08.739579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-654c5ccf-7c2c-44c9-a935-6430888c2892 req-a2d6b92c-f831-44df-99fe-dbf3bb105426 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:08.795892 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-654c5ccf-7c2c-44c9-a935-6430888c2892 req-a2d6b92c-f831-44df-99fe-dbf3bb105426 service nova] Creating event network-changed:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h2-847009-13 Aug 23 11:06:08.810177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:06:08.825007 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-654c5ccf-7c2c-44c9-a935-6430888c2892 req-a2d6b92c-f831-44df-99fe-dbf3bb105426 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122886 Aug 23 11:06:08.829770 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3039/6115] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:09.032971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b93097e6-1692-4292-b295-4de9c84645f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 204 len: 0 microversion: 2.1 time: 0.377964 Aug 23 11:06:09.038544 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3077/6116] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:06:08 2022] DELETE /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:06:09.046016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:09.047184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:09.071084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:09.071589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:09.072381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:09.073284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:09.073902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:09.074504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:09.711900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:09.712721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:09.734678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:09.751218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:09.764534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:09.765178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:09.766080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:09.766697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:09.767378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:10.344827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:10.355192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:10.367060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:10.371847 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-897f2d58-f45f-452d-99fc-6297db40d5e3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1808 microversion: 2.20 time: 0.672592 Aug 23 11:06:10.387088 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3078/6117] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:09 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1808 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:10.398016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:10.410916 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-064d65e8-7c95-4246-95ef-d09d3b208110 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1688 microversion: 2.1 time: 1.370614 Aug 23 11:06:10.414559 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3040/6118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:09 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1688 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:06:10.436434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d8cc19f5-cb45-4306-acce-8f615818a6b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'create', calling method: .version_select at 0x7fdc8f667550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2002095424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnesk1GZpTWiH6qR+3GvzX5rBmatLhbJYeEWX5xN4QwaW3R149EpDXjXeEveZZPYa8DDfe3UI+gWDY2IgXir8J212ame/teriiNkLSTjML66NCdNYqJukgRVW4nRHPxHg=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:10.488916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d8cc19f5-cb45-4306-acce-8f615818a6b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for project ae502704266349bab5642ad154ea1085. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:10.501439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d8cc19f5-cb45-4306-acce-8f615818a6b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for user 4bb6e7d862d84e1c9f5d129b0c41bc37 and project ae502704266349bab5642ad154ea1085. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:10.565457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d8cc19f5-cb45-4306-acce-8f615818a6b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.176626 Aug 23 11:06:10.567114 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3079/6119] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:06:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:11.402352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:11.403638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:11.419882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:11.422875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:11.423580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:11.427889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:11.431705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:11.432764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:11.437430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:11.445729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:11.472689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:11.473515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:11.474123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:11.476326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:11.477063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:11.478849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:11.720184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:11.735557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:11.738914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:11.745595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8941185-8ca1-4f85-a6e5-495b5d2f03ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1795 microversion: 2.20 time: 0.348716 Aug 23 11:06:11.746566 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3041/6120] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:06:11 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1795 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:06:13.551923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:13.594504 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3bd07ec1-b3ae-4c95-bcab-6447c09e9211 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1688 microversion: 2.1 time: 2.153214 Aug 23 11:06:13.598836 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3080/6121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:11 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1688 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:14.562780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-29930225", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "b7a40bd3-7ae7-4452-b8db-9a2d5b952e08"}], "key_name": "tempest-TestNetworkBasicOps-2002095424", "security_groups": [{"name": "tempest-secgroup-smoke-83142788"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:14.620223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:14.622731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:14.641278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:14.642887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:14.644849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:14.646410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:14.664952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:14.666600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:14.825655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] validate_networks() for [('b7a40bd3-7ae7-4452-b8db-9a2d5b952e08', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:06:14.960448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:14.972902 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae3cc1d1-a3ba-4030-bef4-20552732bac5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 200 len: 1351 microversion: 2.1 time: 0.356065 Aug 23 11:06:14.975412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3081/6122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:14 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 1351 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:14.989891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-07fb5787-ce55-4bc7-a09c-edf0bc030b63 req-e1d89f37-5daf-4f93-904d-8a2471efe755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0093c5-e130-46e5-b9e8-55e78c008982", "name": "network-vif-deleted", "tag": "e56cff94-1f11-465c-91e8-251637f723ad"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:15.072577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07fb5787-ce55-4bc7-a09c-edf0bc030b63 req-e1d89f37-5daf-4f93-904d-8a2471efe755 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:15.074497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07fb5787-ce55-4bc7-a09c-edf0bc030b63 req-e1d89f37-5daf-4f93-904d-8a2471efe755 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:15.077284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-07fb5787-ce55-4bc7-a09c-edf0bc030b63 req-e1d89f37-5daf-4f93-904d-8a2471efe755 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:15.116578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-07fb5787-ce55-4bc7-a09c-edf0bc030b63 req-e1d89f37-5daf-4f93-904d-8a2471efe755 service nova] Creating event network-vif-deleted:e56cff94-1f11-465c-91e8-251637f723ad for instance 6c0093c5-e130-46e5-b9e8-55e78c008982 on n-h2-847009-13 Aug 23 11:06:15.130096 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-07fb5787-ce55-4bc7-a09c-edf0bc030b63 req-e1d89f37-5daf-4f93-904d-8a2471efe755 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153239 Aug 23 11:06:15.131700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3082/6123] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:15.998939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:16.000385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 6c0093c5-e130-46e5-b9e8-55e78c008982] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:16.016324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:16.017054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:16.017675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:16.018551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:16.019769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:16.020569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:16.073725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] HTTP exception thrown: Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 could not be found. Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Request method failure captured: Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 HTTP/1.1 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLPS6dqOS_zEv0sC6ZMxneqd8cjvhwM_ReN9ia834ny4t3AfM938V8rdG3LlNSFFPyt-L_78meJbOo2HvxrYN5BnMC7jtt4TymfaTmp0u2dCADn5Z54wnHlalMz17UWbj_or8mR62OencPjC8qMxXls3QLLfOMAMr8QkN-pelrnetpk Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aadc538b532d48b780b04b2ca23e4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}] Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: b40863219f8c498881c9ee5b5ce5a8c5 Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 could not be found. Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6c0093c5-e130-46e5-b9e8-55e78c008982'} Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 could not be found. Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 could not be found. Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:06:16.075776 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 could not be found. Aug 23 11:06:16.080285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:06:16.082642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Returning 404 to user: Instance 6c0093c5-e130-46e5-b9e8-55e78c008982 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:06:16.083708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e338452-c068-4eb2-8de0-43cae2ec8c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982" status: 404 len: 111 microversion: 2.1 time: 0.089902 Aug 23 11:06:16.091603 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3083/6124] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:15 2022] GET /compute/v2.1/servers/6c0093c5-e130-46e5-b9e8-55e78c008982 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:06:16.166261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:06:16.167075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:06:16.167670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:06:16.168185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:06:16.168918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:06:16.188021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:16.193521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:16.194161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:16.195153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:16.195732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:16.197164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:16.263492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for project ae502704266349bab5642ad154ea1085. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:16.277832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Getting quotas for user 4bb6e7d862d84e1c9f5d129b0c41bc37 and project ae502704266349bab5642ad154ea1085. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:16.318649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:06:16.323885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:06:16.453515 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ed1108f-e4dc-4ae6-b819-e8f15a5b936a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.892758 Aug 23 11:06:16.466080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3042/6125] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:06:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:06:16.468306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31b7aa57-665a-440c-8667-dbab7ed673ee tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:16.469030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31b7aa57-665a-440c-8667-dbab7ed673ee tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:16.647737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31b7aa57-665a-440c-8667-dbab7ed673ee tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:16.664710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31b7aa57-665a-440c-8667-dbab7ed673ee tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1247 microversion: 2.1 time: 0.200133 Aug 23 11:06:16.665668 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3084/6126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:16 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1247 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:17.691772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:17.693217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:17.701730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:17.704834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:17.705886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:17.706797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:17.708454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:17.709159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:17.710569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:17.866784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:17.877838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-955b3cd2-667a-493d-971b-0a51b20b9d04 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1243 microversion: 2.1 time: 0.190871 Aug 23 11:06:17.894595 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3043/6127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:17 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1243 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:18.899915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:18.901269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:18.922237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:18.922988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:18.923608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:18.924615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:18.925932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:18.926627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:19.090607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:19.106488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-542d68ae-92d2-45bd-b451-548cbdda23cb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1305 microversion: 2.1 time: 0.209486 Aug 23 11:06:19.107251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3085/6128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:18 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:20.130176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:20.130804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:20.147055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:20.147593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:20.148010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:20.148723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:20.149211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:20.149645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:20.152596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=75 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:20.279933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:20.292448 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf40bde4-fe04-49f2-bb81-a1595855dbd5 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1305 microversion: 2.1 time: 0.167310 Aug 23 11:06:20.295373 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3044/6129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:20 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1305 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:21.319190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:21.319919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:21.329448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:21.329953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:21.330445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:21.331506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:21.332130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:21.333015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:21.642504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:21.662918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ce01fee-7b59-4f18-8d51-49293ae82468 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1305 microversion: 2.1 time: 0.350614 Aug 23 11:06:21.665516 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3086/6130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:21 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1305 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:22.685423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:22.686389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:22.699494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:22.700003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:22.703345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:22.705171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:22.707973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:22.708651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:23.807165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:23.824315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ee072858-6ed3-43b6-a694-8f5e8b7a7d83 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1371 microversion: 2.1 time: 1.142962 Aug 23 11:06:23.827065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3045/6131] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:22 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1371 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:24.853403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:24.854710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:24.879600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:24.880110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:24.880558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:24.881999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:24.882475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:24.882910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:25.295110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:25.310003 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d0a345d5-1aae-4283-8b9c-e72963a7efe7 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1371 microversion: 2.1 time: 0.462169 Aug 23 11:06:25.310833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3087/6132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:24 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:25.363347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0c7e7236-ebb2-4ce1-ba89-8c0592f975e8 req-7c06e715-9fd6-4ffd-ad2e-2800660e0cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f22488e-5598-4475-b288-aa6847903025", "tag": "07d66e67-bcef-478d-8f6e-d24eab8329d6"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:25.387965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c7e7236-ebb2-4ce1-ba89-8c0592f975e8 req-7c06e715-9fd6-4ffd-ad2e-2800660e0cc2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:25.388469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c7e7236-ebb2-4ce1-ba89-8c0592f975e8 req-7c06e715-9fd6-4ffd-ad2e-2800660e0cc2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:25.388975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c7e7236-ebb2-4ce1-ba89-8c0592f975e8 req-7c06e715-9fd6-4ffd-ad2e-2800660e0cc2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:25.415171 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0c7e7236-ebb2-4ce1-ba89-8c0592f975e8 req-7c06e715-9fd6-4ffd-ad2e-2800660e0cc2 service nova] Creating event network-changed:07d66e67-bcef-478d-8f6e-d24eab8329d6 for instance 2f22488e-5598-4475-b288-aa6847903025 on n-h2-847009-13 Aug 23 11:06:25.429136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0c7e7236-ebb2-4ce1-ba89-8c0592f975e8 req-7c06e715-9fd6-4ffd-ad2e-2800660e0cc2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072242 Aug 23 11:06:25.430077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3046/6133] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:26.330806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:26.332019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:26.346096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:26.352403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:26.354090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:26.359941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:26.360529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:26.361096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:26.653145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:27.562359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:27.572133 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ba2b0f81-4811-440c-b038-bb859fe47eb4 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1371 microversion: 2.1 time: 1.245209 Aug 23 11:06:27.572732 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3088/6134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:26 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1371 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:28.496901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:28.497842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:28.593733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:28.594357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:28.602126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:28.603144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:28.603598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:28.604326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:28.605240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:28.605688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:28.777899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a779955-a97d-41cf-8cef-22efc9bea8cd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: .version_select at 0x7fdc9cbe9790>, body: {"keypair": {"name": "tempest-keypair-32438027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2C+nm7KpLqplZto7cUfN/RvxyRIDAzpQnvOLNLusKWsofQFNH0E6N003XIiEveA+b8Hv24N1NByPb8JwUW6pPhDuJ1fK4GY2UC28KvpuoIWmyCjB4tGyLd8yo6ccYrIw=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:28.815925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5a779955-a97d-41cf-8cef-22efc9bea8cd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:28.828961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5a779955-a97d-41cf-8cef-22efc9bea8cd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for user 2f677df65e434e45b050d23769ad5863 and project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:28.885903 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a779955-a97d-41cf-8cef-22efc9bea8cd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.389156 Aug 23 11:06:28.887749 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3047/6135] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:06:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:29.399329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:29.422867 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc4dec8d-3f68-4073-8cce-130fef8f8e8a tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1371 microversion: 2.1 time: 0.832769 Aug 23 11:06:29.426000 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3089/6136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:28 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1371 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:30.135464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5654ce11-3eb2-4129-a7a3-426984fb294a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '.version_select at 0x7fdc8ffe4940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:30.179430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5654ce11-3eb2-4129-a7a3-426984fb294a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-577587505" status: 202 len: 0 microversion: 2.1 time: 0.048963 Aug 23 11:06:30.180814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3048/6137] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 11:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-577587505 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:06:30.212764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b9ba1e0-59dd-4ba8-ae1b-6658548af74d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: .version_select at 0x7fdc9d23d280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1996025219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbvOpcSNxi0/ZprlJ+cW1iC5navs/yN4VbSNSugGqEsnWDTeovVfCv6aPS52mD+vk/ekNtxX5JxnsNwpfMMoefW08+FLBlh+Sanv4rn0loUSZyGAUN/yLZObOKGutDr1g=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:30.255478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4b9ba1e0-59dd-4ba8-ae1b-6658548af74d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:30.282366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4b9ba1e0-59dd-4ba8-ae1b-6658548af74d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:30.348962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b9ba1e0-59dd-4ba8-ae1b-6658548af74d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.140573 Aug 23 11:06:30.356137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3090/6138] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:06:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:30.449013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:30.449833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:30.460947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:30.463265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:30.464653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:30.467842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:30.470021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:30.471595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:30.915199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:30.941365 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5109b990-b6b2-4d21-8b7e-a1b4354463fb tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1371 microversion: 2.1 time: 0.497035 Aug 23 11:06:30.943921 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3049/6139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:30 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:31.752117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6c883fd3-7b41-4b84-afa4-29052d3fcca8 req-a15837e1-06cd-41b6-b68c-bac0140eba65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f22488e-5598-4475-b288-aa6847903025", "name": "network-vif-plugged", "status": "completed", "tag": "07d66e67-bcef-478d-8f6e-d24eab8329d6"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:31.793642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6c883fd3-7b41-4b84-afa4-29052d3fcca8 req-a15837e1-06cd-41b6-b68c-bac0140eba65 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:31.795453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6c883fd3-7b41-4b84-afa4-29052d3fcca8 req-a15837e1-06cd-41b6-b68c-bac0140eba65 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:31.798340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6c883fd3-7b41-4b84-afa4-29052d3fcca8 req-a15837e1-06cd-41b6-b68c-bac0140eba65 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:31.833106 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6c883fd3-7b41-4b84-afa4-29052d3fcca8 req-a15837e1-06cd-41b6-b68c-bac0140eba65 service nova] Creating event network-vif-plugged:07d66e67-bcef-478d-8f6e-d24eab8329d6 for instance 2f22488e-5598-4475-b288-aa6847903025 on n-h2-847009-13 Aug 23 11:06:31.842395 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6c883fd3-7b41-4b84-afa4-29052d3fcca8 req-a15837e1-06cd-41b6-b68c-bac0140eba65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093235 Aug 23 11:06:31.846048 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3091/6140] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:31.986231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:31.986870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:32.005036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:32.005529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:32.006308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:32.007048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:32.008081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:32.008538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:32.363983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:32.383485 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edc3a6e1-bf5c-4c3c-90fe-eabde8ad5958 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1371 microversion: 2.1 time: 0.405822 Aug 23 11:06:32.384956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3050/6141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:31 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:33.415962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:33.416688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:33.434600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:33.436124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:33.436770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:33.438418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:33.440851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:33.442053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:33.507141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1554479084", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "715467b9-97f9-4d53-9db3-ac3c3be12aa8"}], "security_groups": [{"name": "tempest-securitygroup--1067263166"}], "key_name": "tempest-keypair-32438027", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:33.738141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] validate_networks() for [('715467b9-97f9-4d53-9db3-ac3c3be12aa8', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:06:33.751283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:33.759795 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0acf0fdf-7c18-4635-8a25-3a5dfe11131e tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1541 microversion: 2.1 time: 0.354112 Aug 23 11:06:33.760327 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3092/6142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:33 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1541 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:33.783619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:33.785474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:33.793474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:33.794322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:33.794775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:33.796334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:33.797009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:33.797782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:33.959302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:33.981195 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03f68683-4b08-467e-94b8-675a3f04a5d2 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1541 microversion: 2.1 time: 0.203675 Aug 23 11:06:33.982952 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3093/6143] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:33 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1541 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:34.767031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:06:34.768732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:06:34.769513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:06:34.770049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:06:34.770750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:06:34.799197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:34.801772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:34.802249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:34.803072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:34.807068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:34.807828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:34.902247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:34.927946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for user 2f677df65e434e45b050d23769ad5863 and project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:34.974321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:06:34.982284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:06:35.108684 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e5caa06-3fd9-4ae9-b0f2-2516de025b8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.606775 Aug 23 11:06:35.113040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3051/6144] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:06:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:06:35.125871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7967cf05-4789-4021-90f8-0685ed85fe26 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:35.126519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7967cf05-4789-4021-90f8-0685ed85fe26 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:35.257771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7967cf05-4789-4021-90f8-0685ed85fe26 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:35.270899 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7967cf05-4789-4021-90f8-0685ed85fe26 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1236 microversion: 2.1 time: 0.149981 Aug 23 11:06:35.273399 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3094/6145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:35 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1236 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:36.332809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:36.337566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:36.363296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:36.369656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:36.370548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:36.375182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:36.376020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:36.376960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:36.562131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:36.578292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05edee24-2fbd-4144-900f-170beb699959 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1288 microversion: 2.1 time: 0.288622 Aug 23 11:06:36.617831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3052/6146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:36 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1288 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:37.575627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5f47eec3-ddab-470f-a376-63c4196d7e86 req-8fbc1c6b-be78-41c7-8f9c-bfc15fe1bf0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f22488e-5598-4475-b288-aa6847903025", "tag": "07d66e67-bcef-478d-8f6e-d24eab8329d6"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:37.589961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f47eec3-ddab-470f-a376-63c4196d7e86 req-8fbc1c6b-be78-41c7-8f9c-bfc15fe1bf0c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:37.590768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f47eec3-ddab-470f-a376-63c4196d7e86 req-8fbc1c6b-be78-41c7-8f9c-bfc15fe1bf0c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:37.591434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5f47eec3-ddab-470f-a376-63c4196d7e86 req-8fbc1c6b-be78-41c7-8f9c-bfc15fe1bf0c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:37.598251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:37.604340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:37.605701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:37.619239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:37.621191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:37.628525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:37.632171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:37.636122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:37.637816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:37.643854 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5f47eec3-ddab-470f-a376-63c4196d7e86 req-8fbc1c6b-be78-41c7-8f9c-bfc15fe1bf0c service nova] Creating event network-changed:07d66e67-bcef-478d-8f6e-d24eab8329d6 for instance 2f22488e-5598-4475-b288-aa6847903025 on n-h2-847009-13 Aug 23 11:06:37.681728 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5f47eec3-ddab-470f-a376-63c4196d7e86 req-8fbc1c6b-be78-41c7-8f9c-bfc15fe1bf0c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110602 Aug 23 11:06:37.685103 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3095/6147] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:37.917714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:37.926946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2c7dbef-ee23-4096-af84-d3ea055b4d36 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1294 microversion: 2.1 time: 0.326418 Aug 23 11:06:37.936910 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3053/6148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:37 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1294 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:38.949878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:38.950756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:38.979793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:38.982776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:38.983486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:38.987450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:38.988466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:38.990748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:39.395293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:39.425846 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2763e8ad-ec40-4051-b601-7ed74899c985 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1294 microversion: 2.1 time: 0.479835 Aug 23 11:06:39.425846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3096/6149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:38 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1294 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:40.452220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:40.453207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:40.490181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:40.490686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:40.491901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:40.492044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:40.492479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:40.492957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:41.594811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:41.639746 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63e695f9-0a5d-44a5-979d-ce9bcbcbda87 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 1.193302 Aug 23 11:06:41.640181 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3054/6150] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:40 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:42.665572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:42.666195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:42.686593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:42.688118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:42.688684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:42.689221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:42.690434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:42.690971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:42.691330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:43.297723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:43.311907 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8069e66b-8cb7-4432-bb4d-1871f23c1585 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 0.650185 Aug 23 11:06:43.312819 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3097/6151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:42 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:43.394110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-81be9ca2-6ab9-4beb-94d7-2c235690f70a req-5c14d175-69b0-442b-9cfc-e5b2fddb7d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bfde77-3820-4a7f-8409-cd624d68cddb", "tag": "e881b35e-7fd0-4c2f-8d1e-669132e905fb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:43.423837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-81be9ca2-6ab9-4beb-94d7-2c235690f70a req-5c14d175-69b0-442b-9cfc-e5b2fddb7d1f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:43.425357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-81be9ca2-6ab9-4beb-94d7-2c235690f70a req-5c14d175-69b0-442b-9cfc-e5b2fddb7d1f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:43.426661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-81be9ca2-6ab9-4beb-94d7-2c235690f70a req-5c14d175-69b0-442b-9cfc-e5b2fddb7d1f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:43.465169 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-81be9ca2-6ab9-4beb-94d7-2c235690f70a req-5c14d175-69b0-442b-9cfc-e5b2fddb7d1f service nova] Creating event network-changed:e881b35e-7fd0-4c2f-8d1e-669132e905fb for instance 48bfde77-3820-4a7f-8409-cd624d68cddb on n-h1-847009-13 Aug 23 11:06:43.477875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-81be9ca2-6ab9-4beb-94d7-2c235690f70a req-5c14d175-69b0-442b-9cfc-e5b2fddb7d1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087475 Aug 23 11:06:43.480399 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3055/6152] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:44.334135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:44.334750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:44.352597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:44.353382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:44.353990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:44.354901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:44.355730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:44.356595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:45.262718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:45.274882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:45.291640 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28f0d738-ede4-45c3-a032-88418f8460c8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 0.961136 Aug 23 11:06:45.293023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3098/6153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:44 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:46.318210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:46.319941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:46.325119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:46.326110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:46.338417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:46.341572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:46.342241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:46.343188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:46.347545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:46.348543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:46.670525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:46.680497 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24f4fe86-7ab9-49e9-8bc7-2460c0f86e35 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 0.365399 Aug 23 11:06:46.681120 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3056/6154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:46 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:47.522015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-663383394", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "8f29ba65-cb35-429a-bf73-acddf76ef799"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:47.593144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] validate_networks() for [('8f29ba65-cb35-429a-bf73-acddf76ef799', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:06:47.710432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:47.711143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:47.743643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:47.745557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:47.750623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:47.751887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:47.753045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:47.757302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:48.368575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:06:48.369049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:06:48.369841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:06:48.370266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:06:48.370688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:06:48.390590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:48.392448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:48.394468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:48.397926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:48.399215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:48.401283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:48.476866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Getting quotas for project afb1108399874f578802fe733914f9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:48.499640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Getting quotas for user 5fddabec99cd4417990856b38884bbda and project afb1108399874f578802fe733914f9a7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:48.523367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:06:48.530591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:06:48.620220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d2b6a801-4e8f-4d19-830f-f5b42216aa11 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396215 Aug 23 11:06:48.621501 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3099/6155] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:06:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:06:48.628684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1266029890", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "516bb3ce-137b-43ad-9d0e-152e95172365"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1996025219", "security_groups": [{"name": "tempest-secgroup-smoke-877239495"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:48.865329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] validate_networks() for [('516bb3ce-137b-43ad-9d0e-152e95172365', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:06:49.007757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:49.016288 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45a795b7-f613-4fd2-bbf8-6784c1027ce0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 1.313179 Aug 23 11:06:49.024804 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3057/6156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:47 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:49.046393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-061e3343-b0cf-474d-89de-3df1cbc4fc04 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:49.050501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-061e3343-b0cf-474d-89de-3df1cbc4fc04 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:49.066690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:49.171216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-061e3343-b0cf-474d-89de-3df1cbc4fc04 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:49.196136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-061e3343-b0cf-474d-89de-3df1cbc4fc04 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1213 microversion: 2.1 time: 0.178166 Aug 23 11:06:49.216224 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3058/6157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:49 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1213 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:49.850201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:06:49.850785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:06:49.851616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:06:49.852619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:06:49.853465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:06:49.872870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:49.873549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:49.874164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:49.875131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:49.875809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:49.887341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:49.981157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:06:49.996901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:06:50.040438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:50.041424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:50.048238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:06:50.051112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:06:50.070952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:50.074757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:50.075530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:50.078237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:50.080167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:50.082201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:50.226728 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ffc377f-ca77-4d80-b606-054103e9c86c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.603698 Aug 23 11:06:50.229240 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3100/6158] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:06:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:06:50.234723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:50.235932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:50.247124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:50.250769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:50.253657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:50.255431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:50.257540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:50.260852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:50.442688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:50.459376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:50.465008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b65d30d3-3d58-4fd2-acff-1bab8b41a5a4 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1265 microversion: 2.1 time: 0.234376 Aug 23 11:06:50.470200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3101/6159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:50 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:50.470670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=64 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:06:50.483966 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ceea90e1-34f6-4484-b533-90686b8c6fe2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 0.448088 Aug 23 11:06:50.485225 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3059/6160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:50 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:06:50.489389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fd91e623-c78e-4d47-bd05-904072864121 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:50.493414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fd91e623-c78e-4d47-bd05-904072864121 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:50.668555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fd91e623-c78e-4d47-bd05-904072864121 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:50.681855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fd91e623-c78e-4d47-bd05-904072864121 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1267 microversion: 2.1 time: 0.209959 Aug 23 11:06:50.694433 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3102/6161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:50 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:51.489905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:51.491403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:51.501454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:51.501913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:51.503025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:51.503764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:51.504519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:51.506729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:51.512632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:51.513374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:51.532350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:51.532895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:51.544674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:51.553642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:51.555351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:51.556319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:51.703836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:51.725081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95806222-a652-4099-9142-a57c42f344cb tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1271 microversion: 2.1 time: 0.241899 Aug 23 11:06:51.726621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3060/6162] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:51 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:51.749221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:51.755593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:51.769325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:51.770734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:51.772393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:51.777852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:51.778655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:51.779295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:51.921688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:51.930199 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45caa340-39ee-4d1b-9384-bfa1cc867e02 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1263 microversion: 2.1 time: 0.202240 Aug 23 11:06:51.930797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3061/6163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:51 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1263 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:52.004314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:52.015564 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21541370-3297-4d08-aa30-4f5d10588a09 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 0.507087 Aug 23 11:06:52.020264 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3103/6164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:51 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:52.064371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-de390199-98cd-4616-8b8d-755a1a2392da req-661d65a0-8f68-45fe-bcba-561f98df483d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bfde77-3820-4a7f-8409-cd624d68cddb", "name": "network-vif-plugged", "status": "completed", "tag": "e881b35e-7fd0-4c2f-8d1e-669132e905fb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:52.076903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de390199-98cd-4616-8b8d-755a1a2392da req-661d65a0-8f68-45fe-bcba-561f98df483d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:52.077555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de390199-98cd-4616-8b8d-755a1a2392da req-661d65a0-8f68-45fe-bcba-561f98df483d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:52.077992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-de390199-98cd-4616-8b8d-755a1a2392da req-661d65a0-8f68-45fe-bcba-561f98df483d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:52.095229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-de390199-98cd-4616-8b8d-755a1a2392da req-661d65a0-8f68-45fe-bcba-561f98df483d service nova] Creating event network-vif-plugged:e881b35e-7fd0-4c2f-8d1e-669132e905fb for instance 48bfde77-3820-4a7f-8409-cd624d68cddb on n-h1-847009-13 Aug 23 11:06:52.118066 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-de390199-98cd-4616-8b8d-755a1a2392da req-661d65a0-8f68-45fe-bcba-561f98df483d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058471 Aug 23 11:06:52.122493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3062/6165] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:52.748213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:52.753012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:52.769955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:52.770454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:52.770899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:52.771622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:52.772083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:52.772509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:52.956574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:52.973843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:52.995249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:52.998437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:53.001093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:53.002156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:53.004825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:53.011580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:53.053329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:53.081364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6e67bb7e-e814-49ec-81ae-41ad01df0389 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1271 microversion: 2.1 time: 0.331424 Aug 23 11:06:53.084311 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3104/6166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:52 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1271 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:53.100393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:53.102154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:53.120702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:53.125625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:53.129606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:53.131623 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0fefe7b-815f-4f17-af7b-a61518a9489c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1337 microversion: 2.1 time: 0.182847 Aug 23 11:06:53.132348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:53.133414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:53.134099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:53.134941 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3063/6167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:52 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1337 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:53.135589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:53.628296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:53.642631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17a43034-61c2-4fa6-b06e-72bc9565b3dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1362 microversion: 2.1 time: 0.556862 Aug 23 11:06:53.652639 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3105/6168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:53 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1362 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:54.104658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:54.106042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:54.117077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:54.117911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:54.118434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:54.120943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:54.121560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:54.122183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:54.159067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:54.163219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:54.171098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:54.171996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:54.172943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:54.173862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:54.175402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:54.176128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:54.322763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:54.356066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b94afa0d-b8b6-4bbd-aaca-70da11219184 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1325 microversion: 2.1 time: 0.200584 Aug 23 11:06:54.373486 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3106/6169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:54 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:06:54.434659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:54.451682 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-780c5af0-c940-40f4-a76a-27d72aa5d6cd tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1313 microversion: 2.1 time: 0.350816 Aug 23 11:06:54.453424 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3064/6170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:54 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:54.666694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:54.667949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:54.682318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:54.683128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:54.687382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:54.688554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:54.689242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:54.692300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.116880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:55.125736 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b887f6b0-b84c-44ab-be6a-11b3b40ee088 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1548 microversion: 2.1 time: 0.464286 Aug 23 11:06:55.126370 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3107/6171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:54 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1548 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:55.149409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:55.150000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:55.156134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.156564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.157104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.157828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.158413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.159158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.231108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6e305569-53f1-47d8-a55d-5d03cd2f5860 req-f4399c54-cff3-456b-9858-c1448574615e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac63ff06-c16e-4de1-b024-cc4a3e4c9051", "tag": "5ba7d2bd-fe9a-41d3-a53f-d6ffd8f531b4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:55.243528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6e305569-53f1-47d8-a55d-5d03cd2f5860 req-f4399c54-cff3-456b-9858-c1448574615e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.244286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6e305569-53f1-47d8-a55d-5d03cd2f5860 req-f4399c54-cff3-456b-9858-c1448574615e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.244719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6e305569-53f1-47d8-a55d-5d03cd2f5860 req-f4399c54-cff3-456b-9858-c1448574615e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.258610 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6e305569-53f1-47d8-a55d-5d03cd2f5860 req-f4399c54-cff3-456b-9858-c1448574615e service nova] Creating event network-changed:5ba7d2bd-fe9a-41d3-a53f-d6ffd8f531b4 for instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 on n-h2-847009-13 Aug 23 11:06:55.263809 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6e305569-53f1-47d8-a55d-5d03cd2f5860 req-f4399c54-cff3-456b-9858-c1448574615e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036484 Aug 23 11:06:55.264429 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3108/6172] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:55.337543 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7702fe8-208f-4bac-89d2-7222c75fb632 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193694 Aug 23 11:06:55.338810 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3065/6173] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:06:55 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:06:55.384349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:55.385050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:55.392342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.393535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.394726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.399157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.399879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.401817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.493639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:55.495151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:55.509946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.510615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.511382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.513384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:55.514143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:55.514741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:55.740972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:55.752551 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3fa91cd-05e2-4f54-8b81-918f9b95d92c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.374373 Aug 23 11:06:55.753205 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3109/6174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:55 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:56.376265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:56.385242 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-299140d9-7336-4334-adac-f163045d1b77 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1313 microversion: 2.1 time: 0.914114 Aug 23 11:06:56.386443 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3066/6175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:55 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:56.773700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:56.774905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:56.782077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:56.782784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:56.783443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:56.784339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:56.784830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:56.785466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:57.069292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:57.079506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3a88956-26eb-4bf5-aac7-3c61a6954517 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.309561 Aug 23 11:06:57.081512 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3110/6176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:56 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:57.308637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-be5ce10b-4cb8-420e-b28e-6f6497c4237f req-7dcfc759-496b-40d7-9915-7c3e99a17f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bfde77-3820-4a7f-8409-cd624d68cddb", "tag": "e881b35e-7fd0-4c2f-8d1e-669132e905fb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:57.320759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a89ad803-5634-4e30-9a13-9fa20dbf6713 req-e84494b1-1c5d-42b8-a5fc-a5f684f61b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:57.327391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-be5ce10b-4cb8-420e-b28e-6f6497c4237f req-7dcfc759-496b-40d7-9915-7c3e99a17f2d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:57.327899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-be5ce10b-4cb8-420e-b28e-6f6497c4237f req-7dcfc759-496b-40d7-9915-7c3e99a17f2d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:57.328349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-be5ce10b-4cb8-420e-b28e-6f6497c4237f req-7dcfc759-496b-40d7-9915-7c3e99a17f2d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:57.342583 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-be5ce10b-4cb8-420e-b28e-6f6497c4237f req-7dcfc759-496b-40d7-9915-7c3e99a17f2d service nova] Creating event network-changed:e881b35e-7fd0-4c2f-8d1e-669132e905fb for instance 48bfde77-3820-4a7f-8409-cd624d68cddb on n-h1-847009-13 Aug 23 11:06:57.354022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-be5ce10b-4cb8-420e-b28e-6f6497c4237f req-7dcfc759-496b-40d7-9915-7c3e99a17f2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049282 Aug 23 11:06:57.356715 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3067/6177] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:57.358937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a89ad803-5634-4e30-9a13-9fa20dbf6713 req-e84494b1-1c5d-42b8-a5fc-a5f684f61b14 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:57.359437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a89ad803-5634-4e30-9a13-9fa20dbf6713 req-e84494b1-1c5d-42b8-a5fc-a5f684f61b14 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:57.360181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a89ad803-5634-4e30-9a13-9fa20dbf6713 req-e84494b1-1c5d-42b8-a5fc-a5f684f61b14 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:57.377690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a89ad803-5634-4e30-9a13-9fa20dbf6713 req-e84494b1-1c5d-42b8-a5fc-a5f684f61b14 service nova] Creating event network-changed:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:06:57.390293 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a89ad803-5634-4e30-9a13-9fa20dbf6713 req-e84494b1-1c5d-42b8-a5fc-a5f684f61b14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083954 Aug 23 11:06:57.391525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3111/6178] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:06:57.441930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:57.474167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:57.503828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:57.508388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:57.510689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:57.513913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:57.515263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:57.515966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:57.799665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:57.808877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-012ecb9e-4848-4c29-8e88-48b0049811d8 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1313 microversion: 2.1 time: 0.401957 Aug 23 11:06:57.809668 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3068/6179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:57 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:58.103900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:58.105293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:58.111884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:58.112643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:58.113184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:58.114771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:58.115467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:58.116895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:58.829691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:06:58.831069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:58.844981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:58.845494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:58.848509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:58.854006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:58.854520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:58.854971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:59.055233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:59.072456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4611d3a4-c41b-403e-9f1a-6db18f323469 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.973933 Aug 23 11:06:59.073516 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3112/6180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:58 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:06:59.180925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:06:59.190288 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a5d3917-1b12-478c-a662-c1e61bf4d617 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1313 microversion: 2.1 time: 0.364564 Aug 23 11:06:59.192057 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3069/6181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:06:58 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:06:59.311682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:06:59.314569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:06:59.322619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:59.323372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:59.323972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:59.324874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:06:59.325492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:06:59.326220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:06:59.409818 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6bd54c9a-6e7f-452e-bd47-ae6873bfcb31 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025/action" status: 200 len: 24574 microversion: 2.1 time: 0.101865 Aug 23 11:06:59.410884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3113/6182] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:06:59 2022] POST /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025/action => generated 24574 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:00.094368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:00.094995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:00.097975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:00.104420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:00.104951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:00.105400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:00.106362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:00.106834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:00.107436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:00.212703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:00.213705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:00.220063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:00.222289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:00.222793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:00.223234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:00.223986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:00.224529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:00.225005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:00.348732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:00.359734 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c687ba67-4454-49f6-883c-729a4a6924cc tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.269330 Aug 23 11:07:00.374360 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3070/6183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:00 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:00.489428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:00.512635 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-276ec3e7-c5a9-44c3-bec3-b8114a4596d7 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1313 microversion: 2.1 time: 0.290792 Aug 23 11:07:00.514191 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3114/6184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:00 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:00.977480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8f988e2d-243c-49c4-adda-7cfc44fc5d26 req-c66f097c-796d-452f-8888-e8acda493a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac63ff06-c16e-4de1-b024-cc4a3e4c9051", "name": "network-vif-plugged", "status": "completed", "tag": "5ba7d2bd-fe9a-41d3-a53f-d6ffd8f531b4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:01.001579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f988e2d-243c-49c4-adda-7cfc44fc5d26 req-c66f097c-796d-452f-8888-e8acda493a88 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:01.004191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f988e2d-243c-49c4-adda-7cfc44fc5d26 req-c66f097c-796d-452f-8888-e8acda493a88 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:01.004709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f988e2d-243c-49c4-adda-7cfc44fc5d26 req-c66f097c-796d-452f-8888-e8acda493a88 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:01.021400 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8f988e2d-243c-49c4-adda-7cfc44fc5d26 req-c66f097c-796d-452f-8888-e8acda493a88 service nova] Creating event network-vif-plugged:5ba7d2bd-fe9a-41d3-a53f-d6ffd8f531b4 for instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 on n-h2-847009-13 Aug 23 11:07:01.027813 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8f988e2d-243c-49c4-adda-7cfc44fc5d26 req-c66f097c-796d-452f-8888-e8acda493a88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055994 Aug 23 11:07:01.029333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3071/6185] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:07:01.382763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:01.383387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:01.389657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=14 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:01.396173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:01.396601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:01.399444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:01.400199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:01.400875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:01.403305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:01.546798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:01.547685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:01.570087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:01.570845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:01.571456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:01.572373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:01.573356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:01.575124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:01.588033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:01.604383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85447461-aefb-4766-8887-15afbd1d5150 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.225492 Aug 23 11:07:01.605363 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3115/6186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:01 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:07:01.841916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:01.852245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82b25542-3c90-4f78-891e-34569c646392 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1313 microversion: 2.1 time: 0.321551 Aug 23 11:07:01.865935 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3072/6187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:01 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:02.635857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:02.637193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:02.651606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:02.652581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:02.653220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:02.658695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:02.660310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:02.661531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:02.708206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:02.878694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:02.879248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:02.883010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:02.895095 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-80891ccd-f437-4c60-9a85-b28f6535360c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.267535 Aug 23 11:07:02.908766 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3116/6188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:02 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:02.912898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:02.914028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:02.915011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:02.916292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:02.918105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:02.918918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:03.151728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:03.163355 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23818330-d458-47e0-ba70-b554502dec0e tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1496 microversion: 2.1 time: 0.292292 Aug 23 11:07:03.179328 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3073/6189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:02 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1496 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:03.485834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a39ed753-7e65-4604-bca7-bb081f26555c req-81f621e1-0a56-4dde-8cac-2bf8fb604ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "name": "network-vif-plugged", "status": "completed", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:03.510682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a39ed753-7e65-4604-bca7-bb081f26555c req-81f621e1-0a56-4dde-8cac-2bf8fb604ded service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:03.511425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a39ed753-7e65-4604-bca7-bb081f26555c req-81f621e1-0a56-4dde-8cac-2bf8fb604ded service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:03.512131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a39ed753-7e65-4604-bca7-bb081f26555c req-81f621e1-0a56-4dde-8cac-2bf8fb604ded service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:03.546118 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a39ed753-7e65-4604-bca7-bb081f26555c req-81f621e1-0a56-4dde-8cac-2bf8fb604ded service nova] Creating event network-vif-plugged:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:07:03.576655 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a39ed753-7e65-4604-bca7-bb081f26555c req-81f621e1-0a56-4dde-8cac-2bf8fb604ded service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094835 Aug 23 11:07:03.577927 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3117/6190] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:03.920648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:03.921289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:03.938026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:03.938705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:03.939997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:03.941556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:03.942226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:03.942742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:04.383959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:04.404654 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b05e523-1a12-40b3-8451-ab8b25ede024 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1392 microversion: 2.1 time: 0.487721 Aug 23 11:07:04.405810 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3074/6191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:03 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1392 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:05.445861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:05.448054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:05.500911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:05.503970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:05.509303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:05.510106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:05.512934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:05.513318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:05.775961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:05.788627 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b66c54c-f9bb-482b-b73d-eb870569d98a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1565 microversion: 2.1 time: 0.366383 Aug 23 11:07:05.789701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3118/6192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:05 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1565 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:05.809454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:05.810084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:05.824250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:05.824748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:05.825208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:05.828377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:05.828884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:05.829335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:06.064184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:06.073446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a0e3034-722c-4672-88ad-83b86dee1922 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1565 microversion: 2.1 time: 0.267819 Aug 23 11:07:06.077828 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3075/6193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:05 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:06.289424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:06.291167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:06.298403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:06.299986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:06.300876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:06.301771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:06.302552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:06.303149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:06.334570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:07:06.468183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47899157-da23-4850-841f-7314254b7120 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 204 len: 0 microversion: 2.1 time: 0.183547 Aug 23 11:07:06.473661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3119/6194] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:06 2022] DELETE /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:07:06.478773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:06.479415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:06.494686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:06.497720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:06.498184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:06.498935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:06.502884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:06.502884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:06.835779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:06.844914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aae547ad-24f2-4652-866b-4b59ddafc2a3 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1502 microversion: 2.1 time: 0.370731 Aug 23 11:07:06.852351 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3076/6195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:06 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:07.869556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:07.870998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:07.883416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:07.884724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:07.885477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:07.886814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:07.887546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:07.888422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:08.135746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:08.149943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6dd04d86-c0f1-434d-8c08-facfca559376 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1502 microversion: 2.1 time: 0.287281 Aug 23 11:07:08.162351 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3120/6196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:07 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:08.282176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:08.283074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:08.288727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7082a544-c7d0-4cb3-b783-3b923ea36ef0 req-b7e3fcf7-7df7-487e-8e17-901d99d9a8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:08.295800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:08.296307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:08.300710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:08.301475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:08.301965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:08.302417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:08.302667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7082a544-c7d0-4cb3-b783-3b923ea36ef0 req-b7e3fcf7-7df7-487e-8e17-901d99d9a8f2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:08.303157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7082a544-c7d0-4cb3-b783-3b923ea36ef0 req-b7e3fcf7-7df7-487e-8e17-901d99d9a8f2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:08.303601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7082a544-c7d0-4cb3-b783-3b923ea36ef0 req-b7e3fcf7-7df7-487e-8e17-901d99d9a8f2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:08.328351 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7082a544-c7d0-4cb3-b783-3b923ea36ef0 req-b7e3fcf7-7df7-487e-8e17-901d99d9a8f2 service nova] Creating event network-changed:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:07:08.349385 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7082a544-c7d0-4cb3-b783-3b923ea36ef0 req-b7e3fcf7-7df7-487e-8e17-901d99d9a8f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063729 Aug 23 11:07:08.354639 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3121/6197] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:08.560885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:08.573708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e4c166a-820e-488d-ad4b-5e1a66210af4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1565 microversion: 2.1 time: 0.295500 Aug 23 11:07:08.581398 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3077/6198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:08 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1565 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:08.982853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-739678ec-1dc7-421d-a9f5-fd5bcd15f5f1 req-03fd2525-6877-41ae-9764-75b068ab6e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac63ff06-c16e-4de1-b024-cc4a3e4c9051", "name": "network-vif-deleted", "tag": "5ba7d2bd-fe9a-41d3-a53f-d6ffd8f531b4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:08.997355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-739678ec-1dc7-421d-a9f5-fd5bcd15f5f1 req-03fd2525-6877-41ae-9764-75b068ab6e45 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:08.998307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-739678ec-1dc7-421d-a9f5-fd5bcd15f5f1 req-03fd2525-6877-41ae-9764-75b068ab6e45 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:08.998911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-739678ec-1dc7-421d-a9f5-fd5bcd15f5f1 req-03fd2525-6877-41ae-9764-75b068ab6e45 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:09.021542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-739678ec-1dc7-421d-a9f5-fd5bcd15f5f1 req-03fd2525-6877-41ae-9764-75b068ab6e45 service nova] Creating event network-vif-deleted:5ba7d2bd-fe9a-41d3-a53f-d6ffd8f531b4 for instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 on n-h2-847009-13 Aug 23 11:07:09.034872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-739678ec-1dc7-421d-a9f5-fd5bcd15f5f1 req-03fd2525-6877-41ae-9764-75b068ab6e45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056425 Aug 23 11:07:09.036081 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3122/6199] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:09.177558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:09.180850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:09.191856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:09.192369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:09.192872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:09.193602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:09.194129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:09.194560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:09.294061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:09.294696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:09.296047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:09.297862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lazy-loading 'fault' on Instance uuid ac63ff06-c16e-4de1-b024-cc4a3e4c9051 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:07:09.313750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:09.393511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fddabec99cd4417990856b38884bbda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afb1108399874f578802fe733914f9a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:09.405842 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80be4dc7-4116-456f-bdae-8c2a3b9e85c1 tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 200 len: 1303 microversion: 2.1 time: 0.233943 Aug 23 11:07:09.407093 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3078/6200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:09 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:09.477408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:09.478213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:09.488555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:09.497969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:09.498667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:09.499569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:09.500192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:09.500793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:09.546642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddb1ff63-a677-48dc-9d4d-36860c32bb9a tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/ips" status: 200 len: 149 microversion: 2.1 time: 0.073638 Aug 23 11:07:09.549955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3123/6201] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:07:09 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/ips => generated 149 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:10.415628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:10.417956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:10.427610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:10.428346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:10.428473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:10.429396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] [instance: ac63ff06-c16e-4de1-b024-cc4a3e4c9051] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:10.429641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:10.430542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:10.431359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:10.431966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:10.442766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:10.443298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:10.446087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:10.447640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:10.448721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:10.449708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:10.469783 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] HTTP exception thrown: Instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 could not be found. Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Request method failure captured: Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 HTTP/1.1 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLTDKaxB8dSouHc0U3BTF_RmiKDJxL6r-GJ3DVWUTzhUzB5_SXm2VJsWbF8htNcNQFWY2qLov2swvAzgZ8iexkSOe3kHrofBztq2-FOfmz8Tud9R62oOrhuAxnafvfPOxx66kDsqDsNaoLM7oAw0ZlH9lzhTDr36h7ZslZjtgNj73fM Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: afb1108399874f578802fe733914f9a7 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesActionsTest-1380449934 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/afb1108399874f578802fe733914f9a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_afb1108399874f578802fe733914f9a7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/afb1108399874f578802fe733914f9a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/afb1108399874f578802fe733914f9a7"}]}] Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesActionsTest-1380449934 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: afb1108399874f578802fe733914f9a7 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesActionsTest-1380449934 Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesActionsTest-1380449934-project Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 5fddabec99cd4417990856b38884bbda Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesActionsTest-1380449934-project Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 could not be found. Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ac63ff06-c16e-4de1-b024-cc4a3e4c9051'} Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 could not be found. Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 could not be found. Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:10.472976 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 could not be found. Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] Returning 404 to user: Instance ac63ff06-c16e-4de1-b024-cc4a3e4c9051 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:10.477415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92ed40da-1d9f-4b74-9930-ec9ade874ddf tempest-VolumesActionsTest-1380449934 tempest-VolumesActionsTest-1380449934-project] 10.222.0.78 "GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051" status: 404 len: 111 microversion: 2.1 time: 0.051087 Aug 23 11:07:10.479654 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3124/6202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:10 2022] GET /compute/v2.1/servers/ac63ff06-c16e-4de1-b024-cc4a3e4c9051 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:10.519003 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c1cd27ec-5a8a-4611-8ecf-2ba99caccf8f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "POST /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025/action" status: 200 len: 32643 microversion: 2.1 time: 0.106162 Aug 23 11:07:10.526647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3079/6203] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:07:10 2022] POST /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025/action => generated 32643 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:12.026268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:12.026812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:12.048910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.049459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.049945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.051098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8f213598-42f3-4d46-868d-5c4db787154d req-c099d55a-e6d4-4b27-ba4a-1e113ad999d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f22488e-5598-4475-b288-aa6847903025", "tag": "07d66e67-bcef-478d-8f6e-d24eab8329d6"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:12.060008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.060845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.065451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f213598-42f3-4d46-868d-5c4db787154d req-c099d55a-e6d4-4b27-ba4a-1e113ad999d3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.066226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.072162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f213598-42f3-4d46-868d-5c4db787154d req-c099d55a-e6d4-4b27-ba4a-1e113ad999d3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.072906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f213598-42f3-4d46-868d-5c4db787154d req-c099d55a-e6d4-4b27-ba4a-1e113ad999d3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.097698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8f213598-42f3-4d46-868d-5c4db787154d req-c099d55a-e6d4-4b27-ba4a-1e113ad999d3 service nova] Creating event network-changed:07d66e67-bcef-478d-8f6e-d24eab8329d6 for instance 2f22488e-5598-4475-b288-aa6847903025 on n-h2-847009-13 Aug 23 11:07:12.107729 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8f213598-42f3-4d46-868d-5c4db787154d req-c099d55a-e6d4-4b27-ba4a-1e113ad999d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063636 Aug 23 11:07:12.111694 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3080/6204] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 23 11:07:12.121062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:07:12.254528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:12.287519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28036a5e-7b4c-4c52-818e-235df7acc888 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 204 len: 0 microversion: 2.1 time: 0.265686 Aug 23 11:07:12.288921 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3125/6205] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:12 2022] DELETE /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:07:12.299121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:12.300081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:12.313364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.313877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.315109 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.319918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.320438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.324302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.352802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "005947bb-1cdd-4186-a642-d6aed022e247"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:12.356969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:12.373608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.376165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.377429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.381541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:12.384370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:12.385051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:12.618885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:12.644622 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31eee34a-c3f4-4c23-b9f7-089a4ede22b8 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1665 microversion: 2.1 time: 0.350310 Aug 23 11:07:12.655202 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3081/6206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:12 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1665 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:12.865453 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b81c9bb-0a7e-4940-b72e-28655e0614f6 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "POST /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518939 Aug 23 11:07:12.866109 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3126/6207] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:07:12 2022] POST /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:13.677173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:13.677810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:13.702971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:13.703487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:13.703943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:13.705076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:13.705670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:13.706120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:14.263883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:14.276014 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cee3e4c-0564-447f-980b-fb10a18ac7ab tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1665 microversion: 2.1 time: 0.603263 Aug 23 11:07:14.277812 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3082/6208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:13 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1665 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:14.817032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cbf8328f-684e-4cb4-8aa0-497b4c384d81 req-050925f2-5db0-4b88-9566-b79d17ad73e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f22488e-5598-4475-b288-aa6847903025", "name": "network-vif-deleted", "tag": "07d66e67-bcef-478d-8f6e-d24eab8329d6"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:14.848669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cbf8328f-684e-4cb4-8aa0-497b4c384d81 req-050925f2-5db0-4b88-9566-b79d17ad73e6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:14.850615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cbf8328f-684e-4cb4-8aa0-497b4c384d81 req-050925f2-5db0-4b88-9566-b79d17ad73e6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:14.851421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cbf8328f-684e-4cb4-8aa0-497b4c384d81 req-050925f2-5db0-4b88-9566-b79d17ad73e6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:14.881848 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cbf8328f-684e-4cb4-8aa0-497b4c384d81 req-050925f2-5db0-4b88-9566-b79d17ad73e6 service nova] Creating event network-vif-deleted:07d66e67-bcef-478d-8f6e-d24eab8329d6 for instance 2f22488e-5598-4475-b288-aa6847903025 on n-h2-847009-13 Aug 23 11:07:14.895843 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cbf8328f-684e-4cb4-8aa0-497b4c384d81 req-050925f2-5db0-4b88-9566-b79d17ad73e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081538 Aug 23 11:07:14.896823 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3127/6209] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:15.303696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:15.305322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:15.327161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:15.328211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:15.329022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:15.332242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:15.333219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:15.335087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:15.502423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:15.502965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:15.503446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:15.503941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lazy-loading 'fault' on Instance uuid 2f22488e-5598-4475-b288-aa6847903025 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:07:15.616805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bb6e7d862d84e1c9f5d129b0c41bc37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae502704266349bab5642ad154ea1085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:15.645451 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82d443b8-4e5a-4e52-af1c-dec84a977c7f tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 200 len: 1337 microversion: 2.1 time: 0.345953 Aug 23 11:07:15.648822 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3083/6210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:15 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 1337 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:07:16.678415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:16.679359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] [instance: 2f22488e-5598-4475-b288-aa6847903025] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:16.695378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:16.697412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:16.705463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:16.708930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:16.709547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:16.710230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:16.742788 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] HTTP exception thrown: Instance 2f22488e-5598-4475-b288-aa6847903025 could not be found. Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Request method failure captured: Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 HTTP/1.1 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLO7JkE-RbwT1jRuNPIfkNHOjxrrXwLYrT4BQ1ZRGnlXoDOljlqPmD8xhhaIM7JgK95_9UXJFtO_vLqV87nfl4mRcZh7sO-RfIG5hFqbnOayJttMJklmFpKnCjA4xXAIi65iGTfa-kKRME0-XWbIxAGpvCLPu7zuQqE1-I4oRKIMSrg Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: ae502704266349bab5642ad154ea1085 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ae502704266349bab5642ad154ea1085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ae502704266349bab5642ad154ea1085", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ae502704266349bab5642ad154ea1085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ae502704266349bab5642ad154ea1085"}]}] Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: ae502704266349bab5642ad154ea1085 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestNetworkBasicOps-1990801935 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestNetworkBasicOps-1990801935-project Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 4bb6e7d862d84e1c9f5d129b0c41bc37 Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestNetworkBasicOps-1990801935-project Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 2f22488e-5598-4475-b288-aa6847903025 could not be found. Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2f22488e-5598-4475-b288-aa6847903025'} Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f22488e-5598-4475-b288-aa6847903025 could not be found. Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f22488e-5598-4475-b288-aa6847903025 could not be found. Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:16.744611 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f22488e-5598-4475-b288-aa6847903025 could not be found. Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Returning 404 to user: Instance 2f22488e-5598-4475-b288-aa6847903025 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:16.750045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca8cef7f-3db4-43f7-a88b-35938cc05255 tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025" status: 404 len: 111 microversion: 2.1 time: 0.080281 Aug 23 11:07:16.754514 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3128/6211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:16 2022] GET /compute/v2.1/servers/2f22488e-5598-4475-b288-aa6847903025 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:17.135160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35a966fd-5faf-4aaf-b7d2-da966a1c405b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] Calling method '.version_select at 0x7fdc8fdd65e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:17.198719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35a966fd-5faf-4aaf-b7d2-da966a1c405b tempest-TestNetworkBasicOps-1990801935 tempest-TestNetworkBasicOps-1990801935-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2002095424" status: 202 len: 0 microversion: 2.1 time: 0.059743 Aug 23 11:07:17.201587 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3084/6212] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 11:07:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2002095424 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:07:18.981353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:18.983177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:19.000313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:19.001189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:19.001991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:19.002872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:19.003494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:19.004077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:19.067863 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a29380f-067a-4c08-a45a-e3a752b54f12 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments/10fb829a-ac92-4b51-8dcd-e3b61329b01c" status: 200 len: 194 microversion: 2.20 time: 0.091460 Aug 23 11:07:19.069875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3129/6213] 10.222.0.78 () {60 vars in 1454 bytes} [Tue Aug 23 11:07:18 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments/10fb829a-ac92-4b51-8dcd-e3b61329b01c => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:19.181187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:19.182361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:19.185398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:19.197211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:19.197720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:19.198365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:19.199272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:19.199895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:19.200491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:19.455315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lazy-loading 'services' on Instance uuid 3d8297fe-7c5a-4258-b795-34e44f552873 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:07:19.668567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0141e5d-9f4d-49bb-8058-ac6c4f428bf4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments/10fb829a-ac92-4b51-8dcd-e3b61329b01c" status: 202 len: 0 microversion: 2.20 time: 0.491176 Aug 23 11:07:19.673574 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3085/6214] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Aug 23 11:07:19 2022] DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments/10fb829a-ac92-4b51-8dcd-e3b61329b01c => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:07:19.679201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:19.681410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:19.694558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:19.695062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:19.697993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:19.700422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:19.701097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:19.701688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:19.895981 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87bf35a9-60a2-4a9d-b6d2-7f2b257d1d70 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.221084 Aug 23 11:07:19.899485 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3130/6215] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:19 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:20.916204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:20.917821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:20.930737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:20.931669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:20.931669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:20.934565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:20.937872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:20.938516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:21.026299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5483e23-b282-45a0-8c2c-7af03ba16e75 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117474 Aug 23 11:07:21.030242 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3086/6216] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:20 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:22.042979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:22.050665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:22.068340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:22.069822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:22.070541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:22.072551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:22.074082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:22.075413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:22.160465 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81fa519d-0c02-4561-a318-2c899e5d94c4 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125076 Aug 23 11:07:22.164166 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3131/6217] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:22 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:23.176507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:23.180575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:23.206929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:23.210305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:23.211879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:23.212877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:23.214220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:23.219249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:23.314708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86c9837a-e8eb-47bf-9639-81c3539edad1 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.142685 Aug 23 11:07:23.316959 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3087/6218] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:23 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:24.347124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:24.350612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:24.368290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:24.377533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:24.378328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:24.379277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:24.379921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:24.380521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:24.441939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:24.480199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51b15c2c-5a8b-4693-b5ae-29bfc04f1cf3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155271 Aug 23 11:07:24.481086 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3132/6219] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:24 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:25.493895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:25.496235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:25.512198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:25.512716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:25.513197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:25.513927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:25.514396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:25.514834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:25.571699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7b40917-623a-4d98-94a1-1f5374239990 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082008 Aug 23 11:07:25.577085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3088/6220] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:25 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:26.587747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:26.590796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:26.609956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:26.610788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:26.611410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:26.614762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:26.615716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:26.616799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:26.684307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11a40e8e-a91f-498f-ae0d-83d814d8ac92 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103242 Aug 23 11:07:26.695585 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3133/6221] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:26 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:27.709284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:27.711589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:27.725811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:27.726333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:27.726791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:27.727822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:27.728008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:27.741081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:27.837771 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1839fee7-27fd-4557-8b9c-0ad3a7db588b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133289 Aug 23 11:07:27.845724 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3089/6222] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:27 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:27.887199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:27.887809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:27.917673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:27.918179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:27.922356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:27.924482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:27.931515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:27.935929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:28.216378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lazy-loading 'services' on Instance uuid d2c0f34e-dc40-4002-a540-39fae84f6a66 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:07:28.324197 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93e9d4a6-8164-493e-8d5e-4cd901ede4e7 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments/005947bb-1cdd-4186-a642-d6aed022e247" status: 202 len: 0 microversion: 2.1 time: 0.442075 Aug 23 11:07:28.325869 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3134/6223] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:07:27 2022] DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments/005947bb-1cdd-4186-a642-d6aed022e247 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:07:28.336857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:28.339521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:28.354171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:28.355372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:28.356447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:28.357624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:28.358382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:28.359039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:28.439578 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d56dd9fd-f0d1-4c2e-9392-8d8061364c36 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107975 Aug 23 11:07:28.441041 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3090/6224] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:28 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:28.852054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:28.859331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:28.877948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:28.878799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:28.879421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:28.880318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:28.881028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:28.881619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:28.965747 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-be3b70ae-e1f4-4928-be45-f5edd4277556 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117741 Aug 23 11:07:28.968134 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3135/6225] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:28 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:29.455619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:29.456232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:29.463466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:29.463881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:29.464319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:29.465043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:29.465500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:29.466159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:29.502250 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87b4c5dc-fac0-43ca-9301-7adbc2c6a48c tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053023 Aug 23 11:07:29.504973 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3091/6226] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:29 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:29.979907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:29.982904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:29.997946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:29.998438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:29.998888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.004306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.004869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.005332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.055053 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d588f577-6462-4fab-949d-0927427db508 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079270 Aug 23 11:07:30.060919 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3136/6227] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:07:29 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:30.158780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:30.159299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:30.168498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.169039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.169498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.170226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.170703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.171145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.227886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:07:30.354409 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-074e17db-c5de-482b-9cca-f91d8277ce08 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 204 len: 0 microversion: 2.20 time: 0.201069 Aug 23 11:07:30.355558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3092/6228] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:07:30 2022] DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:07:30.363839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:30.364693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:30.382678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.383544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.384196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.385302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.385913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.386507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.517453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:30.521552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:30.537669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.539667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.548786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.551193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:30.555447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:30.556108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:30.617084 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4460cf0-c192-4a6e-9943-4ef491991f43 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104050 Aug 23 11:07:30.621167 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3093/6229] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:30 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:30.676702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:30.686420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:30.695623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:30.697279 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69d3ef36-24f6-4b80-bfa5-d392725422cf tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 0.337395 Aug 23 11:07:30.697863 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3137/6230] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:30 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:31.633045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:31.635415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:31.663861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:31.681522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:31.682193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:31.683151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:31.683782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:31.684380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:31.722501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:31.723705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:31.729067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:31.740659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:31.741499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:31.742110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:31.743012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:31.743635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:31.744262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:31.795782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-72f0abcb-830f-44f0-8dab-bef57487b1cd tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164765 Aug 23 11:07:31.796864 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3094/6231] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:31 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:32.753186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:32.769625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:32.771759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:32.773143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-794a7855-7f78-4379-817f-58202e806e81 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1723 microversion: 2.20 time: 1.055431 Aug 23 11:07:32.787127 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3138/6232] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:31 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1723 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:32.810909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:32.814308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:32.840778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:32.841420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:32.841876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:32.842624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:32.843094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:32.843537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:32.910519 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8455edac-a03b-41c9-93c5-9fae4f7b269e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105715 Aug 23 11:07:32.913688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3095/6233] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:32 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:33.815367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:33.816010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:33.846089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:33.846757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:33.847878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:33.855349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:33.858570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:33.859641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:33.925744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:33.928622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:33.941274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:33.942096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:33.945553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:33.946717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:33.947389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:33.948054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:33.995974 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8eb0e232-cdba-4172-9a10-e696840b82ef tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074816 Aug 23 11:07:34.010751 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3096/6234] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:33 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:34.063136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:34.090113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:34.103861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:34.108146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c921d91-e1eb-4b49-a905-ebe3c6571064 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1655 microversion: 2.20 time: 0.312172 Aug 23 11:07:34.121262 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3139/6235] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:33 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1655 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:34.330487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ab09209f-f39e-4a74-947d-be29d7e6df46 req-90830503-2594-49aa-a7c1-f2dd4d7cc64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8297fe-7c5a-4258-b795-34e44f552873", "name": "network-vif-deleted", "tag": "83b29a44-511f-4c21-82bd-389b15ee9611"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:34.349725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab09209f-f39e-4a74-947d-be29d7e6df46 req-90830503-2594-49aa-a7c1-f2dd4d7cc64b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:34.350584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab09209f-f39e-4a74-947d-be29d7e6df46 req-90830503-2594-49aa-a7c1-f2dd4d7cc64b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:34.352623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ab09209f-f39e-4a74-947d-be29d7e6df46 req-90830503-2594-49aa-a7c1-f2dd4d7cc64b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:34.378402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ab09209f-f39e-4a74-947d-be29d7e6df46 req-90830503-2594-49aa-a7c1-f2dd4d7cc64b service nova] Creating event network-vif-deleted:83b29a44-511f-4c21-82bd-389b15ee9611 for instance 3d8297fe-7c5a-4258-b795-34e44f552873 on n-h1-847009-13 Aug 23 11:07:34.384711 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ab09209f-f39e-4a74-947d-be29d7e6df46 req-90830503-2594-49aa-a7c1-f2dd4d7cc64b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058731 Aug 23 11:07:34.389866 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3097/6236] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:35.105498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:35.108055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:35.132713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:35.137859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:35.138579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:35.144816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:35.145281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:35.146036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:35.163492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:35.164436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:35.165090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:35.170068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:35.170809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:35.171711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:35.172330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:35.173164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:35.271858 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c071e96-8c02-4ff6-be8a-c924f2c528fc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170329 Aug 23 11:07:35.272468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3140/6237] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:35 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:35.301542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:35.302413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:35.303010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:35.303630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lazy-loading 'fault' on Instance uuid 3d8297fe-7c5a-4258-b795-34e44f552873 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:07:35.384630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:35.402311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:35.405021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:35.406416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76212560-309a-49f8-89ff-8c2780da641a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 200 len: 1371 microversion: 2.20 time: 0.276693 Aug 23 11:07:35.422533 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3098/6238] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:35 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:07:36.285378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:36.295871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:36.319997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.320504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.320983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.323844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.325624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.326111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.397667 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4241413c-a7c2-4011-80b6-ae4b78f9798d tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117964 Aug 23 11:07:36.398606 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3141/6239] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:07:36 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:07:36.432593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:36.433136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:36.442826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.443323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.443759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.444480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.449331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.449795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.485715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:36.486553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:36.493907 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] HTTP exception thrown: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:07:36.496200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.496946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Request method failure captured: Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 HTTP/1.1 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPtI1A-BxsdysoFsibhrONPth1T0RU4SFjN-XRyL9DoDAApuIFjJx12SWKyiXWKpQm0z1cgnVjZeJr7Vk4X4Z10fA6CnhEq533_JxxwMUX3HjtCNNxr88apLcyiTemY9KQTB0LEJiOvvl7TdXWK2ou82vr3jMDTnM8j7mEWhj48ts4 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bc56160173245b48e2299234369f3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bc56160173245b48e2299234369f3ca", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}] Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a3e6281c3d024d9b8c9a27bb5144860b Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '3d8297fe-7c5a-4258-b795-34e44f552873'} Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:36.498889 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:07:36.503983 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:36.506001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.506966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.507651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.508554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Returning 404 to user: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:36.509197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.510240 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fc27d49-a12e-4562-a94b-0ffdd6efb3bc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 404 len: 111 microversion: 2.20 time: 0.081956 Aug 23 11:07:36.517146 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3099/6240] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:36 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:07:36.529306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7cf2f4d3-c1fd-480f-b621-a3badb4b1b16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '.version_select at 0x7fdca1ed95e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:36.570972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:07:36.581093 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7cf2f4d3-c1fd-480f-b621-a3badb4b1b16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384415811" status: 204 len: 0 microversion: 2.20 time: 0.059672 Aug 23 11:07:36.581862 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3100/6241] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 11:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384415811 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:07:36.692493 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef035378-7a34-43e6-8f7d-5c344be29463 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 204 len: 0 microversion: 2.1 time: 0.211317 Aug 23 11:07:36.693535 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3142/6242] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:36 2022] DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 11:07:36.702506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:36.703533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:36.711493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.712717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.713722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.715274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:36.716644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:36.717405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:36.961634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:36.992076 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efe99f87-f3f5-4aaf-b2aa-a7fd0aa1f015 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1679 microversion: 2.1 time: 0.293563 Aug 23 11:07:36.992819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3101/6243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:36 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1679 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:37.703623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a5eddb1-cd82-425e-b4e0-056475cd3ec9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'create', calling method: .version_select at 0x7fdca1e91af0>, body: {"keypair": {"name": "tempest-keypair-1131694806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWhtLxNJT8HAP7FFnTtTxxxTH/8xogCVcFueAU9EH9PiiYrfznXSaCpvAKjWSUcyeyOZYRILkzi0snADUY5oCXMYrvU6U5z0Xwo/VPY9ZL5EErzJOlt8L/0kzJdAVXAcQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:37.721817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5a5eddb1-cd82-425e-b4e0-056475cd3ec9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for project 7bc56160173245b48e2299234369f3ca. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:07:37.728287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5a5eddb1-cd82-425e-b4e0-056475cd3ec9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for user a3e6281c3d024d9b8c9a27bb5144860b and project 7bc56160173245b48e2299234369f3ca. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:07:37.759963 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a5eddb1-cd82-425e-b4e0-056475cd3ec9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.060521 Aug 23 11:07:37.761026 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3143/6244] 10.222.0.78 () {62 vars in 1200 bytes} [Tue Aug 23 11:07:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 11:07:38.028495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:38.031848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:38.046241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:38.048486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:38.048486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:38.050899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:38.051577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:38.053713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:38.326971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:38.338210 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0fb41b0-9f4d-4ab8-907f-e3a7c1ebb1be tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1679 microversion: 2.1 time: 0.314095 Aug 23 11:07:38.339455 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3102/6245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:38 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1679 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:39.361443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:39.362812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:39.381855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:39.382648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:39.383255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:39.384146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:39.384790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:39.385382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:40.055294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:40.068337 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac74da18-d0e3-4a44-a556-39ccbb247aeb tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1679 microversion: 2.1 time: 0.712452 Aug 23 11:07:40.084841 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3144/6246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:39 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1679 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:40.952982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-37075101-f8e8-42f1-a336-c8a6d0bd159b req-deca2bdf-b166-460b-acb0-de349d8a7fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c0f34e-dc40-4002-a540-39fae84f6a66", "name": "network-vif-deleted", "tag": "5314dc05-ab29-43b2-9974-9ad88be87d53"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:40.990698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-37075101-f8e8-42f1-a336-c8a6d0bd159b req-deca2bdf-b166-460b-acb0-de349d8a7fbf service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:41.007446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-37075101-f8e8-42f1-a336-c8a6d0bd159b req-deca2bdf-b166-460b-acb0-de349d8a7fbf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:41.008245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-37075101-f8e8-42f1-a336-c8a6d0bd159b req-deca2bdf-b166-460b-acb0-de349d8a7fbf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:41.056488 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-37075101-f8e8-42f1-a336-c8a6d0bd159b req-deca2bdf-b166-460b-acb0-de349d8a7fbf service nova] Creating event network-vif-deleted:5314dc05-ab29-43b2-9974-9ad88be87d53 for instance d2c0f34e-dc40-4002-a540-39fae84f6a66 on n-h1-847009-13 Aug 23 11:07:41.066491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-37075101-f8e8-42f1-a336-c8a6d0bd159b req-deca2bdf-b166-460b-acb0-de349d8a7fbf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119728 Aug 23 11:07:41.070507 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3103/6247] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:41.095109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:41.096511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:41.108514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:41.115042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:41.115658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:41.118891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:41.134985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:41.135872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:41.304936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:41.307025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:41.308587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:41.310062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lazy-loading 'fault' on Instance uuid d2c0f34e-dc40-4002-a540-39fae84f6a66 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:07:41.412701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6081acd297624c4886ff96b386660e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b88ec95895e4b2ab072bbb410a75f0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:41.448863 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a2aff33-ad81-4152-abbc-3b0718900950 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 200 len: 1330 microversion: 2.1 time: 0.357663 Aug 23 11:07:41.449686 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3145/6248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:41 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 1330 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:41.630662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-228941514", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7904eec5-c643-4bed-81b4-8d45cd129858"}], "security_groups": [{"name": "tempest-securitygroup--1225507572"}], "key_name": "tempest-keypair-1131694806", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:41.884961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] validate_networks() for [('7904eec5-c643-4bed-81b4-8d45cd129858', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:07:42.445618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:07:42.446148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:07:42.453298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:07:42.456457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:07:42.457659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:07:42.471530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:42.472290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:42.473046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:42.473979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:42.474702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:42.475845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:42.476842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:42.477560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:42.480547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:42.488320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:42.489381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:42.490995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:42.490995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:42.497721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:42.498565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:42.510245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for project 7bc56160173245b48e2299234369f3ca. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:07:42.523576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Getting quotas for user a3e6281c3d024d9b8c9a27bb5144860b and project 7bc56160173245b48e2299234369f3ca. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:07:42.535909 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 HTTP/1.1 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd2c0f34e-dc40-4002-a540-39fae84f6a66'} Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:42.537790 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:42.544262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:42.549082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-385aefe9-11f1-4e62-8f48-5d092e7494d4 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 404 len: 111 microversion: 2.1 time: 0.069691 Aug 23 11:07:42.550507 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3146/6249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:42 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:07:42.560707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-685474ad-8511-4699-9257-04f9d27434cc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '.version_select at 0x7fdc8fb7d310>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:42.570449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:07:42.572974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:07:42.591252 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-685474ad-8511-4699-9257-04f9d27434cc tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-924297916" status: 202 len: 0 microversion: 2.1 time: 0.036681 Aug 23 11:07:42.592916 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3147/6250] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 11:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-924297916 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:07:42.650373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2007737689", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "aa2fa365-f752-454b-8209-a59e5396f98d"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:42.703705 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3aa351f-5c6e-452b-b41b-bebe3c676f16 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.077827 Aug 23 11:07:42.712551 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3104/6251] 10.222.0.78 () {62 vars in 1188 bytes} [Tue Aug 23 11:07:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 11:07:42.727310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce36cc28-a637-4795-b638-c9695cd678e5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:42.727955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce36cc28-a637-4795-b638-c9695cd678e5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:42.748371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] validate_networks() for [('aa2fa365-f752-454b-8209-a59e5396f98d', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:07:42.910565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce36cc28-a637-4795-b638-c9695cd678e5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:42.918779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce36cc28-a637-4795-b638-c9695cd678e5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:42.930875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce36cc28-a637-4795-b638-c9695cd678e5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:42.932107 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce36cc28-a637-4795-b638-c9695cd678e5 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1281 microversion: 2.20 time: 0.215549 Aug 23 11:07:42.932688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3105/6252] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:42 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:43.537851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:07:43.539129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:07:43.539929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:07:43.541109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:07:43.542342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:07:43.561570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:43.561570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:43.562073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:43.562888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:43.563624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:43.564094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:43.597257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Getting quotas for project 6cb1ce8d006c409ba936872ed4ea4be6. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:07:43.603051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Getting quotas for user 3cb87485f4ac49c5998e3a7c500ffa17 and project 6cb1ce8d006c409ba936872ed4ea4be6. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:07:43.616946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:07:43.620286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:07:43.677130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca9f5f9b-832b-475d-9e60-d5e15d84264e tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044387 Aug 23 11:07:43.678130 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3148/6253] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:07:43.689783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aad57fb5-3add-406e-849b-d35dca3bb6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:43.691310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aad57fb5-3add-406e-849b-d35dca3bb6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:43.789335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aad57fb5-3add-406e-849b-d35dca3bb6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:43.799723 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aad57fb5-3add-406e-849b-d35dca3bb6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1214 microversion: 2.1 time: 0.112361 Aug 23 11:07:43.801573 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3106/6254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:43 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:43.955492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:43.956498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:43.967728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:43.968227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:43.968658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:43.971169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:43.971637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:43.972063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:44.083895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:44.098449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:44.101109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:44.103289 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b7c0ec8-b7e0-4083-a576-f59008199cce tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1333 microversion: 2.20 time: 0.152447 Aug 23 11:07:44.108808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3149/6255] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:43 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1333 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:44.821428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:44.822737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:44.837124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:44.838984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:44.840678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:44.842946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:44.843701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:44.846206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:45.065134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:45.071875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86cdc188-4a47-4dcb-ab45-249b80456e5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1210 microversion: 2.1 time: 0.254421 Aug 23 11:07:45.075941 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3107/6256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:44 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1210 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:45.128895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:45.129522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:45.148263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:45.149449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:45.150063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:45.151954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:45.153466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:45.155428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:45.174953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:45.270880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:45.279900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:45.283533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:45.285387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84947c9e-380d-475e-a817-50bf5a0b8e6a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1339 microversion: 2.20 time: 0.160686 Aug 23 11:07:45.286287 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3150/6257] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:45 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:46.101628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:46.102396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:46.113572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:46.116927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:46.117495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:46.122818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:46.123438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:46.123958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:46.308544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:46.309780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:46.318498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:46.336211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc9affe9-7f1a-4bc2-acf3-6d0a817aaaf0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1272 microversion: 2.1 time: 0.238503 Aug 23 11:07:46.336773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3108/6258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:46 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:46.374756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:46.375275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:46.376587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:46.381400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:46.381912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:46.382355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:46.753460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:46.763047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:46.770163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:46.773868 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98c3dcbb-c9aa-4d9e-9e3c-736a6283f881 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1407 microversion: 2.20 time: 0.469723 Aug 23 11:07:46.778128 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3151/6259] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:46 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:07:47.091174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bafbaa73-8efa-41c9-bb43-b5972c1ff72d req-e33d1594-a7c4-4748-9096-0e91b0935da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:47.124340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bafbaa73-8efa-41c9-bb43-b5972c1ff72d req-e33d1594-a7c4-4748-9096-0e91b0935da0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.125508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bafbaa73-8efa-41c9-bb43-b5972c1ff72d req-e33d1594-a7c4-4748-9096-0e91b0935da0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.127532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bafbaa73-8efa-41c9-bb43-b5972c1ff72d req-e33d1594-a7c4-4748-9096-0e91b0935da0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:47.168866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bafbaa73-8efa-41c9-bb43-b5972c1ff72d req-e33d1594-a7c4-4748-9096-0e91b0935da0 service nova] Creating event network-changed:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h2-847009-13 Aug 23 11:07:47.180713 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bafbaa73-8efa-41c9-bb43-b5972c1ff72d req-e33d1594-a7c4-4748-9096-0e91b0935da0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093645 Aug 23 11:07:47.182996 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3109/6260] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:07:47.363567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:47.364399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:47.379218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.382084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.382732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:47.383649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.387186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.388020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:47.552639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:47.555702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:47.563920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.564814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.565469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:47.566391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.567075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.567847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:47.666556 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9811d209-6df1-44c8-8928-db2c48937762 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action" status: 200 len: 24564 microversion: 2.1 time: 0.507366 Aug 23 11:07:47.667709 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3152/6261] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:07:47 2022] POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action => generated 24564 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:47.799674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:47.810887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:47.811866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:47.818117 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d65373a5-c3d1-404a-9409-c43fd8e7a8fc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 0.464095 Aug 23 11:07:47.823549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.825661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.826202 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3110/6262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:47 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:47.827488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:47.830171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:47.832237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:47.834304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:48.490533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:48.502903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:48.507158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:48.510522 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7495c80c-636f-48ff-904d-c64f425b74bb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1407 microversion: 2.20 time: 0.702238 Aug 23 11:07:48.511669 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3153/6263] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:47 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:48.843606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1b2b57bc-b44d-4eb9-ba83-41b3b367d479 req-8588a214-3063-40da-a559-ba54e64b18cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1145c7ee-15a9-479b-9d6a-b0c7b393a4cd", "tag": "73c1f390-c4cd-438e-bdb3-3464faf3a55d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:48.849975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:48.851658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:48.869626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:48.872142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:48.874391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:48.878638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:48.881208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1b2b57bc-b44d-4eb9-ba83-41b3b367d479 req-8588a214-3063-40da-a559-ba54e64b18cb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:48.881417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:48.882628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1b2b57bc-b44d-4eb9-ba83-41b3b367d479 req-8588a214-3063-40da-a559-ba54e64b18cb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:48.883413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:48.883544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1b2b57bc-b44d-4eb9-ba83-41b3b367d479 req-8588a214-3063-40da-a559-ba54e64b18cb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:48.909677 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1b2b57bc-b44d-4eb9-ba83-41b3b367d479 req-8588a214-3063-40da-a559-ba54e64b18cb service nova] Creating event network-changed:73c1f390-c4cd-438e-bdb3-3464faf3a55d for instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd on n-h1-847009-13 Aug 23 11:07:48.924471 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1b2b57bc-b44d-4eb9-ba83-41b3b367d479 req-8588a214-3063-40da-a559-ba54e64b18cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104174 Aug 23 11:07:48.927276 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3111/6264] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:49.536409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:49.537177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:49.540561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:49.569159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:49.569827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:49.571823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:49.572623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:49.579984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:49.580457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:49.906340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:49.917468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc64fd2d-6cc3-422c-8f2d-bb3e0f8dd398 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 1.072782 Aug 23 11:07:49.921878 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3154/6265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:48 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:07:49.931491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:49.938666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:49.950668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:49.951514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:49.952267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:49.953240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:49.954608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:49.957289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:50.002484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 HTTP/1.1 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd2c0f34e-dc40-4002-a540-39fae84f6a66'} Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:50.004561 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.008482 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.011129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:50.012962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f1c43a1-1f2c-4198-8cc6-05a07a173484 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 404 len: 111 microversion: 2.1 time: 0.089361 Aug 23 11:07:50.016212 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3155/6266] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:49 2022] DELETE /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:50.023728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:50.024706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: d2c0f34e-dc40-4002-a540-39fae84f6a66] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:50.038856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:50.039866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:50.043275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:50.044274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:50.044947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:50.045558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:50.073527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 HTTP/1.1 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd2c0f34e-dc40-4002-a540-39fae84f6a66'} Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:50.076216 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance d2c0f34e-dc40-4002-a540-39fae84f6a66 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d59bad62-726e-4170-b5fc-a764095a5c37 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66" status: 404 len: 111 microversion: 2.1 time: 0.058220 Aug 23 11:07:50.082272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3156/6267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:50 2022] GET /compute/v2.1/servers/d2c0f34e-dc40-4002-a540-39fae84f6a66 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:50.120842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:50.148278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:50.163213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:50.165894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eacd6fdc-7b6b-484c-9ef6-f07b767acd33 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1407 microversion: 2.20 time: 0.634654 Aug 23 11:07:50.166492 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3112/6268] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:49 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1407 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:07:50.946990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:50.947611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:50.963964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:50.964471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:50.964958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:50.966238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:50.966388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:50.966686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:51.071482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-44aa1255-0b08-4bba-83c0-7f2f99ed88e9 req-c3b41b50-5d1d-4a36-8d8c-c2a2587793c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "name": "network-vif-plugged", "status": "completed", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:51.092061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-44aa1255-0b08-4bba-83c0-7f2f99ed88e9 req-c3b41b50-5d1d-4a36-8d8c-c2a2587793c6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:51.095141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-44aa1255-0b08-4bba-83c0-7f2f99ed88e9 req-c3b41b50-5d1d-4a36-8d8c-c2a2587793c6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:51.096691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-44aa1255-0b08-4bba-83c0-7f2f99ed88e9 req-c3b41b50-5d1d-4a36-8d8c-c2a2587793c6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:51.124812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-44aa1255-0b08-4bba-83c0-7f2f99ed88e9 req-c3b41b50-5d1d-4a36-8d8c-c2a2587793c6 service nova] Creating event network-vif-plugged:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h2-847009-13 Aug 23 11:07:51.139625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-44aa1255-0b08-4bba-83c0-7f2f99ed88e9 req-c3b41b50-5d1d-4a36-8d8c-c2a2587793c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072606 Aug 23 11:07:51.141192 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3113/6269] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:51.185671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:51.191942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:51.192768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:51.195969 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb23e816-5fb5-4e8d-b006-f30f4f48d885 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 0.253985 Aug 23 11:07:51.208849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3157/6270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:50 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:51.216057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:51.216769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:51.217261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:51.218018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:51.218490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:51.218925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:51.493056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:51.507316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:51.513447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:51.515381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb16a9d5-65c0-4352-bbbd-45a5d5b1df8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1407 microversion: 2.20 time: 0.329287 Aug 23 11:07:51.520894 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3114/6271] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:51 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1407 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:52.219624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:52.221342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:52.229048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:52.229772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:52.230393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:52.231515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:52.232133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:52.232718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:52.390344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:52.399854 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3caa6f3d-299c-4c04-ba7b-1aafa242ae09 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 0.184017 Aug 23 11:07:52.400649 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3158/6272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:52 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:52.543605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:52.544342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:52.550575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:52.557016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:52.557744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:52.559320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:52.560632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:52.561285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:52.562000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:52.863967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:52.876827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:52.879003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:52.880486 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d66b80d2-4752-4c58-a121-88ee295996ed tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1407 microversion: 2.20 time: 0.341601 Aug 23 11:07:52.881814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3115/6273] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:52 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:53.421811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:53.424035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:53.445602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:53.446400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:53.447024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:53.448018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:53.449347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:53.449987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:53.586453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:53.610792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:53.907819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:53.908601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:53.913906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:53.926470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:53.929418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:53.931266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:53.932147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:53.934161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:53.935313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:53.969153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:53.986690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c55c66c-b93b-402a-b9c0-973b8ce37ac5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 0.568655 Aug 23 11:07:53.987300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3159/6274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:53 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:54.264900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:54.274459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:54.278024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:54.284320 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30f21b1b-51c8-4d3a-b65a-49ce222bd632 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1598 microversion: 2.20 time: 0.382913 Aug 23 11:07:54.286422 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3116/6275] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:07:53 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1598 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:07:54.312107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:54.313054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:54.333196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.340301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.341145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.342637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.343989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.345677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.502184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-285c14e1-1928-4b0b-8f26-b1a67ec38cd6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194362 Aug 23 11:07:54.502792 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3160/6276] 10.222.0.78 () {60 vars in 1316 bytes} [Tue Aug 23 11:07:54 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:07:54.674542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:54.675096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:54.686693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.689496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.690411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.691898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.692982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.697036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.721383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a HTTP/1.1 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1681f67a-7711-4b1f-a0c9-c7f1da291f3a'} Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:54.723735 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a826fbd6-d8e2-404d-8775-1b712b58f5f5 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 404 len: 111 microversion: 2.1 time: 0.055171 Aug 23 11:07:54.728803 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3117/6277] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:54 2022] DELETE /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:54.734186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:54.736026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 1681f67a-7711-4b1f-a0c9-c7f1da291f3a] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:54.746902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.747627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.748183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.749093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.749674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.750218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.768147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a HTTP/1.1 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '1681f67a-7711-4b1f-a0c9-c7f1da291f3a'} Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.769886 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. Aug 23 11:07:54.774619 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.775342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 1681f67a-7711-4b1f-a0c9-c7f1da291f3a could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:54.776240 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f43359b4-aa08-4222-87ec-b0ab56d6f19b tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a" status: 404 len: 111 microversion: 2.1 time: 0.046271 Aug 23 11:07:54.777351 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3161/6278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:54 2022] GET /compute/v2.1/servers/1681f67a-7711-4b1f-a0c9-c7f1da291f3a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:54.787038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:54.787801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:54.794327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.794956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.795488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.796277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.796851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.798083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.835822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc HTTP/1.1 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc'} Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:54.837449 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a3745741-0c39-4c1f-9968-1f9511dde075 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 404 len: 111 microversion: 2.1 time: 0.057426 Aug 23 11:07:54.841282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3118/6279] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:54 2022] DELETE /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:54.848092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:54.848908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:54.856504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.857022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.857459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.858158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:54.858880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:54.859375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:54.881494 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc HTTP/1.1 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc'} Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:54.884515 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. Aug 23 11:07:54.888456 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:54.890964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:54.892488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1c440d8-476c-47fc-8595-497f85b3fc12 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc" status: 404 len: 111 microversion: 2.1 time: 0.048503 Aug 23 11:07:54.894845 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3162/6280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:54 2022] GET /compute/v2.1/servers/9eb47bb3-0946-4a2f-ad07-2c7ee32dfacc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:55.019051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:55.020367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:55.047752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:55.054487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:55.055216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:55.062403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:55.067966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:55.068660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:55.418783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:55.421813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:07:55.443022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f5edd5b-2234-4439-a489-abcef1a472df tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 0.435833 Aug 23 11:07:55.443931 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3119/6281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:55 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:55.746584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0586375a-f331-4752-bd81-9acb6b541521 req-05f6eb16-e041-4299-896b-bebacfd5d4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1145c7ee-15a9-479b-9d6a-b0c7b393a4cd", "name": "network-vif-plugged", "status": "completed", "tag": "73c1f390-c4cd-438e-bdb3-3464faf3a55d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:55.770611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0586375a-f331-4752-bd81-9acb6b541521 req-05f6eb16-e041-4299-896b-bebacfd5d4e9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:55.771503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0586375a-f331-4752-bd81-9acb6b541521 req-05f6eb16-e041-4299-896b-bebacfd5d4e9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:55.772171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0586375a-f331-4752-bd81-9acb6b541521 req-05f6eb16-e041-4299-896b-bebacfd5d4e9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:55.797105 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0586375a-f331-4752-bd81-9acb6b541521 req-05f6eb16-e041-4299-896b-bebacfd5d4e9 service nova] Creating event network-vif-plugged:73c1f390-c4cd-438e-bdb3-3464faf3a55d for instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd on n-h1-847009-13 Aug 23 11:07:55.804497 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0586375a-f331-4752-bd81-9acb6b541521 req-05f6eb16-e041-4299-896b-bebacfd5d4e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061982 Aug 23 11:07:55.805718 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3163/6282] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:56.466371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:56.468079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:56.477650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:56.481254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:56.482086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:56.483027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:56.486559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:56.487247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:56.725939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:56.745987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f454925-b4de-4fec-a89d-a63e2bcaf126 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1314 microversion: 2.1 time: 0.281000 Aug 23 11:07:56.747280 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3120/6283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:56 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:56.767569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-501e79fc-a31f-4b83-81d2-f4803bdef43a req-bbe37634-726d-47d4-ade8-b5e2bc565e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:07:56.782793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-501e79fc-a31f-4b83-81d2-f4803bdef43a req-bbe37634-726d-47d4-ade8-b5e2bc565e10 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:56.783576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-501e79fc-a31f-4b83-81d2-f4803bdef43a req-bbe37634-726d-47d4-ade8-b5e2bc565e10 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:56.784170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-501e79fc-a31f-4b83-81d2-f4803bdef43a req-bbe37634-726d-47d4-ade8-b5e2bc565e10 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:56.801216 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-501e79fc-a31f-4b83-81d2-f4803bdef43a req-bbe37634-726d-47d4-ade8-b5e2bc565e10 service nova] Creating event network-changed:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h2-847009-13 Aug 23 11:07:56.807047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-501e79fc-a31f-4b83-81d2-f4803bdef43a req-bbe37634-726d-47d4-ade8-b5e2bc565e10 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044058 Aug 23 11:07:56.808718 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3164/6284] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:07:57.768791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:57.770035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:57.779619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:57.781119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:57.782405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:57.783744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:57.784459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:57.785362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:57.990361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:58.001949 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36b304f4-359d-4746-b66f-64a8386d8465 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1497 microversion: 2.1 time: 0.238173 Aug 23 11:07:58.002557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3121/6285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:57 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:58.649085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:58.650863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:58.660786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:58.661560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:58.662013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:58.662731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:58.663366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:58.663801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:58.695142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:07:58.798156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84388f27-4f7e-447a-9659-6fef6bf15c47 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 204 len: 0 microversion: 2.1 time: 0.153565 Aug 23 11:07:58.799970 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3165/6286] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:58 2022] DELETE /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:07:58.808139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:58.808861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:58.819804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:58.821491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:58.822383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:58.823738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:58.824400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:58.825150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:59.023831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:07:59.032399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce3785a2-7a5e-4684-b4de-4a44fd909f4b tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1503 microversion: 2.1 time: 0.228675 Aug 23 11:07:59.033623 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3122/6287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:58 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:07:59.458551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:59.459851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:59.467142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:59.468427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:59.469202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:59.470345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:59.471036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:59.471805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:59.490961 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 HTTP/1.1 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7'} Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:59.493928 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-632a5fee-fe6d-42b6-a5e3-aea04e21dcc8 tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 404 len: 111 microversion: 2.1 time: 0.045151 Aug 23 11:07:59.502912 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3166/6288] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:07:59 2022] DELETE /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:07:59.508993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:07:59.510032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] [instance: 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:07:59.517395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:59.518028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:59.518564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:59.519597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:07:59.521020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:07:59.521696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:07:59.538079 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] HTTP exception thrown: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Request method failure captured: Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 HTTP/1.1 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLMAM9ajHeW2tHYMQUVDM-8govbQk0NfyVnZVGmO3K0cr5HtqSUtMDJixabpsHz0aVZp0uYp2UpifGQq7puRjIUGu9knBEwsBCSr-zfytFxG2pUHJpBfR7iRW1oC8Af6Gtai2b49qQO6ombbOUJg16I76P3uobBCvVKJm9bfMHJPCkE Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b88ec95895e4b2ab072bbb410a75f0c", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b88ec95895e4b2ab072bbb410a75f0c"}]}] Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 1b88ec95895e4b2ab072bbb410a75f0c Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-669862727 Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6081acd297624c4886ff96b386660e2b Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeNegativeTest-669862727-project Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7'} Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:07:59.540350 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. Aug 23 11:07:59.544385 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:07:59.548478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] Returning 404 to user: Instance 6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:07:59.549711 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2067b1a-ca13-4f82-bd3a-2228c84d8a5e tempest-AttachVolumeNegativeTest-669862727 tempest-AttachVolumeNegativeTest-669862727-project] 10.222.0.78 "GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7" status: 404 len: 111 microversion: 2.1 time: 0.044983 Aug 23 11:07:59.550936 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3123/6289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:07:59 2022] GET /compute/v2.1/servers/6925d1f8-d8d5-49ac-bbdd-3aaf03e87ae7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:08:00.055757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:00.057484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:00.077232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:00.078546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:00.079474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:00.080376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:00.081032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:00.081768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:00.409287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:00.420366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dcdad582-1101-4891-a5e8-c7d91114eb5c tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1503 microversion: 2.1 time: 0.368524 Aug 23 11:08:00.424813 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3167/6290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:00 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:01.334570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4c121743-e854-4f05-a975-21b4baa3882f req-ee13c2c1-fca4-40ba-b2f1-efb869fcfe07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1145c7ee-15a9-479b-9d6a-b0c7b393a4cd", "name": "network-vif-deleted", "tag": "73c1f390-c4cd-438e-bdb3-3464faf3a55d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:01.372858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4c121743-e854-4f05-a975-21b4baa3882f req-ee13c2c1-fca4-40ba-b2f1-efb869fcfe07 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:01.374605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4c121743-e854-4f05-a975-21b4baa3882f req-ee13c2c1-fca4-40ba-b2f1-efb869fcfe07 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:01.377462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4c121743-e854-4f05-a975-21b4baa3882f req-ee13c2c1-fca4-40ba-b2f1-efb869fcfe07 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:01.405024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4c121743-e854-4f05-a975-21b4baa3882f req-ee13c2c1-fca4-40ba-b2f1-efb869fcfe07 service nova] Creating event network-vif-deleted:73c1f390-c4cd-438e-bdb3-3464faf3a55d for instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd on n-h1-847009-13 Aug 23 11:08:01.425226 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4c121743-e854-4f05-a975-21b4baa3882f req-ee13c2c1-fca4-40ba-b2f1-efb869fcfe07 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099969 Aug 23 11:08:01.426375 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3124/6291] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:01.443620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:01.444827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:01.463859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:01.464416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:01.465014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:01.465682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:01.466183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:01.466655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:01.542205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:01.543025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:01.543676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:01.544340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lazy-loading 'fault' on Instance uuid 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:08:01.763138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:01.772668 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dbb138f1-f89d-47ba-9dc4-0ba95af6e811 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 200 len: 1304 microversion: 2.1 time: 0.334736 Aug 23 11:08:01.773889 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3168/6292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:01 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 1304 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:02.795773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:02.796644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:02.810863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:02.811571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:02.812113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:02.815546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:02.816217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:02.817396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:02.835369 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] HTTP exception thrown: Instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd could not be found. Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Request method failure captured: Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd HTTP/1.1 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLT7myPVo7O_FF71VFA_7iZvK0AM1C1pMKROL4zL2b9krttXEzHqR_7Ix9Ojq05Z2OwfRv_w8XiqTHGlnWgv1MnsfLtWmv6RXffZ7KzaE0F6R_Z22BfNbR8CJSmqVfkIgE2siqtErD0Zh-oMo_CAuhDoR4wvPwuCA30b38qFGfXOf0w Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6cb1ce8d006c409ba936872ed4ea4be6 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesActionsTest-329550193 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cb1ce8d006c409ba936872ed4ea4be6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cb1ce8d006c409ba936872ed4ea4be6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cb1ce8d006c409ba936872ed4ea4be6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cb1ce8d006c409ba936872ed4ea4be6"}]}] Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesActionsTest-329550193 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6cb1ce8d006c409ba936872ed4ea4be6 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesActionsTest-329550193 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesActionsTest-329550193-project Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 3cb87485f4ac49c5998e3a7c500ffa17 Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesActionsTest-329550193-project Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd could not be found. Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '1145c7ee-15a9-479b-9d6a-b0c7b393a4cd'} Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd could not be found. Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd could not be found. Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:08:02.837457 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd could not be found. Aug 23 11:08:02.842124 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:08:02.843358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Returning 404 to user: Instance 1145c7ee-15a9-479b-9d6a-b0c7b393a4cd could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:08:02.845220 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6717572-e93d-4ace-af29-ebdd30b2dbc5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd" status: 404 len: 111 microversion: 2.1 time: 0.054867 Aug 23 11:08:02.846322 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3125/6293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:02 2022] GET /compute/v2.1/servers/1145c7ee-15a9-479b-9d6a-b0c7b393a4cd => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:08:02.997376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-390019614", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "aa2fa365-f752-454b-8209-a59e5396f98d"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:03.143138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] validate_networks() for [('aa2fa365-f752-454b-8209-a59e5396f98d', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:08:03.648072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:08:03.648505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:08:03.649201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:08:03.649805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:08:03.650550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:08:03.662150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:03.662741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:03.663913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:03.664549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:03.665108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:03.665614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:03.686096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Getting quotas for project 6cb1ce8d006c409ba936872ed4ea4be6. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:08:03.693392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Getting quotas for user 3cb87485f4ac49c5998e3a7c500ffa17 and project 6cb1ce8d006c409ba936872ed4ea4be6. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:08:03.710290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:08:03.713296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:08:03.790314 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b8b07e8-9b4f-48a9-90b1-896c842474b9 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797228 Aug 23 11:08:03.795292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3169/6294] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:08:03.812707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8de2e7db-053f-41dc-b384-5e0d3339b1ef tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:03.817623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8de2e7db-053f-41dc-b384-5e0d3339b1ef tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:03.974828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8de2e7db-053f-41dc-b384-5e0d3339b1ef tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:03.986381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8de2e7db-053f-41dc-b384-5e0d3339b1ef tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1213 microversion: 2.1 time: 0.183402 Aug 23 11:08:03.988375 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3126/6295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:03 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:05.009421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:05.010657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:05.024310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:05.026559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:05.027202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:05.031876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:05.032783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:05.033425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:05.164147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:05.166758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:05.179113 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a542fac8-479e-4a25-b903-cf6b94a25be4 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1209 microversion: 2.1 time: 0.173508 Aug 23 11:08:05.181633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3170/6296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:05 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1209 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:06.203445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:06.204052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:06.215086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:06.215593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:06.216037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:06.222378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:06.222922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:06.223376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:06.362896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:06.372665 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de403daa-eebe-4be1-a0f1-66850c51fbf6 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1271 microversion: 2.1 time: 0.173050 Aug 23 11:08:06.378346 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3127/6297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:06 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:07.400472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:07.400990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:07.427573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:07.429426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:07.431877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:07.433456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:07.434992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:07.436445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:07.740316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:07.754129 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-698e106d-b8fb-4e55-a93e-af1bcaa7cb5a tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.358457 Aug 23 11:08:07.754826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3171/6298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:07 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:07.783241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0033fc31-62e3-47ac-b5a1-9a7e4b2bab5e req-932d11f6-b78e-45bf-86bb-c6f208d13f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2285d9fc-abf2-4617-8ec2-c9cdc69a3d24", "tag": "2a472882-3165-42e0-abd1-68ff11e53bcc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:07.799201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0033fc31-62e3-47ac-b5a1-9a7e4b2bab5e req-932d11f6-b78e-45bf-86bb-c6f208d13f58 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:07.800479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0033fc31-62e3-47ac-b5a1-9a7e4b2bab5e req-932d11f6-b78e-45bf-86bb-c6f208d13f58 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:07.801184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0033fc31-62e3-47ac-b5a1-9a7e4b2bab5e req-932d11f6-b78e-45bf-86bb-c6f208d13f58 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:07.827934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0033fc31-62e3-47ac-b5a1-9a7e4b2bab5e req-932d11f6-b78e-45bf-86bb-c6f208d13f58 service nova] Creating event network-changed:2a472882-3165-42e0-abd1-68ff11e53bcc for instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 on n-h1-847009-13 Aug 23 11:08:07.836509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0033fc31-62e3-47ac-b5a1-9a7e4b2bab5e req-932d11f6-b78e-45bf-86bb-c6f208d13f58 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059135 Aug 23 11:08:07.838489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3128/6299] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:08.776667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:08.777315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:08.784494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:08.785042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:08.785480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:08.786186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:08.786643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:08.787066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:08.957725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:08.968164 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cea300a4-de11-40c9-9d73-066fe238732d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.196441 Aug 23 11:08:08.969503 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3172/6300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:08 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:09.992419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:09.993757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:10.013217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:10.014177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:10.014697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:10.015525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:10.016853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:10.017358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:10.192193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:10.208130 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2e9c194-a1aa-4493-9ff0-ace0336dc67d tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.222736 Aug 23 11:08:10.209182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3129/6301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:09 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:11.232021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:11.233341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:11.241547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:11.242387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:11.243031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:11.243971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:11.244633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:11.245454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:11.727200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:11.739046 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3dd6eafa-7f57-4a78-921c-55fe6adc0edd tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.511255 Aug 23 11:08:11.744191 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3173/6302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:11 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:12.763990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:12.764772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:12.787161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:12.789427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:12.790749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:12.791901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:12.792884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:12.793741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:13.064731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:13.077695 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc4d9780-d611-4ac3-b507-c7740d48f6b5 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.317918 Aug 23 11:08:13.080390 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3130/6303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:12 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:13.678883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:13.702870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:13.843428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-49ddc411-2b66-4b1e-8fde-7b631af942cd req-56ce1111-e238-40b7-8651-b2a27f4070cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285d9fc-abf2-4617-8ec2-c9cdc69a3d24", "name": "network-vif-plugged", "status": "completed", "tag": "2a472882-3165-42e0-abd1-68ff11e53bcc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:13.867489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:13.872829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49ddc411-2b66-4b1e-8fde-7b631af942cd req-56ce1111-e238-40b7-8651-b2a27f4070cd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:13.875009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49ddc411-2b66-4b1e-8fde-7b631af942cd req-56ce1111-e238-40b7-8651-b2a27f4070cd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:13.876366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49ddc411-2b66-4b1e-8fde-7b631af942cd req-56ce1111-e238-40b7-8651-b2a27f4070cd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:13.902922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-49ddc411-2b66-4b1e-8fde-7b631af942cd req-56ce1111-e238-40b7-8651-b2a27f4070cd service nova] Creating event network-vif-plugged:2a472882-3165-42e0-abd1-68ff11e53bcc for instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 on n-h1-847009-13 Aug 23 11:08:13.918043 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-49ddc411-2b66-4b1e-8fde-7b631af942cd req-56ce1111-e238-40b7-8651-b2a27f4070cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332422 Aug 23 11:08:13.920133 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3174/6304] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:14.097995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:14.105853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:14.106885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:14.114787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:14.115651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:14.117079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:14.118119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:14.118795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:14.119468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:14.331458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:14.341781 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2609e869-ce6e-4f71-9c6f-61a5fab4f662 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.246156 Aug 23 11:08:14.358157 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3131/6305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:14 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:15.373250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:15.373250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:15.382936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:15.382936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:15.383309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:15.384538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:15.385064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:15.385499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:15.537314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:15.554084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfb25b95-46ec-4c95-90cf-bea211c5d6cc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1313 microversion: 2.1 time: 0.179947 Aug 23 11:08:15.560366 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3175/6306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:15 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:16.572573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:16.575014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:16.598309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:16.601477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:16.602151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:16.603253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:16.603915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:16.604428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:16.777146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:16.789924 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3018d571-d324-4ad3-8187-f86f0778e944 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1497 microversion: 2.1 time: 0.225251 Aug 23 11:08:16.801373 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3132/6307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:16 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:17.385559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:17.386041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:17.397082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:17.397900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:17.398652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:17.399645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:17.400563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:17.401248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:17.438592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:08:17.570955 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df4a8b6d-1929-4a36-a062-da513675eafc tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 204 len: 0 microversion: 2.1 time: 0.189666 Aug 23 11:08:17.573192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3176/6308] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:08:17 2022] DELETE /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:08:17.582978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:17.588588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:17.601731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:17.602613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:17.603300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:17.604976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:17.606203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:17.607558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:17.840415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:17.851877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92a9290c-ba01-4f90-925e-ff652f026fc0 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1503 microversion: 2.1 time: 0.273436 Aug 23 11:08:17.868853 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3133/6309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:17 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:18.876618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:18.879755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:18.897852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:18.899190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:18.899855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:18.900788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:18.901573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:18.901954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:19.135642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:19.144413 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08990b44-cc6b-44fc-8152-21895e4b1c06 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1503 microversion: 2.1 time: 0.274096 Aug 23 11:08:19.148818 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3177/6310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:18 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:20.172245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-fbef58b0-de30-4aa8-b9a2-be4df13ff319 req-bbccf770-cd26-4597-aa02-f605e9d9dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285d9fc-abf2-4617-8ec2-c9cdc69a3d24", "name": "network-vif-deleted", "tag": "2a472882-3165-42e0-abd1-68ff11e53bcc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:20.173960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:20.174436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:20.185854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=46 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:20.193804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:20.194312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:20.194789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:20.195492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:20.195959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:20.196393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:20.201243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fbef58b0-de30-4aa8-b9a2-be4df13ff319 req-bbccf770-cd26-4597-aa02-f605e9d9dd54 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:20.201723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fbef58b0-de30-4aa8-b9a2-be4df13ff319 req-bbccf770-cd26-4597-aa02-f605e9d9dd54 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:20.202351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fbef58b0-de30-4aa8-b9a2-be4df13ff319 req-bbccf770-cd26-4597-aa02-f605e9d9dd54 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:20.230039 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-fbef58b0-de30-4aa8-b9a2-be4df13ff319 req-bbccf770-cd26-4597-aa02-f605e9d9dd54 service nova] Creating event network-vif-deleted:2a472882-3165-42e0-abd1-68ff11e53bcc for instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 on n-h1-847009-13 Aug 23 11:08:20.236485 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-fbef58b0-de30-4aa8-b9a2-be4df13ff319 req-bbccf770-cd26-4597-aa02-f605e9d9dd54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072120 Aug 23 11:08:20.237647 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3178/6311] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:20.297965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb87485f4ac49c5998e3a7c500ffa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb1ce8d006c409ba936872ed4ea4be6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:20.310223 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b687c413-b910-438d-8f54-aa8f18781b51 tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 200 len: 1298 microversion: 2.1 time: 0.142571 Aug 23 11:08:20.321551 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3134/6312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:20 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 1298 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:21.334783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:21.336110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] [instance: 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:21.343247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:21.344023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:21.344733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:21.345638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:21.346264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:21.347008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:21.367040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] HTTP exception thrown: Instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 could not be found. Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Request method failure captured: Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 HTTP/1.1 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLT7myPVo7O_FF71VFA_7iZvK0AM1C1pMKROL4zL2b9krttXEzHqR_7Ix9Ojq05Z2OwfRv_w8XiqTHGlnWgv1MnsfLtWmv6RXffZ7KzaE0F6R_Z22BfNbR8CJSmqVfkIgE2siqtErD0Zh-oMo_CAuhDoR4wvPwuCA30b38qFGfXOf0w Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6cb1ce8d006c409ba936872ed4ea4be6 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesActionsTest-329550193 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6cb1ce8d006c409ba936872ed4ea4be6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6cb1ce8d006c409ba936872ed4ea4be6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cb1ce8d006c409ba936872ed4ea4be6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6cb1ce8d006c409ba936872ed4ea4be6"}]}] Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesActionsTest-329550193 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6cb1ce8d006c409ba936872ed4ea4be6 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesActionsTest-329550193 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesActionsTest-329550193-project Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 3cb87485f4ac49c5998e3a7c500ffa17 Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesActionsTest-329550193-project Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 could not be found. Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2285d9fc-abf2-4617-8ec2-c9cdc69a3d24'} Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 could not be found. Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 could not be found. Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:08:21.371154 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 could not be found. Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] Returning 404 to user: Instance 2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a044c72-69d4-4de6-9ac7-c3e2f13e40ce tempest-VolumesActionsTest-329550193 tempest-VolumesActionsTest-329550193-project] 10.222.0.78 "GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24" status: 404 len: 111 microversion: 2.1 time: 0.047114 Aug 23 11:08:21.377555 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3179/6313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:21 2022] GET /compute/v2.1/servers/2285d9fc-abf2-4617-8ec2-c9cdc69a3d24 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:08:25.615220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:25.616322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:25.657790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:25.668481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:25.673932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:25.676724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:25.681874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:25.683425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:25.688724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=70 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:25.807997 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96fb5923-a523-483b-82bd-4b7481bf42b8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/ips" status: 200 len: 144 microversion: 2.1 time: 0.197579 Aug 23 11:08:25.821819 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3135/6314] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:08:25 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/ips => generated 144 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:27.332321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:27.333699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:27.340981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:27.341986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:27.342621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:27.343794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:27.344540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:27.345408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:27.541949 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35aa3bfb-a473-4734-b12b-2f50d036be12 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1837 microversion: 2.1 time: 0.629172 Aug 23 11:08:27.543076 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3180/6315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:26 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1837 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:27.576459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:27.577167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:27.595102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:27.595642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:27.596264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:27.597293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:27.597907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:27.599223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:27.787162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:27.800612 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61ac6715-e317-4701-94be-dc5c09c98f96 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1684 microversion: 2.1 time: 0.234134 Aug 23 11:08:27.801863 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3136/6316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:27 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:28.099572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:28.103916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:28.141116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:28.146952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:28.148720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:28.151760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:28.159406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:28.160906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:28.295349 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-201de542-14ae-41a7-9a96-8487ad467298 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action" status: 200 len: 32639 microversion: 2.1 time: 0.199843 Aug 23 11:08:28.302635 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3181/6317] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:08:28 2022] POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action => generated 32639 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:08:28.534215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:28.536384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:28.571240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:28.573323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:28.595301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:28.595301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:28.599940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:28.600590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:28.682572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0403d0b67c3f48a39ce78ddd87609360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '583559b4ceaa42ae88fdd5e2e47f57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:28.683225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] flavor_id is None. Assuming migration. {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 11:08:28.683716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:08:29.085847 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71d64461-d1d7-42da-899a-3275b49df496 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action" status: 202 len: 0 microversion: 2.1 time: 0.557000 Aug 23 11:08:29.087520 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3137/6318] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:08:28 2022] POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:08:29.098493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:29.100119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:29.139387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:29.143526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:29.150146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:29.170539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:29.171569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:29.172611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:29.684091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:29.737002 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7e88d138-23db-449a-9633-bf724f6dc0eb tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1693 microversion: 2.1 time: 0.643437 Aug 23 11:08:29.757405 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3182/6319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:29 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1693 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:29.807300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54bc6bba-3dc6-4202-98f9-9ae44159c471"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:29.810736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:29.829876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:29.830674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:29.831301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:29.833573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:29.834312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:29.836576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:30.696501 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b37f712e-5add-4925-b748-a3e1cdea53cf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864113 Aug 23 11:08:30.706748 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3138/6320] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:08:29 2022] POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:08:30.823207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:30.824250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:30.845314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:30.848123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:30.850583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:30.852874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:30.853551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:30.855956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:31.296868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:31.331311 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5e8a2bc-127d-416c-b46a-f5c4f1bb428f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1693 microversion: 2.1 time: 0.510594 Aug 23 11:08:31.331626 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3139/6321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:30 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1693 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:31.368438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:31.368961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:31.390894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:31.391461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:31.393648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:31.394365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:31.398360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:31.398823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:31.537073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f8f9e72-0b05-444f-a4aa-aa6f26f92512 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/ips" status: 200 len: 150 microversion: 2.20 time: 1.113577 Aug 23 11:08:31.537831 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3183/6322] 10.222.0.78 () {60 vars in 1289 bytes} [Tue Aug 23 11:08:30 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/ips => generated 150 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 11:08:32.352313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:32.354584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:32.375876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:32.380123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:32.382982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:32.384487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:32.385804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:32.386467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:32.779634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:32.791847 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a811c498-5c10-4a10-b4e1-25a31db5187c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1693 microversion: 2.1 time: 0.443939 Aug 23 11:08:32.792447 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3140/6323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:32 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1693 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:33.818371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:33.819689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:33.832370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:33.848354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:33.849100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:33.850041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:33.852285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:33.853038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:34.420714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:34.453671 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15a92241-4d5e-447b-811f-6dfe0d05d64a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1693 microversion: 2.1 time: 0.639017 Aug 23 11:08:34.467982 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3184/6324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:33 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1693 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:35.490772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:35.491415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:35.509607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:35.516116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:35.519208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:35.522524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:35.525710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:35.527595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:36.173957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:36.184188 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58172d1e-688e-4f77-9cd6-652738afb584 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.697267 Aug 23 11:08:36.205910 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3141/6325] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:35 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:36.517168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:36.518317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:36.531033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:36.534324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:36.535272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:36.539455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:36.539914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:36.541826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:36.605317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lazy-loading 'flavor' on Instance uuid 30b62eb5-a12c-46ad-beba-d081e1d00561 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:08:37.138100 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-decd00d4-2b0d-441e-878a-5e7b0d9974ee tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/action" status: 202 len: 0 microversion: 2.20 time: 0.622471 Aug 23 11:08:37.142425 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3185/6326] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 11:08:36 2022] POST /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:08:37.150854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:37.152461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:37.175534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:37.177096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:37.181843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:37.184770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:37.186048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:37.188099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:37.219109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:37.224548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:37.238008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:37.240002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:37.242543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:37.248884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:37.253559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:37.258605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:37.306696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:37.630643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:37.640020 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73e148f0-9fa7-40c8-a429-b22592100dea tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.426057 Aug 23 11:08:37.644691 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3186/6327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:37 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:38.362515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:38.376328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:38.378897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:38.381101 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3879594-dd7b-47a6-94e7-605f479e83db tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 1.234870 Aug 23 11:08:38.382627 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3142/6328] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:37 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:38.675747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:38.677785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:38.698315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:38.699080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:38.699689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:38.703030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:38.706007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:38.710038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:39.073856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:39.084025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56c58ecb-e462-4834-84c5-4ee82006aff5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.413785 Aug 23 11:08:39.085451 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3187/6329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:38 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:39.409194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:39.410797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:39.428527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:39.434608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:39.436094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:39.438874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:39.442768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:39.443244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:39.903239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:39.915406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:39.916990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:39.928615 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ff658af-df8f-44de-ba08-42e187bd41b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.521595 Aug 23 11:08:39.933776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3143/6330] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:39 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:40.107544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:40.110184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:40.123887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:40.130753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:40.131508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:40.136241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:40.138049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:40.141404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:40.701942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:40.726532 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b155e04-c60b-4f33-91ee-b562bd6c8a0a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.609198 Aug 23 11:08:40.726532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3188/6331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:40 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:40.957715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:40.958351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:40.981197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:40.981793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:40.982254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:40.983009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:40.988862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:40.989413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:41.375835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:41.388924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:41.399337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:41.400932 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce6dc3fe-6f14-4fff-9e3b-c904aa5bb3a2 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.449013 Aug 23 11:08:41.405373 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3144/6332] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:40 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:41.763388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:41.766138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:41.806299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:41.807093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:41.808391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:41.809526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:41.810504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:41.813617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:42.302129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:42.310749 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea8ed861-b459-4fd6-b5d7-498a7cd6b8a1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.568905 Aug 23 11:08:42.317056 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3189/6333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:41 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:42.427531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:42.428150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:42.453152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:42.454026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:42.457751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:42.461977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:42.462989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:42.463619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:42.823048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:42.839679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:42.848814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:42.850065 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c87c5db3-b3dc-49a8-9a9a-97ee300739d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.426365 Aug 23 11:08:42.852558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3145/6334] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:42 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:43.337054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:43.337677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:43.363882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:43.367557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:43.368296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:43.371963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:43.375590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:43.383796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:43.673002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:43.684603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a6dc5a5-57c9-4449-b30e-3dbcfa2719df tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.352966 Aug 23 11:08:43.686787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3190/6335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:43 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:43.877069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:43.877649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:43.894135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:43.894135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:43.894135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:43.894135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:43.894135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:43.894135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:44.215789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:44.230271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:44.233084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:44.235059 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f12e980-80c9-46d4-893e-4de836298c7a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.363216 Aug 23 11:08:44.236029 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3146/6336] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:43 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:44.709207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:44.709963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:44.727104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:44.727104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:44.727104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:44.729068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:44.729657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:44.730616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:45.002377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:45.012161 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e80aeb43-a126-48fe-87ec-80656a5a8d6f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.308038 Aug 23 11:08:45.022138 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3191/6337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:44 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:45.259351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:45.260032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:45.297464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:45.297950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:45.305952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:45.307616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:45.317630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:45.317630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:45.722452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:45.739410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:45.743994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:45.746335 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-831daef6-1edd-4a3e-9c4e-569acb48b654 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.490866 Aug 23 11:08:45.764089 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3147/6338] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:45 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:46.062454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:46.063801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:46.067497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:46.078871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:46.081315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:46.083072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:46.085575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:46.086259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:46.087017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:46.381349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:46.395313 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61d6e2b7-8d8f-4769-9cb4-0791a8beefb8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.338228 Aug 23 11:08:46.396607 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3192/6339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:46 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:46.773255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:46.774542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:46.808629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:46.809890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:46.813248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:46.816340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:46.822228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:46.829480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:47.173621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:47.187769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:47.192754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:47.195446 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbdcaafc-25c4-487f-ab4c-afb2918ce0ba tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.427804 Aug 23 11:08:47.198859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3148/6340] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:46 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:47.428667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:47.430449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:47.444379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:47.445206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:47.446497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:47.448010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:47.449018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:47.449820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:47.751800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:47.761971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9dada0c-5aec-45d3-a4b5-1a9a73f1f5a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1698 microversion: 2.1 time: 0.341220 Aug 23 11:08:47.763645 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3193/6341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:47 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1698 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:48.223721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:48.225747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:48.242622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:48.244930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:48.246656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:48.249735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:48.254316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:48.255453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:48.259386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:48.936107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "name": "network-vif-unplugged", "status": "completed", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:48.970851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:48.973253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:48.974928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:49.020000 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] Creating event network-vif-unplugged:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h2-847009-13 Aug 23 11:08:49.035699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] Instance 5193c2ff-ff52-47ed-b810-43e8155000bb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:08:49.066694 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-feee28f5-12f1-4bd3-a19e-2fbf36b3bbaa req-551322b7-5936-4617-badc-c74465054eb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.421071 Aug 23 11:08:49.069704 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3194/6342] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:08:49.086415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:49.090207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:49.105897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:49.109411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:49.110063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:49.111903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:49.114793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:49.115876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:49.244276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:49.259158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:49.262745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:49.267183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-41db4747-6413-4edb-b455-6eb4c7e0780b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1743 microversion: 2.20 time: 1.045375 Aug 23 11:08:49.283022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3149/6343] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:48 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1743 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:49.609788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:49.621873 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34e97603-7fc4-406d-996a-d3f1f6c493c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1697 microversion: 2.1 time: 0.551227 Aug 23 11:08:49.626789 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3195/6344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:49 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1697 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:50.295456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:50.296908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:50.304785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=34 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:50.325444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:50.326079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:50.327600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:50.330449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:50.334121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:50.334660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:50.647609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:50.649564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:50.666246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:50.667019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:50.667816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:50.672250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:50.673226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:50.673840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:51.172186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:51.181161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:51.200766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:51.204005 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9a2be94-bcb9-4f8f-93b8-11f04a4abedc tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.912338 Aug 23 11:08:51.205614 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3150/6345] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:50 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:51.217267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c37bb66-2d5f-48b8-af4e-e4975478a351 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:51.250244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c37bb66-2d5f-48b8-af4e-e4975478a351 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:51.251550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c37bb66-2d5f-48b8-af4e-e4975478a351 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:51.252034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c37bb66-2d5f-48b8-af4e-e4975478a351 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:51.311280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c37bb66-2d5f-48b8-af4e-e4975478a351 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 11:08:51.395963 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c37bb66-2d5f-48b8-af4e-e4975478a351 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action" status: 202 len: 0 microversion: 2.1 time: 0.182363 Aug 23 11:08:51.396655 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3151/6346] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:08:51 2022] POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:08:51.411794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:51.429544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:51.429978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:51.430688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:51.450183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] Creating event network-changed:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h2-847009-13 Aug 23 11:08:51.460956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] Instance 5193c2ff-ff52-47ed-b810-43e8155000bb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:08:51.480324 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-89b6a42b-2231-4ad6-84c4-98524af6778b req-7d5f7173-a2b5-48d3-9daa-f9849fc60388 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074021 Aug 23 11:08:51.482863 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3152/6347] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:51.493917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:51.495028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:51.504334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:51.505152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:51.506792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:51.508921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:51.509764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:51.510371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:51.890090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:51.905993 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83ce8d0e-9b4a-4873-a55c-7c591d3cf1e1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.420739 Aug 23 11:08:51.909342 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3153/6348] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:51 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:51.951130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:51.963008 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1d7a5223-919e-4a41-ab87-1566d2aec233 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1697 microversion: 2.1 time: 1.319159 Aug 23 11:08:51.964253 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3196/6349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:50 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1697 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:52.228688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:52.229368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:52.241849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:52.243978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:52.244464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:52.246004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:52.248679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:52.249803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:52.676102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:52.693360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:52.695165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:52.707316 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bd0e9b1-b673-42eb-a88a-5e3d45a1076e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.480039 Aug 23 11:08:52.710681 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3154/6350] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:52 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:52.937758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:52.938527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:52.950703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:52.954513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:52.955657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:52.968776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:52.980728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:52.986663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:52.994159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:52.999719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:53.018915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:53.026305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:53.027753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:53.034959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:53.036308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:53.037048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:53.816015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:53.850412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-188eddce-eee4-4c04-9aee-9e083aa0018b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1695 microversion: 2.1 time: 0.867201 Aug 23 11:08:53.852269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3155/6351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:52 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1695 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:53.855375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:53.877552 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-185a740f-4404-4bda-8db7-f3d2c21e283e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.942897 Aug 23 11:08:53.879766 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3197/6352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:52 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:53.882184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cb093144-3fa0-425c-828f-ba8fef1d2749 req-778ed3d9-0111-4de9-9cb9-1c410f72c02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "name": "network-vif-plugged", "status": "completed", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:53.894470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:53.897618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:53.918654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:53.920149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb093144-3fa0-425c-828f-ba8fef1d2749 req-778ed3d9-0111-4de9-9cb9-1c410f72c02b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:53.923090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb093144-3fa0-425c-828f-ba8fef1d2749 req-778ed3d9-0111-4de9-9cb9-1c410f72c02b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:53.923530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:53.924001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:53.926422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cb093144-3fa0-425c-828f-ba8fef1d2749 req-778ed3d9-0111-4de9-9cb9-1c410f72c02b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:53.930699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:53.931199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:53.931653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:53.978691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cb093144-3fa0-425c-828f-ba8fef1d2749 req-778ed3d9-0111-4de9-9cb9-1c410f72c02b service nova] Creating event network-vif-plugged:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h2-847009-13 Aug 23 11:08:54.000576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cb093144-3fa0-425c-828f-ba8fef1d2749 req-778ed3d9-0111-4de9-9cb9-1c410f72c02b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144059 Aug 23 11:08:54.008814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3156/6353] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:54.768011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:54.777717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:54.781100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:54.782724 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82d883bd-ce83-4a79-b120-0ea907f76273 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.901706 Aug 23 11:08:54.797408 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3198/6354] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:53 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:54.882338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:54.883818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:54.904534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:54.907803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:54.908358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:54.914290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:54.914876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:54.915681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:54.917000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:54.917624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:54.927916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:54.928803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:54.929269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:54.931191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:54.933296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:54.933727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:55.167083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:55.180471 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-100679c1-220e-4163-92bd-df635ef78f45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1692 microversion: 2.1 time: 0.302358 Aug 23 11:08:55.181779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3157/6355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:54 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1692 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:55.207511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:55.210846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:55.223961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:55.230356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:55.232554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:55.234981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:55.238090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:55.239073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:55.337038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:55.351691 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00aa0968-3547-4c6c-9993-1d79315d11c2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.438643 Aug 23 11:08:55.370060 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3199/6356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:54 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:55.607769 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e758ca0c-c552-43f7-aa0b-b7047c7a4bce tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action" status: 202 len: 0 microversion: 2.1 time: 0.405133 Aug 23 11:08:55.613109 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3158/6357] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:08:55 2022] POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:08:55.632845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:55.633619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:55.653365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:55.653869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:55.654313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:55.655124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:55.655746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:55.656180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:55.807027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:55.807747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:55.818194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:55.818718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:55.819155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:55.819892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:55.820387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:55.820816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:56.061991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:56.073353 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1fab1665-caa4-4914-a132-0e2d9e42986f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.457755 Aug 23 11:08:56.075158 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3200/6358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:55 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:08:56.342399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:56.416610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:56.419382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:56.420491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:56.421385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:56.427675 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f317902a-ce93-416f-8cc1-a3faa64bf300 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.621814 Aug 23 11:08:56.428587 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3159/6359] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:55 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:08:56.431289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:56.431919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:56.432467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:56.433314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:56.433872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:56.434538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:56.801503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:56.822295 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51d644fc-df4d-4710-9433-0b392d3948da tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.405758 Aug 23 11:08:56.822912 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3201/6360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:56 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:57.098973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:57.099609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:57.115764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.119294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.121590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.124820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.125400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.131398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.399562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "name": "network-vif-plugged", "status": "completed", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:08:57.421676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.422591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.423571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.479053 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] Creating event network-vif-plugged:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h2-847009-13 Aug 23 11:08:57.487937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] Instance 5193c2ff-ff52-47ed-b810-43e8155000bb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:08:57.525677 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d74a5fb0-6a54-4e8b-ad03-e283ca7e79f0 req-608a5065-b1e5-4b6c-afc3-c522e7de4f76 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130285 Aug 23 11:08:57.532418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3202/6361] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:08:57.545040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:57.546388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:57.561070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.562076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.562677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.563599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.564210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.566002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.812234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:57.829380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0647c46-4ed5-49f2-a290-01bb6c6b5a30 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.734221 Aug 23 11:08:57.832238 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3160/6362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:57 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:57.851267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:57.852175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:57.871715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.872479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.888213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.889642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:57.890640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:57.891254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:57.955891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:57.959954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:57.973598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:57.983538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:57.985492 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59bc223f-a01d-447f-953d-d758f8770fd0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.451641 Aug 23 11:08:57.988544 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3203/6363] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:57 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:08:58.105747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:58.119582 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99e3f163-3413-443e-8364-2e14a9272cfa tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.279660 Aug 23 11:08:58.120169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3161/6364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:57 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:58.855654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:58.856367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:58.864132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:58.864973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:58.865622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:58.866814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:58.869437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:58.871909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:59.011421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:59.012643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:59.021175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:59.021946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:59.022705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:59.023639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:59.025061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:59.025735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:59.199439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:59.210834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:59.214133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:59.215953 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7bc81004-2b41-463f-9ba5-d951ece493aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.208204 Aug 23 11:08:59.229463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3162/6365] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:08:59 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:08:59.240507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:08:59.241591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:08:59.248126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:59.249864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:59.250568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:59.251906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:08:59.252599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:08:59.253291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:08:59.484246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:59.488628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:08:59.497384 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d3387b8-f051-4c23-aa22-7aa911af506b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.265895 Aug 23 11:08:59.513484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3163/6366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:59 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:08:59.538863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:08:59.550627 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67432856-e26f-4a98-9088-3871ba74b7f3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.699985 Aug 23 11:08:59.574322 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3204/6367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:08:58 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:00.243930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:00.244564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:00.261828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:00.263389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:00.267661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:00.270140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:00.273863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:00.275308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:00.516541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:00.525640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:00.526911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:00.542572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:00.547326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:00.550870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:00.551625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:00.553300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-27a29db4-0b80-448b-9c82-d0f048a175b8 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.314361 Aug 23 11:09:00.553999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:00.554921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:00.556256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:00.558509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:00.558692 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3164/6368] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:00 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:00.579772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:00.580666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:00.595931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:00.598608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:00.601661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:00.605677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:00.606594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:00.611211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:00.906707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:00.920232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad52df35-1556-4007-b32e-04b6eb18eaa4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.344464 Aug 23 11:09:00.934481 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3165/6369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:00 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:09:01.071222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:01.092710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-842a0435-0689-4504-a13e-ad86d0954eee tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.574405 Aug 23 11:09:01.092710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3205/6370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:00 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:01.580645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:01.582184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:01.610163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:01.616640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:01.620407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:01.623223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:01.627073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:01.630016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:01.646247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "name": "network-vif-unplugged", "status": "completed", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:01.676917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:01.677432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:01.677937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:01.716222 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] Creating event network-vif-unplugged:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:09:01.737376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] Instance 5193c2ff-ff52-47ed-b810-43e8155000bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:09:01.771481 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b346a302-d09c-4253-88d4-61973923111e req-5eb2da76-ae21-44f6-9d58-26099daa94b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.321604 Aug 23 11:09:01.772683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3166/6371] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:01.960307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:01.961447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:01.980640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:01.982202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:01.986219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:01.987217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:01.991600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:01.992828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:02.214973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:02.229515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:02.236917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:02.239549 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da75990d-d7ea-4627-a4a6-89b2d815423b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.663847 Aug 23 11:09:02.259591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3206/6372] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:01 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:02.268353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:02.270032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:02.280505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:02.282048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:02.282753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:02.283788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:02.284834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:02.285522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:02.740465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:02.757951 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84b53914-f601-49b4-be17-9bc92d46b255 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.496781 Aug 23 11:09:02.759922 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3207/6373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:02 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:02.789610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:02.813407 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03078720-74f3-49db-9fa0-bae6282c0a0e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.855957 Aug 23 11:09:02.814309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3167/6374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:01 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:03.271734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:03.272619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:03.287320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:03.288410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:03.289177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:03.290082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:03.292180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:03.295016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:03.743990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:03.752887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:03.766865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:03.768104 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92f11832-563d-4525-8dd7-d4aa59cb18d0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.503764 Aug 23 11:09:03.785097 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3208/6375] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:03 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:03.788244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:03.789509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:03.799814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:03.805850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:03.806638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:03.807649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:03.808320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:03.809031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:03.835819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:03.836544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:03.846024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:03.846885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:03.848208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:03.850725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:03.852364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:03.853637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:04.057947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:04.100024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-03160c0c-4c16-48bd-a4a2-d5e4f1bd16ae tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.316749 Aug 23 11:09:04.103845 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3168/6376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:03 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:04.114606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:04.145880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:04.147166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:04.149687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:04.168246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] Creating event network-changed:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:09:04.216267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] Instance 5193c2ff-ff52-47ed-b810-43e8155000bb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:09:04.302198 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-03301c70-0a07-4efa-80d6-f51417f1e1c7 req-56d89b0d-3eed-4c1c-a794-72e63e02a958 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195074 Aug 23 11:09:04.303395 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3169/6377] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:04.801394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:04.802816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:04.819385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:04.820210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:04.820967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:04.822241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:04.822925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:04.823537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:04.901869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:04.912457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e80bf943-0ada-4ecb-a185-0fac6f9bb556 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 1.080916 Aug 23 11:09:04.924895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3209/6378] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:03 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:05.124641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:05.125649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:05.166160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:05.169346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:05.173339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:05.174398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:05.177431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:05.181581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:05.297568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:05.308037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:05.315512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:05.318158 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6b68e29-540a-44eb-b53a-b045c039d68d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.527149 Aug 23 11:09:05.325902 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3170/6379] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:04 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:09:05.563875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:05.590698 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-df5e497c-812a-4c8c-85e2-e9c951265695 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.470889 Aug 23 11:09:05.596787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3210/6380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:05 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:09:05.945800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:05.946417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:06.001998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:06.006143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:06.007110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:06.013678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:06.014757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:06.015380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:06.354168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:06.355089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:06.364584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:06.365153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:06.365772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:06.366822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:06.367464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:06.368144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:06.688943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:06.700966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:06.707159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:06.710700 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2853e2b2-47c6-4c40-a09b-38fee4bf690b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.361155 Aug 23 11:09:06.712483 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3211/6381] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:06 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:09:06.719774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:06.721144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:06.727789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:06.728441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:06.729123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:06.730260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:06.730911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:06.731557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:06.737499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:06.769292 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d36ec742-4b1c-4514-a163-a492561f204b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.828683 Aug 23 11:09:06.769906 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3171/6382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:05 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:06.976201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:06.994864 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a0b3c688-54bc-40e6-ab37-4863ede97de2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1721 microversion: 2.1 time: 0.281018 Aug 23 11:09:06.996224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3212/6383] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:06 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:07.740483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:07.742295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:07.752516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:07.753350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:07.753816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:07.754540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:07.755162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:07.755760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:07.799563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:07.800924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:07.812905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:07.813868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:07.814841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:07.815957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:07.816856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:07.817480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:08.144668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:08.159445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:08.161187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:08.162814 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b02e5b0f-892f-479b-a9ce-7b6659750928 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.426485 Aug 23 11:09:08.163980 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3172/6384] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:07 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:08.169912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:08.171706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:08.179900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:08.180410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:08.180919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:08.181752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:08.182408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:08.183046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:08.306899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:08.322739 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19611a33-ec8e-4f3f-8e13-52085dc042f0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1691 microversion: 2.1 time: 0.524529 Aug 23 11:09:08.323403 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3213/6385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:07 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1691 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:09:08.513696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:08.536953 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9247bdce-316f-465d-b191-9e09724eac7c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1698 microversion: 2.1 time: 0.371679 Aug 23 11:09:08.537677 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3173/6386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:08 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1698 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:08.560299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bff5515e-32ce-43bd-b441-696decf6a009 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:08.570185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bff5515e-32ce-43bd-b441-696decf6a009 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:08.570936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bff5515e-32ce-43bd-b441-696decf6a009 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:08.571808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bff5515e-32ce-43bd-b441-696decf6a009 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:08.604232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bff5515e-32ce-43bd-b441-696decf6a009 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Going to try to start instance {{(pid=128859) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 11:09:08.685178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bff5515e-32ce-43bd-b441-696decf6a009 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action" status: 202 len: 0 microversion: 2.1 time: 0.128514 Aug 23 11:09:08.692090 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3214/6387] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:09:08 2022] POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:09:08.695823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:08.697129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:08.706077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:08.707181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:08.707931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:08.708995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:08.710123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:08.710786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:08.929585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:08.946056 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-01718281-def3-49f5-8d54-03ee61c3a83a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1707 microversion: 2.1 time: 0.252231 Aug 23 11:09:08.949986 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3174/6388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:08 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1707 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:09.191890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:09.193685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:09.224681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:09.225839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:09.226718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:09.231173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:09.233707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:09.237116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:09.355317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:09.356778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:09.377877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:09.383731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:09.385635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:09.388001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:09.388510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:09.389608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:09.665922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:09.682440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:09.700468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:09.704697 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ef466e9-22eb-4b33-8c54-84479d9e5075 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.518734 Aug 23 11:09:09.705451 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3215/6389] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:09 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:09.930331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:09.950525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-08273497-ff33-4a3d-92b2-c43e928bd189 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1684 microversion: 2.1 time: 0.605039 Aug 23 11:09:09.951134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3175/6390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:09 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1684 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:09.974100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:09.974995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:09.986489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:09.992066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:09.992532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:09.993328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:09.993802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:09.994240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:10.376544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:10.395885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c6b490cb-92e8-46f8-95fa-eff37b292a2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1707 microversion: 2.1 time: 0.419986 Aug 23 11:09:10.415764 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3216/6391] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:09 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1707 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:10.728603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:10.737642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:10.758880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:10.762842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:10.765663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:10.768045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:10.770585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:10.772654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:11.172777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:11.183304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:11.202881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:11.207719 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6220753a-6d84-40c4-bbf6-0fcc977d9435 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.484128 Aug 23 11:09:11.216017 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3176/6392] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:10 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:11.419532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:11.421650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:11.442368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:11.446455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:11.447242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:11.450715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:11.453473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:11.454864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:11.838575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:11.894059 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36e1ac56-dc08-459b-847b-f8f709765368 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1711 microversion: 2.1 time: 0.477212 Aug 23 11:09:11.897806 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3217/6393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:11 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1711 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:12.239845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:12.240594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:12.250975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e57fdca5-7f51-44e0-82b3-d33e0e1a211e req-3630d73e-31a5-4fda-af69-06d6636be3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "name": "network-vif-plugged", "status": "completed", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:12.276025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:12.277749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:12.281230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:12.284961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:12.288643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:12.291418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:12.292346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e57fdca5-7f51-44e0-82b3-d33e0e1a211e req-3630d73e-31a5-4fda-af69-06d6636be3c4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:12.296423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e57fdca5-7f51-44e0-82b3-d33e0e1a211e req-3630d73e-31a5-4fda-af69-06d6636be3c4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:12.299015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e57fdca5-7f51-44e0-82b3-d33e0e1a211e req-3630d73e-31a5-4fda-af69-06d6636be3c4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:12.366379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e57fdca5-7f51-44e0-82b3-d33e0e1a211e req-3630d73e-31a5-4fda-af69-06d6636be3c4 service nova] Creating event network-vif-plugged:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:09:12.379404 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e57fdca5-7f51-44e0-82b3-d33e0e1a211e req-3630d73e-31a5-4fda-af69-06d6636be3c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132667 Aug 23 11:09:12.386471 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3218/6394] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:12.519899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:12.529779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:12.531703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:12.533426 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cacead6f-97a2-4178-9145-e96883c67f31 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.298972 Aug 23 11:09:12.534704 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3177/6395] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:12 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:12.937560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-972613112", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:13.563184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:13.563939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:13.570890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:13.571769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:13.572373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:13.575383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:13.575857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:13.576333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:13.846930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:13.860324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:13.863484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:13.866448 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa53422b-b6fb-464b-8fac-abc5d3c58610 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.308033 Aug 23 11:09:13.882977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3178/6396] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:13 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:14.740460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:09:14.900213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:14.904474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:14.933691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:14.934310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:14.934768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:14.935514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:14.936913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:14.950618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:15.203497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:09:15.204396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:09:15.205345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:09:15.206691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:09:15.207313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:09:15.225109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:15.226834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:15.227534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:15.228509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:15.229292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:15.230759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:15.255333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Getting quotas for project c26d632590e14f50a2852c11c46c7ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:09:15.261471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Getting quotas for user 46475fe52d07404bb209b8d7d2475971 and project c26d632590e14f50a2852c11c46c7ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:09:15.277672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:09:15.282226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:15.283435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:09:15.303649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:15.305499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:15.309722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93955ea6-8b85-4759-bbd7-8b229df36992 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.419891 Aug 23 11:09:15.311134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3179/6397] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:14 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:09:15.379133 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38fb57fc-3cac-4c76-a2f4-c2b2b92efec7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.446926 Aug 23 11:09:15.379724 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3219/6398] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:09:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:09:15.392042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-175c5e48-3faa-44fa-9fb4-14338728e447 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:15.392971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-175c5e48-3faa-44fa-9fb4-14338728e447 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:15.498323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-175c5e48-3faa-44fa-9fb4-14338728e447 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:15.509895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-175c5e48-3faa-44fa-9fb4-14338728e447 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1213 microversion: 2.1 time: 0.123049 Aug 23 11:09:15.525023 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3180/6399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:15 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:16.336441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:16.337105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:16.343761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:16.374323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:16.374977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:16.375522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:16.376331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:16.376913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:16.377448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:16.533286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:16.534488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:16.547629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:16.552128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:16.553614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:16.556417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:16.559215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:16.562568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:16.696093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:16.698319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:16.707821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:16.709350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:16.722357 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56bbc38e-97c4-498f-b0b2-bc08870b2989 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.390656 Aug 23 11:09:16.737149 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3220/6400] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:16 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:16.747641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:16.764076 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2a239c3-1d9b-4a23-8b47-b01f3889e5de tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1209 microversion: 2.1 time: 0.236088 Aug 23 11:09:16.764806 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3181/6401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:16 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1209 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:09:17.759988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:17.762464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:17.790118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:17.791296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:17.792462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:17.793818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:17.793943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:17.794523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:17.801250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:17.802726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:17.803476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:17.809519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:17.810355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:17.811414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:17.812092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:17.812696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:17.866146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:18.006885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:18.026343 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61f94c27-7f49-4ac2-bff8-97e7607072c7 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1271 microversion: 2.1 time: 0.236359 Aug 23 11:09:18.041647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3182/6402] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:17 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:18.172317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:18.187707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:18.189736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:18.191028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b42801f9-2d68-4879-b083-8ebc2ca129eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.443041 Aug 23 11:09:18.191967 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3221/6403] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:17 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:19.055397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:19.057488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:19.071684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:19.075208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:19.077239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:19.080778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:19.081525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:19.082552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:19.227899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:19.228686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:19.245141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:19.250541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:19.251806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:19.253948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:19.254565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:19.256058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:19.280074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:19.292532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-38afed92-4fe1-4fdb-9f2e-155fa558a05f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1271 microversion: 2.1 time: 0.242610 Aug 23 11:09:19.307865 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3183/6404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:19 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:20.266377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:20.291852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:20.293968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:20.301280 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66975b35-899c-4005-84b1-193f4147a862 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 1.072229 Aug 23 11:09:20.314315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:20.315677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:20.322531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3222/6405] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:19 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:20.324646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=74 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:20.328058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:20.333538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:20.334301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:20.335268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:20.336063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:20.336709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:20.650150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-44919180-ae5f-401a-88c1-e1071ca7d2ff req-88bf0d45-6731-4b68-ab12-c12925afb01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eecb5d2-c425-4dc2-b75c-79cb378e3e36", "tag": "68595182-f1a0-4ccb-a796-c79a5fedbf12"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:20.678271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-44919180-ae5f-401a-88c1-e1071ca7d2ff req-88bf0d45-6731-4b68-ab12-c12925afb01a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:20.697690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-44919180-ae5f-401a-88c1-e1071ca7d2ff req-88bf0d45-6731-4b68-ab12-c12925afb01a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:20.698406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-44919180-ae5f-401a-88c1-e1071ca7d2ff req-88bf0d45-6731-4b68-ab12-c12925afb01a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:20.713057 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-44919180-ae5f-401a-88c1-e1071ca7d2ff req-88bf0d45-6731-4b68-ab12-c12925afb01a service nova] Creating event network-changed:68595182-f1a0-4ccb-a796-c79a5fedbf12 for instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 on n-h2-847009-13 Aug 23 11:09:20.718663 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-44919180-ae5f-401a-88c1-e1071ca7d2ff req-88bf0d45-6731-4b68-ab12-c12925afb01a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074170 Aug 23 11:09:20.719720 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3223/6406] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:20.812294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:20.828388 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-30c27240-4939-4a49-afd0-65d5ad937951 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.517992 Aug 23 11:09:20.835364 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3184/6407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:20 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:21.346971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:21.348339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:21.365989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:21.366712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:21.367314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:21.368401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:21.369748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:21.370342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:21.861001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:21.861622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:21.873846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:21.874454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:21.874903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:21.885417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:21.891991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:21.892450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:22.131204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:22.142401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:22.144460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:22.145938 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e111b3e2-a62d-4b7a-85fd-a15e9138bc90 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.804686 Aug 23 11:09:22.147142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3224/6408] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:21 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:22.182545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:22.196174 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-884ffeb3-83f8-43f7-a9b1-18f0d2d5edfa tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.339697 Aug 23 11:09:22.207664 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3185/6409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:21 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:23.173437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:23.176111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:23.193846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:23.200167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:23.201022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:23.204648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:23.205459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:23.207291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:23.239207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:23.242009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:23.266804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:23.267359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:23.268105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:23.275885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:23.278473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:23.279244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:23.632652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:23.641268 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f1562aa-f571-41b4-8872-e4b940f93bb2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.421475 Aug 23 11:09:23.641858 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3186/6410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:23 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:23.856060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:23.879750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:23.884694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:23.887954 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc7b6adf-37a4-45da-b337-5dfadbeb63bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.721843 Aug 23 11:09:23.906280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3225/6411] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:23 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:24.664466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:24.665096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:24.676101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:24.681445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:24.682149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:24.683057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:24.683678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:24.684265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:24.918827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:24.920222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:24.937694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:24.942114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:24.942841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:24.944143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:24.946821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:24.951841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:24.964725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:24.980008 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7ad8bf9-06f6-4255-8ecc-fae49e26907f tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.319082 Aug 23 11:09:24.980618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3187/6412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:24 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:25.227316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:25.236934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:25.238413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:25.242370 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e6a8500-69c2-4349-9915-083a1dbdd76a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.328498 Aug 23 11:09:25.249666 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3226/6413] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:24 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:26.007209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:26.008711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:26.011503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:26.028239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:26.032300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:26.032998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:26.034924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:26.037599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:26.042834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:26.279097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:26.283750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:26.299787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:26.307694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:26.329166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:26.330047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:26.330753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:26.331690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:26.332841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:26.333661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:26.546273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:26.563060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2abedb0-9628-4118-b7ed-9f2f3b071e40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.560416 Aug 23 11:09:26.566598 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3188/6414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:26 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:26.599465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:26.611858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:26.613637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:26.615559 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e189dd2a-c417-4d50-a937-7ac11207fc8d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.344553 Aug 23 11:09:26.617000 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3227/6415] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:26 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:27.355842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-49b32cde-8a6d-4ad1-b8f9-92dcb374bda9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Action: 'create', calling method: .version_select at 0x7fdc8f81b4c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-461798026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuN4lMG0b8cLoGFzEr1G0lG5v1a1mbe0a1iVJu/0+znzU0XAOJcJG43+nxNGy+05kvA1ANdB89LkPZH9W0b3xrmdbSJD29lylfRIzCpVzMgH5qWVqd9PJgHPn0v9KzFvg=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:27.378900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e65837f1-b690-4621-9540-20123727b211 req-ab8aef32-0f4d-4a55-b1d8-80ad794028a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eecb5d2-c425-4dc2-b75c-79cb378e3e36", "name": "network-vif-plugged", "status": "completed", "tag": "68595182-f1a0-4ccb-a796-c79a5fedbf12"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:27.396504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e65837f1-b690-4621-9540-20123727b211 req-ab8aef32-0f4d-4a55-b1d8-80ad794028a3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:27.397021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e65837f1-b690-4621-9540-20123727b211 req-ab8aef32-0f4d-4a55-b1d8-80ad794028a3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:27.397641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e65837f1-b690-4621-9540-20123727b211 req-ab8aef32-0f4d-4a55-b1d8-80ad794028a3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:27.411293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-49b32cde-8a6d-4ad1-b8f9-92dcb374bda9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Getting quotas for project 4bdbe227f743406a9e93c8e86dc76cde. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:09:27.412652 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e65837f1-b690-4621-9540-20123727b211 req-ab8aef32-0f4d-4a55-b1d8-80ad794028a3 service nova] Creating event network-vif-plugged:68595182-f1a0-4ccb-a796-c79a5fedbf12 for instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 on n-h2-847009-13 Aug 23 11:09:27.419655 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e65837f1-b690-4621-9540-20123727b211 req-ab8aef32-0f4d-4a55-b1d8-80ad794028a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046275 Aug 23 11:09:27.421296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3228/6416] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:09:27.422650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-49b32cde-8a6d-4ad1-b8f9-92dcb374bda9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Getting quotas for user 7c32c0e05d9e47a6950dd0297ed8aabc and project 4bdbe227f743406a9e93c8e86dc76cde. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:09:27.476137 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-49b32cde-8a6d-4ad1-b8f9-92dcb374bda9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.603232 Aug 23 11:09:27.483807 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3189/6417] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:09:26 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:27.586078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:27.586795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:27.608544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:27.609813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:27.610295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:27.611625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:27.612099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:27.612527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:27.651524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:27.652441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:27.664165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:27.666300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:27.669427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:27.672133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:27.673607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:27.676252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:27.945823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:27.962222 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7dc6f5c1-d9a7-4fba-8bda-5abc08fa0c3b tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.381027 Aug 23 11:09:27.963265 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3229/6418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:27 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:28.047612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:28.056078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:28.057862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:28.059336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b384bc19-e7b2-4acd-a40d-742096bad5bd tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 0.412950 Aug 23 11:09:28.061041 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3190/6419] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:27 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:28.991862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:28.992550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:29.004564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:29.005125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:29.005674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:29.006733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:29.007944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:29.009797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:29.087195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:29.088602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:29.118324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:29.119136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:29.119858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:29.120844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:29.121465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:29.122175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:29.240214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:29.262795 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e26fef7f-8b4f-4116-87c1-adc1ee2264e9 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1313 microversion: 2.1 time: 0.278964 Aug 23 11:09:29.280927 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3230/6420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:28 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:30.067134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:30.080406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:30.082002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:30.083224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffdc2dd2-cb95-4376-b52c-d29465cfa92e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1738 microversion: 2.20 time: 1.003113 Aug 23 11:09:30.083801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3191/6421] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:29 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1738 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:09:30.292446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:30.293363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:30.302787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:30.305382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:30.306075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:30.307049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:30.307743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:30.309550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:30.471145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:30.487024 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce7845a1-171f-412c-a57b-84484288f93d tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1463 microversion: 2.1 time: 0.200977 Aug 23 11:09:30.503553 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3231/6422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:30 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1463 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:30.512615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76498970-412f-4ae8-817a-dc38a15f1d47", "device": "/dev/sdb"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:30.515729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:30.523199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:30.523908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:30.524423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:30.525368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:30.526041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:30.526690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:30.913426 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83929d6f-49cb-473b-bb8f-607d036aa1ef tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "POST /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406926 Aug 23 11:09:30.915279 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3192/6423] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:09:30 2022] POST /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:31.110783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:31.112995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:31.132368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:31.132936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:31.135412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:31.136644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:31.140502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:31.141639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:31.394421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:31.406083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:31.408204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:31.409725 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0704b2f-36e2-43c7-a965-eae360253878 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1720 microversion: 2.20 time: 0.304099 Aug 23 11:09:31.411663 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3232/6424] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:31 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:32.439186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:32.440554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:32.466868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:32.469162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:32.473910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:32.474709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:32.479728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:32.482640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:33.015105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:33.025771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:33.030571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:33.034104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e21ee64-3212-4603-911d-926dc87dc08a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1720 microversion: 2.20 time: 0.603654 Aug 23 11:09:33.037530 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3193/6425] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:32 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1720 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:33.697067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8395b3e8-ec6e-47a1-9dd2-18e1361fd213 req-21577988-7c08-49ce-9494-7bd31d98d662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "name": "network-vif-unplugged", "status": "completed", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:33.728512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8395b3e8-ec6e-47a1-9dd2-18e1361fd213 req-21577988-7c08-49ce-9494-7bd31d98d662 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:33.729088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8395b3e8-ec6e-47a1-9dd2-18e1361fd213 req-21577988-7c08-49ce-9494-7bd31d98d662 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:33.730206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8395b3e8-ec6e-47a1-9dd2-18e1361fd213 req-21577988-7c08-49ce-9494-7bd31d98d662 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:33.765266 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8395b3e8-ec6e-47a1-9dd2-18e1361fd213 req-21577988-7c08-49ce-9494-7bd31d98d662 service nova] Creating event network-vif-unplugged:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h2-847009-13 Aug 23 11:09:33.784022 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8395b3e8-ec6e-47a1-9dd2-18e1361fd213 req-21577988-7c08-49ce-9494-7bd31d98d662 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089642 Aug 23 11:09:33.784648 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3233/6426] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:34.061348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:34.062261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:34.077903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:34.079071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:34.079839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:34.081980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:34.083356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:34.085505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:35.240896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:35.285452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:35.290474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:35.294046 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-113461ab-5bf6-4e82-8fe3-d6c874334661 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1723 microversion: 2.20 time: 1.237088 Aug 23 11:09:35.296342 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3194/6427] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:34 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1723 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:35.326266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "317e09a9-a85d-45c0-b65f-7e0072d9ef7d"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:35.333687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:35.350644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:35.353101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:35.357412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:35.358339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:35.361372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:35.363055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:36.367511 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e49d36c-b9ee-476c-8c68-3c26e5fb2786 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.051214 Aug 23 11:09:36.369355 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3234/6428] 10.222.0.78 () {62 vars in 1364 bytes} [Tue Aug 23 11:09:35 2022] POST /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-volume_attachments => generated 188 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:09:37.019178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:37.019904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:37.035955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:37.041480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:37.048084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:37.051362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:37.062980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:37.063364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:37.438016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:37.768277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae421ddc-a56f-48e9-bfc6-a8e0b0eb50f9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-volume_attachments/317e09a9-a85d-45c0-b65f-7e0072d9ef7d" status: 202 len: 0 microversion: 2.20 time: 0.754662 Aug 23 11:09:37.769593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3195/6429] 10.222.0.78 () {60 vars in 1457 bytes} [Tue Aug 23 11:09:37 2022] DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-volume_attachments/317e09a9-a85d-45c0-b65f-7e0072d9ef7d => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:09:37.965350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:37.966067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:37.977150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:37.977936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:37.979583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:37.983360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:37.984022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:37.984639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:38.047019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128859) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 11:09:38.136389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:38.166499 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c1c4f111-7478-4dc2-914d-c1f56a6d7809 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "POST /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/action" status: 202 len: 0 microversion: 2.20 time: 0.208522 Aug 23 11:09:38.167722 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3235/6430] 10.222.0.78 () {62 vars in 1319 bytes} [Tue Aug 23 11:09:37 2022] POST /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:09:38.179111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:38.180723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:38.204580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:38.206250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:38.210020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:38.211709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:38.214502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:38.215061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:38.311136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:38.752888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:38.773437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:38.775356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:38.776598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4e7f4da-da59-4047-aeb1-d47e6aa5b006 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1671 microversion: 2.20 time: 0.603900 Aug 23 11:09:38.777217 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3196/6431] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:38 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1671 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:39.812615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:39.813092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:39.830642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:39.832184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:39.832876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:39.833858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:39.839450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:39.840209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:40.185490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:40.209049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:40.215700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:40.220076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a427b32-bf14-42fd-bde3-96c013f49d7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1671 microversion: 2.20 time: 0.420095 Aug 23 11:09:40.222555 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3236/6432] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:39 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1671 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:41.246967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:41.248434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:41.257524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:41.258479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:41.259227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:41.260781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:41.261614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:41.262222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:42.017623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:42.031219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:42.033276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:42.034993 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b73f0973-87b9-4314-b891-2accb8bc1ea3 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.792986 Aug 23 11:09:42.036615 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3197/6433] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:41 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:43.061429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:43.063071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:43.071617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:43.072229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:43.072987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:43.074234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:43.075021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:43.076362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:43.387488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:43.410135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4845fbdd-b78e-40ca-9df9-8be8eb8720d1 req-ac68a873-56ff-4c7f-94b0-e92e9c3d8325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:43.424529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:43.428597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:43.431810 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02da4909-94e4-41c3-a8f8-9f7056f08048 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.375194 Aug 23 11:09:43.436380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4845fbdd-b78e-40ca-9df9-8be8eb8720d1 req-ac68a873-56ff-4c7f-94b0-e92e9c3d8325 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:43.436986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4845fbdd-b78e-40ca-9df9-8be8eb8720d1 req-ac68a873-56ff-4c7f-94b0-e92e9c3d8325 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:43.437615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4845fbdd-b78e-40ca-9df9-8be8eb8720d1 req-ac68a873-56ff-4c7f-94b0-e92e9c3d8325 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:43.438576 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3237/6434] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:43 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:43.479481 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4845fbdd-b78e-40ca-9df9-8be8eb8720d1 req-ac68a873-56ff-4c7f-94b0-e92e9c3d8325 service nova] Creating event network-changed:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h1-847009-13 Aug 23 11:09:43.486945 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4845fbdd-b78e-40ca-9df9-8be8eb8720d1 req-ac68a873-56ff-4c7f-94b0-e92e9c3d8325 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080651 Aug 23 11:09:43.488697 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3198/6435] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:09:43.965583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-204172568-access_point-819946609", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "6e0f760d-b88a-42f6-b30e-a2ebc77b1cd2"}], "key_name": "tempest-TestSecurityGroupsBasicOps-461798026", "security_groups": [{"name": "tempest-secgroup_access--489509556"}, {"name": "tempest-secgroup_general--691359030"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:44.218205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] validate_networks() for [('6e0f760d-b88a-42f6-b30e-a2ebc77b1cd2', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:09:44.283019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:44.286071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:44.302352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:44.302788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:44.303240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:44.303970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:44.304440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:44.310700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:44.425743 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43f34e48-596a-4332-ac19-812bb723b1a8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action" status: 200 len: 63165 microversion: 2.1 time: 0.148022 Aug 23 11:09:44.427086 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3199/6436] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:09:44 2022] POST /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb/action => generated 63165 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:09:44.463974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:44.464707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:44.482604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:44.483266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:44.483763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:44.484781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:44.486019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:44.487384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:44.806089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:09:44.810969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:09:44.812072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:09:44.812335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:09:44.813207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:09:44.828313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:44.829738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:44.830534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:44.831489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:44.832196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:44.832874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:44.863092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Getting quotas for project 4bdbe227f743406a9e93c8e86dc76cde. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:09:44.873780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Getting quotas for user 7c32c0e05d9e47a6950dd0297ed8aabc and project 4bdbe227f743406a9e93c8e86dc76cde. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:09:44.892524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:09:44.899318 n-d-847009-13 devstack@n-api.service[128859]: WARNING nova.utils [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-204172568-access_point-819946609 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-204172568-acc Aug 23 11:09:44.915055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:09:44.993669 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4677a206-98ed-4a3f-b0c4-68325a27523a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.038556 Aug 23 11:09:44.994899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3238/6437] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:09:43 2022] POST /compute/v2.1/servers => generated 456 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:09:45.020068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:45.021031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-de635c74-9bc8-4c2c-9da3-5cc1bed9292c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:45.022345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-de635c74-9bc8-4c2c-9da3-5cc1bed9292c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:45.044040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:45.045784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:45.047026 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccd5cddb-70d4-48ed-b595-27ec3d387045 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.588800 Aug 23 11:09:45.047606 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3200/6438] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:44 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:45.114440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-de635c74-9bc8-4c2c-9da3-5cc1bed9292c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:45.130124 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-de635c74-9bc8-4c2c-9da3-5cc1bed9292c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1292 microversion: 2.1 time: 0.119513 Aug 23 11:09:45.132048 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3239/6439] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:45 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1292 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:46.078887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:46.081036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:46.090372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:46.091716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:46.092955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:46.094239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:46.095061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:46.095849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:46.158155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:46.159339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:46.178176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:46.178911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:46.179511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:46.180472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:46.181110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:46.181836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:46.558830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:46.572152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:46.575913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:46.577468 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c769e326-9222-42c4-a8fd-5c03f4152f0a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.509779 Aug 23 11:09:46.591039 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3201/6440] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:46 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:46.925419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:46.937989 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65385bd9-7d4b-4f43-b04d-1da2baab1efb tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1288 microversion: 2.1 time: 0.785804 Aug 23 11:09:46.938578 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3240/6441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:46 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1288 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:47.603778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:47.605353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:47.618967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:47.637590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:47.639219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:47.640197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:47.641350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:47.648225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:47.909974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:47.922834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:47.924417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:47.925656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-581f0dba-683a-4edc-bcce-c1a2614a392c tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.326116 Aug 23 11:09:47.940765 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3202/6442] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:47 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:47.962454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:47.963235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:47.967984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:47.993114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:47.993770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:47.994389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:47.996107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:47.996560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:47.997266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:48.192705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:48.202274 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51c20eb5-aa54-4315-8fc7-b9d71d0b1e89 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1352 microversion: 2.1 time: 0.244181 Aug 23 11:09:48.226016 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3241/6443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:47 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:48.967977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:48.976490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:48.988474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:48.998949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:49.003424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:49.004598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:49.005400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:49.006189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:49.235732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:49.236323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:49.260696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:49.261660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:49.262279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:49.263315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:49.264037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:49.264828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:49.391091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:49.404506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e906f410-192c-42f0-b894-bae98a9d4c4f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1350 microversion: 2.1 time: 0.173410 Aug 23 11:09:49.423287 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3242/6444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:49 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1350 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:50.295391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:50.314861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:50.316849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:50.318599 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-92704d4e-29e4-4a51-a08d-f8e98f4add99 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 1.369664 Aug 23 11:09:50.319391 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3203/6445] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:48 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:50.430417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:50.431309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:50.464014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:50.464870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:50.465570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:50.473704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:50.477131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:50.477784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:50.687115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:50.700045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cbbbb8b2-d9ba-4f52-bf87-ac99469a5a21 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1350 microversion: 2.1 time: 0.273999 Aug 23 11:09:50.703055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3243/6446] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:50 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1350 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:51.349984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:51.351247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:51.354816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:51.371129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:51.380351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:51.380855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:51.381748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:51.382234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:51.382681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:51.703985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:51.720654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:51.723817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:51.724706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:51.730744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:51.732082 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6030ff98-6b44-4e93-85d2-f9690dca7b40 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.386323 Aug 23 11:09:51.737905 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3204/6447] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:51 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:51.740793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:51.744174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:51.751950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:51.755817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:51.757954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:51.764300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:51.921010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:51.931307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1d24e97b-dfcc-4aa8-a66b-79d1d67d633e tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1350 microversion: 2.1 time: 0.211760 Aug 23 11:09:51.941546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3244/6448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:51 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:09:52.766482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:52.767781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:52.789705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:52.790508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:52.791141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:52.792051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:52.792686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:52.793308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:52.963328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:52.968753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:53.000218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:53.002434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:53.003822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:53.007898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:53.009488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:53.011785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:53.390001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:53.418233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:53.421652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:53.432314 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c961ac36-8a9a-4074-b81c-04fd3a261a62 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.670550 Aug 23 11:09:53.436922 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3205/6449] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:52 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:53.576285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:53.589382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4522ee7-560c-448e-81ae-90c1b2fdb44f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.630480 Aug 23 11:09:53.589993 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3245/6450] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:52 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:54.464660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:54.465645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:54.479626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:54.486124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:54.486759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:54.488916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:54.489429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:54.489985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:54.615544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:54.616164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:54.644063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:54.644593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:54.650016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:54.651584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:54.652075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:54.652659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:54.851892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:54.951458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:54.963900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:54.969335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:54.971017 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f00eff92-b080-4995-96bf-8bc31549f11a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.511221 Aug 23 11:09:54.980096 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3206/6451] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:54 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:55.000293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-37a86a2b-5267-47dd-8620-791dfc35d75c req-a4846dc1-76bc-4621-9037-b9f1446a8547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d217f215-b58f-466d-9b0f-9950de9a1015", "tag": "6d483fd6-6512-46e4-94ce-3ede9270e7ce"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:09:55.020139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-37a86a2b-5267-47dd-8620-791dfc35d75c req-a4846dc1-76bc-4621-9037-b9f1446a8547 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:55.021905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-37a86a2b-5267-47dd-8620-791dfc35d75c req-a4846dc1-76bc-4621-9037-b9f1446a8547 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:55.023934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-37a86a2b-5267-47dd-8620-791dfc35d75c req-a4846dc1-76bc-4621-9037-b9f1446a8547 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:55.057336 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-37a86a2b-5267-47dd-8620-791dfc35d75c req-a4846dc1-76bc-4621-9037-b9f1446a8547 service nova] Creating event network-changed:6d483fd6-6512-46e4-94ce-3ede9270e7ce for instance d217f215-b58f-466d-9b0f-9950de9a1015 on n-h1-847009-13 Aug 23 11:09:55.070035 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-37a86a2b-5267-47dd-8620-791dfc35d75c req-a4846dc1-76bc-4621-9037-b9f1446a8547 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074096 Aug 23 11:09:55.074156 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3207/6452] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:09:55.124197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:09:55.202358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:55.213779 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5303e6e5-0e29-4e1d-88dc-fa588e5677fe tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.602606 Aug 23 11:09:55.224781 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3246/6453] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:54 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:56.003743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:56.005792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:56.036365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:56.037159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:56.037273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:56.045917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:56.048638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:56.049488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:56.241091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:56.243613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:56.274905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:56.276698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:56.278087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:56.282792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:56.283324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:56.285394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:56.615864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:56.633722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:56.635278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:56.636570 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a98ce700-cde6-4423-af2e-778d643c3c7f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.639463 Aug 23 11:09:56.660265 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3208/6454] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:55 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:56.738765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:56.756267 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1eab864f-8788-4ade-84eb-2b9f21c1bd57 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.521771 Aug 23 11:09:56.760878 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3247/6455] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:56 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:57.681090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:57.681839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:57.690601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:57.691468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:57.692068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:57.703918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:57.704668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:57.705513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:57.780154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:57.781938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:57.797703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:57.798486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:57.803114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:57.804256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:57.805049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:57.809149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:58.024400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:58.042800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:58.045992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:58.048091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fc06c7d-e597-46f5-87e5-0add9b9edb43 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.371611 Aug 23 11:09:58.050561 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3209/6456] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:57 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:58.157529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:58.164981 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99f725a9-a7c8-48c9-8f30-498e42ba98ca tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.389324 Aug 23 11:09:58.168450 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3248/6457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:57 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:09:59.081386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:59.082853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:59.094794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:59.095649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:59.096263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:59.097287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:59.098258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:59.098912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:59.187713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:09:59.188575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:09:59.219011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:59.222713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:59.225388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:59.230265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:09:59.233902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:09:59.234528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:09:59.311533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:59.324554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:59.330725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:59.336145 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-427b85a9-ad2c-4d4d-8a30-1143cfc97a7b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.257738 Aug 23 11:09:59.338516 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3210/6458] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:09:59 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:09:59.497978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:09:59.508012 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84ab54c7-8a04-42bf-91e4-83a21d02aee9 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.325923 Aug 23 11:09:59.524583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3249/6459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:09:59 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:00.379861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:00.381153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:00.389238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:00.391569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:00.392341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:00.393588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:00.394283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:00.394903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:00.534671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:00.538142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:00.556098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:00.556098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:00.556098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:00.556098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:00.556585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:00.556964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:00.647945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:00.658830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:00.660823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:00.662356 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b63733f2-f103-43e6-86c5-686f804b49ef tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.287490 Aug 23 11:10:00.669698 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3211/6460] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:00 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:01.078057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:01.088310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3d42705-4f80-4a9a-9449-e76f4a224d23 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.559572 Aug 23 11:10:01.093566 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3250/6461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:00 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:01.695597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:01.696164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:01.712329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:01.714702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:01.717278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:01.719664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:01.722708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:01.724064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:02.115722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:02.117104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:02.128677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:02.131713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:02.132773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:02.135429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:02.136200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:02.140074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:02.140539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:02.174974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:02.180639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:02.197964 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04ca2c4e-575c-4de9-996f-d6aaac01f9f6 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.501448 Aug 23 11:10:02.205143 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3212/6462] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:01 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:10:02.616912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:02.630050 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6aa81435-1d4c-4625-9e84-654c1504a4cd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.517941 Aug 23 11:10:02.630670 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3251/6463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:02 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:03.228458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:03.230228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:03.245615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:03.246350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:03.252043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:03.253180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:03.253840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:03.258279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:03.651917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:03.652515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:03.671878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:03.673457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:03.674401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:03.675606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:03.676236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:03.677286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:03.697783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:03.735026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:03.735026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:03.736427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61f807c3-0587-4d70-ad61-258dacdd0c7d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.505141 Aug 23 11:10:03.737490 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3213/6464] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:03 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:04.243730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:04.258093 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f858bf16-becc-4b89-9139-733d055e5e02 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.609799 Aug 23 11:10:04.273767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3252/6465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:03 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:04.763265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:04.764257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:04.834176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:04.834857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:04.835320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:04.836081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:04.853798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:04.854628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:04.882146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:05.284823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:05.286150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:05.293994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:05.294494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:05.295198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:05.296099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:05.296818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:05.297409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:05.418816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:05.440138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:05.452999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:05.455723 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf4e8e80-525b-4e8b-9825-af3deb2de0eb tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.699262 Aug 23 11:10:05.457870 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3214/6466] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:04 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:05.597880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:05.610130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-24ec9b8c-f582-4bb4-a388-5426f2f57457 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.331892 Aug 23 11:10:05.611048 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3253/6467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:05 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:06.484971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:06.486409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:06.502024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:06.502850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:06.503729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:06.506499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:06.507217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:06.507765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:06.631691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:06.633559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:06.646653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:06.650509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:06.651291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:06.654198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:06.655098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:06.655794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:06.682878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:07.052502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:07.063521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:07.077449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:07.078764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a40626e-3f32-4cc0-abae-cbd4d95b3a47 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.600223 Aug 23 11:10:07.079484 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3215/6468] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:06 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:07.084082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cdaeaba6-8e99-47d7-9535-06f5a362ba87 req-fbcd4810-2551-4c80-86c2-0f6919996349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d217f215-b58f-466d-9b0f-9950de9a1015", "name": "network-vif-plugged", "status": "completed", "tag": "6d483fd6-6512-46e4-94ce-3ede9270e7ce"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:07.111662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cdaeaba6-8e99-47d7-9535-06f5a362ba87 req-fbcd4810-2551-4c80-86c2-0f6919996349 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:07.113602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cdaeaba6-8e99-47d7-9535-06f5a362ba87 req-fbcd4810-2551-4c80-86c2-0f6919996349 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:07.113602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cdaeaba6-8e99-47d7-9535-06f5a362ba87 req-fbcd4810-2551-4c80-86c2-0f6919996349 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:07.129140 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cdaeaba6-8e99-47d7-9535-06f5a362ba87 req-fbcd4810-2551-4c80-86c2-0f6919996349 service nova] Creating event network-vif-plugged:6d483fd6-6512-46e4-94ce-3ede9270e7ce for instance d217f215-b58f-466d-9b0f-9950de9a1015 on n-h1-847009-13 Aug 23 11:10:07.134836 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cdaeaba6-8e99-47d7-9535-06f5a362ba87 req-fbcd4810-2551-4c80-86c2-0f6919996349 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054093 Aug 23 11:10:07.136210 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3216/6469] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:07.209456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:07.218261 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ad9f2b7-5e3e-4ac3-8e5e-6bb95188d779 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.590431 Aug 23 11:10:07.233111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3254/6470] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:06 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:08.109492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:08.110428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:08.125756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:08.126432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:08.127856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:08.130386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:08.132824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:08.135684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:08.248833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:08.250739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:08.269158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:08.270057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:08.271396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:08.272356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:08.273048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:08.273670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:08.439127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:08.454113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:08.455875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:08.464579 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-344aa1f7-7baf-441e-ad8d-197f8f483a02 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.361381 Aug 23 11:10:08.465984 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3217/6471] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:08 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:08.782637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:08.804919 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1cf663c1-926d-4d0c-84b5-099ae1698d61 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1468 microversion: 2.1 time: 0.560933 Aug 23 11:10:08.812833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3255/6472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:08 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1468 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:09.492107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:09.492916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:09.515203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:09.520235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:09.527065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:09.527994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:09.529008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:09.529550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:09.826003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:09.827409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:09.842891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:09.843391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:09.850299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:09.851082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:09.851560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:09.851995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:09.952543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:09.992885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:09.994726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:09.996111 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24969207-2c90-4635-a4bd-7639f5747116 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.508602 Aug 23 11:10:10.001802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3218/6473] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:09 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:10.341284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:10.353874 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6dab037-fa5f-46d3-a5f2-220ef20353fd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1640 microversion: 2.1 time: 0.531682 Aug 23 11:10:10.355000 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3256/6474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:09 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1640 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:10.386569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:10.388012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:10.399726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:10.400510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:10.401241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:10.402264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:10.404938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:10.405665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:11.029774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:11.031112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:11.053054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:11.054408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:11.058499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:11.060055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:11.062843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:11.063527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:11.092051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:11.114516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67db647d-ab9b-43b8-86c9-3aa7613bad7b tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1640 microversion: 2.1 time: 0.731637 Aug 23 11:10:11.118407 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3219/6475] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:10 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1640 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:11.147458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:11.148350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:11.159789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:11.160370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:11.164690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:11.166939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:11.167878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:11.168868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:11.494472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:11.506856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:11.508671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:11.510104 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-073f5466-e781-40ee-90fd-abe61fbac6df tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.485370 Aug 23 11:10:11.512880 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3257/6476] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:11 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:10:11.520844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-be19d029-aaad-4ef3-9a29-efc748150ed3 req-f6fcced4-1ff9-4e9d-bb62-ef3fd736fee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "name": "network-vif-plugged", "status": "completed", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:11.560770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-be19d029-aaad-4ef3-9a29-efc748150ed3 req-f6fcced4-1ff9-4e9d-bb62-ef3fd736fee4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:11.561556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-be19d029-aaad-4ef3-9a29-efc748150ed3 req-f6fcced4-1ff9-4e9d-bb62-ef3fd736fee4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:11.562327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-be19d029-aaad-4ef3-9a29-efc748150ed3 req-f6fcced4-1ff9-4e9d-bb62-ef3fd736fee4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:11.596242 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-be19d029-aaad-4ef3-9a29-efc748150ed3 req-f6fcced4-1ff9-4e9d-bb62-ef3fd736fee4 service nova] Creating event network-vif-plugged:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h1-847009-13 Aug 23 11:10:11.604550 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-be19d029-aaad-4ef3-9a29-efc748150ed3 req-f6fcced4-1ff9-4e9d-bb62-ef3fd736fee4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089259 Aug 23 11:10:11.614638 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3258/6477] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:12.541059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:12.543177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:12.573899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:12.576995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:12.578787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:12.579582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:12.582094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:12.583556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:12.914684 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-974a99c2-f336-431e-8ef9-738eb10a0284 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1793 microversion: 2.1 time: 1.774745 Aug 23 11:10:12.919717 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3220/6478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:11 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1793 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:13.275047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:13.306319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:13.313253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:13.315686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae354956-6230-49b3-accb-9bac8697d45a tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 0.782486 Aug 23 11:10:13.317564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3259/6479] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:12 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:14.343410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:14.344724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:14.362675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:14.363425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:14.364725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:14.367438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:14.368115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:14.370329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:14.709268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:14.710110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:14.728048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:14.731882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:14.753041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:14.755142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:14.758514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:14.761308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:15.495324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e414822e-85db-4df2-afde-d40c9bf0dbd6 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1837 microversion: 2.1 time: 0.789837 Aug 23 11:10:15.497789 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3260/6480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:14 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1837 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:16.122795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:16.139252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:16.141741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:16.150998 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61c5113b-b421-4701-8050-981f3090a35f tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1729 microversion: 2.20 time: 1.807019 Aug 23 11:10:16.164880 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3221/6481] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:14 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1729 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:16.797640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:16.798128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:16.811839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:16.812292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:16.813564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:16.814432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:16.816919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:16.817463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:17.049323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lazy-loading 'services' on Instance uuid 48bfde77-3820-4a7f-8409-cd624d68cddb {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:10:17.192608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:17.195258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:17.211810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:17.214443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:17.216283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:17.223204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:17.223917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:17.224622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:17.257811 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b7aeda1-32c3-4c61-b4d4-a6002350b132 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-volume_attachments/54bc6bba-3dc6-4202-98f9-9ae44159c471" status: 202 len: 0 microversion: 2.1 time: 0.464068 Aug 23 11:10:17.264541 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3261/6482] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:10:16 2022] DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-volume_attachments/54bc6bba-3dc6-4202-98f9-9ae44159c471 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:10:17.487456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0733156c-521d-485f-8a38-6095de1ffc3e req-57b231cb-279d-4240-9f58-c6f0199ae4fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d217f215-b58f-466d-9b0f-9950de9a1015", "tag": "6d483fd6-6512-46e4-94ce-3ede9270e7ce"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:17.513724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0733156c-521d-485f-8a38-6095de1ffc3e req-57b231cb-279d-4240-9f58-c6f0199ae4fa service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:17.526455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0733156c-521d-485f-8a38-6095de1ffc3e req-57b231cb-279d-4240-9f58-c6f0199ae4fa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:17.527391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0733156c-521d-485f-8a38-6095de1ffc3e req-57b231cb-279d-4240-9f58-c6f0199ae4fa service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:17.565863 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0733156c-521d-485f-8a38-6095de1ffc3e req-57b231cb-279d-4240-9f58-c6f0199ae4fa service nova] Creating event network-changed:6d483fd6-6512-46e4-94ce-3ede9270e7ce for instance d217f215-b58f-466d-9b0f-9950de9a1015 on n-h1-847009-13 Aug 23 11:10:17.571958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0733156c-521d-485f-8a38-6095de1ffc3e req-57b231cb-279d-4240-9f58-c6f0199ae4fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089963 Aug 23 11:10:17.573258 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3262/6483] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:17.635140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:17.644227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:17.645796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:17.647002 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bcc44104-194e-4a00-a122-9d2c024acdac tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1716 microversion: 2.20 time: 0.459582 Aug 23 11:10:17.647575 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3222/6484] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:10:17 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1716 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:10:20.097195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:20.098157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:20.109882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=44 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:20.129568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:20.130211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:20.130556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5524b685-073f-45df-a790-7f8838b49dc2 req-752305be-b4d0-46f0-ba7d-c8cff3cc4815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:20.133361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:20.137707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:20.138632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:20.142182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:20.158015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5524b685-073f-45df-a790-7f8838b49dc2 req-752305be-b4d0-46f0-ba7d-c8cff3cc4815 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:20.158604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5524b685-073f-45df-a790-7f8838b49dc2 req-752305be-b4d0-46f0-ba7d-c8cff3cc4815 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:20.160270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5524b685-073f-45df-a790-7f8838b49dc2 req-752305be-b4d0-46f0-ba7d-c8cff3cc4815 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:20.175973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:10:20.204392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5524b685-073f-45df-a790-7f8838b49dc2 req-752305be-b4d0-46f0-ba7d-c8cff3cc4815 service nova] Creating event network-changed:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:10:20.225427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5524b685-073f-45df-a790-7f8838b49dc2 req-752305be-b4d0-46f0-ba7d-c8cff3cc4815 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097268 Aug 23 11:10:20.232823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3223/6485] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:20.306965 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2979ac05-53a3-40cc-abab-1e9f1a371f7d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 204 len: 0 microversion: 2.1 time: 0.214074 Aug 23 11:10:20.308349 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3263/6486] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:10:20 2022] DELETE /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:10:20.317580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:20.318300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:20.325514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:20.340991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:20.341903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:20.342864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:20.345842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:20.346488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:21.483827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:21.497471 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1da6193-3e50-4a47-9143-5c106edf47e0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1690 microversion: 2.1 time: 1.181815 Aug 23 11:10:21.502147 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3224/6487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:20 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1690 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:22.523733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:22.524497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:22.546341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:22.546843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:22.547286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:22.548009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:22.548469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:22.551892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:23.833560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:23.843436 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3aa487b6-0dc3-4b9d-b078-0d3009918144 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1690 microversion: 2.1 time: 1.325119 Aug 23 11:10:23.844383 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3264/6488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:22 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1690 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:24.254681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c4075b82-f4ea-4125-98ab-3a7cf3c8085f req-e8d78866-43da-4f2f-9a11-83c055982f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5193c2ff-ff52-47ed-b810-43e8155000bb", "name": "network-vif-deleted", "tag": "be35ebd7-5fd5-459f-90df-a59b5675fb92"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:24.268468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=42 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:24.271970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4075b82-f4ea-4125-98ab-3a7cf3c8085f req-e8d78866-43da-4f2f-9a11-83c055982f67 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:24.272476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4075b82-f4ea-4125-98ab-3a7cf3c8085f req-e8d78866-43da-4f2f-9a11-83c055982f67 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:24.272954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c4075b82-f4ea-4125-98ab-3a7cf3c8085f req-e8d78866-43da-4f2f-9a11-83c055982f67 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:24.309586 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c4075b82-f4ea-4125-98ab-3a7cf3c8085f req-e8d78866-43da-4f2f-9a11-83c055982f67 service nova] Creating event network-vif-deleted:be35ebd7-5fd5-459f-90df-a59b5675fb92 for instance 5193c2ff-ff52-47ed-b810-43e8155000bb on n-h1-847009-13 Aug 23 11:10:24.319971 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c4075b82-f4ea-4125-98ab-3a7cf3c8085f req-e8d78866-43da-4f2f-9a11-83c055982f67 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071265 Aug 23 11:10:24.326400 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3225/6489] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:24.877247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:24.878740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:24.902241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:24.905088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:24.907031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:24.908058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:24.911436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:24.912099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:24.988928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:24.991218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:24.991732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:24.992715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lazy-loading 'fault' on Instance uuid 5193c2ff-ff52-47ed-b810-43e8155000bb {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:10:25.071717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:25.084191 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87dc3b68-dedf-4e3d-be0b-8fec7af588f2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1509 microversion: 2.1 time: 0.216594 Aug 23 11:10:25.099066 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3265/6490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:24 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:26.110689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:26.112121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:26.145863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:26.147820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:26.148636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:26.151405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:26.154822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:26.157578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:26.214657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:26.216550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:26.217207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:26.217852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lazy-loading 'fault' on Instance uuid 5193c2ff-ff52-47ed-b810-43e8155000bb {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:10:26.334828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:26.349267 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b833aedd-73d0-4698-8b5b-10df023e29a9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 200 len: 1509 microversion: 2.1 time: 0.241708 Aug 23 11:10:26.352166 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3226/6491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:26 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:27.348926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10f8f4cc-b3dc-48ec-9631-37cbb0b2e662 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1752351593", "availability_zone": "foo_zone"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:27.372633 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:27.372633 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:27.374296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.aggregate [None req-10f8f4cc-b3dc-48ec-9631-37cbb0b2e662 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Generated uuid 8c20c1e2-1026-49d0-aace-d2e00b3609c3 for aggregate {{(pid=128859) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 11:10:27.376597 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10f8f4cc-b3dc-48ec-9631-37cbb0b2e662 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] [a1ae4342-906e-4f42-92f6-eb0a766361ed] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:10:27.381361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:27.382966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 5193c2ff-ff52-47ed-b810-43e8155000bb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:27.413769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:27.418476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:27.419354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:27.420287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:27.420962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:27.421564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:27.453024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] HTTP exception thrown: Instance 5193c2ff-ff52-47ed-b810-43e8155000bb could not be found. Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Request method failure captured: Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb HTTP/1.1 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPS6dqOS_zEv0sC6ZMxneqd8cjvhwM_ReN9ia834ny4t3AfM938V8rdG3LlNSFFPyt-L_78meJbOo2HvxrYN5BnMC7jtt4TymfaTmp0u2dCADn5Z54wnHlalMz17UWbj_or8mR62OencPjC8qMxXls3QLLfOMAMr8QkN-pelrnetpk Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aadc538b532d48b780b04b2ca23e4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}] Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: b40863219f8c498881c9ee5b5ce5a8c5 Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 5193c2ff-ff52-47ed-b810-43e8155000bb could not be found. Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '5193c2ff-ff52-47ed-b810-43e8155000bb'} Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5193c2ff-ff52-47ed-b810-43e8155000bb could not be found. Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5193c2ff-ff52-47ed-b810-43e8155000bb could not be found. Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:10:27.461747 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5193c2ff-ff52-47ed-b810-43e8155000bb could not be found. Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Returning 404 to user: Instance 5193c2ff-ff52-47ed-b810-43e8155000bb could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:10:27.469656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-135a5916-66c1-42a2-8f0c-fd646be855b0 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb" status: 404 len: 111 microversion: 2.1 time: 0.095081 Aug 23 11:10:27.470952 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3227/6492] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:27 2022] GET /compute/v2.1/servers/5193c2ff-ff52-47ed-b810-43e8155000bb => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:10:27.517748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f61b004-d51c-4f57-a454-b6b9c08e7688 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:27.530733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f61b004-d51c-4f57-a454-b6b9c08e7688 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:27.531410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f61b004-d51c-4f57-a454-b6b9c08e7688 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:27.532023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f61b004-d51c-4f57-a454-b6b9c08e7688 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:27.582963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f61b004-d51c-4f57-a454-b6b9c08e7688 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 11:10:27.732706 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f61b004-d51c-4f57-a454-b6b9c08e7688 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action" status: 202 len: 0 microversion: 2.1 time: 0.203888 Aug 23 11:10:27.736264 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3228/6493] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:10:27 2022] POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:10:27.761905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:27.764721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:27.780116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:27.780889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:27.782639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:27.784101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:27.785083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:27.787258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:28.195081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:28.217344 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79dbcd45-2637-4e6e-a730-1d07dade9edc tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1675 microversion: 2.1 time: 0.476544 Aug 23 11:10:28.222489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3229/6494] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:27 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1675 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:28.387964 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-10f8f4cc-b3dc-48ec-9631-37cbb0b2e662 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] [a1ae4342-906e-4f42-92f6-eb0a766361ed] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51256. Aug 23 11:10:28.445391 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10f8f4cc-b3dc-48ec-9631-37cbb0b2e662 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 1.353933 Aug 23 11:10:28.452380 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3266/6495] 10.222.0.78 () {60 vars in 1164 bytes} [Tue Aug 23 11:10:27 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:28.459557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e1ff5f7d-208d-4d84-a2ba-d7fccfc87d37 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:28.463106 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:28.463106 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:10:28.516291 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e1ff5f7d-208d-4d84-a2ba-d7fccfc87d37 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.060911 Aug 23 11:10:28.516977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3230/6496] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 11:10:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:28.539629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:28.545796 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:28.545796 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:28.552404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:28.552553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:28.554547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:28.555871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:28.556344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:28.556817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:28.634813 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9de1687d-3571-4e70-af5f-e89b7ffc3c50 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.109751 Aug 23 11:10:28.642115 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3267/6497] 10.222.0.78 () {58 vars in 1176 bytes} [Tue Aug 23 11:10:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:28.653887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cecb5cf-487d-4848-b5cf-e6e0261671bf tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:28.666325 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:28.666325 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:10:28.702726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cecb5cf-487d-4848-b5cf-e6e0261671bf tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.052337 Aug 23 11:10:28.703352 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3231/6498] 10.222.0.78 () {58 vars in 1143 bytes} [Tue Aug 23 11:10:28 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:28.714608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-72426960-5d56-42a2-8153-d35f24b40f76 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:28.718903 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:28.718903 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:28.738607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72426960-5d56-42a2-8153-d35f24b40f76 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:28.739115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72426960-5d56-42a2-8153-d35f24b40f76 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:28.739570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72426960-5d56-42a2-8153-d35f24b40f76 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:29.195895 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-72426960-5d56-42a2-8153-d35f24b40f76 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.485034 Aug 23 11:10:29.208848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a72c1821-c07e-440d-9e0a-7d0bc6daf0b5 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:29.209032 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3268/6499] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 11:10:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:29.209682 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:29.209682 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:10:29.229191 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a72c1821-c07e-440d-9e0a-7d0bc6daf0b5 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.023992 Aug 23 11:10:29.229805 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3232/6500] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 11:10:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:29.265974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85f31fd0-b3ad-4f80-8f4e-97b9f0570bae tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1320029233", "availability_zone": "foo_zone"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:29.270704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:29.273838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:29.333280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:29.334896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:29.340648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:29.346163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:29.346936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:29.355767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:29.516658 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:29.516658 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:29.618451 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85f31fd0-b3ad-4f80-8f4e-97b9f0570bae tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.362578 Aug 23 11:10:29.619326 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3269/6501] 10.222.0.78 () {60 vars in 1173 bytes} [Tue Aug 23 11:10:29 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:29.642982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-516bc71a-12a2-4ec1-ad5a-1547c98c96f6 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:29.669052 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:29.669052 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:29.808146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-516bc71a-12a2-4ec1-ad5a-1547c98c96f6 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.168915 Aug 23 11:10:29.809992 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3270/6502] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 11:10:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:29.822765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b6f9807-9a40-4efa-a902-835efc871209 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:29.823594 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:29.823594 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:29.861412 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b6f9807-9a40-4efa-a902-835efc871209 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.044205 Aug 23 11:10:29.862848 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3271/6503] 10.222.0.78 () {58 vars in 1152 bytes} [Tue Aug 23 11:10:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:29.875385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-05de5d4c-9472-46f3-aeca-baf588225f54 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-847009-13"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:29.882989 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:29.882989 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:10:29.913701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05de5d4c-9472-46f3-aeca-baf588225f54 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:29.914886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05de5d4c-9472-46f3-aeca-baf588225f54 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:29.915531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-05de5d4c-9472-46f3-aeca-baf588225f54 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:30.266353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:30.280404 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2d9c2795-c2f7-4668-9760-ca8dfadf1b31 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1679 microversion: 2.1 time: 1.019290 Aug 23 11:10:30.291481 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3233/6504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:29 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1679 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:30.316157 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-05de5d4c-9472-46f3-aeca-baf588225f54 tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.446800 Aug 23 11:10:30.318183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3272/6505] 10.222.0.78 () {60 vars in 1194 bytes} [Tue Aug 23 11:10:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:30.333840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9e1140c7-36cd-43e9-a781-8646c3e2690c tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:30.334717 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:10:30.334717 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:10:30.384296 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9e1140c7-36cd-43e9-a781-8646c3e2690c tempest-TestAggregatesBasicOps-179709862 tempest-TestAggregatesBasicOps-179709862-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.058364 Aug 23 11:10:30.394427 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3234/6506] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 11:10:30 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 11:10:31.326689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:31.327945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:31.345606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:31.347012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:31.347636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:31.348804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:31.349439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:31.351568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:31.788258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:31.834972 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7893fd0-db65-4578-b1d6-dc1ec5ab4c91 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1675 microversion: 2.1 time: 0.518772 Aug 23 11:10:31.835941 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3273/6507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:31 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1675 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:32.856619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:32.857459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:32.873577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:32.874224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:32.874947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:32.875758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:32.876468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:32.877175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:33.214570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:33.227845 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0bae3fa0-6b9a-412a-b172-a3dd17e6e67a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1675 microversion: 2.1 time: 0.375223 Aug 23 11:10:33.229351 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3235/6508] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:32 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1675 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:34.249880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:34.250844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:34.264300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:34.265318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:34.268380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:34.269465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:34.270229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:34.271603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:34.556054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:34.560133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:34.572659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfdf11fe-1bf2-4480-8e94-5d2fc3bb6125 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1675 microversion: 2.1 time: 0.327025 Aug 23 11:10:34.576213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3274/6509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:34 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:35.605440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:35.606105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:35.617563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:35.618064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:35.618510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:35.619229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:35.619691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:35.620122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:35.643422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:36.102105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9330a8f-4c07-489e-8853-031c6d541d32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '.version_select at 0x7fdc9c1100d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:36.161792 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9330a8f-4c07-489e-8853-031c6d541d32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996025219" status: 202 len: 0 microversion: 2.1 time: 0.063659 Aug 23 11:10:36.162525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3275/6510] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Aug 23 11:10:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996025219 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:10:36.234372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b201c392-37a4-40af-b989-66ba6bcd30c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: .version_select at 0x7fdc8f5b00d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-890553049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnx4hxfm1D2Cy83s1EX6uAPmIWaPcjdJWaVPUPt555mHN40JYjg/hdbXuh/tcSD2Z9BXK2m0qwLcMJG0L4Cm6mOXutI4Y297OrLAmFNd7MXBWpfkDgcgWix0ZT+gH9pNw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:36.321094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b201c392-37a4-40af-b989-66ba6bcd30c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:10:36.338097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b201c392-37a4-40af-b989-66ba6bcd30c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:10:36.397754 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b201c392-37a4-40af-b989-66ba6bcd30c4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.187450 Aug 23 11:10:36.407418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3276/6511] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:10:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:10:36.750687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:36.763702 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-700fc022-5a04-4ccf-926a-b4ee2c277c5a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1675 microversion: 2.1 time: 1.168242 Aug 23 11:10:36.764307 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3236/6512] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:35 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1675 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:37.790106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:37.790907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:37.804776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:37.806662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:37.807117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:37.811996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:37.813043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:37.813752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:38.315384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:38.326437 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c28b165-1a3b-4594-a074-6ef01147b11e tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1675 microversion: 2.1 time: 0.542975 Aug 23 11:10:38.328377 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3277/6513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:37 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1675 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:39.349512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:39.350763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:39.360616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:39.364886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:39.365659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:39.366624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:39.369645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:39.372897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:39.632961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:39.641965 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de9cf24f-bd63-4ed8-90d7-2730a45088f9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1652 microversion: 2.1 time: 0.296257 Aug 23 11:10:39.644784 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3237/6514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:39 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1652 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:39.666220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2fdb4d35-c15b-4b2b-ab90-d389f642af52 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:39.670700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:39.686353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fdb4d35-c15b-4b2b-ab90-d389f642af52 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:39.686876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fdb4d35-c15b-4b2b-ab90-d389f642af52 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:39.687332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2fdb4d35-c15b-4b2b-ab90-d389f642af52 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:39.753151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2fdb4d35-c15b-4b2b-ab90-d389f642af52 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Going to try to start instance {{(pid=128859) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 11:10:39.863767 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2fdb4d35-c15b-4b2b-ab90-d389f642af52 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action" status: 202 len: 0 microversion: 2.1 time: 0.201144 Aug 23 11:10:39.869006 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3278/6515] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:10:39 2022] POST /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:10:39.874309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:39.874933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:39.891058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:39.891769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:39.892396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:39.893312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:39.893931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:39.894520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:40.349890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:40.382498 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7d259ad-acfe-4393-9174-9db5378fd5a9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1661 microversion: 2.1 time: 0.512011 Aug 23 11:10:40.383343 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3238/6516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:39 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1661 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:41.407157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:41.407955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:41.421668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:41.423702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:41.424298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:41.426220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:41.427159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:41.428298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:41.932975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:41.973769 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9abf8568-d2b3-4894-9fc4-a893e078f969 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1661 microversion: 2.1 time: 0.571039 Aug 23 11:10:41.987852 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3279/6517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:41 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1661 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:42.995434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:42.996662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:43.013478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:43.013676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:43.014051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:43.014785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:43.015249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:43.015687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:43.607614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:43.623352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fee3804f-528e-4c4d-82fe-7fad11da30f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1665 microversion: 2.1 time: 0.631595 Aug 23 11:10:43.627367 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3239/6518] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:42 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1665 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:48.319759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1277047227", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "3404da97-0139-49fb-b157-ddfab6b14e50"}], "key_name": "tempest-TestNetworkAdvancedServerOps-890553049", "security_groups": [{"name": "tempest-secgroup-smoke-363717115"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:48.334209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:48.724572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] validate_networks() for [('3404da97-0139-49fb-b157-ddfab6b14e50', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:10:49.851705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:10:49.852314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:10:49.852672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:10:49.853122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:10:49.853988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:10:49.874590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:49.876101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:49.877878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:49.878850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:49.880421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:49.885302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:49.947531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:10:49.957619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:10:49.960365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:50.003396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:10:50.005824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:10:50.183024 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e871561c-9195-4d7d-8849-2b4ada6b6f6b tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.866966 Aug 23 11:10:50.190871 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3280/6519] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:10:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:10:50.195571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4297ff86-7f40-4e3e-a10d-5d398861e2b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:50.196193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4297ff86-7f40-4e3e-a10d-5d398861e2b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:50.434488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4297ff86-7f40-4e3e-a10d-5d398861e2b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:50.458025 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4297ff86-7f40-4e3e-a10d-5d398861e2b8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1266 microversion: 2.1 time: 0.260685 Aug 23 11:10:50.459284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3240/6520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:50 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:10:51.482153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:51.482765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:51.512828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:51.514342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:51.528074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:51.531903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:51.533146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:51.538933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:51.777830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:51.787382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd6ad907-4b65-43c0-897c-bb0bb53b7c10 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1262 microversion: 2.1 time: 0.311478 Aug 23 11:10:51.799577 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3281/6521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:51 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1262 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:52.823615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:52.824943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:52.844339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:52.845414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:52.845975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:52.847105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:52.848294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:52.848843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:53.067985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:53.104170 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea0ec872-d037-4834-aeb2-3f702dea5eed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1324 microversion: 2.1 time: 0.284152 Aug 23 11:10:53.106289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3241/6522] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:52 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:54.127376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:54.128683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:54.140328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:54.144605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:54.148440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:54.149665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:54.150508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:54.151141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:54.315244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:54.326542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-459bff0c-f34a-4e90-b737-9099ce315f01 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1324 microversion: 2.1 time: 0.203375 Aug 23 11:10:54.340127 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3282/6523] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:54 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1324 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:55.347480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:55.348113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:55.352184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:10:55.361827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:55.362338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:55.373478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:55.374495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:55.375151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:55.376004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:55.645608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:55.663559 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e87d944-b0ad-4791-8169-1a6f4f12df2d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.319958 Aug 23 11:10:55.665543 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3242/6524] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:55 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:56.192325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-32816421-974e-461a-a061-fdcad838d5a2 req-3f4790c8-2e4b-4579-9bf4-a2e0493f1ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:10:56.223867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-32816421-974e-461a-a061-fdcad838d5a2 req-3f4790c8-2e4b-4579-9bf4-a2e0493f1ec7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:56.225290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-32816421-974e-461a-a061-fdcad838d5a2 req-3f4790c8-2e4b-4579-9bf4-a2e0493f1ec7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:56.225640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-32816421-974e-461a-a061-fdcad838d5a2 req-3f4790c8-2e4b-4579-9bf4-a2e0493f1ec7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:56.264254 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-32816421-974e-461a-a061-fdcad838d5a2 req-3f4790c8-2e4b-4579-9bf4-a2e0493f1ec7 service nova] Creating event network-changed:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h2-847009-13 Aug 23 11:10:56.287485 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-32816421-974e-461a-a061-fdcad838d5a2 req-3f4790c8-2e4b-4579-9bf4-a2e0493f1ec7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095079 Aug 23 11:10:56.292855 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3283/6525] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:10:56.696337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:56.697243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:56.707647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:56.708545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:56.709171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:56.710059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:56.710770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:56.711568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:57.289880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:57.305935 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1a677fcc-5295-4181-a268-8551d7719fed tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.624292 Aug 23 11:10:57.306548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3243/6526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:56 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:58.330362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:58.331090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:58.349326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:58.349834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:58.352781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:58.356531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:58.357103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:58.357559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:58.632172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:10:58.649031 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e186c913-29ca-4893-9715-40077167baef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.325392 Aug 23 11:10:58.653838 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3284/6527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:58 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:10:59.675722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:10:59.676367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:10:59.686338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:59.688166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:59.688832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:10:59.689878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:10:59.691256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:10:59.693213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:00.164956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:00.176994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4893f83-eeae-4a65-b5f2-835472ed0f9d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.507451 Aug 23 11:11:00.193062 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3244/6528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:10:59 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:01.200715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:01.201560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:01.222199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:01.223161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:01.225725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:01.226472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:01.227100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:01.230879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:01.231790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:01.232404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:01.595357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:01.606469 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0dde8f17-3c92-4d21-b5ed-ac4c1ae0d325 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.411062 Aug 23 11:11:01.607391 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3285/6529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:01 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:02.628102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:02.628930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:02.638234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:02.644814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:02.648688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:02.649518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:02.650398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:02.652377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:02.653308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:03.164835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:03.203726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-331d7b96-35ca-4750-9788-82b1fd444639 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.579571 Aug 23 11:11:03.229283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3245/6530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:02 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:04.094995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-06599a3f-57fd-40c6-8e4b-c04062a069be req-7c5c398b-ebaa-4652-92fb-3d84f110b6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "name": "network-vif-plugged", "status": "completed", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:04.134055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-06599a3f-57fd-40c6-8e4b-c04062a069be req-7c5c398b-ebaa-4652-92fb-3d84f110b6e7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:04.134894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-06599a3f-57fd-40c6-8e4b-c04062a069be req-7c5c398b-ebaa-4652-92fb-3d84f110b6e7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:04.136295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-06599a3f-57fd-40c6-8e4b-c04062a069be req-7c5c398b-ebaa-4652-92fb-3d84f110b6e7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:04.160692 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-06599a3f-57fd-40c6-8e4b-c04062a069be req-7c5c398b-ebaa-4652-92fb-3d84f110b6e7 service nova] Creating event network-vif-plugged:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h2-847009-13 Aug 23 11:11:04.168257 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-06599a3f-57fd-40c6-8e4b-c04062a069be req-7c5c398b-ebaa-4652-92fb-3d84f110b6e7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078819 Aug 23 11:11:04.169984 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3286/6531] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:04.254887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:04.255857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:04.268712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:04.269404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:04.271810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:04.272857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:04.273594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:04.274283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:04.854088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:04.869914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25186b2d-45b9-4779-b6d5-871d82c9aa1e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.617107 Aug 23 11:11:04.872654 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3246/6532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:04 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:05.899400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:05.900335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:05.913283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:05.918761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:05.919541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:05.920422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:05.921052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:05.921603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:06.363343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:06.367174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:06.395934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e33b8460-511b-4b4e-89cb-85d0ab49650d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1391 microversion: 2.1 time: 0.501292 Aug 23 11:11:06.399831 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3287/6533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:05 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:07.451966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:07.452590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:07.468411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:07.468941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:07.469391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:07.470102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:07.470562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:07.470991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:07.489210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=60 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:07.823265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:07.842795 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-626e741b-329e-4b86-8f1b-3cfc80adcf6a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1562 microversion: 2.1 time: 0.394232 Aug 23 11:11:07.857770 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3247/6534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:07 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1562 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:07.868190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:07.869106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:07.878870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:07.879690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:07.880186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:07.881130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:07.881720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:07.882310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:08.181486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:08.192005 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4a4925c-fed3-4476-b13f-0cda7b0ea243 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1562 microversion: 2.1 time: 0.329231 Aug 23 11:11:08.196775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3288/6535] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:07 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1562 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:12.048182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:12.049921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:12.095247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:12.095957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:12.099103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:12.101357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:12.102053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:12.102735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:12.123740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-18d2b201-ec7f-46da-bf44-f08cadaa8047 req-7637bf97-7b61-43bb-8699-bad89ca2ede1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:12.148248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-18d2b201-ec7f-46da-bf44-f08cadaa8047 req-7637bf97-7b61-43bb-8699-bad89ca2ede1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:12.152795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-18d2b201-ec7f-46da-bf44-f08cadaa8047 req-7637bf97-7b61-43bb-8699-bad89ca2ede1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:12.153195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-18d2b201-ec7f-46da-bf44-f08cadaa8047 req-7637bf97-7b61-43bb-8699-bad89ca2ede1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:12.199554 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-18d2b201-ec7f-46da-bf44-f08cadaa8047 req-7637bf97-7b61-43bb-8699-bad89ca2ede1 service nova] Creating event network-changed:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h2-847009-13 Aug 23 11:11:12.226042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-18d2b201-ec7f-46da-bf44-f08cadaa8047 req-7637bf97-7b61-43bb-8699-bad89ca2ede1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104039 Aug 23 11:11:12.231058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3289/6536] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:13.950707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:13.988544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-038d0713-c546-437e-b7cf-e09fa8dd6fc1 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1562 microversion: 2.1 time: 1.944860 Aug 23 11:11:14.011629 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3248/6537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:12 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1562 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:18.353580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:18.354504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:18.375479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:18.383977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:18.384912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:18.386964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:18.390297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:18.394038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:18.625313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lazy-loading 'services' on Instance uuid 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:11:18.809387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d629b35-3f69-4695-8f2e-7e0e09362b9a tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36/os-volume_attachments/76498970-412f-4ae8-817a-dc38a15f1d47" status: 202 len: 0 microversion: 2.1 time: 0.455774 Aug 23 11:11:18.812231 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3290/6538] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:11:18 2022] DELETE /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36/os-volume_attachments/76498970-412f-4ae8-817a-dc38a15f1d47 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:11:21.722374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:21.726022 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:11:21.726022 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:11:21.728867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:21.732067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:21.733803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:21.736381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:21.737322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:21.739259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:21.785392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a19bf1f8-994a-4af6-bb3f-b75ccc06fe9c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.235262 Aug 23 11:11:21.786180 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3249/6539] 10.222.0.78 () {58 vars in 1185 bytes} [Tue Aug 23 11:11:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:22.005426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2019677141", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "availability_zone": "nova:n-h2-847009-13", "networks": [{"uuid": "ddb1011a-c962-40db-9221-af26c1b6d422"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:22.017839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:22.117727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] validate_networks() for [('ddb1011a-c962-40db-9221-af26c1b6d422', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:11:22.931736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:11:22.933078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:11:22.934890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:11:22.936484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:11:22.937211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:11:22.987114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:22.987883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:22.988557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:22.989713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:22.990417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:22.991100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:23.023421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Getting quotas for project 3facc0728c2441b397bcbed1f1b0c28d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:11:23.033191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Getting quotas for user 1e427e96a99846f5afba70eb7f0849e0 and project 3facc0728c2441b397bcbed1f1b0c28d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:11:23.058988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:11:23.062536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:11:23.125099 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ab1c363-7517-4d90-837a-71c9afa693ad tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125293 Aug 23 11:11:23.126439 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3291/6540] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:11:23.137013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2eed020b-f0aa-4cbe-afb0-c565229c3336 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:23.137635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2eed020b-f0aa-4cbe-afb0-c565229c3336 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:23.237795 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2eed020b-f0aa-4cbe-afb0-c565229c3336 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1329 microversion: 2.1 time: 0.104955 Aug 23 11:11:23.238671 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3250/6541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:23 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1329 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:24.259402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:24.260020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:24.286743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:24.287244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:24.296511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:24.297301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:24.297837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:24.301290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:24.466760 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e374963a-baf7-4eba-81bd-1f08f5ad5fcd tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1418 microversion: 2.1 time: 0.212021 Aug 23 11:11:24.468782 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3292/6542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:24 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1418 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:25.489647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:25.490436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:25.494076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=22 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:25.504892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:25.514745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:25.515363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:25.517963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:25.522437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:25.526245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:25.805618 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33f6a07e-061b-4c74-8598-b647836a3e5c tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1424 microversion: 2.1 time: 0.319550 Aug 23 11:11:25.806540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3251/6543] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:25 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1424 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:26.698376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:26.699054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:26.708533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:26.709167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:26.709921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:26.711055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:26.712532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:26.714434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:26.830461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:11:26.831227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:26.832524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:26.856306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:26.863292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:26.864110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:26.867086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:26.867836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:26.868513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:27.020215 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e84a137b-4be4-4d88-8ec7-ae4c4b9518c6 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 204 len: 0 microversion: 2.1 time: 0.330477 Aug 23 11:11:27.023067 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3293/6544] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:11:26 2022] DELETE /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:11:27.032193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:27.033232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:27.040155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:27.040944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:27.042406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:27.043569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:27.044246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:27.044875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:27.272973 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f666cc2-47fa-43e0-bac7-04ad12db9933 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.446945 Aug 23 11:11:27.273910 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3252/6545] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:26 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:27.339803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:27.367129 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4adb2db2-0753-4ea5-beac-a4298ce00c40 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1469 microversion: 2.1 time: 0.339476 Aug 23 11:11:27.371254 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3294/6546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:27 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:27.606313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7db8b146-29a6-4329-abe3-b324debe04f5 req-289b823b-ef11-4aad-9bbf-ba86cf569158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4841b11-b9fd-4c7d-b9c5-468f9658456b", "tag": "86d7ccfc-a5ec-4fef-8711-26095efe742d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:27.624465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7db8b146-29a6-4329-abe3-b324debe04f5 req-289b823b-ef11-4aad-9bbf-ba86cf569158 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:27.625000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7db8b146-29a6-4329-abe3-b324debe04f5 req-289b823b-ef11-4aad-9bbf-ba86cf569158 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:27.625452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7db8b146-29a6-4329-abe3-b324debe04f5 req-289b823b-ef11-4aad-9bbf-ba86cf569158 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:27.649977 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7db8b146-29a6-4329-abe3-b324debe04f5 req-289b823b-ef11-4aad-9bbf-ba86cf569158 service nova] Creating event network-changed:86d7ccfc-a5ec-4fef-8711-26095efe742d for instance c4841b11-b9fd-4c7d-b9c5-468f9658456b on n-h2-847009-13 Aug 23 11:11:27.661717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7db8b146-29a6-4329-abe3-b324debe04f5 req-289b823b-ef11-4aad-9bbf-ba86cf569158 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059161 Aug 23 11:11:27.672043 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3253/6547] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:28.293643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:28.294367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:28.302752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:28.303255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:28.303918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:28.304643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:28.305330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:28.305880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:28.396012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:28.396894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:28.404716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:28.405379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:28.406083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:28.407647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:28.408357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:28.409128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:28.449550 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8515c38c-cbdb-4f70-8417-b827e1820379 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.160159 Aug 23 11:11:28.450434 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3295/6548] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:28 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:28.605823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:28.613994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e78f7dae-a8c9-4b8c-91b6-0ee76f5c9882 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1469 microversion: 2.1 time: 0.224081 Aug 23 11:11:28.614587 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3254/6549] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:28 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:29.471049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:29.471749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:29.480438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:29.481112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:29.481815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:29.482642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:29.483209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:29.483743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:29.657888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:29.659336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:29.672543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:29.677735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:29.678301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:29.679080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:29.679566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:29.680003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:29.830064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46475fe52d07404bb209b8d7d2475971', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d632590e14f50a2852c11c46c7ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:29.843525 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6ac45113-e3e7-4946-bc29-fdc9e0ebd7d2 tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 200 len: 1427 microversion: 2.1 time: 0.211959 Aug 23 11:11:29.856051 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3255/6550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:29 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:29.873394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3dbf31e8-397f-449e-af43-af0b7ba560a7 req-9a229cec-84ee-4eb3-8872-f7572ee9d5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eecb5d2-c425-4dc2-b75c-79cb378e3e36", "name": "network-vif-deleted", "tag": "68595182-f1a0-4ccb-a796-c79a5fedbf12"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:29.891270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3dbf31e8-397f-449e-af43-af0b7ba560a7 req-9a229cec-84ee-4eb3-8872-f7572ee9d5d9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:29.892469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3dbf31e8-397f-449e-af43-af0b7ba560a7 req-9a229cec-84ee-4eb3-8872-f7572ee9d5d9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:29.893181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3dbf31e8-397f-449e-af43-af0b7ba560a7 req-9a229cec-84ee-4eb3-8872-f7572ee9d5d9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:29.916902 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3dbf31e8-397f-449e-af43-af0b7ba560a7 req-9a229cec-84ee-4eb3-8872-f7572ee9d5d9 service nova] Creating event network-vif-deleted:68595182-f1a0-4ccb-a796-c79a5fedbf12 for instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 on n-h2-847009-13 Aug 23 11:11:29.939229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3dbf31e8-397f-449e-af43-af0b7ba560a7 req-9a229cec-84ee-4eb3-8872-f7572ee9d5d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076024 Aug 23 11:11:29.942440 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3256/6551] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:29.986755 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6926eb10-270a-42a0-924a-0bebf5eec1f3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.519609 Aug 23 11:11:29.987261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3296/6552] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:29 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:30.868873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:30.870807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] [instance: 0eecb5d2-c425-4dc2-b75c-79cb378e3e36] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:30.877715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:30.878217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:30.878865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:30.879593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:30.880224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:30.880853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:30.895191 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] HTTP exception thrown: Instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 could not be found. Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Request method failure captured: Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 HTTP/1.1 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLVVjwbvv1HR2-fiFU7wEhp1U8vA4KHKEqYY2immrw39Vt2J6SSTm4F8udw3x6aBUfASrKwHLtT73rTErGqXq-VtkEfVkHxG_jBDlJKCwkmX1JpsdTAB_26xWyA6GZZQArTxtilgmAI5Jm3vlqiQifszcBL-z5FcskCOcQZAXfy5dtE Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: c26d632590e14f50a2852c11c46c7ba1 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesBackupsTest-1612107456 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c26d632590e14f50a2852c11c46c7ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c26d632590e14f50a2852c11c46c7ba1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c26d632590e14f50a2852c11c46c7ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c26d632590e14f50a2852c11c46c7ba1"}]}] Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesBackupsTest-1612107456 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: c26d632590e14f50a2852c11c46c7ba1 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesBackupsTest-1612107456 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesBackupsTest-1612107456-project Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 46475fe52d07404bb209b8d7d2475971 Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesBackupsTest-1612107456-project Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 could not be found. Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0eecb5d2-c425-4dc2-b75c-79cb378e3e36'} Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 could not be found. Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 could not be found. Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:30.897373 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 could not be found. Aug 23 11:11:30.903598 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:30.905037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] Returning 404 to user: Instance 0eecb5d2-c425-4dc2-b75c-79cb378e3e36 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:11:30.906311 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4abc9e60-2c63-4061-b138-752768de7c9c tempest-VolumesBackupsTest-1612107456 tempest-VolumesBackupsTest-1612107456-project] 10.222.0.78 "GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36" status: 404 len: 111 microversion: 2.1 time: 0.042974 Aug 23 11:11:30.910465 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3257/6553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:30 2022] GET /compute/v2.1/servers/0eecb5d2-c425-4dc2-b75c-79cb378e3e36 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:11:31.007650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:31.012966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:31.027207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:31.030814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:31.032209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:31.035812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:31.038483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:31.039658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:31.343648 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19d1774c-0b13-42f1-a263-ff153dc49a59 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.339806 Aug 23 11:11:31.345223 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3297/6554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:31 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:32.370630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:32.372275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:32.386125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:32.393595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:32.394450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:32.395284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:32.396550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:32.397486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:32.398141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:32.597984 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5168fc83-6bdd-4e0f-b297-f04049548b8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.234752 Aug 23 11:11:32.599291 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3258/6555] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:32 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:33.351167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:33.356448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:33.361375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:33.362555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:33.366574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:33.367232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:33.367845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:33.368727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:33.369530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:33.370165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:33.451253 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78ec3412-1117-4581-a542-0e13c3b1196c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action" status: 200 len: 24574 microversion: 2.1 time: 0.104759 Aug 23 11:11:33.452242 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3298/6556] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:11:33 2022] POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action => generated 24574 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 11:11:33.626662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:33.627366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:33.629786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:33.636696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:33.637534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:33.638015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:33.639039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:33.639576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:33.640088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:33.866659 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de0cc414-5527-4795-8fdc-2e21d32e434b tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.246886 Aug 23 11:11:33.867652 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3259/6557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:33 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:34.270525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:34.273126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:34.289037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.296928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.297542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.298392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.303504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.304295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.388578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a00c3932-37bb-4271-b55d-12b974c15954 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.122350 Aug 23 11:11:34.408358 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3299/6558] 10.222.0.78 () {60 vars in 1343 bytes} [Tue Aug 23 11:11:34 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:34.477782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:34.497046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:34.516927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.519483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.520151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.521095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.521739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.522474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.579942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:11:34.756063 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c65e5c39-c080-4f11-97ee-f693aab1fbc9 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 204 len: 0 microversion: 2.20 time: 0.283097 Aug 23 11:11:34.757459 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3260/6559] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:11:34 2022] DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:11:34.766739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:34.767359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:34.780339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.780875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.781321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.782042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.782505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.782933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.890061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:34.894548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:34.910007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.910584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.911082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:34.911645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:34.912099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:34.912525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:35.209132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebfd4ab8-6156-43bf-a787-c07792c7d2ac tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.323444 Aug 23 11:11:35.210325 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3261/6560] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:34 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:35.248180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:35.258676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:35.263220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:35.267335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6837460a-70e4-444d-b2b3-aa9f29b077b7 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.504107 Aug 23 11:11:35.279538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3300/6561] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:34 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:11:36.243158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a96824e8-3f26-4c97-ada9-1bf363b4947c req-2c38f036-7159-4858-88aa-3b84d5273d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4841b11-b9fd-4c7d-b9c5-468f9658456b", "name": "network-vif-plugged", "status": "completed", "tag": "86d7ccfc-a5ec-4fef-8711-26095efe742d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:36.247799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:36.248306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:36.259704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a96824e8-3f26-4c97-ada9-1bf363b4947c req-2c38f036-7159-4858-88aa-3b84d5273d1d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:36.261753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a96824e8-3f26-4c97-ada9-1bf363b4947c req-2c38f036-7159-4858-88aa-3b84d5273d1d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:36.262275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a96824e8-3f26-4c97-ada9-1bf363b4947c req-2c38f036-7159-4858-88aa-3b84d5273d1d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:36.275125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:36.275836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:36.279625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a96824e8-3f26-4c97-ada9-1bf363b4947c req-2c38f036-7159-4858-88aa-3b84d5273d1d service nova] Creating event network-vif-plugged:86d7ccfc-a5ec-4fef-8711-26095efe742d for instance c4841b11-b9fd-4c7d-b9c5-468f9658456b on n-h2-847009-13 Aug 23 11:11:36.283833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:36.287363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:36.288415 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a96824e8-3f26-4c97-ada9-1bf363b4947c req-2c38f036-7159-4858-88aa-3b84d5273d1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050008 Aug 23 11:11:36.289005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:36.289918 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3262/6562] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:36.297712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:36.308029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:36.309182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:36.325750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:36.326802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:36.327500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:36.328469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:36.329330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:36.349400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:36.721465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:36.736720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:36.738355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:36.739753 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a991e75f-5dbb-4387-953c-8b4cc6889bc0 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.448385 Aug 23 11:11:36.740332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3263/6563] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:36 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:11:36.922360 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87d699bb-20ee-49d8-87be-26db1ff1bbd8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.681286 Aug 23 11:11:36.923354 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3301/6564] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:36 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:37.764919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:37.765545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:37.782364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:37.782863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:37.783306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:37.784023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:37.793808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:37.794389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:37.811831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:37.953810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:37.954231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:37.963774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:37.964897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:37.967540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:37.976831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:37.977840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:37.982079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:37.992258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:38.391606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3374ae7-c479-42c4-8e91-926eb3b91623 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1466 microversion: 2.1 time: 0.443971 Aug 23 11:11:38.393410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3302/6565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:37 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1466 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:38.407783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:38.437057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:38.444925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:38.451934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ef9015e-463f-4f2b-9cc6-fa08d5aa25ec tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1722 microversion: 2.20 time: 0.689779 Aug 23 11:11:38.454369 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3264/6566] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:37 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1722 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 11:11:39.413441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:39.414219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:39.446169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:39.446816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:39.449139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:39.449985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:39.450784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:39.451583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:39.476282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:39.477293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:39.494020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:39.500495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:39.501134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:39.508248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:39.509040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:39.511918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:39.652641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:39.670913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:39.678894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3e6281c3d024d9b8c9a27bb5144860b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc56160173245b48e2299234369f3ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:39.686297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e70a647-edd6-4c77-8c8c-40a7c93cbe00 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 200 len: 1654 microversion: 2.20 time: 0.213260 Aug 23 11:11:39.686895 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3265/6567] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:39 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 1654 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 11:11:39.694159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4773e244-455e-4c19-a9dc-e201068ed3fa req-0b0fce3c-6f80-4861-9745-48eaa3194ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b62eb5-a12c-46ad-beba-d081e1d00561", "name": "network-vif-deleted", "tag": "1a9e8dac-d15f-4285-b1d9-9b9e1407b82f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:39.722248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4773e244-455e-4c19-a9dc-e201068ed3fa req-0b0fce3c-6f80-4861-9745-48eaa3194ebd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:39.723176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4773e244-455e-4c19-a9dc-e201068ed3fa req-0b0fce3c-6f80-4861-9745-48eaa3194ebd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:39.723808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4773e244-455e-4c19-a9dc-e201068ed3fa req-0b0fce3c-6f80-4861-9745-48eaa3194ebd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:39.749665 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4773e244-455e-4c19-a9dc-e201068ed3fa req-0b0fce3c-6f80-4861-9745-48eaa3194ebd service nova] Creating event network-vif-deleted:1a9e8dac-d15f-4285-b1d9-9b9e1407b82f for instance 30b62eb5-a12c-46ad-beba-d081e1d00561 on n-h1-847009-13 Aug 23 11:11:39.766017 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4773e244-455e-4c19-a9dc-e201068ed3fa req-0b0fce3c-6f80-4861-9745-48eaa3194ebd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075082 Aug 23 11:11:39.768991 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3266/6568] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:40.407205 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9801293-6a57-4e45-a6b6-d49e2e689426 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1650 microversion: 2.1 time: 0.997601 Aug 23 11:11:40.410469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3303/6569] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:39 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1650 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:40.437850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:40.438374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:40.474541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:40.475191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:40.476540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:40.479870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:40.485657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:40.487866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:40.724709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:40.731444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:40.761384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:40.763292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:40.768269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:40.773835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:40.776487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:40.782582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:40.821745 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] HTTP exception thrown: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Request method failure captured: Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 HTTP/1.1 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLPtI1A-BxsdysoFsibhrONPth1T0RU4SFjN-XRyL9DoDAApuIFjJx12SWKyiXWKpQm0z1cgnVjZeJr7Vk4X4Z10fA6CnhEq533_JxxwMUX3HjtCNNxr88apLcyiTemY9KQTB0LEJiOvvl7TdXWK2ou82vr3jMDTnM8j7mEWhj48ts4 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bc56160173245b48e2299234369f3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bc56160173245b48e2299234369f3ca", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}] Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a3e6281c3d024d9b8c9a27bb5144860b Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '30b62eb5-a12c-46ad-beba-d081e1d00561'} Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:40.826945 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:40.832900 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:40.836279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Returning 404 to user: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:11:40.837438 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d1fd01c-329e-4ecb-9f6e-df7f251f4769 tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 404 len: 111 microversion: 2.20 time: 0.126543 Aug 23 11:11:40.838295 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3304/6570] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:40 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:11:40.871211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-504cc9f8-9c7d-4919-ab5f-e5109507d326 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1650 microversion: 2.1 time: 0.440074 Aug 23 11:11:40.890919 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3267/6571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:40 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1650 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:40.897317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b78529f-dcbb-4a6b-9069-cdc262fcc40d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '.version_select at 0x7fdc9c1e6280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:40.905721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:40.907963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:40.925967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:40.926736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:40.927956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:40.933016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:40.937684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:40.938284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:40.946288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b78529f-dcbb-4a6b-9069-cdc262fcc40d tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131694806" status: 204 len: 0 microversion: 2.20 time: 0.099210 Aug 23 11:11:40.946895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3305/6572] 10.222.0.78 () {60 vars in 1262 bytes} [Tue Aug 23 11:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131694806 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 11:11:41.326947 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d488170c-e15e-4387-80b7-d223726f25ce tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1650 microversion: 2.1 time: 0.430053 Aug 23 11:11:41.328611 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3268/6573] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:40 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1650 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:41.449294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1508914607", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "availability_zone": "nova:n-h1-847009-13", "networks": [{"uuid": "ddb1011a-c962-40db-9221-af26c1b6d422"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:41.542655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] validate_networks() for [('ddb1011a-c962-40db-9221-af26c1b6d422', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:11:43.018463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:11:43.019199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:11:43.021557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:11:43.023074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:11:43.023627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:11:43.069677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:43.071275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:43.074163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:43.075989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:43.077286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:43.077809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:43.131663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Getting quotas for project 3facc0728c2441b397bcbed1f1b0c28d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:11:43.153185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Getting quotas for user 1e427e96a99846f5afba70eb7f0849e0 and project 3facc0728c2441b397bcbed1f1b0c28d. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:11:43.187896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:11:43.194483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:11:43.356689 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9decdea4-e7ad-4bd1-bb5b-af4b41980159 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918077 Aug 23 11:11:43.362721 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3306/6574] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:11:43.368911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcee714f-56a3-45a9-9edb-e377393b99cc tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:43.371040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcee714f-56a3-45a9-9edb-e377393b99cc tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:43.637948 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcee714f-56a3-45a9-9edb-e377393b99cc tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1329 microversion: 2.1 time: 0.272250 Aug 23 11:11:43.640449 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3269/6575] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:43 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1329 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:44.395198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:44.397020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:44.427412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:44.428091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:44.433570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:44.435218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:44.440098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:44.441190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:44.664035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:44.665048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:44.695331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:44.698692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:44.700831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:44.706259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:44.711634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:44.713404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:44.973089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:44.987128 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-76f86e75-bec4-457d-ae71-8b97e84b3fa5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1679 microversion: 2.1 time: 0.594533 Aug 23 11:11:45.013982 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3307/6576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:44 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1679 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:45.155132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-807c592f-e9b0-4b7a-816f-11089e78433d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1338 microversion: 2.1 time: 0.496189 Aug 23 11:11:45.163048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:45.181403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:45.183409 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3270/6577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:44 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:45.208485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:45.210506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:45.211788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:45.214546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:45.216633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:45.218364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:45.335558 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8249c1f9-a555-4071-b349-d02ee4fd3516 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action" status: 200 len: 32645 microversion: 2.1 time: 0.177236 Aug 23 11:11:45.336705 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3308/6578] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:11:45 2022] POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action => generated 32645 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:11:45.475412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:45.476367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:45.491163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:45.495641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:45.497195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:45.497976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:45.499736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:45.500198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:46.205363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:46.207188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:46.225295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:46.226980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:46.229872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:46.230847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:46.233287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:46.252376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:46.618132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ad2956e-a957-45e8-aab1-338f149d3a39 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1832 microversion: 2.1 time: 1.147033 Aug 23 11:11:46.624184 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3271/6579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:45 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1832 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:46.656082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:46.659766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:46.680408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:46.682681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:46.684758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:46.688071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:46.689052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:46.689797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:46.764988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lazy-loading 'flavor' on Instance uuid 0752a001-1352-4a66-8fa3-38806a2dc938 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:11:46.782052 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-66ed701c-40d4-494e-ba69-f8397a996a09 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1424 microversion: 2.1 time: 0.581527 Aug 23 11:11:46.785374 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3309/6580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:46 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1424 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:46.803924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Going to try to live migrate instance to another host {{(pid=128860) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 11:11:47.806817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:47.808263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:47.819913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:47.830022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:47.832690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:47.835182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:47.843898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:47.846213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:48.074920 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfbf4202-8f11-4f6e-8395-09519d29d2ea tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1424 microversion: 2.1 time: 0.271779 Aug 23 11:11:48.081541 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3310/6581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:47 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1424 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:48.096171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:48.098673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:48.111319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:48.112079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:48.112708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:48.115857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:48.116785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:48.117431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:48.139472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] HTTP exception thrown: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Request method failure captured: Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 HTTP/1.1 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLPtI1A-BxsdysoFsibhrONPth1T0RU4SFjN-XRyL9DoDAApuIFjJx12SWKyiXWKpQm0z1cgnVjZeJr7Vk4X4Z10fA6CnhEq533_JxxwMUX3HjtCNNxr88apLcyiTemY9KQTB0LEJiOvvl7TdXWK2ou82vr3jMDTnM8j7mEWhj48ts4 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bc56160173245b48e2299234369f3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bc56160173245b48e2299234369f3ca", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}] Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a3e6281c3d024d9b8c9a27bb5144860b Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '30b62eb5-a12c-46ad-beba-d081e1d00561'} Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:11:48.142972 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Returning 404 to user: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:11:48.147932 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e180818e-8620-4f6c-ba5f-c6e05e0573aa tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 404 len: 111 microversion: 2.20 time: 0.064143 Aug 23 11:11:48.149765 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3311/6582] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:11:48 2022] DELETE /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:11:48.181251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:48.184339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 30b62eb5-a12c-46ad-beba-d081e1d00561] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:48.193387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:48.194203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:48.194764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:48.195861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:48.196978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:48.199687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:48.231583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] HTTP exception thrown: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Request method failure captured: Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 HTTP/1.1 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLPtI1A-BxsdysoFsibhrONPth1T0RU4SFjN-XRyL9DoDAApuIFjJx12SWKyiXWKpQm0z1cgnVjZeJr7Vk4X4Z10fA6CnhEq533_JxxwMUX3HjtCNNxr88apLcyiTemY9KQTB0LEJiOvvl7TdXWK2ou82vr3jMDTnM8j7mEWhj48ts4 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bc56160173245b48e2299234369f3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bc56160173245b48e2299234369f3ca", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}] Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a3e6281c3d024d9b8c9a27bb5144860b Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '30b62eb5-a12c-46ad-beba-d081e1d00561'} Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.234343 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. Aug 23 11:11:48.241120 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:48.262603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Returning 404 to user: Instance 30b62eb5-a12c-46ad-beba-d081e1d00561 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:11:48.264871 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f56abd15-119b-4338-a7c9-147c71dad60b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561" status: 404 len: 111 microversion: 2.20 time: 0.098399 Aug 23 11:11:48.267290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3312/6583] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:48 2022] GET /compute/v2.1/servers/30b62eb5-a12c-46ad-beba-d081e1d00561 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:11:49.099255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:49.100026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:49.124526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:49.129442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:49.130457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:49.134096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:49.136587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:49.141563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:49.475662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c03f6a25-3da1-43fd-8e37-34fa3cffbe50 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.381705 Aug 23 11:11:49.476913 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3313/6584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:49 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:50.140788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1474356844", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "4d6e1150-c594-483a-ad85-5f3df4bd4a63"}], "key_name": "tempest-TestSecurityGroupsBasicOps-461798026", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d217f215-b58f-466d-9b0f-9950de9a1015"]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:50.260412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] validate_networks() for [('4d6e1150-c594-483a-ad85-5f3df4bd4a63', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:11:51.374909 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8d2f713b-d01e-4809-89f8-f72338663406 tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action" status: 202 len: 0 microversion: 2.1 time: 4.725324 Aug 23 11:11:51.383109 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3272/6585] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:11:46 2022] POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action => generated 0 bytes in 4735 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:11:51.391024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:51.394505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:51.412660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.413591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.414240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.418386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.419138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.419785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.551708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:11:51.552154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:11:51.552633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:11:51.553068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:11:51.554949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:11:51.570382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.571627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.572265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.574724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.577193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.580238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.610428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Getting quotas for project 4bdbe227f743406a9e93c8e86dc76cde. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:11:51.623871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Getting quotas for user 7c32c0e05d9e47a6950dd0297ed8aabc and project 4bdbe227f743406a9e93c8e86dc76cde. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:11:51.645222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:11:51.649017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:11:51.690189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:51.717519 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-851af1a0-ae98-4b81-b69a-92b76ec00778 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.583239 Aug 23 11:11:51.718845 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3314/6586] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:11:50 2022] POST /compute/v2.1/servers => generated 361 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:11:51.726504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:51.729951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:51.737862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.738645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.739285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.740190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.741604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.742264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.826236 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-255d4542-44c8-4f9d-b499-36975f5a7286 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104599 Aug 23 11:11:51.827783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3315/6587] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:11:51 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:11:51.834694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:51.838495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:51.848329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.849260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.850074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:51.850989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:51.851623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:51.852295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:52.229162 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a907903-053a-4b57-8e96-a41ebd6a0027 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.840910 Aug 23 11:11:52.229808 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3273/6588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:51 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:52.237179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9848092-0a0a-469d-904e-5ced14369314 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:52.239494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9848092-0a0a-469d-904e-5ced14369314 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:52.453372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:52.469575 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f72e727-093e-4a7c-9037-15be3354e484 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.640051 Aug 23 11:11:52.470172 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3316/6589] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:51 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:52.490688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:52.493381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:52.508702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:52.509748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:52.510444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:52.511993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:52.514635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:52.515406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:52.524222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9848092-0a0a-469d-904e-5ced14369314 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:52.534652 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9848092-0a0a-469d-904e-5ced14369314 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1241 microversion: 2.1 time: 0.302520 Aug 23 11:11:52.535274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3274/6590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:52 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1241 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:52.572206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:11:52.711806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-053b18ce-bfb8-4361-854f-82c442e9a82f req-b5916dd1-4006-4290-8903-5482c3b80fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f989bb7b-3c70-414f-8c72-d68a13707eea", "tag": "ed952c50-d2b1-40af-8113-ee4755882d9d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:52.728020 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c46e2e9d-c598-416b-a74d-68bbaff9410a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 204 len: 0 microversion: 2.1 time: 0.240901 Aug 23 11:11:52.733387 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3317/6591] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:11:52 2022] DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:11:52.741441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:52.742888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:52.751800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-053b18ce-bfb8-4361-854f-82c442e9a82f req-b5916dd1-4006-4290-8903-5482c3b80fbf service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:52.752276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-053b18ce-bfb8-4361-854f-82c442e9a82f req-b5916dd1-4006-4290-8903-5482c3b80fbf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:52.752725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-053b18ce-bfb8-4361-854f-82c442e9a82f req-b5916dd1-4006-4290-8903-5482c3b80fbf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:52.760814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:52.763170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:52.763912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:52.766997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:52.769175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:52.770252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:52.792833 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-053b18ce-bfb8-4361-854f-82c442e9a82f req-b5916dd1-4006-4290-8903-5482c3b80fbf service nova] Creating event network-changed:ed952c50-d2b1-40af-8113-ee4755882d9d for instance f989bb7b-3c70-414f-8c72-d68a13707eea on n-h1-847009-13 Aug 23 11:11:52.810356 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-053b18ce-bfb8-4361-854f-82c442e9a82f req-b5916dd1-4006-4290-8903-5482c3b80fbf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096876 Aug 23 11:11:52.812065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3275/6592] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:11:53.083531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:53.099785 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-861e1ca3-5f70-4ada-a100-d6f95fae1210 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1671 microversion: 2.1 time: 0.363820 Aug 23 11:11:53.101553 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3318/6593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:52 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1671 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:53.254196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:53.255311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:53.264682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:53.265514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:53.266165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:53.268663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:53.269373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:53.269984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:53.498483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:53.499122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:53.511016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:53.513923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:53.514639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:53.515843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:53.518971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:53.519637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:53.571415 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a17ebb2-1dc6-4592-8590-7905c5decc4d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.320675 Aug 23 11:11:53.574024 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3276/6594] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:53 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:53.589758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:53.591490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:53.608563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:53.610703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:53.613036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:53.615642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:53.617334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:53.618757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:53.794857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:53.813289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:53.828407 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91af90c9-e2d8-447d-b0c2-e6b18780c5fe tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.335536 Aug 23 11:11:53.830613 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3319/6595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:53 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:53.849780 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b915e63c-3954-4c0f-a234-19948b287bf8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1293 microversion: 2.1 time: 0.272996 Aug 23 11:11:53.851557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3277/6596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:53 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1293 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:54.127561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:54.128889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:54.151426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:54.151726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:54.156092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:54.166940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:54.167834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:54.170334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:54.595122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:54.595758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:54.609395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:54.610210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:54.611019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:54.615641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:54.616386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:54.617067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:54.736607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:54.750312 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb9f5484-39ac-4d9e-aa57-601245cccd74 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1671 microversion: 2.1 time: 0.628236 Aug 23 11:11:54.752442 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3320/6597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:54 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1671 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:54.856280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:54.857697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:54.868303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:54.872688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:54.873489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:54.874890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:54.879231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:54.880013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:55.217865 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a33becf-e341-4c5e-a873-635da0a6dde6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.627576 Aug 23 11:11:55.231436 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3278/6598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:54 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:55.236959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:55.238284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:55.247706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:55.252410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:55.253264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:55.254558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:55.258821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:55.260203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.034979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:56.039916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:56.057043 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe3fd2ed-38c1-4281-a79d-103c71f591b2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 1.204566 Aug 23 11:11:56.064538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3321/6599] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:54 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:56.076365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:56.080050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:56.095678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.096332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.109243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.110623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.111239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.111931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.170178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] HTTP exception thrown: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Request method failure captured: Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 HTTP/1.1 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLPtI1A-BxsdysoFsibhrONPth1T0RU4SFjN-XRyL9DoDAApuIFjJx12SWKyiXWKpQm0z1cgnVjZeJr7Vk4X4Z10fA6CnhEq533_JxxwMUX3HjtCNNxr88apLcyiTemY9KQTB0LEJiOvvl7TdXWK2ou82vr3jMDTnM8j7mEWhj48ts4 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bc56160173245b48e2299234369f3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bc56160173245b48e2299234369f3ca", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}] Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: a3e6281c3d024d9b8c9a27bb5144860b Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '3d8297fe-7c5a-4258-b795-34e44f552873'} Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:11:56.178002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.184054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Returning 404 to user: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:11:56.189249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-072013a1-1e37-4d15-a8d6-05253ebe5f0b tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 404 len: 111 microversion: 2.20 time: 0.121619 Aug 23 11:11:56.189249 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3322/6600] 10.222.0.78 () {60 vars in 1280 bytes} [Tue Aug 23 11:11:56 2022] DELETE /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:11:56.201660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:56.208871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:56.225079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.226887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.228840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.231250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.236418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:56.237524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.238044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.257006 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ccac7c5-f35e-4738-bea1-673cb9c7d9dc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 1.024143 Aug 23 11:11:56.282350 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3279/6601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:55 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:56.297637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:56.310898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] [instance: 3d8297fe-7c5a-4258-b795-34e44f552873] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:56.331745 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:56.354131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.354660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.355119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.356050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.356708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.363881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.434264 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] HTTP exception thrown: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Request method failure captured: Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 HTTP/1.1 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPtI1A-BxsdysoFsibhrONPth1T0RU4SFjN-XRyL9DoDAApuIFjJx12SWKyiXWKpQm0z1cgnVjZeJr7Vk4X4Z10fA6CnhEq533_JxxwMUX3HjtCNNxr88apLcyiTemY9KQTB0LEJiOvvl7TdXWK2ou82vr3jMDTnM8j7mEWhj48ts4 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7bc56160173245b48e2299234369f3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7bc56160173245b48e2299234369f3ca", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7bc56160173245b48e2299234369f3ca"}]}] Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 7bc56160173245b48e2299234369f3ca Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1103841686 Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a3e6281c3d024d9b8c9a27bb5144860b Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1103841686-project Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '3d8297fe-7c5a-4258-b795-34e44f552873'} Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.444696 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] Returning 404 to user: Instance 3d8297fe-7c5a-4258-b795-34e44f552873 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:11:56.451175 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c05b997c-c585-4af6-89fa-301feeea4e1e tempest-AttachVolumeShelveTestJSON-1103841686 tempest-AttachVolumeShelveTestJSON-1103841686-project] 10.222.0.78 "GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873" status: 404 len: 111 microversion: 2.20 time: 0.163154 Aug 23 11:11:56.453336 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3280/6602] 10.222.0.78 () {60 vars in 1277 bytes} [Tue Aug 23 11:11:56 2022] GET /compute/v2.1/servers/3d8297fe-7c5a-4258-b795-34e44f552873 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:11:56.466864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:56.467507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:56.489611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.490093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.490553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.496262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:56.499640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:56.500168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:56.920990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:56.929641 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8283f3c8-d980-4866-98cf-e2b04af20a40 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1671 microversion: 2.1 time: 0.739260 Aug 23 11:11:56.930450 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3323/6603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:56 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1671 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:57.079996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:57.080659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:57.089724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.090222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.090670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:57.091393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.095957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.097091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:57.418260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:57.443153 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-22251b50-79ea-4f65-b96e-314ea1303046 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.367306 Aug 23 11:11:57.445549 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3324/6604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:57 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:57.457421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:57.461099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:57.478748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.483957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.484606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:57.485557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.487415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.487941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:57.648863 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-876e598a-6169-4222-aef2-9b9e7c1d2bf8 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 1.194365 Aug 23 11:11:57.663687 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3281/6605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:56 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:57.668920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-928be6c1-cb1b-467a-b420-c2aa52c3390c req-a2c03f58-a734-430a-977f-3b78fb423f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "name": "network-vif-unplugged", "status": "completed", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:57.678795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-928be6c1-cb1b-467a-b420-c2aa52c3390c req-a2c03f58-a734-430a-977f-3b78fb423f01 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.679514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-928be6c1-cb1b-467a-b420-c2aa52c3390c req-a2c03f58-a734-430a-977f-3b78fb423f01 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.680135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-928be6c1-cb1b-467a-b420-c2aa52c3390c req-a2c03f58-a734-430a-977f-3b78fb423f01 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:57.692764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-928be6c1-cb1b-467a-b420-c2aa52c3390c req-a2c03f58-a734-430a-977f-3b78fb423f01 service nova] Creating event network-vif-unplugged:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h2-847009-13 Aug 23 11:11:57.702522 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-928be6c1-cb1b-467a-b420-c2aa52c3390c req-a2c03f58-a734-430a-977f-3b78fb423f01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037197 Aug 23 11:11:57.703190 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3282/6606] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:11:57.738226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:57.755596 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47890663-938a-4740-bbb3-5d7acd56d4cc tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.306688 Aug 23 11:11:57.757625 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3325/6607] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:57 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:57.955851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:57.956872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:57.976316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.977277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.978761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:57.979771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:57.981051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:57.982313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:58.467393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:58.468579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:58.479764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:58.480419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:58.484728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:58.485837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:58.486707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:58.487415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:58.727224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:58.730850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:11:58.751656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70df3737-04bb-4dee-bac5-68051b506d90 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1671 microversion: 2.1 time: 0.801217 Aug 23 11:11:58.752875 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3283/6608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:57 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1671 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:58.758444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:58.759849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:58.768630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:58.769466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:58.770105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:58.771005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:58.773156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:58.773776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:59.011410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:59.023939 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b385cc2-a850-4fc9-8279-209d8c56da8c tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.560543 Aug 23 11:11:59.042188 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3326/6609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:58 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:11:59.050018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:59.050982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:59.058914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:59.060618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:59.061341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:59.062273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:59.062917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:59.063728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:59.238116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:11:59.250237 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7afdba83-22db-4b99-8a80-50b86a404031 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.204851 Aug 23 11:11:59.252681 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3327/6610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:59 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:59.343056 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8af0ab4-9334-4c9e-abac-317069d70388 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.588735 Aug 23 11:11:59.343988 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3284/6611] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:58 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:11:59.780542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:11:59.785816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:11:59.788095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8a81cac1-f446-4540-8dd4-bad468a900f8 req-25b3033e-34e4-4447-b03c-1529ce596a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:11:59.811881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a81cac1-f446-4540-8dd4-bad468a900f8 req-25b3033e-34e4-4447-b03c-1529ce596a92 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:59.812365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a81cac1-f446-4540-8dd4-bad468a900f8 req-25b3033e-34e4-4447-b03c-1529ce596a92 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:59.813033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a81cac1-f446-4540-8dd4-bad468a900f8 req-25b3033e-34e4-4447-b03c-1529ce596a92 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:59.820917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:59.821579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:59.824492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:59.829894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8a81cac1-f446-4540-8dd4-bad468a900f8 req-25b3033e-34e4-4447-b03c-1529ce596a92 service nova] Creating event network-changed:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h2-847009-13 Aug 23 11:11:59.830066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:11:59.830637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:11:59.831230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:11:59.853750 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8a81cac1-f446-4540-8dd4-bad468a900f8 req-25b3033e-34e4-4447-b03c-1529ce596a92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068392 Aug 23 11:11:59.855099 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3285/6612] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:12:00.051271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:00.053767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:00.067793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.068506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.069336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:00.070268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.070933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.071632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:00.104570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:00.116452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d03c4771-7a70-48e2-9cfd-8630fce91833 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1603 microversion: 2.1 time: 0.344883 Aug 23 11:12:00.134178 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3328/6613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:11:59 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1603 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:00.279704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:00.280820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:00.295139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.295647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.309562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:00.310361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.310856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.311301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:00.661811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:00.683990 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e54366bb-6587-4f2b-9b82-949b66f09612 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.407912 Aug 23 11:12:00.685059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3329/6614] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:00 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:00.691190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:00.691817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:00.714416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.717286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.731794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:00.734744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.736300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.736816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:00.778139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:00.785995 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-236a9132-acc1-4c88-bd3f-f796accd3d58 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.740585 Aug 23 11:12:00.794544 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3286/6615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:00 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:00.936430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c01ab8fe-4c73-464f-abf0-77eddd9577fd req-d72508ad-b419-404e-ab35-c201bbd88c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bfde77-3820-4a7f-8409-cd624d68cddb", "name": "network-vif-deleted", "tag": "e881b35e-7fd0-4c2f-8d1e-669132e905fb"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:00.973424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c01ab8fe-4c73-464f-abf0-77eddd9577fd req-d72508ad-b419-404e-ab35-c201bbd88c90 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:00.974391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c01ab8fe-4c73-464f-abf0-77eddd9577fd req-d72508ad-b419-404e-ab35-c201bbd88c90 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:00.975070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c01ab8fe-4c73-464f-abf0-77eddd9577fd req-d72508ad-b419-404e-ab35-c201bbd88c90 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:01.065533 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c01ab8fe-4c73-464f-abf0-77eddd9577fd req-d72508ad-b419-404e-ab35-c201bbd88c90 service nova] Creating event network-vif-deleted:e881b35e-7fd0-4c2f-8d1e-669132e905fb for instance 48bfde77-3820-4a7f-8409-cd624d68cddb on n-h1-847009-13 Aug 23 11:12:01.070936 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c01ab8fe-4c73-464f-abf0-77eddd9577fd req-d72508ad-b419-404e-ab35-c201bbd88c90 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152795 Aug 23 11:12:01.072534 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3287/6616] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:01.149634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:01.155153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:01.168703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:01.169244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:01.169697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:01.170427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:01.170903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:01.171341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:01.279952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:01.280665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:01.281227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:01.282465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lazy-loading 'fault' on Instance uuid 48bfde77-3820-4a7f-8409-cd624d68cddb {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:12:01.483343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:01.496090 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6be6f3c0-852f-47fd-ac8a-b7b8973d7cdf tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 200 len: 1326 microversion: 2.1 time: 0.359609 Aug 23 11:12:01.496712 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3288/6617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:01 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 1326 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:01.597407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:01.636795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:01.707651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:01.708287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:01.722730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:01.723525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:01.724727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:01.728679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:01.730051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:01.733618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:02.161374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:02.178944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62156f94-5e78-44ff-b21d-f0f768444f65 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.475267 Aug 23 11:12:02.193468 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3289/6618] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:01 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:02.199267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:02.200162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:02.214240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:02.214755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:02.215208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:02.215941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:02.216407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:02.216928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:02.485721 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-71b18ac1-6810-4147-9c06-0f06951c6b7f tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 1.797680 Aug 23 11:12:02.487103 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3330/6619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:00 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:02.518103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:02.520367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:02.531682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:02.532700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:02.533383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:02.534393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:02.535464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:02.537476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:02.538202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:02.572932 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] HTTP exception thrown: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Request method failure captured: Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb HTTP/1.1 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLS0HEhlpKgLjfhGydJVE_e5ZIIn8kq3aznJG-6hx3YFqIxtvFSQ8g20K93QwkDczNVgCelFOPSDe7kRkHTOL2fAYgD4Tq3DAa48A7ohNiss5XnhYg4uAlxlf0QoKUG9OAYq7KUqS56kw3gbvD7EuefVj7Tc1-IA6f76sYKJDnkdedc Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e89c4738f5f4f7a9e7985bc175d8867", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}] Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2f677df65e434e45b050d23769ad5863 Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '48bfde77-3820-4a7f-8409-cd624d68cddb'} Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:02.574983 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:12:02.579736 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:02.582505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Returning 404 to user: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:02.585231 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e92effd-af3a-423d-a560-78d6f6302dcd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 404 len: 111 microversion: 2.1 time: 0.070421 Aug 23 11:12:02.589234 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3331/6620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:02 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:02.605804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d131790-c953-4323-b8da-37f211e3b634 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '.version_select at 0x7fdc9c528ca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:02.647159 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d131790-c953-4323-b8da-37f211e3b634 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32438027" status: 202 len: 0 microversion: 2.1 time: 0.053180 Aug 23 11:12:02.647950 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3332/6621] 10.222.0.78 () {58 vars in 1215 bytes} [Tue Aug 23 11:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32438027 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:12:02.981950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:02.995709 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b1feeb8d-03c5-44a1-8b68-f4ce57ce70ef tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.800719 Aug 23 11:12:02.997319 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3290/6622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:02 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:03.100145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6180249a-74c9-47f3-a469-eb8b025bac38 req-c01a410a-608a-4dab-a8f5-665f2566c9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6124010-7725-4a88-afa7-e16a26fa6545", "tag": "a2f6d496-bbaa-42d6-bd03-98b3f1b5831d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:03.137568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6180249a-74c9-47f3-a469-eb8b025bac38 req-c01a410a-608a-4dab-a8f5-665f2566c9b5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:03.138232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6180249a-74c9-47f3-a469-eb8b025bac38 req-c01a410a-608a-4dab-a8f5-665f2566c9b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:03.139060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6180249a-74c9-47f3-a469-eb8b025bac38 req-c01a410a-608a-4dab-a8f5-665f2566c9b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:03.176123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6180249a-74c9-47f3-a469-eb8b025bac38 req-c01a410a-608a-4dab-a8f5-665f2566c9b5 service nova] Creating event network-changed:a2f6d496-bbaa-42d6-bd03-98b3f1b5831d for instance e6124010-7725-4a88-afa7-e16a26fa6545 on n-h2-847009-13 Aug 23 11:12:03.188684 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6180249a-74c9-47f3-a469-eb8b025bac38 req-c01a410a-608a-4dab-a8f5-665f2566c9b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092987 Aug 23 11:12:03.200450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:03.201899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:03.208079 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3333/6623] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:03.218478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:03.222528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:03.223099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:03.225613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:03.228925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:03.229547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:03.490992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:03.510900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:03.511682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:03.523597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:03.528183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:03.528970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:03.531647 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f88928f8-da1a-41d4-a3da-1d5b896947db tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.336047 Aug 23 11:12:03.532153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:03.534328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:03.535017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:03.547070 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3291/6624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:03 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:03.886862 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17794640-0f21-44e7-a8ea-7c191c749b69 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.383230 Aug 23 11:12:03.896980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3334/6625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:03 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:04.019707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:04.020477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:04.045146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:04.049523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:04.052126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:04.054666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:04.055869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:04.059660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:04.557020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:04.558376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:04.572460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:04.574960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:04.575802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:04.578442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:04.579308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:04.582076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:04.741315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:04.754084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce4bfe1c-bbe7-4973-960b-e80162f6f7e0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.201872 Aug 23 11:12:04.758856 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3335/6626] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:04 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:04.909275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:04.910064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:04.919695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:04.922462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:04.924225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:04.926251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:04.930854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:04.932548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:05.594117 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6efbedf5-b040-434c-91e4-1910fca2a8bb tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.685866 Aug 23 11:12:05.595533 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3336/6627] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:04 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:05.686972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:05.698686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f043622e-285c-4fee-b919-1d1e6b52bc22 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 1.682684 Aug 23 11:12:05.699296 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3292/6628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:04 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:05.779361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-864cfbf4-020f-4fb7-976d-7d36c40be7ad tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: .version_select at 0x7fdc8fc541f0>, body: {"keypair": {"name": "tempest-keypair-2048142317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8YDw3qN8sgUKanPQYVb/+9bxkseTnw8zc5gIviAgAd5FXtyP8GHqBAIHgkaRBUYz6USsUE9j73EAkzfhApkid6vXY6I1xs7yjPlev/8sqxQiIqU0SKwGyfx2qKJZdBbQ=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:05.785318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:05.786193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:05.796707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:05.797496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:05.802391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:05.803427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:05.804344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:05.805004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:05.818377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-864cfbf4-020f-4fb7-976d-7d36c40be7ad tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:12:05.835925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-864cfbf4-020f-4fb7-976d-7d36c40be7ad tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for user 2f677df65e434e45b050d23769ad5863 and project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:12:05.894992 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-864cfbf4-020f-4fb7-976d-7d36c40be7ad tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121252 Aug 23 11:12:05.899189 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3337/6629] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:12:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:05.952539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:05.982604 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab958ac6-1165-4835-bdfe-687000794fe1 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.201077 Aug 23 11:12:05.983199 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3293/6630] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:05 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:06.617077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:06.619149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:06.641182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:06.646845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:06.648388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:06.651022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:06.653355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:06.655171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:06.721608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:06.722602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:06.745825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:06.747148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:06.752462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:06.753677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:06.756767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:06.758591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:07.145645 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f4b75ac-b1fe-487e-b483-1bcbfb7f994d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 0.533428 Aug 23 11:12:07.147676 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3338/6631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:06 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:07.153925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:07.155057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:07.163681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:07.164670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:07.165615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:07.166895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:07.167666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:07.170583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:07.179370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:07.197537 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c06fabc6-510f-445e-a370-a0e04fa27273 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.479715 Aug 23 11:12:07.203631 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3294/6632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:06 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:07.386701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:07.395955 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5395ecd6-8a19-4ab2-871d-25f01f2aa79c tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.246568 Aug 23 11:12:07.409099 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3339/6633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:07 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:07.531296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e039bdef-fa43-4566-bb89-d208e2d4db78 req-7a4b5f5a-36e2-408f-acfb-7664ab592cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f989bb7b-3c70-414f-8c72-d68a13707eea", "name": "network-vif-plugged", "status": "completed", "tag": "ed952c50-d2b1-40af-8113-ee4755882d9d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:07.560644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e039bdef-fa43-4566-bb89-d208e2d4db78 req-7a4b5f5a-36e2-408f-acfb-7664ab592cbb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:07.561303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e039bdef-fa43-4566-bb89-d208e2d4db78 req-7a4b5f5a-36e2-408f-acfb-7664ab592cbb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:07.562085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e039bdef-fa43-4566-bb89-d208e2d4db78 req-7a4b5f5a-36e2-408f-acfb-7664ab592cbb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:07.593368 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e039bdef-fa43-4566-bb89-d208e2d4db78 req-7a4b5f5a-36e2-408f-acfb-7664ab592cbb service nova] Creating event network-vif-plugged:ed952c50-d2b1-40af-8113-ee4755882d9d for instance f989bb7b-3c70-414f-8c72-d68a13707eea on n-h1-847009-13 Aug 23 11:12:07.607923 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e039bdef-fa43-4566-bb89-d208e2d4db78 req-7a4b5f5a-36e2-408f-acfb-7664ab592cbb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083956 Aug 23 11:12:07.608733 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3295/6634] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:08.173339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:08.174028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:08.194007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:08.194559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:08.195010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:08.195941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:08.196244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:08.197245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:08.225930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:08.226561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:08.240613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:08.245306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:08.246063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:08.252468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:08.252985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:08.253437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:08.723435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:08.733698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9307f89b-4fca-4ee7-9079-ebd6def0a309 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.511956 Aug 23 11:12:08.734302 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3296/6635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:08 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:08.750916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:08.751103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:08.760043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:08.760780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:08.761239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:08.761974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:08.762575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:08.762882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:08.942702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:08.954304 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-13cfe8b8-5634-4ae3-b79c-0efee0b32107 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 0.211976 Aug 23 11:12:08.955401 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3297/6636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:08 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:09.331746 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe7ad859-a370-459c-9b02-93ff748e216e tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1466 microversion: 2.1 time: 1.166988 Aug 23 11:12:09.337155 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3340/6637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:08 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1466 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:09.653732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-91cb3456-bab5-48d6-b86d-e3feb159dbfc req-1651423d-c024-4c51-af76-fcf8722a3cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6124010-7725-4a88-afa7-e16a26fa6545", "name": "network-vif-plugged", "status": "completed", "tag": "a2f6d496-bbaa-42d6-bd03-98b3f1b5831d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:09.674499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-91cb3456-bab5-48d6-b86d-e3feb159dbfc req-1651423d-c024-4c51-af76-fcf8722a3cc0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:09.674991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-91cb3456-bab5-48d6-b86d-e3feb159dbfc req-1651423d-c024-4c51-af76-fcf8722a3cc0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:09.675431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-91cb3456-bab5-48d6-b86d-e3feb159dbfc req-1651423d-c024-4c51-af76-fcf8722a3cc0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:09.705081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-91cb3456-bab5-48d6-b86d-e3feb159dbfc req-1651423d-c024-4c51-af76-fcf8722a3cc0 service nova] Creating event network-vif-plugged:a2f6d496-bbaa-42d6-bd03-98b3f1b5831d for instance e6124010-7725-4a88-afa7-e16a26fa6545 on n-h2-847009-13 Aug 23 11:12:09.716109 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-91cb3456-bab5-48d6-b86d-e3feb159dbfc req-1651423d-c024-4c51-af76-fcf8722a3cc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067318 Aug 23 11:12:09.717337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3298/6638] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:09.757961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:09.758755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:09.770135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:09.772786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:09.774091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:09.778983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:09.779805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:09.780509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:09.983134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:09.983928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:10.000491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:10.001117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:10.003047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:10.004974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:10.005459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:10.005905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:10.294554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:10.309224 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7094034-430e-43c3-866b-2bb0fc62d7b4 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.554970 Aug 23 11:12:10.310962 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3341/6639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:09 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:10.358635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:10.360139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:10.371023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:10.377033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:10.377577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:10.378346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:10.378835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:10.379276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:10.408533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:10.705084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee5ad2e3-7fb3-493d-b79c-8f89f5b487f6 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1651 microversion: 2.1 time: 0.350381 Aug 23 11:12:10.705688 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3342/6640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:10 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1651 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:10.721192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-139143262", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "715467b9-97f9-4d53-9db3-ac3c3be12aa8"}], "security_groups": [{"name": "tempest-securitygroup--590738046"}], "key_name": "tempest-keypair-2048142317", "user_data": "}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:10.914908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] validate_networks() for [('715467b9-97f9-4d53-9db3-ac3c3be12aa8', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:12:11.004007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:11.025340 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9b845d88-cd4e-418e-a3dd-e3c28f635f73 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1299 microversion: 2.1 time: 1.048118 Aug 23 11:12:11.027325 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3299/6641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:09 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1299 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:11.053152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:11.054124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:11.066222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:11.066931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:11.067607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:11.069828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:11.070493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:11.071120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:11.414496 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-992109ca-ea5a-4fb5-b001-fd253f417b60 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1651 microversion: 2.1 time: 0.366454 Aug 23 11:12:11.418413 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3300/6642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:11 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1651 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:11.434201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:11.434967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:11.449197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:11.449846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:11.450408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:11.460043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:11.461159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:11.461955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:11.748535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:11.756875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0cd8392-3af8-4e4c-b233-aa6136269e76 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.336915 Aug 23 11:12:11.757475 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3301/6643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:11 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:11.770278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:11.774952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:11.792144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:11.792660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:11.793157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:11.793873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:11.794346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:11.794781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.038351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:12.043945 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbfe7d57-fa4e-4b7a-8165-ac400784d44d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1651 microversion: 2.1 time: 0.277406 Aug 23 11:12:12.045558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3302/6644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:11 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1651 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:12.052030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:12.053230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:12.059910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.064366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.064366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.064366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.064366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.065964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.233071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:12.248268 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bae9032-4534-4171-ab67-1fbdadd8df0a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1471 microversion: 2.1 time: 0.200752 Aug 23 11:12:12.250817 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3303/6645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:12 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:12.285017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:12.289072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:12.309019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.321397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:12:12.322049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:12:12.322303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:12:12.323656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:12:12.324242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:12:12.325302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.327017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.330866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.333134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.334106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.352263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.356599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.357135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.357962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.369177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.369669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.386774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:12:12.450898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:12:12.472640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Getting quotas for user 2f677df65e434e45b050d23769ad5863 and project 8e89c4738f5f4f7a9e7985bc175d8867. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:12:12.494448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:12:12.497232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:12:12.568885 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c5c5152-c733-4a03-a600-bb1bd4eddd8a tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.862090 Aug 23 11:12:12.570276 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3343/6646] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:12:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:12:12.575664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:12.576694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:12.585277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.586170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.586897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.588415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.589227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.589955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.600453 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fe7c2ec-4158-4a67-8045-89a8193ac640 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 204 len: 0 microversion: 2.1 time: 0.347208 Aug 23 11:12:12.602130 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3304/6647] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:12:12 2022] DELETE /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:12:12.611947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0dea95d-f01c-475e-bfb0-d521b58e4f6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:12.612674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0dea95d-f01c-475e-bfb0-d521b58e4f6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:12.717116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:12.726025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89594ec4-ca2c-4bd3-bc48-af439167059f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1471 microversion: 2.1 time: 0.154415 Aug 23 11:12:12.729051 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3344/6648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:12 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:12.738970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:12.739922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:12.749407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.749918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.752209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.757347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.760097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.762556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.817215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0dea95d-f01c-475e-bfb0-d521b58e4f6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:12.832147 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0dea95d-f01c-475e-bfb0-d521b58e4f6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1237 microversion: 2.1 time: 0.223457 Aug 23 11:12:12.842874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3305/6649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:12 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1237 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:12.872817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:12.875673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:12.903134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.905037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.907946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:12.911051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:12.915204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:12.929810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:13.127210 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-39c45eaf-2a64-4665-88e2-fdc295104790 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1657 microversion: 2.1 time: 0.396768 Aug 23 11:12:13.155867 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3345/6650] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:12 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1657 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:13.176455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:13.177130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:13.186728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:13.200632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:13.201689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:13.202404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:13.203997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:13.204717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:13.205454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:13.272580 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b77a623-90fa-4115-a446-d4d3eeaaee66 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1624 microversion: 2.1 time: 0.426924 Aug 23 11:12:13.276004 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3306/6651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:12 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1624 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:13.452724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:13.469744 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa3e76ee-8ee6-4a77-8604-3d83251f2850 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.312593 Aug 23 11:12:13.476795 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3346/6652] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:13 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:13.488720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:13.489600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:13.501521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:13.513302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:13.513909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:13.514765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:13.515640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:13.516321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:13.568674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96aa9224-a5a0-465a-9305-440891588493 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Action: 'create', calling method: .version_select at 0x7fdc8f7ee700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1927053174"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:13.876160 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8de7c1fa-e09a-49c9-b832-a06a316eab24 tempest-TestSecurityGroupsBasicOps-13599240 tempest-TestSecurityGroupsBasicOps-13599240-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1912 microversion: 2.1 time: 0.404099 Aug 23 11:12:13.888374 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3347/6653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:13 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1912 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:13.902044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:13.903118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:13.913200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:13.914301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:13.915846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:13.917651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:13.918429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:13.919463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.036638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:14.070166 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dbfb5283-187f-4cf9-a8bb-6360142a386f tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1233 microversion: 2.1 time: 0.180208 Aug 23 11:12:14.070771 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3348/6654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:13 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1233 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:14.077743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:14.087150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:14.102155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.103851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.104571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.105578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.106058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.106503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.164795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:12:14.331505 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96aa9224-a5a0-465a-9305-440891588493 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.049792 Aug 23 11:12:14.332153 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3307/6655] 10.222.0.78 () {60 vars in 1155 bytes} [Tue Aug 23 11:12:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1055 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 11:12:14.337787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:14.338521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:14.362804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.366254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.369487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.370951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.374959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.375664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.436527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad256fab-e822-4b85-855f-676b0ac10061 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 204 len: 0 microversion: 2.1 time: 0.356860 Aug 23 11:12:14.443553 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3349/6656] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:12:14 2022] DELETE /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:12:14.462125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1746459b-cbec-4f14-abe6-22572e90752e tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8fb6cf70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:14.579315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1746459b-cbec-4f14-abe6-22572e90752e tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 345 microversion: 2.1 time: 0.136986 Aug 23 11:12:14.586368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3350/6657] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:14 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:14.594544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:14.602161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:14.616631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.617176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.619999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.620777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.621241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.621675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.906073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:14.934658 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a51ff0ec-2492-4f68-b70b-025dee612028 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1477 microversion: 2.1 time: 0.346120 Aug 23 11:12:14.940612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3351/6658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:14 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1477 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:14.948012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:14.948902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:14.956445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.957196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.958308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:14.960962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:14.961618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:14.963541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:15.066693 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c9a2043-35e4-4330-9f12-62f218511a35 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1657 microversion: 2.1 time: 0.733257 Aug 23 11:12:15.073283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3308/6659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:14 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1657 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:15.093105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:15.094001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:15.103651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:15.108933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:15.109947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:15.110870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:15.112838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:15.113499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:15.312898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:15.326676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bcd07593-9405-48bd-ae6f-5508a2800f46 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1689 microversion: 2.1 time: 0.384113 Aug 23 11:12:15.327262 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3352/6660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:14 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1689 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:15.534441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:15.559812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-096c7a5d-5faa-4b21-8423-28d484f216a1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1289 microversion: 2.1 time: 0.469473 Aug 23 11:12:15.563685 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3309/6661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:15 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1289 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:15.593712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cdd33fe3-855e-4fc5-96ca-6b906d2c9d37 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c21baf0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:15.674173 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cdd33fe3-855e-4fc5-96ca-6b906d2c9d37 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 345 microversion: 2.1 time: 0.084532 Aug 23 11:12:15.675442 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3353/6662] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:15 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:15.963621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:15.964774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:15.981183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:15.981861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:15.982617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:15.987977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:15.989242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:15.990096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.097983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:16.098673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:16.105297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.106057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.106679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.107589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.108243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.109018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.159037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:16.175539 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c62d3214-49d7-47af-b118-f3d9a1526491 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1477 microversion: 2.1 time: 0.217194 Aug 23 11:12:16.176767 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3310/6663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:15 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:16.354884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:16.355269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:16.366915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.369814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.370390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.371134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.373360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.374015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.829089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:16.837272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88559181-47e7-4838-9a43-b66264da13b1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 200 len: 1657 microversion: 2.1 time: 0.742985 Aug 23 11:12:16.852391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f5f4a26b-6d8c-43cf-b42f-eea318f1e005 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1679 microversion: 2.1 time: 0.500677 Aug 23 11:12:16.852391 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3311/6664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:16 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1679 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:16.853812 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3354/6665] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:16 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 1657 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:16.859058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d44ce76e-291b-43af-a9cf-431eeae263d8 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f58d790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:16.874428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:16.875552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:16.897691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.898202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.898646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.900298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.901079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.901696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:16.943181 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d44ce76e-291b-43af-a9cf-431eeae263d8 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 346 microversion: 2.1 time: 0.087814 Aug 23 11:12:16.962750 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3355/6666] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:16 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:16.975491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-bde59174-b414-4379-95b7-0852fcf97fec req-23f49e0f-7393-4315-8f2a-dd700fe4f5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f989bb7b-3c70-414f-8c72-d68a13707eea", "name": "network-vif-deleted", "tag": "ed952c50-d2b1-40af-8113-ee4755882d9d"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:16.992829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bde59174-b414-4379-95b7-0852fcf97fec req-23f49e0f-7393-4315-8f2a-dd700fe4f5a0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:16.997088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bde59174-b414-4379-95b7-0852fcf97fec req-23f49e0f-7393-4315-8f2a-dd700fe4f5a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:16.999043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-bde59174-b414-4379-95b7-0852fcf97fec req-23f49e0f-7393-4315-8f2a-dd700fe4f5a0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.020340 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-bde59174-b414-4379-95b7-0852fcf97fec req-23f49e0f-7393-4315-8f2a-dd700fe4f5a0 service nova] Creating event network-vif-deleted:ed952c50-d2b1-40af-8113-ee4755882d9d for instance f989bb7b-3c70-414f-8c72-d68a13707eea on n-h1-847009-13 Aug 23 11:12:17.037768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-bde59174-b414-4379-95b7-0852fcf97fec req-23f49e0f-7393-4315-8f2a-dd700fe4f5a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068738 Aug 23 11:12:17.038859 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3356/6667] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:17.052609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:17.053781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:17.100011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.110905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.112768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.113759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.116319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.117024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.291473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:17.300563 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36af34d3-5913-4e29-ab61-d5532f546ba9 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.449716 Aug 23 11:12:17.301981 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3312/6668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:16 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:17.307280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b5d364f3-0d17-47b1-b4dd-e59672bd4919 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Action: 'create', calling method: .version_select at 0x7fdc8f7ee670>, body: {"snapshot": {"volume_id": "11311fcc-4d4c-4e39-9417-f9ee5dd7f514", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-232217831"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:17.382282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0fdc5ade-89eb-4625-884f-d3a038cbd2bd tempest-TestNetworkAdvancedServerOps-171334671 tempest-TestNetworkAdvancedServerOps-171334671-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1832 microversion: 2.1 time: 0.341270 Aug 23 11:12:17.384528 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3357/6669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:17 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1832 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:17.390151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:17.391576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:17.399970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.400984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.403133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.404167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.406040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.406646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.758296 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b5d364f3-0d17-47b1-b4dd-e59672bd4919 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.454937 Aug 23 11:12:17.760399 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3313/6670] 10.222.0.78 () {60 vars in 1162 bytes} [Tue Aug 23 11:12:17 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:17.769239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:17.777378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:17.782791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:17.799758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.802882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.803101 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c1b99e2-ce36-4de7-a0e1-b1a295ddf8b0 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1477 microversion: 2.1 time: 0.413387 Aug 23 11:12:17.803689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.814827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.815549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.816504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.817595 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3358/6671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:17 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:17.828308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4833fd2-8863-4389-bc34-dd7c250079f8 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c11c430>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:17.907535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4833fd2-8863-4389-bc34-dd7c250079f8 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 286 microversion: 2.1 time: 0.088357 Aug 23 11:12:17.908171 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3359/6672] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:17 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:17.920551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:17.922225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: f989bb7b-3c70-414f-8c72-d68a13707eea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:17.939216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.939804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.940279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.941109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:17.941590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:17.942242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:17.979364 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] HTTP exception thrown: Instance f989bb7b-3c70-414f-8c72-d68a13707eea could not be found. Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Request method failure captured: Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea HTTP/1.1 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLXZAtB1-iY7bEiKLVxl8TrIsCVjqRXFKFYTmI353vBiJOpswBLNaC8LMb3ky6cyjUauMxVLj4sl25FzbwbaVt30p7fQaaUtd3SI59-3tS6APlPXiYcxkp4iUpXucMujOgIX5qw984Y7Z7Ot730ziegJwXsgTOpl6RN_l-7KW_WBGr8 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 3facc0728c2441b397bcbed1f1b0c28d Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestServerMultinode-535998752 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3facc0728c2441b397bcbed1f1b0c28d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3facc0728c2441b397bcbed1f1b0c28d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3facc0728c2441b397bcbed1f1b0c28d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3facc0728c2441b397bcbed1f1b0c28d"}]}] Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestServerMultinode-535998752 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 3facc0728c2441b397bcbed1f1b0c28d Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestServerMultinode-535998752 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestServerMultinode-535998752-project-admin Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 1e427e96a99846f5afba70eb7f0849e0 Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestServerMultinode-535998752-project-admin Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance f989bb7b-3c70-414f-8c72-d68a13707eea could not be found. Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'f989bb7b-3c70-414f-8c72-d68a13707eea'} Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f989bb7b-3c70-414f-8c72-d68a13707eea could not be found. Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f989bb7b-3c70-414f-8c72-d68a13707eea could not be found. Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:17.982658 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f989bb7b-3c70-414f-8c72-d68a13707eea could not be found. Aug 23 11:12:17.987990 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:17.992068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Returning 404 to user: Instance f989bb7b-3c70-414f-8c72-d68a13707eea could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:17.993839 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d3ae2ae-e1b3-4d63-9fa4-2a16c76d51de tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea" status: 404 len: 111 microversion: 2.1 time: 0.077827 Aug 23 11:12:17.994963 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3360/6673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:17 2022] GET /compute/v2.1/servers/f989bb7b-3c70-414f-8c72-d68a13707eea => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:18.012149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92e4f485-b06c-46d9-9ca6-c1fc694b7258 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c11c820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:18.069994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92e4f485-b06c-46d9-9ca6-c1fc694b7258 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.073684 Aug 23 11:12:18.071128 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3361/6674] 10.222.0.78 () {58 vars in 1140 bytes} [Tue Aug 23 11:12:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:18.077866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:18.078468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:18.094532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.096143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.096615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.097433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.098073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.098519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.165601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:12:18.199435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:18.209875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a712f107-ed4e-4a16-9a18-65f5d8eaee5d tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1679 microversion: 2.1 time: 0.447181 Aug 23 11:12:18.217278 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3314/6675] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:17 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1679 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:18.222395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-753d11ba-6123-4920-9fa0-735125ff625c tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f746dc0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:18.282339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-753d11ba-6123-4920-9fa0-735125ff625c tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 286 microversion: 2.1 time: 0.063559 Aug 23 11:12:18.283174 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3315/6676] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:18 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:18.295241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:18.324071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:18.325098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:18.335793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.336661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.337565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.338717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.339436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.340121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.395335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea0e9099-f454-479b-b0ad-89ec219bcfd3 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 204 len: 0 microversion: 2.1 time: 0.321272 Aug 23 11:12:18.395935 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3362/6677] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:12:18 2022] DELETE /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:12:18.405384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:18.407078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:18.424181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.424721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.431362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.432391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.433078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.433714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.714984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:18.725645 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fc5f1432-1cdd-4f0f-a871-9fa5ff3ed030 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.406320 Aug 23 11:12:18.727005 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3316/6678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:18 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:18.734474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:18.748828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:18.756925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.757354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.757806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.758529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.759558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.759996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.799374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-57001d28-76da-47c9-887f-e9d485782139 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1656 microversion: 2.1 time: 0.398524 Aug 23 11:12:18.802571 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3363/6679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:18 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1656 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:18.831252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:18.831880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:18.842525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.850922 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-722f8348-dfbd-4e58-b8c0-987ad9614510 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action" status: 200 len: 38576 microversion: 2.1 time: 0.121952 Aug 23 11:12:18.851611 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3317/6680] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:12:18 2022] POST /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938/action => generated 38576 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:12:18.860378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.860958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.862084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.862566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.863009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.938597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:18.939264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:18.939549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:18.940021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lazy-loading 'fault' on Instance uuid e6124010-7725-4a88-afa7-e16a26fa6545 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:12:19.063301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:19.083704 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7cf67941-29a7-4bb9-af07-37cbd86ebbae tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1331 microversion: 2.1 time: 0.256030 Aug 23 11:12:19.084236 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3364/6681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:18 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:19.151744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8d63f3ef-d89a-4b15-a190-ceabdc867224 req-4d86e77f-f3fa-4758-adb2-64209c60ac26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6124010-7725-4a88-afa7-e16a26fa6545", "name": "network-vif-deleted", "tag": "a2f6d496-bbaa-42d6-bd03-98b3f1b5831d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:19.184557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8d63f3ef-d89a-4b15-a190-ceabdc867224 req-4d86e77f-f3fa-4758-adb2-64209c60ac26 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:19.185134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8d63f3ef-d89a-4b15-a190-ceabdc867224 req-4d86e77f-f3fa-4758-adb2-64209c60ac26 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:19.185585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8d63f3ef-d89a-4b15-a190-ceabdc867224 req-4d86e77f-f3fa-4758-adb2-64209c60ac26 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:19.211569 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8d63f3ef-d89a-4b15-a190-ceabdc867224 req-4d86e77f-f3fa-4758-adb2-64209c60ac26 service nova] Creating event network-vif-deleted:a2f6d496-bbaa-42d6-bd03-98b3f1b5831d for instance e6124010-7725-4a88-afa7-e16a26fa6545 on n-h2-847009-13 Aug 23 11:12:19.225483 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8d63f3ef-d89a-4b15-a190-ceabdc867224 req-4d86e77f-f3fa-4758-adb2-64209c60ac26 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077550 Aug 23 11:12:19.230054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3318/6682] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:19.296112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c6518c86-acb1-4280-bec8-8a43c07e50dd tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f62bdc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:19.341895 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c6518c86-acb1-4280-bec8-8a43c07e50dd tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 286 microversion: 2.1 time: 0.049796 Aug 23 11:12:19.342837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3365/6683] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:19 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:19.755172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:19.755995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:19.767407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:19.774729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:19.777850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:19.780726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:19.781570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:19.783706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:19.825447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:19.826291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:19.843474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:19.845121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:19.846464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:19.848882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:19.851773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:19.854034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:20.394375 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c19887a4-154e-4b0e-ab79-843f75f52a8a tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1656 microversion: 2.1 time: 0.575659 Aug 23 11:12:20.410361 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3366/6684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:19 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1656 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:20.415311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:20.418939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3c393f10-df5e-4285-970f-38da1308fed6 req-92d5e144-c9de-42a4-9a00-0206be0049e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d145121-67ea-4c28-9f14-dd99936df4a6", "tag": "a9576825-18cf-47f4-bb8b-532b19791e07"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:20.449962 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccdcadbc-413d-4f97-a374-1711b9489e2c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.700148 Aug 23 11:12:20.450835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3319/6685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:19 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:20.464349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c393f10-df5e-4285-970f-38da1308fed6 req-92d5e144-c9de-42a4-9a00-0206be0049e4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:20.465286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c393f10-df5e-4285-970f-38da1308fed6 req-92d5e144-c9de-42a4-9a00-0206be0049e4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:20.465984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3c393f10-df5e-4285-970f-38da1308fed6 req-92d5e144-c9de-42a4-9a00-0206be0049e4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:20.472608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:20.473416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:20.499942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:20.501989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:20.502790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:20.505156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:20.506517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:20.507587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:20.511278 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3c393f10-df5e-4285-970f-38da1308fed6 req-92d5e144-c9de-42a4-9a00-0206be0049e4 service nova] Creating event network-changed:a9576825-18cf-47f4-bb8b-532b19791e07 for instance 2d145121-67ea-4c28-9f14-dd99936df4a6 on n-h1-847009-13 Aug 23 11:12:20.542372 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3c393f10-df5e-4285-970f-38da1308fed6 req-92d5e144-c9de-42a4-9a00-0206be0049e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130073 Aug 23 11:12:20.554970 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3367/6686] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:20.572006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a5d7b88f-c9f7-45a6-adb9-e43480c65369 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f556d30>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:20.577711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:20.578599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:20.579202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:20.579823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lazy-loading 'fault' on Instance uuid e6124010-7725-4a88-afa7-e16a26fa6545 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:12:20.638848 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a5d7b88f-c9f7-45a6-adb9-e43480c65369 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 287 microversion: 2.1 time: 0.081841 Aug 23 11:12:20.646422 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3368/6687] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:20 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:20.660693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7a7cc9b-66f0-46ac-97f9-4082178a2cdb tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c1e6f70>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:20.797994 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7a7cc9b-66f0-46ac-97f9-4082178a2cdb tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 202 len: 0 microversion: 2.1 time: 0.150154 Aug 23 11:12:20.798608 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3369/6688] 10.222.0.78 () {58 vars in 1254 bytes} [Tue Aug 23 11:12:20 2022] DELETE /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:12:20.808871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b52b744d-30ab-43a0-89a0-08093e693f3f tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8fb6ca60>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:20.860164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:20.888503 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5d8a639d-ab2c-444a-a0de-a927055b80e8 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 200 len: 1331 microversion: 2.1 time: 0.430598 Aug 23 11:12:20.889657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3320/6689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:20 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 1331 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:20.903986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b52b744d-30ab-43a0-89a0-08093e693f3f tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 286 microversion: 2.1 time: 0.099843 Aug 23 11:12:20.904875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3370/6690] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:20 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:12:21.426637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:21.428797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:21.451676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:21.452518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:21.454863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:21.455841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:21.458657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:21.459354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:21.492472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:21.495106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:21.513039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:21.517719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:21.518540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:21.519893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:21.520817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:21.521640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:21.904623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:21.971077 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bae9bdba-a5be-4121-a2f0-e5d6d0649055 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.495857 Aug 23 11:12:21.972955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3371/6691] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:21 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:21.976105 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22bf77e5-d9df-4632-9e72-fce4cac797d4 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1656 microversion: 2.1 time: 0.556869 Aug 23 11:12:21.985464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:21.986351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: e6124010-7725-4a88-afa7-e16a26fa6545] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:22.001664 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3321/6692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:21 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1656 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:22.002490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.003256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.004521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.005545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.006248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.006885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.014684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2b7f9dd-9ef9-4de2-939a-8501846860af tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f71e700>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:22.031968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] HTTP exception thrown: Instance e6124010-7725-4a88-afa7-e16a26fa6545 could not be found. Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Request method failure captured: Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 HTTP/1.1 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLVksi0bxWqQqiXRcU6JG5MHKznGRo8_7GOIDePLc1e_-OJ_DuNwgaFPxB3NqlmrfQLujyjPfABFyj2-TUQVOaix5QecqX1Y1ZBaO2DY0zrJJ7vRjnkKCcbwyF_aGyuVLYpDNQspN7VzVsR6g07LdIZuuO_Fa219VQ7D69nA_K8d1q0 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4bdbe227f743406a9e93c8e86dc76cde Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-204172568 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4bdbe227f743406a9e93c8e86dc76cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4bdbe227f743406a9e93c8e86dc76cde", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4bdbe227f743406a9e93c8e86dc76cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4bdbe227f743406a9e93c8e86dc76cde"}]}] Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestSecurityGroupsBasicOps-204172568 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4bdbe227f743406a9e93c8e86dc76cde Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-204172568 Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestSecurityGroupsBasicOps-204172568-project Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7c32c0e05d9e47a6950dd0297ed8aabc Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestSecurityGroupsBasicOps-204172568-project Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance e6124010-7725-4a88-afa7-e16a26fa6545 could not be found. Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'e6124010-7725-4a88-afa7-e16a26fa6545'} Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6124010-7725-4a88-afa7-e16a26fa6545 could not be found. Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6124010-7725-4a88-afa7-e16a26fa6545 could not be found. Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:22.034516 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6124010-7725-4a88-afa7-e16a26fa6545 could not be found. Aug 23 11:12:22.039215 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:22.044167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Returning 404 to user: Instance e6124010-7725-4a88-afa7-e16a26fa6545 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:22.045829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28e9bd87-8d4f-4662-9a36-2d678d2c47dd tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545" status: 404 len: 111 microversion: 2.1 time: 0.065650 Aug 23 11:12:22.046915 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3372/6693] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:21 2022] GET /compute/v2.1/servers/e6124010-7725-4a88-afa7-e16a26fa6545 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:22.053165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:22.053946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:22.063314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.064477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.065854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.066808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.067461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.068082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.082229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2b7f9dd-9ef9-4de2-939a-8501846860af tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 286 microversion: 2.1 time: 0.078927 Aug 23 11:12:22.083061 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3322/6694] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:22 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:22.110723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:12:22.234538 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08f64771-50e7-461b-a035-dd51ae85f989 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 204 len: 0 microversion: 2.1 time: 0.184829 Aug 23 11:12:22.239426 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3373/6695] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:12:22 2022] DELETE /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:12:22.245468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:22.246392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:22.253817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.256664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.259821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.264007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.264808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.265600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.295686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:22.602016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-13319372-c00f-460b-9057-ba2ff0f318d9 req-0c31e26a-cdf9-4fd8-ab75-5c063c5e1805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:22.620011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:22.623055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:22.629973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-13319372-c00f-460b-9057-ba2ff0f318d9 req-0c31e26a-cdf9-4fd8-ab75-5c063c5e1805 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:22.633756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-13319372-c00f-460b-9057-ba2ff0f318d9 req-0c31e26a-cdf9-4fd8-ab75-5c063c5e1805 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:22.634430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-13319372-c00f-460b-9057-ba2ff0f318d9 req-0c31e26a-cdf9-4fd8-ab75-5c063c5e1805 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:22.689284 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-13319372-c00f-460b-9057-ba2ff0f318d9 req-0c31e26a-cdf9-4fd8-ab75-5c063c5e1805 service nova] Creating event network-changed:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h1-847009-13 Aug 23 11:12:22.709431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-13319372-c00f-460b-9057-ba2ff0f318d9 req-0c31e26a-cdf9-4fd8-ab75-5c063c5e1805 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111455 Aug 23 11:12:22.710411 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3374/6696] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:12:22.823587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:23.004514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:23.006764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:23.023779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:23.024904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:23.025750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:23.029428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:23.036485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:23.037171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:23.255894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:23.279330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a41e7dd-f8aa-4ad7-b9af-b62c07a313bd tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1685 microversion: 2.1 time: 1.030270 Aug 23 11:12:23.280034 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3323/6697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:22 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1685 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:23.302150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:23.302818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:23.326963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:23.327484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:23.327942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:23.328682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:23.337573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:23.341819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:23.483244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a1c9a83-4752-43b9-b84a-e1372d7df3f1 tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 200 len: 1614 microversion: 2.1 time: 0.189831 Aug 23 11:12:23.483998 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3324/6698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:23 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 1614 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:23.492418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21933415-bd44-4d11-9cd4-1183ad45afc7 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f777f70>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:23.563630 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21933415-bd44-4d11-9cd4-1183ad45afc7 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 200 len: 286 microversion: 2.1 time: 0.076689 Aug 23 11:12:23.565818 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3325/6699] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:23 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:23.579135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-107c7340-13e6-47ae-8f54-4aaa7879c5fa req-47a5d38d-79ac-4173-a072-75656474179e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4841b11-b9fd-4c7d-b9c5-468f9658456b", "name": "network-vif-deleted", "tag": "86d7ccfc-a5ec-4fef-8711-26095efe742d"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:23.611892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-107c7340-13e6-47ae-8f54-4aaa7879c5fa req-47a5d38d-79ac-4173-a072-75656474179e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:23.613717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-107c7340-13e6-47ae-8f54-4aaa7879c5fa req-47a5d38d-79ac-4173-a072-75656474179e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:23.614868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-107c7340-13e6-47ae-8f54-4aaa7879c5fa req-47a5d38d-79ac-4173-a072-75656474179e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:23.629058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:23.641850 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-70b740d3-94bf-4fd3-815f-75f875b29e63 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.651524 Aug 23 11:12:23.643091 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3375/6700] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:22 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:23.660837 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-107c7340-13e6-47ae-8f54-4aaa7879c5fa req-47a5d38d-79ac-4173-a072-75656474179e service nova] Creating event network-vif-deleted:86d7ccfc-a5ec-4fef-8711-26095efe742d for instance c4841b11-b9fd-4c7d-b9c5-468f9658456b on n-h2-847009-13 Aug 23 11:12:23.668567 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-107c7340-13e6-47ae-8f54-4aaa7879c5fa req-47a5d38d-79ac-4173-a072-75656474179e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100536 Aug 23 11:12:23.670312 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3326/6701] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:24.308811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:24.309943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:24.334986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:24.337555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:24.339236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:24.341318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:24.343533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:24.343966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:24.509327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:24.510046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] [instance: c4841b11-b9fd-4c7d-b9c5-468f9658456b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:24.537195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:24.542474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:24.543163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:24.549327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:24.550216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:24.551177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:24.591470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] HTTP exception thrown: Instance c4841b11-b9fd-4c7d-b9c5-468f9658456b could not be found. Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Request method failure captured: Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b HTTP/1.1 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLXZAtB1-iY7bEiKLVxl8TrIsCVjqRXFKFYTmI353vBiJOpswBLNaC8LMb3ky6cyjUauMxVLj4sl25FzbwbaVt30p7fQaaUtd3SI59-3tS6APlPXiYcxkp4iUpXucMujOgIX5qw984Y7Z7Ot730ziegJwXsgTOpl6RN_l-7KW_WBGr8 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 3facc0728c2441b397bcbed1f1b0c28d Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestServerMultinode-535998752 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3facc0728c2441b397bcbed1f1b0c28d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3facc0728c2441b397bcbed1f1b0c28d", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3facc0728c2441b397bcbed1f1b0c28d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3facc0728c2441b397bcbed1f1b0c28d"}]}] Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestServerMultinode-535998752 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 3facc0728c2441b397bcbed1f1b0c28d Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestServerMultinode-535998752 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestServerMultinode-535998752-project-admin Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 1e427e96a99846f5afba70eb7f0849e0 Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestServerMultinode-535998752-project-admin Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance c4841b11-b9fd-4c7d-b9c5-468f9658456b could not be found. Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'c4841b11-b9fd-4c7d-b9c5-468f9658456b'} Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4841b11-b9fd-4c7d-b9c5-468f9658456b could not be found. Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4841b11-b9fd-4c7d-b9c5-468f9658456b could not be found. Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:24.593415 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4841b11-b9fd-4c7d-b9c5-468f9658456b could not be found. Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] Returning 404 to user: Instance c4841b11-b9fd-4c7d-b9c5-468f9658456b could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:24.600486 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4853ee12-3f22-478c-9458-2f7a0e4e402d tempest-TestServerMultinode-535998752 tempest-TestServerMultinode-535998752-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b" status: 404 len: 111 microversion: 2.1 time: 0.094237 Aug 23 11:12:24.607751 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3327/6702] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:24 2022] GET /compute/v2.1/servers/c4841b11-b9fd-4c7d-b9c5-468f9658456b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:24.615650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-085b6653-16c0-4b65-9780-e52f7cac54ad tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f763040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:24.671523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-085b6653-16c0-4b65-9780-e52f7cac54ad tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] HTTP exception thrown: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-085b6653-16c0-4b65-9780-e52f7cac54ad tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Request method failure captured: Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a HTTP/1.1 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLYNjjP-1HuLqpdsn-RmRx7ddhazEC4cnEn0cLENmaGYs7JC9cDCKvOo1sGWE-ugAMqBA61kX8_vyoCsWWLnPxjyi4cGxIZi7xLDsNCaEfwZbnEFLlOFrgip_al_5RqArgImhZOYcLkpUmfYMhznBEy_vQTIQF40srjKBWogcxHy-_s Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23a5487cf7314a4bb24cb0d838215c68", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}] Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: dd4b89d738144bdc86fddaaea850d3c1 Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: exception: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '3b4cf3e3-38e2-4e20-a727-cec69055cb4a'} Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. (HTTP 404) (Request-ID: req-c0b2ccf2-92f4-4349-97e7-4fd653874646) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:12:24.684309 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-085b6653-16c0-4b65-9780-e52f7cac54ad tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Returning 404 to user: Snapshot 3b4cf3e3-38e2-4e20-a727-cec69055cb4a could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-085b6653-16c0-4b65-9780-e52f7cac54ad tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a" status: 404 len: 111 microversion: 2.1 time: 0.077075 Aug 23 11:12:24.689414 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3328/6703] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:12:24 2022] GET /compute/v2.1/os-snapshots/3b4cf3e3-38e2-4e20-a727-cec69055cb4a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:24.696977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:24.701335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:24.717710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:24.718435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:24.719311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:24.720286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:24.721439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:24.723761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:24.813189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:24.831342 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bb80ae3c-23de-4018-a9aa-1ee7102343be tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1685 microversion: 2.1 time: 0.529691 Aug 23 11:12:24.831952 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3376/6704] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:24 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1685 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:24.837448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-91792f1b-72aa-4cf1-b89b-6fc560b46eab tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdca1d87940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:24.984160 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-91792f1b-72aa-4cf1-b89b-6fc560b46eab tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 202 len: 0 microversion: 2.1 time: 0.150158 Aug 23 11:12:24.986438 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3377/6705] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:12:24 2022] DELETE /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:12:24.996490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bcae4f91-bd1c-451b-9748-0af30e4ff633 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c1f31f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:25.094729 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bcae4f91-bd1c-451b-9748-0af30e4ff633 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 345 microversion: 2.1 time: 0.102853 Aug 23 11:12:25.102713 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3378/6706] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:24 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:25.377132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:25.386202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c31b19a2-a461-45c0-a8d5-e55538540ded tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.697732 Aug 23 11:12:25.386785 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3329/6707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:24 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:25.859078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:25.859700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:25.887364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:25.899392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:25.899974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:25.900839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:25.901346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:25.901773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:26.114202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-941ae8f3-81a6-42e9-a120-88c46716573d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f748e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:26.259157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-941ae8f3-81a6-42e9-a120-88c46716573d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 345 microversion: 2.1 time: 0.152150 Aug 23 11:12:26.260895 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3330/6708] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:26 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:26.407862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:26.408486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:26.423743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:26.425345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:26.425980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:26.426431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:26.427157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:26.427617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:26.440250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:26.500185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:26.513990 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d361c157-df1d-47b0-ad4b-e22649ef31a3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 200 len: 1685 microversion: 2.1 time: 0.658910 Aug 23 11:12:26.517056 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3379/6709] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:25 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 1685 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:26.667878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-49197eee-49b1-4289-aaa2-57f1e84811cf req-90b5b654-41a1-4b5c-81be-601981763441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0752a001-1352-4a66-8fa3-38806a2dc938", "name": "network-vif-deleted", "tag": "d9037c99-6c7c-4cfe-99ac-593a0002779e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:26.717160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49197eee-49b1-4289-aaa2-57f1e84811cf req-90b5b654-41a1-4b5c-81be-601981763441 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:26.720443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49197eee-49b1-4289-aaa2-57f1e84811cf req-90b5b654-41a1-4b5c-81be-601981763441 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:26.721737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49197eee-49b1-4289-aaa2-57f1e84811cf req-90b5b654-41a1-4b5c-81be-601981763441 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:26.775417 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-49197eee-49b1-4289-aaa2-57f1e84811cf req-90b5b654-41a1-4b5c-81be-601981763441 service nova] Creating event network-vif-deleted:d9037c99-6c7c-4cfe-99ac-593a0002779e for instance 0752a001-1352-4a66-8fa3-38806a2dc938 on n-h1-847009-13 Aug 23 11:12:26.798252 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-49197eee-49b1-4289-aaa2-57f1e84811cf req-90b5b654-41a1-4b5c-81be-601981763441 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137115 Aug 23 11:12:26.802513 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3380/6710] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:12:27.069469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:27.080960 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd8a1051-7a74-45a1-bafb-160bc6641c3d tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.677274 Aug 23 11:12:27.082186 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3331/6711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:26 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:27.278696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18a19d4d-e364-440a-85bb-01d8793108e9 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c1e4b80>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:27.388138 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-18a19d4d-e364-440a-85bb-01d8793108e9 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 345 microversion: 2.1 time: 0.116262 Aug 23 11:12:27.397482 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3381/6712] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:27 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:27.555803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:27.558564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 0752a001-1352-4a66-8fa3-38806a2dc938] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:27.584197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b1e878b4-60b9-433e-99d3-88f2f2f15bfc req-307dfe92-8efa-4269-b4b8-3151f52c4730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d145121-67ea-4c28-9f14-dd99936df4a6", "name": "network-vif-plugged", "status": "completed", "tag": "a9576825-18cf-47f4-bb8b-532b19791e07"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:27.593298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:27.597721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:27.599565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:27.605213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:27.605892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:27.609895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:27.618730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b1e878b4-60b9-433e-99d3-88f2f2f15bfc req-307dfe92-8efa-4269-b4b8-3151f52c4730 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:27.625147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b1e878b4-60b9-433e-99d3-88f2f2f15bfc req-307dfe92-8efa-4269-b4b8-3151f52c4730 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:27.625884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b1e878b4-60b9-433e-99d3-88f2f2f15bfc req-307dfe92-8efa-4269-b4b8-3151f52c4730 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:27.665399 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b1e878b4-60b9-433e-99d3-88f2f2f15bfc req-307dfe92-8efa-4269-b4b8-3151f52c4730 service nova] Creating event network-vif-plugged:a9576825-18cf-47f4-bb8b-532b19791e07 for instance 2d145121-67ea-4c28-9f14-dd99936df4a6 on n-h1-847009-13 Aug 23 11:12:27.676277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] HTTP exception thrown: Instance 0752a001-1352-4a66-8fa3-38806a2dc938 could not be found. Aug 23 11:12:27.676535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b1e878b4-60b9-433e-99d3-88f2f2f15bfc req-307dfe92-8efa-4269-b4b8-3151f52c4730 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096151 Aug 23 11:12:27.679669 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3382/6713] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Request method failure captured: Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 HTTP/1.1 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPS6dqOS_zEv0sC6ZMxneqd8cjvhwM_ReN9ia834ny4t3AfM938V8rdG3LlNSFFPyt-L_78meJbOo2HvxrYN5BnMC7jtt4TymfaTmp0u2dCADn5Z54wnHlalMz17UWbj_or8mR62OencPjC8qMxXls3QLLfOMAMr8QkN-pelrnetpk Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aadc538b532d48b780b04b2ca23e4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}] Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: b40863219f8c498881c9ee5b5ce5a8c5 Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 0752a001-1352-4a66-8fa3-38806a2dc938 could not be found. Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '0752a001-1352-4a66-8fa3-38806a2dc938'} Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0752a001-1352-4a66-8fa3-38806a2dc938 could not be found. Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0752a001-1352-4a66-8fa3-38806a2dc938 could not be found. Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:27.683114 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0752a001-1352-4a66-8fa3-38806a2dc938 could not be found. Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Returning 404 to user: Instance 0752a001-1352-4a66-8fa3-38806a2dc938 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:27.688662 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68bffd8c-400d-4f6f-b31e-7b96e7c952b5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938" status: 404 len: 111 microversion: 2.1 time: 0.147781 Aug 23 11:12:27.693073 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3332/6714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:27 2022] GET /compute/v2.1/servers/0752a001-1352-4a66-8fa3-38806a2dc938 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:28.104725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:28.105965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:28.121544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:28.123099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:28.123977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:28.127673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:28.128445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:28.129153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:28.444653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f293fe9-e5cc-43b6-a07f-9fb00451cf7d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f748e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:28.556545 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f293fe9-e5cc-43b6-a07f-9fb00451cf7d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 200 len: 345 microversion: 2.1 time: 0.157023 Aug 23 11:12:28.564389 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3333/6715] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:28 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:12:29.083167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:29.103107 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a4f309e1-041b-4bb1-ae48-93ef5b7a12f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 1.003603 Aug 23 11:12:29.116701 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3383/6716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:28 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:29.593216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ea3e8e1-df6b-4361-aa3e-af56a949a062 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f728820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:29.654614 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-2ea3e8e1-df6b-4361-aa3e-af56a949a062 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] HTTP exception thrown: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ea3e8e1-df6b-4361-aa3e-af56a949a062 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Request method failure captured: Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 HTTP/1.1 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLYNjjP-1HuLqpdsn-RmRx7ddhazEC4cnEn0cLENmaGYs7JC9cDCKvOo1sGWE-ugAMqBA61kX8_vyoCsWWLnPxjyi4cGxIZi7xLDsNCaEfwZbnEFLlOFrgip_al_5RqArgImhZOYcLkpUmfYMhznBEy_vQTIQF40srjKBWogcxHy-_s Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23a5487cf7314a4bb24cb0d838215c68", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}] Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: dd4b89d738144bdc86fddaaea850d3c1 Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: exception: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '11311fcc-4d4c-4e39-9417-f9ee5dd7f514'} Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. (HTTP 404) (Request-ID: req-aab299f1-26ab-497e-8ec5-962a4d5a18d5) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:12:29.656695 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ea3e8e1-df6b-4361-aa3e-af56a949a062 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Returning 404 to user: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:29.663375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ea3e8e1-df6b-4361-aa3e-af56a949a062 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 404 len: 109 microversion: 2.1 time: 0.095648 Aug 23 11:12:29.669595 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3334/6717] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:29 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:29.672212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7f92383-baa2-43a5-ab1a-0a1d40658296 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc9c1e4e50>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:29.730260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d7f92383-baa2-43a5-ab1a-0a1d40658296 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] HTTP exception thrown: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7f92383-baa2-43a5-ab1a-0a1d40658296 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Request method failure captured: Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 HTTP/1.1 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLYNjjP-1HuLqpdsn-RmRx7ddhazEC4cnEn0cLENmaGYs7JC9cDCKvOo1sGWE-ugAMqBA61kX8_vyoCsWWLnPxjyi4cGxIZi7xLDsNCaEfwZbnEFLlOFrgip_al_5RqArgImhZOYcLkpUmfYMhznBEy_vQTIQF40srjKBWogcxHy-_s Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23a5487cf7314a4bb24cb0d838215c68", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}] Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dd4b89d738144bdc86fddaaea850d3c1 Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: method: Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: exception: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '11311fcc-4d4c-4e39-9417-f9ee5dd7f514'} Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. (HTTP 404) (Request-ID: req-d0296ba7-af62-4b60-b8a4-81a5b45ce0ab) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:12:29.733436 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.738618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.744390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7f92383-baa2-43a5-ab1a-0a1d40658296 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Returning 404 to user: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:29.745639 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7f92383-baa2-43a5-ab1a-0a1d40658296 tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 404 len: 109 microversion: 2.1 time: 0.077272 Aug 23 11:12:29.746729 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3384/6718] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:12:29 2022] DELETE /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:29.759651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b4de8b0-7b29-410f-a1d2-61bc4fedfe5d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Calling method '.version_select at 0x7fdc8f728e50>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:29.803452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-1b4de8b0-7b29-410f-a1d2-61bc4fedfe5d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] HTTP exception thrown: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b4de8b0-7b29-410f-a1d2-61bc4fedfe5d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Request method failure captured: Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 HTTP/1.1 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLYNjjP-1HuLqpdsn-RmRx7ddhazEC4cnEn0cLENmaGYs7JC9cDCKvOo1sGWE-ugAMqBA61kX8_vyoCsWWLnPxjyi4cGxIZi7xLDsNCaEfwZbnEFLlOFrgip_al_5RqArgImhZOYcLkpUmfYMhznBEy_vQTIQF40srjKBWogcxHy-_s Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_23a5487cf7314a4bb24cb0d838215c68", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/23a5487cf7314a4bb24cb0d838215c68"}]}] Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 23a5487cf7314a4bb24cb0d838215c68 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1275588644 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: dd4b89d738144bdc86fddaaea850d3c1 Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1275588644-project Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: exception: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '11311fcc-4d4c-4e39-9417-f9ee5dd7f514'} Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. (HTTP 404) (Request-ID: req-2459681d-9555-4bfa-89c2-a5b26f5ec95c) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:12:29.806544 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. Aug 23 11:12:29.811854 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:29.820656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b4de8b0-7b29-410f-a1d2-61bc4fedfe5d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] Returning 404 to user: Volume 11311fcc-4d4c-4e39-9417-f9ee5dd7f514 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:29.820656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b4de8b0-7b29-410f-a1d2-61bc4fedfe5d tempest-VolumesSnapshotsTestJSON-1275588644 tempest-VolumesSnapshotsTestJSON-1275588644-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514" status: 404 len: 109 microversion: 2.1 time: 0.064412 Aug 23 11:12:29.827574 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3335/6719] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:29 2022] GET /compute/v2.1/os-volumes/11311fcc-4d4c-4e39-9417-f9ee5dd7f514 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:30.125891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:30.126524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:30.142523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:30.154911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:30.155370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:30.156195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:30.156665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:30.157136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:30.854775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:30.871747 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-582252aa-f098-4793-ba54-a3a9ca71635c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1362 microversion: 2.1 time: 0.750761 Aug 23 11:12:30.872530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3385/6720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:30 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1362 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:31.914464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:31.921042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:31.939291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:31.939883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:31.940344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:31.942830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:31.943377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:31.943832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:32.906393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:32.916021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15c773d7-8fdf-4b12-80b7-eb5adb372846 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1549 microversion: 2.1 time: 1.025821 Aug 23 11:12:32.917663 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3336/6721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:31 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1549 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:12:32.941831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:32.943141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:32.955554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:32.957324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:32.958047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:32.962270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:32.963929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:32.964913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:33.133044 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f06b914-7701-4eea-88d9-1cdac993a798 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195038 Aug 23 11:12:33.133906 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3386/6722] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:12:32 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:35.533838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f6450746-529b-4e56-b09c-87028510aeaf req-220bc8b0-5feb-495b-a1c5-f703638e1c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d145121-67ea-4c28-9f14-dd99936df4a6", "tag": "a9576825-18cf-47f4-bb8b-532b19791e07"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:35.535596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e5d55339-27b9-4264-ad27-199cd01e985d tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Action: 'create', calling method: .version_select at 0x7fdca1dac1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-522091355", "metadata": {"Type": "work"}}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:35.567724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f6450746-529b-4e56-b09c-87028510aeaf req-220bc8b0-5feb-495b-a1c5-f703638e1c47 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:35.568689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f6450746-529b-4e56-b09c-87028510aeaf req-220bc8b0-5feb-495b-a1c5-f703638e1c47 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:35.569345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f6450746-529b-4e56-b09c-87028510aeaf req-220bc8b0-5feb-495b-a1c5-f703638e1c47 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:35.598583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f6450746-529b-4e56-b09c-87028510aeaf req-220bc8b0-5feb-495b-a1c5-f703638e1c47 service nova] Creating event network-changed:a9576825-18cf-47f4-bb8b-532b19791e07 for instance 2d145121-67ea-4c28-9f14-dd99936df4a6 on n-h1-847009-13 Aug 23 11:12:35.622117 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f6450746-529b-4e56-b09c-87028510aeaf req-220bc8b0-5feb-495b-a1c5-f703638e1c47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094601 Aug 23 11:12:35.624676 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3387/6723] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:36.104238 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e5d55339-27b9-4264-ad27-199cd01e985d tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.791359 Aug 23 11:12:36.106014 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3337/6724] 10.222.0.78 () {60 vars in 1156 bytes} [Tue Aug 23 11:12:35 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 796 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 11:12:36.120462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac5362df-10a4-47e9-9118-1a7af15814f1 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc8f58d820>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:36.294197 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac5362df-10a4-47e9-9118-1a7af15814f1 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 352 microversion: 2.1 time: 0.179170 Aug 23 11:12:36.296219 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3388/6725] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:36 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 352 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:37.309471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b585907-3d30-4ad6-ba9f-be809683d0b0 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc8f799280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:37.462844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b585907-3d30-4ad6-ba9f-be809683d0b0 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 352 microversion: 2.1 time: 0.158172 Aug 23 11:12:37.463423 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3338/6726] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:37 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:38.484555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58dcc19d-10bc-4b3b-9862-23f6b1ce15c9 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc8f67cca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:38.590148 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58dcc19d-10bc-4b3b-9862-23f6b1ce15c9 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 353 microversion: 2.1 time: 0.117070 Aug 23 11:12:38.591228 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3389/6727] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:38 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:38.605458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c6a8b81-7eeb-42e4-a75b-c14f9abc912e tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc9c09a670>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:38.750917 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c6a8b81-7eeb-42e4-a75b-c14f9abc912e tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 353 microversion: 2.1 time: 0.151349 Aug 23 11:12:38.751507 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3339/6728] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:38 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:38.769089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15fd8910-306b-4919-802b-2b1694c50f90 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc9c258280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:38.904540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15fd8910-306b-4919-802b-2b1694c50f90 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 202 len: 0 microversion: 2.1 time: 0.141868 Aug 23 11:12:38.905025 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3390/6729] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:12:38 2022] DELETE /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:12:38.914732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7251dec-8b33-4351-a187-4e9e3d613510 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc8f728820>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:39.029562 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7251dec-8b33-4351-a187-4e9e3d613510 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 352 microversion: 2.1 time: 0.120364 Aug 23 11:12:39.035420 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3340/6730] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:38 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:40.043679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c268a5ce-47a3-4b70-84c5-d26a16f2323b tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc9c258ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:40.143477 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c268a5ce-47a3-4b70-84c5-d26a16f2323b tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 352 microversion: 2.1 time: 0.104372 Aug 23 11:12:40.144689 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3391/6731] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:40 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:40.436101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:40.437804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:40.474631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:40.475146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:40.475741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:40.476489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:40.477787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:40.484237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:40.582005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:12:40.732030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-165db553-6d79-4eef-9621-0cb6286689fa req-a4926d12-e3a5-4771-8e62-2f98c7afaef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d217f215-b58f-466d-9b0f-9950de9a1015", "tag": "6d483fd6-6512-46e4-94ce-3ede9270e7ce"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:40.750130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-165db553-6d79-4eef-9621-0cb6286689fa req-a4926d12-e3a5-4771-8e62-2f98c7afaef5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:40.751003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-165db553-6d79-4eef-9621-0cb6286689fa req-a4926d12-e3a5-4771-8e62-2f98c7afaef5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:40.751794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-165db553-6d79-4eef-9621-0cb6286689fa req-a4926d12-e3a5-4771-8e62-2f98c7afaef5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:40.762868 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83d94cfe-9706-465c-970a-f2f80414e42f tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 204 len: 0 microversion: 2.1 time: 0.332212 Aug 23 11:12:40.763861 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3341/6732] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:12:40 2022] DELETE /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:12:40.769319 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-165db553-6d79-4eef-9621-0cb6286689fa req-a4926d12-e3a5-4771-8e62-2f98c7afaef5 service nova] Creating event network-changed:6d483fd6-6512-46e4-94ce-3ede9270e7ce for instance d217f215-b58f-466d-9b0f-9950de9a1015 on n-h1-847009-13 Aug 23 11:12:40.789821 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-165db553-6d79-4eef-9621-0cb6286689fa req-a4926d12-e3a5-4771-8e62-2f98c7afaef5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062838 Aug 23 11:12:40.791285 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3392/6733] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:40.797791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:40.802571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:40.816274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:40.816809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:40.820301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:40.821861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:40.851572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:40.855049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:41.160652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d19b2ba2-6435-41c3-92c3-a3a5bc3411d8 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdca1d87940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:41.279371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d19b2ba2-6435-41c3-92c3-a3a5bc3411d8 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 352 microversion: 2.1 time: 0.125151 Aug 23 11:12:41.280667 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3393/6734] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:41 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:41.667527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-51f69fe6-922d-4281-bb22-f71e49966a45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '.version_select at 0x7fdc8f5214c0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:41.710897 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-51f69fe6-922d-4281-bb22-f71e49966a45 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-890553049" status: 202 len: 0 microversion: 2.1 time: 0.048300 Aug 23 11:12:41.713733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:41.717809 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3394/6735] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 11:12:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-890553049 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:12:41.733520 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9679babf-6d53-4d5a-8fe6-46c4e80c9174 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1765 microversion: 2.1 time: 0.951443 Aug 23 11:12:41.741913 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3342/6736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:40 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1765 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:41.763678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-924487fc-4e38-43eb-a41d-ca5b4c7dfdd7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: .version_select at 0x7fdc8f5b08b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2054733182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSDvGuQYDH0IJt0KTCZp7hhgVGkGasn20LhrnJJTHMG82C6c8hgR1lwnSCqWaKvVvAxjRK8WRcqSZrdpErg+JU00xbAaL9gM/t4iHsnv0UKMon2PfFbdXJTdeBV03bllw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:41.842028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-924487fc-4e38-43eb-a41d-ca5b4c7dfdd7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:12:41.864605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-924487fc-4e38-43eb-a41d-ca5b4c7dfdd7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:12:41.969370 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-924487fc-4e38-43eb-a41d-ca5b4c7dfdd7 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.209477 Aug 23 11:12:41.970995 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3395/6737] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:12:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:42.294264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-784f5435-8d2b-4210-a73c-606915f34cd3 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc8f74fc10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:42.410455 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-784f5435-8d2b-4210-a73c-606915f34cd3 tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 200 len: 352 microversion: 2.1 time: 0.119903 Aug 23 11:12:42.410851 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3343/6738] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:42 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:42.759715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:42.761309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:42.772077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:42.772829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:42.773472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:42.774685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:42.775421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:42.776084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:43.426513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8acbbdb-cf3b-4b7b-a536-61f3c97fa3fb tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Calling method '.version_select at 0x7fdc8f70ac10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:43.477895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-f8acbbdb-cf3b-4b7b-a536-61f3c97fa3fb tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] HTTP exception thrown: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8acbbdb-cf3b-4b7b-a536-61f3c97fa3fb tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Request method failure captured: Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 HTTP/1.1 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLYjPkiDgtoAU9cuwJjlcdgl7i7_6lLRw0iurI1GUEz5DWApBwXQrnNRm6oK7jUn5LldylFqijN9xOK4P4996JeBAalz_KhKppKa7DF0UbQqJVu0dBoXZIXCqoDqG8JHOLrqCx7vj1qeHPF1-elnMuy7eEt8ru346yg5VWGDLSmiVwo Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b4dbe0fb463a4e93880f7ed16c3415e6 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesGetTestJSON-1881123386 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4dbe0fb463a4e93880f7ed16c3415e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4dbe0fb463a4e93880f7ed16c3415e6", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4dbe0fb463a4e93880f7ed16c3415e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4dbe0fb463a4e93880f7ed16c3415e6"}]}] Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesGetTestJSON-1881123386 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b4dbe0fb463a4e93880f7ed16c3415e6 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesGetTestJSON-1881123386 Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesGetTestJSON-1881123386-project Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 7b81577f0c354898a76dd53c99413fdc Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesGetTestJSON-1881123386-project Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: method: Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: exception: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8984f44d-308a-4312-9292-1d9c788a88e9'} Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. (HTTP 404) (Request-ID: req-658e63f6-29fa-4239-876a-151c402df980) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 11:12:43.480424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8acbbdb-cf3b-4b7b-a536-61f3c97fa3fb tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] Returning 404 to user: Volume 8984f44d-308a-4312-9292-1d9c788a88e9 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:43.487249 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8acbbdb-cf3b-4b7b-a536-61f3c97fa3fb tempest-VolumesGetTestJSON-1881123386 tempest-VolumesGetTestJSON-1881123386-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9" status: 404 len: 109 microversion: 2.1 time: 0.065458 Aug 23 11:12:43.490782 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3344/6739] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:12:43 2022] GET /compute/v2.1/os-volumes/8984f44d-308a-4312-9292-1d9c788a88e9 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:43.894586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c0e05d9e47a6950dd0297ed8aabc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bdbe227f743406a9e93c8e86dc76cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:12:43.917401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7431df8d-a8dd-4482-ba08-9f31283412bf tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 200 len: 1765 microversion: 2.1 time: 1.151133 Aug 23 11:12:43.931598 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3396/6740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:42 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 1765 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:12:43.950611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3106740a-ba8e-44e5-b39a-a88c02735f73 req-8793dd85-a2a0-4086-9ba0-04c8bcde1aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d217f215-b58f-466d-9b0f-9950de9a1015", "name": "network-vif-deleted", "tag": "6d483fd6-6512-46e4-94ce-3ede9270e7ce"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:43.973054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3106740a-ba8e-44e5-b39a-a88c02735f73 req-8793dd85-a2a0-4086-9ba0-04c8bcde1aa0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:43.973831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3106740a-ba8e-44e5-b39a-a88c02735f73 req-8793dd85-a2a0-4086-9ba0-04c8bcde1aa0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:43.975612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3106740a-ba8e-44e5-b39a-a88c02735f73 req-8793dd85-a2a0-4086-9ba0-04c8bcde1aa0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:44.016004 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3106740a-ba8e-44e5-b39a-a88c02735f73 req-8793dd85-a2a0-4086-9ba0-04c8bcde1aa0 service nova] Creating event network-vif-deleted:6d483fd6-6512-46e4-94ce-3ede9270e7ce for instance d217f215-b58f-466d-9b0f-9950de9a1015 on n-h1-847009-13 Aug 23 11:12:44.030191 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3106740a-ba8e-44e5-b39a-a88c02735f73 req-8793dd85-a2a0-4086-9ba0-04c8bcde1aa0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086030 Aug 23 11:12:44.031352 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3345/6741] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:12:44.941021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:44.942659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [instance: d217f215-b58f-466d-9b0f-9950de9a1015] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:12:44.963555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:44.969891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:44.971852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:44.972596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:44.973699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:12:44.974443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:12:44.985093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:12:45.020700 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] HTTP exception thrown: Instance d217f215-b58f-466d-9b0f-9950de9a1015 could not be found. Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Request method failure captured: Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 HTTP/1.1 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLVksi0bxWqQqiXRcU6JG5MHKznGRo8_7GOIDePLc1e_-OJ_DuNwgaFPxB3NqlmrfQLujyjPfABFyj2-TUQVOaix5QecqX1Y1ZBaO2DY0zrJJ7vRjnkKCcbwyF_aGyuVLYpDNQspN7VzVsR6g07LdIZuuO_Fa219VQ7D69nA_K8d1q0 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4bdbe227f743406a9e93c8e86dc76cde Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-204172568 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4bdbe227f743406a9e93c8e86dc76cde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4bdbe227f743406a9e93c8e86dc76cde", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4bdbe227f743406a9e93c8e86dc76cde"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4bdbe227f743406a9e93c8e86dc76cde"}]}] Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestSecurityGroupsBasicOps-204172568 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4bdbe227f743406a9e93c8e86dc76cde Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-204172568 Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestSecurityGroupsBasicOps-204172568-project Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 7c32c0e05d9e47a6950dd0297ed8aabc Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestSecurityGroupsBasicOps-204172568-project Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d217f215-b58f-466d-9b0f-9950de9a1015 could not be found. Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd217f215-b58f-466d-9b0f-9950de9a1015'} Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d217f215-b58f-466d-9b0f-9950de9a1015 could not be found. Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d217f215-b58f-466d-9b0f-9950de9a1015 could not be found. Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:12:45.022757 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d217f215-b58f-466d-9b0f-9950de9a1015 could not be found. Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Returning 404 to user: Instance d217f215-b58f-466d-9b0f-9950de9a1015 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d763d917-9fcf-4bf5-8deb-dfab34446790 tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015" status: 404 len: 111 microversion: 2.1 time: 0.089396 Aug 23 11:12:45.030373 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3397/6742] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:12:44 2022] GET /compute/v2.1/servers/d217f215-b58f-466d-9b0f-9950de9a1015 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:12:54.279498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:54.282911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:54.291659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-481e38b3-2916-4735-b45f-1f661647fb4a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] Calling method '.version_select at 0x7fdc8fc9c430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:12:54.299151 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-481e38b3-2916-4735-b45f-1f661647fb4a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [d73e0466-0d6a-4291-a236-cccd3fdc3fb4] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:12:55.309086 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-481e38b3-2916-4735-b45f-1f661647fb4a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] [d73e0466-0d6a-4291-a236-cccd3fdc3fb4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 54522. Aug 23 11:12:55.340757 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-481e38b3-2916-4735-b45f-1f661647fb4a tempest-TestSecurityGroupsBasicOps-204172568 tempest-TestSecurityGroupsBasicOps-204172568-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-461798026" status: 202 len: 0 microversion: 2.1 time: 1.074306 Aug 23 11:12:55.341569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3346/6743] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-461798026 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:12:59.576468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1625332179", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "e0db1fd7-deda-49b6-b420-d9b16b913ed8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2054733182", "security_groups": [{"name": "tempest-secgroup-smoke-439069378"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:12:59.604820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:59.606306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:12:59.780066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] validate_networks() for [('e0db1fd7-deda-49b6-b420-d9b16b913ed8', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:13:00.507980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:13:00.508857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:13:00.509668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:13:00.510319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:13:00.510994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:13:00.529057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:00.529785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:00.530510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:00.531546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:00.532005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:00.532834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:00.560792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:13:00.576312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Getting quotas for user b40863219f8c498881c9ee5b5ce5a8c5 and project aadc538b532d48b780b04b2ca23e4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:13:00.603914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:13:00.606264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:13:00.687006 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a19c9b7-4a18-4b63-b58e-d8bd1236aa32 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.114275 Aug 23 11:13:00.688251 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3398/6744] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:12:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:13:00.702876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25e465e4-3cf0-43bc-9095-5f0c6e86dd05 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:00.703929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25e465e4-3cf0-43bc-9095-5f0c6e86dd05 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:00.862923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-25e465e4-3cf0-43bc-9095-5f0c6e86dd05 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:00.879947 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25e465e4-3cf0-43bc-9095-5f0c6e86dd05 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1267 microversion: 2.1 time: 0.184258 Aug 23 11:13:00.891356 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3347/6745] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:00 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:01.909656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:01.910725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:01.922989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:01.931939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:01.934810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:01.935688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:01.942292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:01.943140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:02.153824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:02.165269 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a49d7392-56d3-4f64-b692-429e44fa80bf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1319 microversion: 2.1 time: 0.262888 Aug 23 11:13:02.167528 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3399/6746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:01 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:03.189643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:03.192151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:03.215070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:03.222693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:03.223749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:03.225010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:03.226128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:03.228479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:03.427573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:03.468132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c12f06d8-21e0-44ab-b92d-677040057856 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1325 microversion: 2.1 time: 0.283299 Aug 23 11:13:03.473035 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3348/6747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:03 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:04.496983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:04.498194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:04.510464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:04.513804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:04.514474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:04.515701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:04.518470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:04.519130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:05.162788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:05.177401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cb34b12b-d3ce-413a-ba05-5ac0ea877c69 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 0.686616 Aug 23 11:13:05.178792 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3400/6748] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:04 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:06.214642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:06.214642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:06.245806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:06.246676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:06.247322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:06.248263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:06.248952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:06.249588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:06.589216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-19b35889-8491-42b0-a56c-d75b43f601a8 req-a7d0dcf8-2332-48cd-8364-a2dd96992af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f603c4c-f6b1-4252-8458-83f305a2d642", "tag": "4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:06.618313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-19b35889-8491-42b0-a56c-d75b43f601a8 req-a7d0dcf8-2332-48cd-8364-a2dd96992af9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:06.619060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-19b35889-8491-42b0-a56c-d75b43f601a8 req-a7d0dcf8-2332-48cd-8364-a2dd96992af9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:06.620519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-19b35889-8491-42b0-a56c-d75b43f601a8 req-a7d0dcf8-2332-48cd-8364-a2dd96992af9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:06.646541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-19b35889-8491-42b0-a56c-d75b43f601a8 req-a7d0dcf8-2332-48cd-8364-a2dd96992af9 service nova] Creating event network-changed:4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2 for instance 9f603c4c-f6b1-4252-8458-83f305a2d642 on n-h2-847009-13 Aug 23 11:13:06.663393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-19b35889-8491-42b0-a56c-d75b43f601a8 req-a7d0dcf8-2332-48cd-8364-a2dd96992af9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078358 Aug 23 11:13:06.665457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3401/6749] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:07.275590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:07.288153 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b8ccdc5-7fb1-4f20-999f-ca4a3a9e1e04 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 1.081573 Aug 23 11:13:07.290725 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3349/6750] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:06 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:08.312203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:08.312959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:08.324704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:08.325235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:08.325692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:08.340479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:08.392684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:08.392684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:08.758742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:08.783016 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0572b115-f6e9-4032-b6b5-216abf3684c9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 0.474941 Aug 23 11:13:08.788388 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3402/6751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:08 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:09.814688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:09.816251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:09.839717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:09.840478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:09.841096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:09.846274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:09.847019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:09.850186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:10.681696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:10.693555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2448a5bb-955a-465c-bc0e-9e19ea859520 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 0.891825 Aug 23 11:13:10.712537 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3350/6752] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:09 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:11.717408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:11.718172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:11.727774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:11.734741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:11.755744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:11.756250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:11.756699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:11.757673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:11.766481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:11.767950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:12.143748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:12.165672 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7954e517-9a82-459b-8a66-76e081e4e03e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 0.449974 Aug 23 11:13:12.168368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3403/6753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:11 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:13.097706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:13.198695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:13.200400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:13.217616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:13.219007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:13.221068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:13.222982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:13.225168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:13.225869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:13.522942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-096001c2-3129-4a87-801c-9a6cb27fbfa9 req-b761f831-87ec-4cc0-9fe4-5a92579c20a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f603c4c-f6b1-4252-8458-83f305a2d642", "name": "network-vif-plugged", "status": "completed", "tag": "4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:13.548619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-096001c2-3129-4a87-801c-9a6cb27fbfa9 req-b761f831-87ec-4cc0-9fe4-5a92579c20a5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:13.549443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-096001c2-3129-4a87-801c-9a6cb27fbfa9 req-b761f831-87ec-4cc0-9fe4-5a92579c20a5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:13.550090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-096001c2-3129-4a87-801c-9a6cb27fbfa9 req-b761f831-87ec-4cc0-9fe4-5a92579c20a5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:13.575350 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-096001c2-3129-4a87-801c-9a6cb27fbfa9 req-b761f831-87ec-4cc0-9fe4-5a92579c20a5 service nova] Creating event network-vif-plugged:4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2 for instance 9f603c4c-f6b1-4252-8458-83f305a2d642 on n-h2-847009-13 Aug 23 11:13:13.593403 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-096001c2-3129-4a87-801c-9a6cb27fbfa9 req-b761f831-87ec-4cc0-9fe4-5a92579c20a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.510186 Aug 23 11:13:13.595044 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3351/6754] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:13.618590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:13.632520 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54457f49-58da-49f7-a152-3cdcf4338124 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 0.440106 Aug 23 11:13:13.635577 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3404/6755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:13 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:14.655793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:14.657159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:14.677155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:14.678091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:14.678838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:14.681340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:14.681967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:14.682560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:14.997887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:15.011164 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a9d2d8e-58ed-4769-9825-586db86b9387 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1392 microversion: 2.1 time: 0.359650 Aug 23 11:13:15.039591 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3352/6756] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:14 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1392 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:16.034976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:16.036197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:16.047299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:16.051917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:16.052552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:16.055478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:16.055969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:16.056416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:16.394224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:16.415786 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e721062a-2bb5-464d-8007-923fb7e74a7f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1564 microversion: 2.1 time: 0.383491 Aug 23 11:13:16.417117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3405/6757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:16 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1564 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:16.441247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:16.442663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:16.458972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:16.460209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:16.461670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:16.462454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:16.462934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:16.463449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:16.826739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:16.837686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-345c6226-2d07-4410-8a88-b94412130d34 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1564 microversion: 2.1 time: 0.399010 Aug 23 11:13:16.848851 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3353/6758] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:16 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1564 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:22.185216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:22.186607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:22.188351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-215c4d43-7369-41ab-a25a-090509579144 req-97f63fb2-4f65-49f6-be3b-a324b7bcccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f603c4c-f6b1-4252-8458-83f305a2d642", "tag": "4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:22.208246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:22.210856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:22.212470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-215c4d43-7369-41ab-a25a-090509579144 req-97f63fb2-4f65-49f6-be3b-a324b7bcccc4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:22.214214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:22.216202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-215c4d43-7369-41ab-a25a-090509579144 req-97f63fb2-4f65-49f6-be3b-a324b7bcccc4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:22.216665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:22.217215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-215c4d43-7369-41ab-a25a-090509579144 req-97f63fb2-4f65-49f6-be3b-a324b7bcccc4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:22.220935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:22.221569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:22.246408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-215c4d43-7369-41ab-a25a-090509579144 req-97f63fb2-4f65-49f6-be3b-a324b7bcccc4 service nova] Creating event network-changed:4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2 for instance 9f603c4c-f6b1-4252-8458-83f305a2d642 on n-h2-847009-13 Aug 23 11:13:22.260987 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-215c4d43-7369-41ab-a25a-090509579144 req-97f63fb2-4f65-49f6-be3b-a324b7bcccc4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076180 Aug 23 11:13:22.262466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3354/6759] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:13:22.665493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:22.673818 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47b23a8a-da47-4184-aad7-34490d3523ae tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1564 microversion: 2.1 time: 0.495328 Aug 23 11:13:22.674833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3406/6760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:22 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1564 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:25.516969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6e90f4b-d8c2-45a4-8b45-0abaa5269032 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Action: 'create', calling method: .version_select at 0x7fdc8f71e9d0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-835874224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjXLXm2yGRdEIJkyY2cuTejZ+N2XF7TNZKb/BziBbuz8Qt14ATZTQSVNPoR9ylBNSU/xq1Kg4M11lx+oDAxtv/O6hVP7F8qUHauO58rKwErz5RHiD6eMD+KUIM41fx7pA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:25.528051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:25.555043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c6e90f4b-d8c2-45a4-8b45-0abaa5269032 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Getting quotas for project ec74398f86074c79af47f2b605e98823. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:13:25.565999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-c6e90f4b-d8c2-45a4-8b45-0abaa5269032 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Getting quotas for user 9669b751be524094a8b4f10d6b916dee and project ec74398f86074c79af47f2b605e98823. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:13:25.633618 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6e90f4b-d8c2-45a4-8b45-0abaa5269032 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.682747 Aug 23 11:13:25.640605 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3355/6761] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:13:24 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:27.627240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1117054400", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-835874224", "security_groups": [{"name": "tempest-secgroup-smoke-1540830779"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "820e343e-24de-4e25-92ea-29be55003b27"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:27.815828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] validate_networks() for [('820e343e-24de-4e25-92ea-29be55003b27', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:13:28.370045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Getting quotas for project ec74398f86074c79af47f2b605e98823. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:13:28.377393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Getting quotas for user 9669b751be524094a8b4f10d6b916dee and project ec74398f86074c79af47f2b605e98823. Resources: dict_keys(['metadata_items']) {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:13:28.406521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:13:28.407330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:13:28.407943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:13:28.408369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:13:28.409006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:13:28.419054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:28.419746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:28.420276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:28.421502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:28.422129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:28.422736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:28.442853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Getting quotas for project ec74398f86074c79af47f2b605e98823. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:13:28.449189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Getting quotas for user 9669b751be524094a8b4f10d6b916dee and project ec74398f86074c79af47f2b605e98823. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:13:28.466528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:13:28.469373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:13:28.527283 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bdcbedd5-3780-4350-bb86-00efedc5d732 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.907092 Aug 23 11:13:28.528059 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3407/6762] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:13:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:13:28.541421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9cea7408-0aa0-4ae7-9267-017762fa58d9 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:28.542251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9cea7408-0aa0-4ae7-9267-017762fa58d9 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:28.687398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9cea7408-0aa0-4ae7-9267-017762fa58d9 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:28.700429 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9cea7408-0aa0-4ae7-9267-017762fa58d9 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1302 microversion: 2.1 time: 0.165116 Aug 23 11:13:28.714916 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3356/6763] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:28 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1302 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:29.724103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:29.726158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:29.731446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:29.738321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:29.739466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:29.740071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:29.742505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:29.743337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:29.744392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:29.774512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=49 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:29.827857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:29.839625 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15a5c9d6-0a0b-422f-b3e5-0eaeae6b15cc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1298 microversion: 2.1 time: 0.121622 Aug 23 11:13:29.855532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3408/6764] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:29 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:30.863773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:30.864959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:30.886808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:30.889337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:30.889959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:30.891027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:30.894234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:30.894835 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:30.899703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=35 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:31.192213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Calling method '.version_select at 0x7fdc9c1ca1f0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:31.193378 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:13:31.193378 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:13:31.195398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:31.196031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:31.196555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:31.210132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:31.226391 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6667bcc1-5888-4f63-96eb-aba5611a5f4d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1360 microversion: 2.1 time: 0.367127 Aug 23 11:13:31.239877 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3357/6765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:30 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1360 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:31.260733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:31.261645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:31.262706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:31.282785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:31.283393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:31.284187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:31.294782 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30bf2597-a1c6-4d08-a6f7-8a85071938af tempest-PortsAdminExtendedAttrsTestJSON-92017696 tempest-PortsAdminExtendedAttrsTestJSON-92017696-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.346385 Aug 23 11:13:31.295488 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3409/6766] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 11:13:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:32.248375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:32.249666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:32.261318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:32.263859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:32.264532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:32.265601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:32.268725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:32.269420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:32.635717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:32.646986 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bbc6569d-861d-4b79-aee6-8130b4ca3f7f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.402600 Aug 23 11:13:32.648851 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3358/6767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:32 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:33.083088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-40e012a9-d3e5-430c-9c72-6b28dd141672 req-79f11191-ea9a-467f-926d-392eb8fe6100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba9e199-7300-414c-b39a-0e142b20e27e", "tag": "658645f7-52ac-4fac-a11b-bf36c7e937e5"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:33.098865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-40e012a9-d3e5-430c-9c72-6b28dd141672 req-79f11191-ea9a-467f-926d-392eb8fe6100 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:33.099383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-40e012a9-d3e5-430c-9c72-6b28dd141672 req-79f11191-ea9a-467f-926d-392eb8fe6100 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:33.100043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-40e012a9-d3e5-430c-9c72-6b28dd141672 req-79f11191-ea9a-467f-926d-392eb8fe6100 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:33.114072 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-40e012a9-d3e5-430c-9c72-6b28dd141672 req-79f11191-ea9a-467f-926d-392eb8fe6100 service nova] Creating event network-changed:658645f7-52ac-4fac-a11b-bf36c7e937e5 for instance bba9e199-7300-414c-b39a-0e142b20e27e on n-h1-847009-13 Aug 23 11:13:33.121073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-40e012a9-d3e5-430c-9c72-6b28dd141672 req-79f11191-ea9a-467f-926d-392eb8fe6100 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044168 Aug 23 11:13:33.122084 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3410/6768] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:33.671060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:33.671805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:33.685577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:33.686320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:33.686975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:33.687900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:33.688513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:33.689178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:33.975809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:33.997694 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f4cf8cfc-4c27-4a65-b0b7-e5e62a8e4157 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.330312 Aug 23 11:13:34.000593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3359/6769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:33 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:35.025417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:35.026128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:35.032867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:35.033590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:35.034204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:35.035092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:35.035748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:35.036325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:35.346016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:35.354884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f2bee5d-3160-451c-9170-17a6f9b9c54e tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.335178 Aug 23 11:13:35.357519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3411/6770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:35 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:36.383133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:36.384678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:36.396414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:36.396962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:36.398055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:36.398961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:36.399582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:36.400156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:36.698088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:36.711161 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70dba57e-9f7d-4db9-84d8-02556aa2c3a3 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.335527 Aug 23 11:13:36.711940 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3360/6771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:36 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:37.733760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:37.735238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:37.743170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:37.744099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:37.744775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:37.745848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:37.746492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:37.747102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:37.987791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:38.005352 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a08ad94a-6554-45ab-8959-ef0fe779a7bc tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.273995 Aug 23 11:13:38.021002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3412/6772] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:37 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:39.027026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:39.027667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:39.046471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:39.056713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:39.057240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:39.057686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:39.058416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:39.059490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:39.059939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:39.219289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:39.240248 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e433609c-d8c4-4b78-95dd-a6a54850d9e7 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.218603 Aug 23 11:13:39.256926 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3361/6773] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:39 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:39.712089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-4859f01e-b6a5-4991-88b9-1b4dd127df96 req-2fb839af-538e-40ec-9139-51c650bd5856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba9e199-7300-414c-b39a-0e142b20e27e", "name": "network-vif-plugged", "status": "completed", "tag": "658645f7-52ac-4fac-a11b-bf36c7e937e5"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:39.721973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:39.723465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:39.755777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4859f01e-b6a5-4991-88b9-1b4dd127df96 req-2fb839af-538e-40ec-9139-51c650bd5856 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:39.760718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4859f01e-b6a5-4991-88b9-1b4dd127df96 req-2fb839af-538e-40ec-9139-51c650bd5856 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:39.761660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4859f01e-b6a5-4991-88b9-1b4dd127df96 req-2fb839af-538e-40ec-9139-51c650bd5856 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:39.798307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-4859f01e-b6a5-4991-88b9-1b4dd127df96 req-2fb839af-538e-40ec-9139-51c650bd5856 service nova] Creating event network-vif-plugged:658645f7-52ac-4fac-a11b-bf36c7e937e5 for instance bba9e199-7300-414c-b39a-0e142b20e27e on n-h1-847009-13 Aug 23 11:13:39.808896 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-4859f01e-b6a5-4991-88b9-1b4dd127df96 req-2fb839af-538e-40ec-9139-51c650bd5856 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102111 Aug 23 11:13:39.810015 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3413/6774] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:40.277956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:40.278596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:40.290527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:40.291220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:40.291776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:40.292634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:40.293434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:40.293943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:40.470414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:40.473016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:40.479849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:40.483405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:40.483914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:40.484368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:40.485118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:40.485592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:40.486032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:40.488808 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8629842-45c4-42c3-b0df-84b2866ad79f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.230626 Aug 23 11:13:40.501815 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3362/6775] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:40 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:40.583822 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c0d3478-a9c1-4418-b759-aba96cdac3a5 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642/action" status: 200 len: 24576 microversion: 2.1 time: 0.119429 Aug 23 11:13:40.585676 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3414/6776] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:13:40 2022] POST /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642/action => generated 24576 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:13:41.516335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:41.516991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:41.526135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:41.526879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:41.527320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:41.528042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:41.528501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:41.529166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:41.751798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:41.760367 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a777e29-179b-4791-8a55-131e62d6c2f5 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1428 microversion: 2.1 time: 0.249770 Aug 23 11:13:41.761680 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3363/6777] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:41 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1428 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:42.786363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:42.787088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:42.798150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:42.798641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:42.799086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:42.799801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:42.800262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:42.800693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:43.160944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:43.173309 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10991d8f-02f5-4740-a98f-8cfbbb48855d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1607 microversion: 2.1 time: 0.395372 Aug 23 11:13:43.188147 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3415/6778] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:42 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1607 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:43.199996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:43.200768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:43.211044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:43.211697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:43.212373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:43.213213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:43.213774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:43.214308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:43.368642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:43.378081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46306c5b-401c-4433-86cf-2f1640e82d97 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1607 microversion: 2.1 time: 0.182699 Aug 23 11:13:43.380788 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3364/6779] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:43 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1607 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:43.402807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:43.403445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:43.411113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:43.411617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:43.412072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:43.413615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:43.414110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:43.414532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:43.642416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:43.655044 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2bca9b6f-bf61-4d41-b2c2-21c826b1b366 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1607 microversion: 2.1 time: 0.256426 Aug 23 11:13:43.655920 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3416/6780] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:43 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1607 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:46.638533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e7b2de28-e680-4deb-9bfb-c8e5bb7e9ce5 req-9eb9c4a5-4481-40e2-bd35-b7e0d335fa72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba9e199-7300-414c-b39a-0e142b20e27e", "tag": "658645f7-52ac-4fac-a11b-bf36c7e937e5"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:46.652731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e7b2de28-e680-4deb-9bfb-c8e5bb7e9ce5 req-9eb9c4a5-4481-40e2-bd35-b7e0d335fa72 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:46.653501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e7b2de28-e680-4deb-9bfb-c8e5bb7e9ce5 req-9eb9c4a5-4481-40e2-bd35-b7e0d335fa72 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:46.654085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e7b2de28-e680-4deb-9bfb-c8e5bb7e9ce5 req-9eb9c4a5-4481-40e2-bd35-b7e0d335fa72 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:46.666785 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e7b2de28-e680-4deb-9bfb-c8e5bb7e9ce5 req-9eb9c4a5-4481-40e2-bd35-b7e0d335fa72 service nova] Creating event network-changed:658645f7-52ac-4fac-a11b-bf36c7e937e5 for instance bba9e199-7300-414c-b39a-0e142b20e27e on n-h1-847009-13 Aug 23 11:13:46.672208 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e7b2de28-e680-4deb-9bfb-c8e5bb7e9ce5 req-9eb9c4a5-4481-40e2-bd35-b7e0d335fa72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037244 Aug 23 11:13:46.673072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3365/6781] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:48.545704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:48.546182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:48.560902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:48.561410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:48.561856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:48.562575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:48.563040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:48.563476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:48.591143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-698cc5ae-7db9-402e-903a-006023ec2c64 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/ips" status: 200 len: 147 microversion: 2.1 time: 0.049417 Aug 23 11:13:48.592371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3417/6782] 10.222.0.78 () {58 vars in 1248 bytes} [Tue Aug 23 11:13:48 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:51.216593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45f562af-ec41-4a2a-970d-d3f0c7a95029"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:51.219685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:51.228181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.228975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.229628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.230769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.231411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.232018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.606467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:13:51.610196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:51.622622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.623074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.623526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.624369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.625211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.625682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.644454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a76a0d9-b3f6-4c5a-8f9b-1c888749aa34 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430904 Aug 23 11:13:51.649870 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3366/6783] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:13:51 2022] POST /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:13:51.747998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:13:51.749201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:13:51.749851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:13:51.750790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:13:51.751415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:13:51.886743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:51.896331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.898051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.899069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.900334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.901153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.902066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.939005 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-27f413f0-8902-48d7-ad28-56b90c220c95 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642/action" status: 202 len: 1138 microversion: 2.1 time: 0.337303 Aug 23 11:13:51.940456 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3418/6784] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:13:51 2022] POST /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642/action => generated 1138 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 11:13:51.965861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:51.967420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:51.979087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.979955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.981056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:51.982234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:51.982948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:51.984593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:52.248904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:52.268683 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97d4a74c-0592-4ba5-9791-e59205358689 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.309654 Aug 23 11:13:52.269489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3367/6785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:51 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:53.302477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:53.303821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:53.319677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:53.320197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:53.320901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:53.321815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:53.322478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:53.322916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:53.617090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:53.627908 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e64ef8e8-84a9-4a59-9040-7f6224129525 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.329628 Aug 23 11:13:53.628952 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3419/6786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:53 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:54.651612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:54.652979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:54.662885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:54.663683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:54.664596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:54.665829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:54.666543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:54.667164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:54.837413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:54.846061 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-292eea35-dfed-4e34-b353-edd99c06899a tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.199980 Aug 23 11:13:54.847448 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3368/6787] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:54 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:55.868791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:55.870332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:55.879386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:55.880299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:55.880872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:55.882157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:55.882770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:55.883413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:56.134153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:56.145296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f28feef-10f1-421c-8ed7-d1b798a17ed8 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.281546 Aug 23 11:13:56.159011 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3420/6788] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:55 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:57.171180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:57.172099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:57.175268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:13:57.180951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:57.181472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:57.182059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:57.182949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:57.183445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:57.183882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:57.345025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:57.355972 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea529447-e178-4eea-abca-a51001f4e308 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.188698 Aug 23 11:13:57.357015 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3369/6789] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:57 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:58.378803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:58.379582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:58.387878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:58.388552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:58.389139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:58.390133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:58.390944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:58.391658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:58.630079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:58.664963 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e6b2e1f-aa2b-4ce3-8c2b-1168cd4f8c86 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.287484 Aug 23 11:13:58.666882 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3421/6790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:58 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:13:59.700063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:13:59.701676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:13:59.719613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:59.720669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:59.723208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:59.724247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:13:59.725581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:13:59.726500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:13:59.946123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:13:59.956206 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d448ae54-3a67-4eaa-8a02-b994a5f1a135 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.259249 Aug 23 11:13:59.957165 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3370/6791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:13:59 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:14:00.980386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:00.981034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:00.984005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=34 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:00.989972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:00.991010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:00.991465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:00.992384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:00.992897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:00.993363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:00.996532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:01.305667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:01.315517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a380df0-15c4-4c48-8f49-47f48906ded9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.338541 Aug 23 11:14:01.344298 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3422/6792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:00 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:02.346738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:02.348653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:02.359730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:02.360495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:02.361260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:02.362246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:02.362851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:02.363423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:02.376638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:02.573890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:02.583319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8fe8565-b9b9-4aa9-8288-fe207c2d98b9 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.243632 Aug 23 11:14:02.598556 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3371/6793] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:02 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:03.608197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:03.609571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:03.620205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:03.620725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:03.621946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:03.622752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:03.623369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:03.624167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:03.944980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:03.957192 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a6c7fef6-73da-4fad-bba4-aa92b083590e tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.352644 Aug 23 11:14:03.974095 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3423/6794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:03 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:04.981284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:04.981911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:04.997525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:05.002031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:05.002494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:05.003567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:05.004054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:05.004489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:05.273235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:05.284002 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b90753c8-28bf-4f6b-90fa-a544ba6e9575 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.307445 Aug 23 11:14:05.296759 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3372/6795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:04 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:06.315870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:06.320063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:06.337975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:06.338474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:06.339859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:06.353648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:06.356421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:06.357089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:06.627389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:06.636197 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a875873-e7c1-40ae-b763-ee04539c5232 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.332493 Aug 23 11:14:06.637513 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3424/6796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:06 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:07.235590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:07.238304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:07.245972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:07.246764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:07.247219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:07.247945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:07.248411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:07.248878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:07.293837 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbc79131-f088-412b-a6a9-8bda9fb2c299 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062458 Aug 23 11:14:07.294908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3373/6797] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:14:07 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:07.305641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:07.306495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:07.312834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:07.313454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:07.314003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:07.314843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:07.315418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:07.315961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:07.349434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8e4e57ad-2d8b-4901-b736-9a64d14c4eb7 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/45f562af-ec41-4a2a-970d-d3f0c7a95029" status: 200 len: 194 microversion: 2.1 time: 0.047816 Aug 23 11:14:07.350743 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3425/6798] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Aug 23 11:14:07 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/45f562af-ec41-4a2a-970d-d3f0c7a95029 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:14:07.658044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:07.658622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:07.665072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:07.665776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:07.666398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:07.667255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:07.668022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:07.680311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:07.831390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:07.845970 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60a6309c-678e-42cb-965c-4893aa4a3d43 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.191656 Aug 23 11:14:07.847177 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3374/6799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:07 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:08.873193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:08.873890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:08.893812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:08.894820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:08.895436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:08.896558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:08.897251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:08.898120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:09.167401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:09.179178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d55aad61-7cbc-4ca2-926c-aed2b6e174b3 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1692 microversion: 2.1 time: 0.313481 Aug 23 11:14:09.180259 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3426/6800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:08 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1692 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:09.851619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d1f6b01-ef56-433e-9aed-7e80d2fcd25a"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:14:09.854090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:09.865077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:09.867446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:09.867758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:09.868629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:09.869228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:09.869724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:10.201830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:10.202532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:10.212412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:10.212925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:10.213378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:10.214201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:10.214584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:10.215026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:10.371332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9abfd404-7102-48c3-9709-5a2927e04182 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "POST /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510268 Aug 23 11:14:10.372772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3375/6801] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:14:09 2022] POST /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:10.552879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:10.561234 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bfdd06fa-8018-46d3-b16f-e60d5ebadede tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1698 microversion: 2.1 time: 0.363594 Aug 23 11:14:10.562530 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3427/6802] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:10 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1698 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:11.585035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:11.586378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:11.601049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:11.603995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:11.604535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:11.608147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:11.608719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:11.609322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:11.956663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:11.975373 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-68d06b9b-018d-48aa-906f-9eb2ed28fbaf tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1698 microversion: 2.1 time: 0.394853 Aug 23 11:14:11.976857 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3376/6803] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:11 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1698 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:13.002315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:13.003068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:13.030836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:13.042644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:13.043144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:13.064206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:13.064915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:13.065380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:13.532087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:13.548372 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b1b7dbb-b76f-4659-a8f0-9785c7c795ec tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1683 microversion: 2.1 time: 0.550244 Aug 23 11:14:13.549616 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3428/6804] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:12 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1683 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:14.842569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e7a65077-f771-4676-aab4-07baca411fd0 req-ad6bba32-91a6-4d20-9eb9-89cceee74133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f603c4c-f6b1-4252-8458-83f305a2d642", "name": "network-vif-plugged", "status": "completed", "tag": "4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:14:14.857294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e7a65077-f771-4676-aab4-07baca411fd0 req-ad6bba32-91a6-4d20-9eb9-89cceee74133 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:14.857839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e7a65077-f771-4676-aab4-07baca411fd0 req-ad6bba32-91a6-4d20-9eb9-89cceee74133 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:14.858284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e7a65077-f771-4676-aab4-07baca411fd0 req-ad6bba32-91a6-4d20-9eb9-89cceee74133 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:14.872547 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e7a65077-f771-4676-aab4-07baca411fd0 req-ad6bba32-91a6-4d20-9eb9-89cceee74133 service nova] Creating event network-vif-plugged:4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2 for instance 9f603c4c-f6b1-4252-8458-83f305a2d642 on n-h2-847009-13 Aug 23 11:14:14.882635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e7a65077-f771-4676-aab4-07baca411fd0 req-ad6bba32-91a6-4d20-9eb9-89cceee74133 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044651 Aug 23 11:14:14.883923 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3377/6805] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:17.376336 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:14:17.376939 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:14:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:14:25.925284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:25.928330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:25.935358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=13 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:25.936385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=41 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:25.937784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:25.938600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:25.939210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:25.940670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:25.941806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:25.942457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:25.986033 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf86626b-582e-4497-9dd9-a814c16f7474 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066680 Aug 23 11:14:25.986737 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3429/6806] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:14:25 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:26.132370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:26.133149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:26.135882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=17 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:26.136715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:26.142905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:26.143699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:26.144033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:26.145138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:26.145786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:26.147228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:26.181546 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-235cd89d-8dda-42f6-a25c-8116debd8ac3 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/45f562af-ec41-4a2a-970d-d3f0c7a95029" status: 200 len: 194 microversion: 2.1 time: 0.054967 Aug 23 11:14:26.182229 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3378/6807] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Aug 23 11:14:26 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/45f562af-ec41-4a2a-970d-d3f0c7a95029 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:26.195504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:26.196349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:26.202788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:26.203296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:26.203746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:26.204469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:26.204961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:26.205400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:26.309092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lazy-loading 'services' on Instance uuid 2d145121-67ea-4c28-9f14-dd99936df4a6 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:14:26.401665 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-21925fe6-617e-40de-aed4-e745efcdc36c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/45f562af-ec41-4a2a-970d-d3f0c7a95029" status: 202 len: 0 microversion: 2.1 time: 0.210544 Aug 23 11:14:26.402685 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3430/6808] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:14:26 2022] DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/45f562af-ec41-4a2a-970d-d3f0c7a95029 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:14:32.900547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:32.901942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:32.909981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:32.910742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:32.912016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:32.913815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:32.914650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:32.915290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:32.947838 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0a62dba5-bed2-4bed-b537-fa78b6090fb4 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/7d1f6b01-ef56-433e-9aed-7e80d2fcd25a" status: 200 len: 194 microversion: 2.1 time: 0.052606 Aug 23 11:14:32.952948 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3379/6809] 10.222.0.78 () {58 vars in 1413 bytes} [Tue Aug 23 11:14:32 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/7d1f6b01-ef56-433e-9aed-7e80d2fcd25a => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:32.961049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:32.962281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:32.970993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:32.971741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:32.972408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:32.973380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:32.974835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:32.975500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:33.094426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lazy-loading 'services' on Instance uuid 2d145121-67ea-4c28-9f14-dd99936df4a6 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:14:33.191038 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3fd138c5-3f6d-4758-9e61-7fda54cf57c0 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/7d1f6b01-ef56-433e-9aed-7e80d2fcd25a" status: 202 len: 0 microversion: 2.1 time: 0.235247 Aug 23 11:14:33.191860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3431/6810] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:14:32 2022] DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments/7d1f6b01-ef56-433e-9aed-7e80d2fcd25a => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:14:37.859912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:14:37.862875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:37.870988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:37.871486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:37.871928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:37.872637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:37.873315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:37.873744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:37.952895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0183cf0d-d3b6-42dc-af15-9eb277ee026f tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "POST /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642/action" status: 200 len: 24577 microversion: 2.1 time: 0.096678 Aug 23 11:14:37.953660 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3380/6811] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:14:37 2022] POST /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642/action => generated 24577 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:14:39.754287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:39.756732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:39.763319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:39.764245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:39.765161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:39.766454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:39.767540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:39.768670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:39.803472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67e9f992-2784-476b-be91-198b91f3e894 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054566 Aug 23 11:14:39.804564 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3432/6812] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:14:39 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:14:39.954238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:39.956624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:39.964184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:39.964923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:39.965715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:39.966666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:39.967328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:39.967916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:40.006399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e597ab7-fc16-4004-af1e-d588ba7f2867 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055827 Aug 23 11:14:40.007135 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3381/6813] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:14:39 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:14:40.089789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:40.090783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:40.097886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:40.099703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:40.100535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:40.102672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:40.103495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:40.104161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:40.165493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:14:40.277178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c1099dcd-62ca-4999-b9d7-ecce035954f2 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 204 len: 0 microversion: 2.1 time: 0.197110 Aug 23 11:14:40.277947 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3433/6814] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:14:40 2022] DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:14:40.286998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:40.288198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:40.295014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:40.295972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:40.296619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:40.297812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:40.298480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:40.299124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:40.529872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:40.541855 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-307eb787-ed0a-425f-9753-969fd7bb4521 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1674 microversion: 2.1 time: 0.259251 Aug 23 11:14:40.543324 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3382/6815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:40 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1674 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:41.570510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:41.571962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:41.579350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:41.580149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:41.580892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:41.581841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:41.582511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:41.583172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:41.813290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:41.828387 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc9d30b9-377f-4ceb-9b20-3905d1275824 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1674 microversion: 2.1 time: 0.262579 Aug 23 11:14:41.829309 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3434/6816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:41 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1674 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:42.853713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:42.854949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:42.866664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:42.867228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:42.867693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:42.868492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:42.869050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:42.869494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:43.181058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:43.193441 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f1478b1-2c33-4eb8-8b7a-0ac0df4f7e6c tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1674 microversion: 2.1 time: 0.346011 Aug 23 11:14:43.195112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3383/6817] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:42 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1674 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:44.173184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1711c1c7-6f3c-48df-9de7-5f96dfadd5d2 req-6d3001db-fd52-45d3-8af9-6c127b87c7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d145121-67ea-4c28-9f14-dd99936df4a6", "name": "network-vif-deleted", "tag": "a9576825-18cf-47f4-bb8b-532b19791e07"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:14:44.201871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1711c1c7-6f3c-48df-9de7-5f96dfadd5d2 req-6d3001db-fd52-45d3-8af9-6c127b87c7b5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:44.203455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1711c1c7-6f3c-48df-9de7-5f96dfadd5d2 req-6d3001db-fd52-45d3-8af9-6c127b87c7b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:44.206579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1711c1c7-6f3c-48df-9de7-5f96dfadd5d2 req-6d3001db-fd52-45d3-8af9-6c127b87c7b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:44.219883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:44.221598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:44.228632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1711c1c7-6f3c-48df-9de7-5f96dfadd5d2 req-6d3001db-fd52-45d3-8af9-6c127b87c7b5 service nova] Creating event network-vif-deleted:a9576825-18cf-47f4-bb8b-532b19791e07 for instance 2d145121-67ea-4c28-9f14-dd99936df4a6 on n-h1-847009-13 Aug 23 11:14:44.235073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1711c1c7-6f3c-48df-9de7-5f96dfadd5d2 req-6d3001db-fd52-45d3-8af9-6c127b87c7b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379857 Aug 23 11:14:44.236626 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3435/6818] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:44.240966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:44.241223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:44.241510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:44.250608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:44.253247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:44.253872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:44.294278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:44.295009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:44.295608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:44.296382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lazy-loading 'fault' on Instance uuid 2d145121-67ea-4c28-9f14-dd99936df4a6 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:14:44.930454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f677df65e434e45b050d23769ad5863', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e89c4738f5f4f7a9e7985bc175d8867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:44.938450 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cfe459ee-fd59-40c8-9420-8a6f21c53bd1 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 200 len: 1327 microversion: 2.1 time: 0.724852 Aug 23 11:14:44.939530 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3384/6819] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:44 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 1327 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:14:45.963103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:45.964515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:45.980899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:45.981579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:45.982322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:45.983153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:45.983731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:45.984879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:46.003303 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] HTTP exception thrown: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Request method failure captured: Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 HTTP/1.1 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLS0HEhlpKgLjfhGydJVE_e5ZIIn8kq3aznJG-6hx3YFqIxtvFSQ8g20K93QwkDczNVgCelFOPSDe7kRkHTOL2fAYgD4Tq3DAa48A7ohNiss5XnhYg4uAlxlf0QoKUG9OAYq7KUqS56kw3gbvD7EuefVj7Tc1-IA6f76sYKJDnkdedc Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e89c4738f5f4f7a9e7985bc175d8867", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}] Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2f677df65e434e45b050d23769ad5863 Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2d145121-67ea-4c28-9f14-dd99936df4a6'} Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:46.005919 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:46.009649 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:46.012057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Returning 404 to user: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:14:46.015899 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b0dafa8-e310-4cef-925b-384d4cb2c02b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 404 len: 111 microversion: 2.1 time: 0.059887 Aug 23 11:14:46.026809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7e87927-aaea-4013-96a6-efb863dbff6b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '.version_select at 0x7fdc9c07e790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:46.031296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3436/6820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:45 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:14:46.058233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7e87927-aaea-4013-96a6-efb863dbff6b tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048142317" status: 202 len: 0 microversion: 2.1 time: 0.035313 Aug 23 11:14:46.060018 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3385/6821] 10.222.0.78 () {58 vars in 1221 bytes} [Tue Aug 23 11:14:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048142317 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:14:51.540441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:51.541257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:51.556200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:51.556707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:51.557182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:51.557906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:51.558378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:51.558814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:51.655038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:14:51.732923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-dd529e47-e0aa-4844-afcc-1aee157621da req-49bf849d-963f-4368-bde1-37128b39d019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f603c4c-f6b1-4252-8458-83f305a2d642", "tag": "4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:14:51.767150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dd529e47-e0aa-4844-afcc-1aee157621da req-49bf849d-963f-4368-bde1-37128b39d019 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:51.769679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dd529e47-e0aa-4844-afcc-1aee157621da req-49bf849d-963f-4368-bde1-37128b39d019 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:51.773501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dd529e47-e0aa-4844-afcc-1aee157621da req-49bf849d-963f-4368-bde1-37128b39d019 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:51.812560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-dd529e47-e0aa-4844-afcc-1aee157621da req-49bf849d-963f-4368-bde1-37128b39d019 service nova] Creating event network-changed:4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2 for instance 9f603c4c-f6b1-4252-8458-83f305a2d642 on n-h2-847009-13 Aug 23 11:14:51.839474 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-dd529e47-e0aa-4844-afcc-1aee157621da req-49bf849d-963f-4368-bde1-37128b39d019 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251081 Aug 23 11:14:51.839474 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3386/6822] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:51.919355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7bd7a646-3b3d-4e87-a89a-55c4ee1fc629 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 204 len: 0 microversion: 2.1 time: 0.383609 Aug 23 11:14:51.921174 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3437/6823] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:14:51 2022] DELETE /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 11:14:51.932480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:51.933431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:51.943097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:51.943955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:51.944712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:51.949036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:51.949943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:51.950412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:52.320415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:52.339277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11ec0ba0-8732-4d83-8ceb-ff1c060b7052 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1689 microversion: 2.1 time: 0.408955 Aug 23 11:14:52.355263 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3387/6824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:51 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1689 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:53.370084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:53.370800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:53.383302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:53.383798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:53.384251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:53.384996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:53.385453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:53.389531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:53.924942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:53.936127 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d94be56d-a9ae-41dd-b6c0-2ac21a347787 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1689 microversion: 2.1 time: 0.572126 Aug 23 11:14:53.946468 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3438/6825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:53 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1689 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:54.620683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e4b3fe4c-5b20-4854-8bc5-87df62c4fff1 req-4da31d1a-876b-4708-b62d-bb3d9ffc7ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f603c4c-f6b1-4252-8458-83f305a2d642", "name": "network-vif-deleted", "tag": "4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:14:54.633794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e4b3fe4c-5b20-4854-8bc5-87df62c4fff1 req-4da31d1a-876b-4708-b62d-bb3d9ffc7ee2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:54.634571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e4b3fe4c-5b20-4854-8bc5-87df62c4fff1 req-4da31d1a-876b-4708-b62d-bb3d9ffc7ee2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:54.636500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e4b3fe4c-5b20-4854-8bc5-87df62c4fff1 req-4da31d1a-876b-4708-b62d-bb3d9ffc7ee2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:54.653238 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e4b3fe4c-5b20-4854-8bc5-87df62c4fff1 req-4da31d1a-876b-4708-b62d-bb3d9ffc7ee2 service nova] Creating event network-vif-deleted:4a3259ba-30c7-4eaa-9dcb-30ad3e167bd2 for instance 9f603c4c-f6b1-4252-8458-83f305a2d642 on n-h2-847009-13 Aug 23 11:14:54.662182 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e4b3fe4c-5b20-4854-8bc5-87df62c4fff1 req-4da31d1a-876b-4708-b62d-bb3d9ffc7ee2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045267 Aug 23 11:14:54.667518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3388/6826] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:14:54.970599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:54.971698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:54.981946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:54.982562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:54.983120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:54.983886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:54.984389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:54.984900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:55.067386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:55.072708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:55.073331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:55.073888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lazy-loading 'fault' on Instance uuid 9f603c4c-f6b1-4252-8458-83f305a2d642 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:14:55.324602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40863219f8c498881c9ee5b5ce5a8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadc538b532d48b780b04b2ca23e4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:14:55.345845 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-93b2c755-768d-4ebe-a5f8-9bcee2f19fa2 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 200 len: 1357 microversion: 2.1 time: 0.379237 Aug 23 11:14:55.347405 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3439/6827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:54 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:14:56.393554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:56.394333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] [instance: 9f603c4c-f6b1-4252-8458-83f305a2d642] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:56.406056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:56.408004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:56.408615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:56.409121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:56.414487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:56.415171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:56.420997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:56.438477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=53 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:56.469129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] HTTP exception thrown: Instance 9f603c4c-f6b1-4252-8458-83f305a2d642 could not be found. Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Request method failure captured: Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 HTTP/1.1 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLPS6dqOS_zEv0sC6ZMxneqd8cjvhwM_ReN9ia834ny4t3AfM938V8rdG3LlNSFFPyt-L_78meJbOo2HvxrYN5BnMC7jtt4TymfaTmp0u2dCADn5Z54wnHlalMz17UWbj_or8mR62OencPjC8qMxXls3QLLfOMAMr8QkN-pelrnetpk Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aadc538b532d48b780b04b2ca23e4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aadc538b532d48b780b04b2ca23e4fc7"}]}] Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: aadc538b532d48b780b04b2ca23e4fc7 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-79389311 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: b40863219f8c498881c9ee5b5ce5a8c5 Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-79389311-project Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9f603c4c-f6b1-4252-8458-83f305a2d642 could not be found. Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9f603c4c-f6b1-4252-8458-83f305a2d642'} Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f603c4c-f6b1-4252-8458-83f305a2d642 could not be found. Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f603c4c-f6b1-4252-8458-83f305a2d642 could not be found. Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:56.470986 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f603c4c-f6b1-4252-8458-83f305a2d642 could not be found. Aug 23 11:14:56.475198 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:56.476198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Returning 404 to user: Instance 9f603c4c-f6b1-4252-8458-83f305a2d642 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:14:56.492216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-14300b77-33d3-4d4a-97c2-73e96bc76706 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642" status: 404 len: 111 microversion: 2.1 time: 0.125727 Aug 23 11:14:56.492837 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3389/6828] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:56 2022] GET /compute/v2.1/servers/9f603c4c-f6b1-4252-8458-83f305a2d642 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:14:56.733692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:56.735812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:56.740595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:56.746149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:56.747094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:56.747698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:56.748629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:56.749588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:56.750256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:56.755967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:14:56.795902 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-103ba098-f80d-430f-80a7-acd11d71c185 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.066934 Aug 23 11:14:56.796461 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3440/6829] 10.222.0.78 () {58 vars in 1293 bytes} [Tue Aug 23 11:14:56 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e/os-server-password => generated 116 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:14:57.440699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:57.441257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:57.479083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:57.480357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:57.481163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:57.482263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:57.482848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:57.483440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:57.500775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] HTTP exception thrown: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Request method failure captured: Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 HTTP/1.1 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLS0HEhlpKgLjfhGydJVE_e5ZIIn8kq3aznJG-6hx3YFqIxtvFSQ8g20K93QwkDczNVgCelFOPSDe7kRkHTOL2fAYgD4Tq3DAa48A7ohNiss5XnhYg4uAlxlf0QoKUG9OAYq7KUqS56kw3gbvD7EuefVj7Tc1-IA6f76sYKJDnkdedc Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e89c4738f5f4f7a9e7985bc175d8867", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}] Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 2f677df65e434e45b050d23769ad5863 Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '2d145121-67ea-4c28-9f14-dd99936df4a6'} Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:14:57.502815 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.507838 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.509586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Returning 404 to user: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:14:57.510764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c34f39a0-dea0-447a-9e9c-8a48c4e0eeeb tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 404 len: 111 microversion: 2.1 time: 0.075134 Aug 23 11:14:57.521670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:14:57.522467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 2d145121-67ea-4c28-9f14-dd99936df4a6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:14:57.525504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3390/6830] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:14:57 2022] DELETE /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:14:57.529733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:57.530868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:57.531464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:57.532397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:14:57.533359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:14:57.534611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:14:57.554332 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] HTTP exception thrown: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Request method failure captured: Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 HTTP/1.1 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLS0HEhlpKgLjfhGydJVE_e5ZIIn8kq3aznJG-6hx3YFqIxtvFSQ8g20K93QwkDczNVgCelFOPSDe7kRkHTOL2fAYgD4Tq3DAa48A7ohNiss5XnhYg4uAlxlf0QoKUG9OAYq7KUqS56kw3gbvD7EuefVj7Tc1-IA6f76sYKJDnkdedc Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e89c4738f5f4f7a9e7985bc175d8867", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}] Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2f677df65e434e45b050d23769ad5863 Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '2d145121-67ea-4c28-9f14-dd99936df4a6'} Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:14:57.556067 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Returning 404 to user: Instance 2d145121-67ea-4c28-9f14-dd99936df4a6 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:14:57.559838 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-197ba482-585a-4dd5-97ca-606e0deb8054 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6" status: 404 len: 111 microversion: 2.1 time: 0.041771 Aug 23 11:14:57.573145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3441/6831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:14:57 2022] GET /compute/v2.1/servers/2d145121-67ea-4c28-9f14-dd99936df4a6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:15:02.497702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-edbb5fc2-d038-4716-85b4-75bcee992c13 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] Calling method '.version_select at 0x7fdc8f7b9940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:02.552691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-edbb5fc2-d038-4716-85b4-75bcee992c13 tempest-TestNetworkAdvancedServerOps-79389311 tempest-TestNetworkAdvancedServerOps-79389311-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2054733182" status: 202 len: 0 microversion: 2.1 time: 0.060416 Aug 23 11:15:02.553589 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3391/6832] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Aug 23 11:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2054733182 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:15:03.352066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:03.352568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:03.367165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:03.367691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:03.368151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:03.368936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:03.369414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:03.369863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:03.397217 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] HTTP exception thrown: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Request method failure captured: Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb HTTP/1.1 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLS0HEhlpKgLjfhGydJVE_e5ZIIn8kq3aznJG-6hx3YFqIxtvFSQ8g20K93QwkDczNVgCelFOPSDe7kRkHTOL2fAYgD4Tq3DAa48A7ohNiss5XnhYg4uAlxlf0QoKUG9OAYq7KUqS56kw3gbvD7EuefVj7Tc1-IA6f76sYKJDnkdedc Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e89c4738f5f4f7a9e7985bc175d8867", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}] Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 2f677df65e434e45b050d23769ad5863 Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '48bfde77-3820-4a7f-8409-cd624d68cddb'} Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:15:03.406533 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.411503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Returning 404 to user: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:15:03.413042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe3eef6e-454c-4b5c-bbcc-e56a0e5722dd tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 404 len: 111 microversion: 2.1 time: 0.065372 Aug 23 11:15:03.413873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3442/6833] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:15:03 2022] DELETE /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:15:03.422597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:03.423237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] [instance: 48bfde77-3820-4a7f-8409-cd624d68cddb] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:03.437809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:03.438322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:03.438778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:03.439509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:03.439980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:03.440424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:03.467583 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] HTTP exception thrown: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Request method failure captured: Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb HTTP/1.1 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLS0HEhlpKgLjfhGydJVE_e5ZIIn8kq3aznJG-6hx3YFqIxtvFSQ8g20K93QwkDczNVgCelFOPSDe7kRkHTOL2fAYgD4Tq3DAa48A7ohNiss5XnhYg4uAlxlf0QoKUG9OAYq7KUqS56kw3gbvD7EuefVj7Tc1-IA6f76sYKJDnkdedc Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e89c4738f5f4f7a9e7985bc175d8867", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e89c4738f5f4f7a9e7985bc175d8867"}]}] Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 8e89c4738f5f4f7a9e7985bc175d8867 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2068750062 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 2f677df65e434e45b050d23769ad5863 Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-AttachVolumeTestJSON-2068750062-project Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '48bfde77-3820-4a7f-8409-cd624d68cddb'} Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:15:03.471357 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] Returning 404 to user: Instance 48bfde77-3820-4a7f-8409-cd624d68cddb could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:15:03.477730 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b2443b0-45f6-419f-9e4e-000df1ba56f8 tempest-AttachVolumeTestJSON-2068750062 tempest-AttachVolumeTestJSON-2068750062-project] 10.222.0.78 "GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb" status: 404 len: 111 microversion: 2.1 time: 0.059264 Aug 23 11:15:03.478359 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3392/6834] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:03 2022] GET /compute/v2.1/servers/48bfde77-3820-4a7f-8409-cd624d68cddb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:15:10.037078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-925022281", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "97f27918-7d0a-451c-b0f3-63beac02ea0c"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:10.157474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] validate_networks() for [('97f27918-7d0a-451c-b0f3-63beac02ea0c', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:15:10.797157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:15:10.797714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:15:10.798247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:15:10.798968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:15:10.799816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:15:10.813072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:10.817931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:10.819054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:10.820585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:10.821319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:10.822070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:10.862483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Getting quotas for project 772a5fa220c7426baf4f3abd3367c0f1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:15:10.869799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Getting quotas for user a6bd74d039fe45a1b5ac16c3d2768219 and project 772a5fa220c7426baf4f3abd3367c0f1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:15:10.887099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:15:10.889688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:15:10.984198 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2649d818-91be-46ee-8055-ddbc5a19e135 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323141 Aug 23 11:15:10.985129 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3443/6835] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:15:10.998331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d2c4f6c-35d2-4d57-a80d-524a72391069 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:10.999056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d2c4f6c-35d2-4d57-a80d-524a72391069 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:11.122445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6d2c4f6c-35d2-4d57-a80d-524a72391069 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:11.131718 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d2c4f6c-35d2-4d57-a80d-524a72391069 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1214 microversion: 2.1 time: 0.138062 Aug 23 11:15:11.132543 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3393/6836] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:10 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:12.153791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:12.155095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:12.176095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:12.177016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:12.179085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:12.181799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:12.182483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:12.192537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:12.365990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:12.375618 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ad1a72c-8934-45ea-bb52-cab0ec91c289 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1266 microversion: 2.1 time: 0.227552 Aug 23 11:15:12.385516 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3444/6837] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:12 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:13.405630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:13.406196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:13.442714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:13.443794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:13.446632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:13.448693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:13.452106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:13.453009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:13.454264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=5 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:13.565783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:13.574882 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-334639b0-6809-4a64-bf5f-061fcbb462cc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1272 microversion: 2.1 time: 0.172975 Aug 23 11:15:13.585298 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3394/6838] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:13 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:14.607397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:14.608077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:14.622930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:14.623415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:14.623773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:14.624486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:14.627384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:14.628006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:15.167033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:15.182906 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd554932-8ec8-44d9-8f05-9cd0aa6451aa tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1314 microversion: 2.1 time: 0.579333 Aug 23 11:15:15.184258 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3445/6839] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:14 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:15.289350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-17517069-a08c-4cc3-840d-14189ff1c53c req-a590bd23-c729-4999-82d3-801fdb3a8063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19c9896-b172-4f18-8bc9-9c3298af2656", "tag": "2e2225e9-592c-4bcd-8391-80bf8c2ed76b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:15.312915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-17517069-a08c-4cc3-840d-14189ff1c53c req-a590bd23-c729-4999-82d3-801fdb3a8063 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:15.313511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-17517069-a08c-4cc3-840d-14189ff1c53c req-a590bd23-c729-4999-82d3-801fdb3a8063 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:15.314050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-17517069-a08c-4cc3-840d-14189ff1c53c req-a590bd23-c729-4999-82d3-801fdb3a8063 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:15.328699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-17517069-a08c-4cc3-840d-14189ff1c53c req-a590bd23-c729-4999-82d3-801fdb3a8063 service nova] Creating event network-changed:2e2225e9-592c-4bcd-8391-80bf8c2ed76b for instance e19c9896-b172-4f18-8bc9-9c3298af2656 on n-h2-847009-13 Aug 23 11:15:15.336432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-17517069-a08c-4cc3-840d-14189ff1c53c req-a590bd23-c729-4999-82d3-801fdb3a8063 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052082 Aug 23 11:15:15.337687 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3395/6840] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:16.146453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e8245f1a-54f8-469a-9956-62ebee955f41 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9cb6e790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:16.205465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:16.206187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:16.220769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:16.221596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:16.224869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:16.226042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:16.226517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:16.229609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:16.255984 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e8245f1a-54f8-469a-9956-62ebee955f41 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/43e8f12a-ff05-4699-a3b5-aa3c57cc49f9" status: 200 len: 350 microversion: 2.1 time: 0.114420 Aug 23 11:15:16.265038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3446/6841] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:15:16 2022] GET /compute/v2.1/os-volumes/43e8f12a-ff05-4699-a3b5-aa3c57cc49f9 => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:16.493141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:16.514279 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-babb291f-ae00-4daf-ac46-a19428503156 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1314 microversion: 2.1 time: 0.313492 Aug 23 11:15:16.519587 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3396/6842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:16 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:17.543847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:17.544218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:17.567642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:17.572635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:17.573848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:17.575039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:17.576002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:17.576652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:18.071958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:18.089489 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f36b698-8cf6-4256-a6c4-3e09f82ea09e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1314 microversion: 2.1 time: 0.549577 Aug 23 11:15:18.091294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3447/6843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:17 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:19.038128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b8581fad-a184-45d0-80ab-5efea57d6120 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9c4a7940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:19.108667 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b8581fad-a184-45d0-80ab-5efea57d6120 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/8298c40b-a824-4306-b31d-47c403de41e0" status: 200 len: 350 microversion: 2.1 time: 0.078658 Aug 23 11:15:19.116652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:19.119542 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3397/6844] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:15:19 2022] GET /compute/v2.1/os-volumes/8298c40b-a824-4306-b31d-47c403de41e0 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:19.129856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:19.150734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:19.151353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:19.153986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:19.154876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:19.155462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:19.157194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:19.507941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:19.544135 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7407bbe-be8d-45ce-b5f0-e95f302925e1 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1314 microversion: 2.1 time: 0.432446 Aug 23 11:15:19.559161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3448/6845] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:19 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:20.568362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:20.569019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:20.583048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:20.584216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:20.598262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:20.599174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:20.599674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:20.600128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:20.873496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:20.886465 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c830b4fa-05a2-4cfc-a741-2067d0c6f91e tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1314 microversion: 2.1 time: 0.321768 Aug 23 11:15:20.887466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3398/6846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:20 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:21.320074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b687092f-4605-43bb-97c2-52d180aac535 req-751b8791-79c9-4d8d-8797-990884c2cbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19c9896-b172-4f18-8bc9-9c3298af2656", "name": "network-vif-plugged", "status": "completed", "tag": "2e2225e9-592c-4bcd-8391-80bf8c2ed76b"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:21.352554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:21.356428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:21.377877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b687092f-4605-43bb-97c2-52d180aac535 req-751b8791-79c9-4d8d-8797-990884c2cbde service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:21.380469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b687092f-4605-43bb-97c2-52d180aac535 req-751b8791-79c9-4d8d-8797-990884c2cbde service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:21.381130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b687092f-4605-43bb-97c2-52d180aac535 req-751b8791-79c9-4d8d-8797-990884c2cbde service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:21.417923 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b687092f-4605-43bb-97c2-52d180aac535 req-751b8791-79c9-4d8d-8797-990884c2cbde service nova] Creating event network-vif-plugged:2e2225e9-592c-4bcd-8391-80bf8c2ed76b for instance e19c9896-b172-4f18-8bc9-9c3298af2656 on n-h2-847009-13 Aug 23 11:15:21.432848 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b687092f-4605-43bb-97c2-52d180aac535 req-751b8791-79c9-4d8d-8797-990884c2cbde service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116333 Aug 23 11:15:21.436061 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3449/6847] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:21.909436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:21.911832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:21.927730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:21.938752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:21.939538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:21.940368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:21.943129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:21.943910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:21.944438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:22.085013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4448520b-5e04-4c1b-a6d3-a96dd83f34be tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9c1ca280>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.175172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:22.188585 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-396fcdc9-4b1d-4fba-a29b-928f9e30077b tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1314 microversion: 2.1 time: 0.284171 Aug 23 11:15:22.189377 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3399/6848] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:21 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:22.205883 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4448520b-5e04-4c1b-a6d3-a96dd83f34be tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/54aaacfe-e5d9-41c8-ba77-22f0078f5d21" status: 200 len: 351 microversion: 2.1 time: 0.125161 Aug 23 11:15:22.207095 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3450/6849] 10.222.0.78 () {58 vars in 1245 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes/54aaacfe-e5d9-41c8-ba77-22f0078f5d21 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:15:22.228432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8bb2e85-bda2-44ee-a20d-5c8f5e59c1e9 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc8fdd6a60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.346848 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8bb2e85-bda2-44ee-a20d-5c8f5e59c1e9 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.127247 Aug 23 11:15:22.359514 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3400/6850] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:22.365258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-03984eb7-5982-4a3e-8f7d-51df45ded6e7 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9cb6edc0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.496752 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-03984eb7-5982-4a3e-8f7d-51df45ded6e7 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.136779 Aug 23 11:15:22.497519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3451/6851] 10.222.0.78 () {58 vars in 1149 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:15:22.511049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b6ea6a4-04db-4a21-83fb-f31b4a3bfb52 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9cbe9a60>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.642281 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b6ea6a4-04db-4a21-83fb-f31b4a3bfb52 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.135004 Aug 23 11:15:22.642931 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3401/6852] 10.222.0.78 () {58 vars in 1134 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:22.658635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5a94768-6b91-4d9f-9bee-54580ade253a tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9c1e4af0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.757882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d5a94768-6b91-4d9f-9bee-54580ade253a tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103368 Aug 23 11:15:22.758852 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3452/6853] 10.222.0.78 () {58 vars in 1167 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:22.772129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd708961-845d-48c1-b0fe-d00ebc463bb2 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc8f70a160>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.861255 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd708961-845d-48c1-b0fe-d00ebc463bb2 tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093041 Aug 23 11:15:22.870662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3402/6854] 10.222.0.78 () {58 vars in 1170 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:22.877596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5051a86c-6b76-4df2-bf19-0193570185bd tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc9c2e0550>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:22.974513 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5051a86c-6b76-4df2-bf19-0193570185bd tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101432 Aug 23 11:15:22.975849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3453/6855] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:15:22.990224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5c0b6391-663e-4d99-b434-a586d2e6041d tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdc8fc9c280>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:23.089777 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5c0b6391-663e-4d99-b434-a586d2e6041d tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105050 Aug 23 11:15:23.097156 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3403/6856] 10.222.0.78 () {58 vars in 1188 bytes} [Tue Aug 23 11:15:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:23.106453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73a71260-16a0-437f-a637-4dc61bbef92b tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] Calling method '.version_select at 0x7fdca1e0e9d0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:23.193050 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73a71260-16a0-437f-a637-4dc61bbef92b tempest-VolumesTestJSON-316697143 tempest-VolumesTestJSON-316697143-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090447 Aug 23 11:15:23.193819 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3454/6857] 10.222.0.78 () {58 vars in 1155 bytes} [Tue Aug 23 11:15:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:23.212691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:23.213468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:23.223181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.223881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.224333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.225069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.225778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.226365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.388534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:23.399669 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-802ce319-2704-49ae-9b2e-4668fc9f7453 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1501 microversion: 2.1 time: 0.190931 Aug 23 11:15:23.406173 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3404/6858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:23 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1501 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:23.429890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:23.430641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:23.437935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.438556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.438877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.439600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.440074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.440511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.602156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:23.616491 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8e933dc-da9e-4e7c-a4cc-5fa7d25f91f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1501 microversion: 2.1 time: 0.191737 Aug 23 11:15:23.617697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3455/6859] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:23 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1501 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:23.642697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:23.643625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:23.654649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.655472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.656277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.657256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.658564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.659974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.736913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lazy-loading 'flavor' on Instance uuid e19c9896-b172-4f18-8bc9-9c3298af2656 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:15:23.870454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9405862f-6a7d-4826-bb5a-71479ed6c221 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action" status: 202 len: 0 microversion: 2.1 time: 0.232767 Aug 23 11:15:23.871415 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3405/6860] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:15:23 2022] POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:15:23.883016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:23.883869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:23.896170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.897318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.898020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:23.899099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:23.900598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:23.901243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:24.163342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:24.174144 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f2b10f26-d6cc-4cdb-a8a0-324e25331414 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1509 microversion: 2.1 time: 0.296013 Aug 23 11:15:24.185207 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3456/6861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:23 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:25.198851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:25.199574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:25.212932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:25.213798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:25.214701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:25.216092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:25.216804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:25.217449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:25.464339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:25.501427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b08ec1cd-895b-4b64-ae37-80983c471898 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1492 microversion: 2.1 time: 0.308991 Aug 23 11:15:25.511593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3406/6862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:25 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1492 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:25.535750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:25.536348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:25.566938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:25.567500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:25.567946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:25.568670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:25.574445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:25.574901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:25.690074 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a23bf033-8d26-44ae-b654-a9c7491790ba tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action" status: 202 len: 0 microversion: 2.1 time: 0.158179 Aug 23 11:15:25.691522 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3457/6863] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:15:25 2022] POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:15:25.701747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:25.702379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:25.713438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:25.714174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:25.714630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:25.715347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:25.715806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:25.716244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:25.969034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:25.998473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3633f65b-7b3d-4d93-b07e-e5f8bebf42ee tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1498 microversion: 2.1 time: 0.300822 Aug 23 11:15:25.999926 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3407/6864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:25 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1498 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:27.030206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:27.035955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:27.052712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:27.058108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:27.063403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:27.065060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:27.069122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:27.072796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:27.078643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:27.402512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:27.411196 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a25a3aa-4d1d-49c7-b959-6cc2d061cdc0 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1498 microversion: 2.1 time: 0.394411 Aug 23 11:15:27.429356 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3458/6865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:27 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1498 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:28.440861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:28.442744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:28.453321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:28.457930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:28.459381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:28.460405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:28.461905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:28.463849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:28.464885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:28.652157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:28.661811 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f3b3940-b7cf-45ff-bc8b-2a5c36fdacfe tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1501 microversion: 2.1 time: 0.226440 Aug 23 11:15:28.677814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3408/6866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:28 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:28.685115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:28.686325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:28.694884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:28.695711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:28.696340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:28.698476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:28.698955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:28.699385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:28.703778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:28.729043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lazy-loading 'flavor' on Instance uuid e19c9896-b172-4f18-8bc9-9c3298af2656 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:15:28.852118 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f42609c1-2dbc-4b67-850b-3ff5c3c543f4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action" status: 202 len: 0 microversion: 2.1 time: 0.170861 Aug 23 11:15:28.853410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3459/6867] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:15:28 2022] POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:15:28.861774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:28.862617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:28.874950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:28.875670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:28.876271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:28.877173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:28.877922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:28.879268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:29.176295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:29.188455 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06e7f4d3-af13-43b8-bd69-a4e24b675f75 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1509 microversion: 2.1 time: 0.330529 Aug 23 11:15:29.205567 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3409/6868] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:28 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:30.217172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:30.219026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:30.232768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:30.239377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:30.239996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:30.244214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:30.244782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:30.245210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:30.573568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:30.583208 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6f6a2296-54c6-4c50-bc8b-90d5e5d529c4 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1492 microversion: 2.1 time: 0.372066 Aug 23 11:15:30.584128 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3460/6869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:30 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1492 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:30.610688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:30.611250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:30.622180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:30.622677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:30.623127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:30.623841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:30.624310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:30.624831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:30.712043 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e66b13d-921a-41da-a080-ffab66034adc tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action" status: 202 len: 0 microversion: 2.1 time: 0.105088 Aug 23 11:15:30.713199 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3410/6870] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:15:30 2022] POST /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:15:30.722364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:30.724342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:30.731815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:30.732772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:30.733598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:30.734961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:30.735776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:30.736639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:31.241793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:31.254595 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44511c58-ab96-4744-960c-8cfacb596a79 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1498 microversion: 2.1 time: 0.537461 Aug 23 11:15:31.267868 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3461/6871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:30 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1498 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:15:32.279804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:32.281294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:32.287866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:32.288434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:32.288920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:32.289638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:32.290106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:32.290540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:32.479144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:32.490954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4259997-1f3d-46f7-85f4-a1e5cd90ca8d tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1498 microversion: 2.1 time: 0.216319 Aug 23 11:15:32.491557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3411/6872] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:32 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1498 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:33.515206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:33.515844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:33.540423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:33.540967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:33.541600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:33.542813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:33.543452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:33.545722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:33.767134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:33.776156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-738049ea-4fbe-43e0-bab9-03c2bfdf786f tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1501 microversion: 2.1 time: 0.264905 Aug 23 11:15:33.776778 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3462/6873] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:33 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:33.798362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:33.799031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:33.806342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:33.807223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:33.807677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:33.808422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:33.808928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:33.809721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:33.871145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:15:33.954826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:15:34.093254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-133c7afc-ee74-4fee-847d-8f876b49f282 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 204 len: 0 microversion: 2.1 time: 0.299920 Aug 23 11:15:34.094069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3412/6874] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:15:33 2022] DELETE /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:15:34.105801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:34.106736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:34.119944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:34.123256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:34.124194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:34.125245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:34.129945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:34.130553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:34.417532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:34.429147 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e4dc402b-7579-4027-a6e2-72780f0855b8 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1507 microversion: 2.1 time: 0.328878 Aug 23 11:15:34.430209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3463/6875] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:34 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:35.452513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:35.453395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:35.462831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:35.463541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:35.464927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:35.465881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:35.466499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:35.467079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:35.665730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:35.674232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f80a5384-2636-44b2-ba27-881700434108 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1507 microversion: 2.1 time: 0.227171 Aug 23 11:15:35.676040 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3413/6876] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:35 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:36.696297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:36.697764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:36.713906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:36.716979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:36.718002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:36.719145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:36.720128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:36.723352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:37.533180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:37.542567 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a83ad585-645a-4700-bdca-97934c077176 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1507 microversion: 2.1 time: 0.850263 Aug 23 11:15:37.543161 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3464/6877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:36 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1507 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:37.920695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-13ba8a41-eef0-4c10-b62d-01e3c95d2cfe req-6c752304-2aad-459f-8e2a-3e0d4742bbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19c9896-b172-4f18-8bc9-9c3298af2656", "name": "network-vif-deleted", "tag": "2e2225e9-592c-4bcd-8391-80bf8c2ed76b"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:15:37.937103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-13ba8a41-eef0-4c10-b62d-01e3c95d2cfe req-6c752304-2aad-459f-8e2a-3e0d4742bbf7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:37.938336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-13ba8a41-eef0-4c10-b62d-01e3c95d2cfe req-6c752304-2aad-459f-8e2a-3e0d4742bbf7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:37.939060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-13ba8a41-eef0-4c10-b62d-01e3c95d2cfe req-6c752304-2aad-459f-8e2a-3e0d4742bbf7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:37.977205 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-13ba8a41-eef0-4c10-b62d-01e3c95d2cfe req-6c752304-2aad-459f-8e2a-3e0d4742bbf7 service nova] Creating event network-vif-deleted:2e2225e9-592c-4bcd-8391-80bf8c2ed76b for instance e19c9896-b172-4f18-8bc9-9c3298af2656 on n-h2-847009-13 Aug 23 11:15:38.001831 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-13ba8a41-eef0-4c10-b62d-01e3c95d2cfe req-6c752304-2aad-459f-8e2a-3e0d4742bbf7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084693 Aug 23 11:15:38.003637 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3414/6878] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:15:38.570247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:38.572522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:38.586560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:38.587928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:38.588614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:38.589661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:38.590696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:38.591286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:38.633231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:38.633964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:38.634687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:38.635370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lazy-loading 'fault' on Instance uuid e19c9896-b172-4f18-8bc9-9c3298af2656 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:15:38.748419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6bd74d039fe45a1b5ac16c3d2768219', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772a5fa220c7426baf4f3abd3367c0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:15:38.766428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef98c0ae-1f51-4759-ad5a-9a35b3768f69 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 200 len: 1304 microversion: 2.1 time: 0.204929 Aug 23 11:15:38.767236 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3465/6879] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:38 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:15:39.791647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:15:39.793194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] [instance: e19c9896-b172-4f18-8bc9-9c3298af2656] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:15:39.808951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:39.809817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:39.812382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:39.825049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:15:39.827558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:15:39.828264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:15:39.858476 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] HTTP exception thrown: Instance e19c9896-b172-4f18-8bc9-9c3298af2656 could not be found. Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Request method failure captured: Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 HTTP/1.1 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLa6hi8i9eE3mbjktJVXdXiDVkaC_FGf8bbwPDrlcYGKlxtxVCIoNNWpjhbYUbPE8NLjFtsNObmroZb-LSZb_JQskEb3s1RZD13yZSvPXxq_VyHfHwJ2o2kOSSBMb34jnATHBR8jmOFwm5LRLCp0PVR1XCMkykRA7FpeXv4QLprvNSI Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 772a5fa220c7426baf4f3abd3367c0f1 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestServerAdvancedOps-948219128 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/772a5fa220c7426baf4f3abd3367c0f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_772a5fa220c7426baf4f3abd3367c0f1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/772a5fa220c7426baf4f3abd3367c0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/772a5fa220c7426baf4f3abd3367c0f1"}]}] Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestServerAdvancedOps-948219128 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 772a5fa220c7426baf4f3abd3367c0f1 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestServerAdvancedOps-948219128 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestServerAdvancedOps-948219128-project Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: a6bd74d039fe45a1b5ac16c3d2768219 Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestServerAdvancedOps-948219128-project Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance e19c9896-b172-4f18-8bc9-9c3298af2656 could not be found. Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'e19c9896-b172-4f18-8bc9-9c3298af2656'} Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19c9896-b172-4f18-8bc9-9c3298af2656 could not be found. Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19c9896-b172-4f18-8bc9-9c3298af2656 could not be found. Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:15:39.860487 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19c9896-b172-4f18-8bc9-9c3298af2656 could not be found. Aug 23 11:15:39.866189 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:15:39.868369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] Returning 404 to user: Instance e19c9896-b172-4f18-8bc9-9c3298af2656 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:15:39.869572 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b654406-0a76-4f49-80ed-1b82e0599c62 tempest-TestServerAdvancedOps-948219128 tempest-TestServerAdvancedOps-948219128-project] 10.222.0.78 "GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656" status: 404 len: 111 microversion: 2.1 time: 0.082619 Aug 23 11:15:39.873836 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3415/6880] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:15:39 2022] GET /compute/v2.1/servers/e19c9896-b172-4f18-8bc9-9c3298af2656 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:16:48.760635 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:16:48.761262 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:16:57.916432 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:16:57.917139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=17 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:16:57.917772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:16:57.922506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1272607628", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:16:58.262880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:16:58.746235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:16:58.746664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:16:58.747468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:16:58.747891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:16:58.748487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:16:58.761692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:16:58.762528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:16:58.763183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:16:58.767354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:16:58.768398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:16:58.769131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:16:58.789247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Getting quotas for project d45189a1dfbd4149b1d8432b75955891. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:16:58.796992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Getting quotas for user 474d04afe1c844029bf9cb9469ac9916 and project d45189a1dfbd4149b1d8432b75955891. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:16:58.816155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:16:58.819045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:16:58.905807 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-175cd3ca-8593-41aa-bf24-d0ff7edf42c9 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991448 Aug 23 11:16:58.916831 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3466/6881] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:16:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:16:58.922539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ec674f0c-4434-4f30-8205-497f028dab4e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:16:58.925098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ec674f0c-4434-4f30-8205-497f028dab4e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:16:58.928716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:16:58.931268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:16:59.347521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ec674f0c-4434-4f30-8205-497f028dab4e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:16:59.356626 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ec674f0c-4434-4f30-8205-497f028dab4e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1215 microversion: 2.1 time: 0.439583 Aug 23 11:16:59.360103 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3416/6882] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:16:58 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1215 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:17:00.379455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-643ac7b1-e3d9-4cfd-9208-1a8135a92fcf tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:00.380366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-643ac7b1-e3d9-4cfd-9208-1a8135a92fcf tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:00.419077 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 35478. Aug 23 11:17:00.462554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-643ac7b1-e3d9-4cfd-9208-1a8135a92fcf tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:00.471150 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-643ac7b1-e3d9-4cfd-9208-1a8135a92fcf tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1215 microversion: 2.1 time: 0.096529 Aug 23 11:17:00.472571 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3467/6883] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:00 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:01.493479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3773f090-7933-43a0-b27c-9f5bd88afff3 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:01.494678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3773f090-7933-43a0-b27c-9f5bd88afff3 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:01.619882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3773f090-7933-43a0-b27c-9f5bd88afff3 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:01.633060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3773f090-7933-43a0-b27c-9f5bd88afff3 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1215 microversion: 2.1 time: 0.142776 Aug 23 11:17:01.634199 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3417/6884] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:01 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:02.655353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:02.655981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:02.669392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:02.669810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:02.670259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:02.670992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:02.671461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:02.671899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:02.768517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:02.781676 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7dcc78af-3d0c-4b33-97bf-a8479ff4f13e tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1219 microversion: 2.1 time: 0.130634 Aug 23 11:17:02.791481 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3468/6885] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:02 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:03.809419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:03.811540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:03.831359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:03.832091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:03.832760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:03.835601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:03.848798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:03.850094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:03.982462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:03.996091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02b831ab-640e-4ba9-8b2e-077a05f1f85a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1211 microversion: 2.1 time: 0.191476 Aug 23 11:17:04.014304 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3418/6886] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:03 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1211 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:05.019641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:05.020913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:05.028495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:05.029239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:05.029876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:05.030773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:05.031478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:05.032732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:05.164455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:05.178753 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-273eb39a-0ec0-4de7-810a-f2bcfa2016b8 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1273 microversion: 2.1 time: 0.163867 Aug 23 11:17:05.180331 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3469/6887] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:05 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:06.201265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:06.202538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:06.210760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:06.211262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:06.211707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:06.212425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:06.212918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:06.213349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:06.281288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:06.289622 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-191e03f2-2fce-4180-9c52-03e478d6596f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1273 microversion: 2.1 time: 0.092710 Aug 23 11:17:06.290303 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3419/6888] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:06 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:07.312632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:07.314713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:07.336555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:07.339075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:07.342296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:07.346031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:07.347652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:07.350673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:08.056709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:08.066398 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce967617-69cc-45e2-8d19-24ee443ed383 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.758615 Aug 23 11:17:08.071466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3470/6889] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:07 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:08.200682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7af330aa-472a-4a0b-b905-eb21427a5c66 req-cd80160f-5dbd-4a49-84e0-2fcb61d7d545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d455417-c374-430d-bf9f-de887a476f22", "tag": "f7eaeef6-b225-4b8d-bcd9-6f0c59b35673"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:17:08.245713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7af330aa-472a-4a0b-b905-eb21427a5c66 req-cd80160f-5dbd-4a49-84e0-2fcb61d7d545 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:08.246547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7af330aa-472a-4a0b-b905-eb21427a5c66 req-cd80160f-5dbd-4a49-84e0-2fcb61d7d545 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:08.249654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7af330aa-472a-4a0b-b905-eb21427a5c66 req-cd80160f-5dbd-4a49-84e0-2fcb61d7d545 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:08.280083 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7af330aa-472a-4a0b-b905-eb21427a5c66 req-cd80160f-5dbd-4a49-84e0-2fcb61d7d545 service nova] Creating event network-changed:f7eaeef6-b225-4b8d-bcd9-6f0c59b35673 for instance 6d455417-c374-430d-bf9f-de887a476f22 on n-h2-847009-13 Aug 23 11:17:08.292812 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7af330aa-472a-4a0b-b905-eb21427a5c66 req-cd80160f-5dbd-4a49-84e0-2fcb61d7d545 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098582 Aug 23 11:17:08.296278 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3420/6890] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:17:09.088484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:09.089280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:09.093354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:17:09.109705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:09.111657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:09.116357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:09.117566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:09.118207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:09.118808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:09.433633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:09.443581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-44bbc0e3-aa9e-48d2-a8c8-b991fd05fa1a tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.359739 Aug 23 11:17:09.444174 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3471/6891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:09 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:17:10.471021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:10.473217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:10.517731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:10.520436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:10.522768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:10.532611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:10.533498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:10.534063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:10.915028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:10.931193 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f6a63a5d-7d67-4cb5-91dd-85db8e2b3a7f tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.466955 Aug 23 11:17:10.933836 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3421/6892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:10 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:11.954815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:11.956177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:11.968709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:17:11.972407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:11.976412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:11.978004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:11.979345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:11.979841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:11.982567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:12.195618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:12.207214 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9747edd-6ad9-4f85-ad6c-6f336de84747 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.255189 Aug 23 11:17:12.208334 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3472/6893] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:11 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:13.226562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:17:13.231401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:13.232248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:13.273297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:13.274062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:13.274627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:13.275415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:13.275890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:13.276330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:13.645249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:13.666265 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb0b714f-2b18-48f7-8e4c-15ec9dc02864 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.440662 Aug 23 11:17:13.668812 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3422/6894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:13 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:14.694059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:14.695283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:14.716469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:14.717305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:14.717916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:14.719149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:14.722412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:14.723066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:15.035499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:15.051873 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7855f3e1-8c3c-414c-84c4-d7094ebfc0d5 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.362111 Aug 23 11:17:15.052503 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3473/6895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:14 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:15.182353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6e024961-b71e-4eb0-b73f-414e097f32b3 req-96564ea0-f005-453c-bafe-8268b317ce58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d455417-c374-430d-bf9f-de887a476f22", "name": "network-vif-plugged", "status": "completed", "tag": "f7eaeef6-b225-4b8d-bcd9-6f0c59b35673"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:17:15.200204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6e024961-b71e-4eb0-b73f-414e097f32b3 req-96564ea0-f005-453c-bafe-8268b317ce58 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:15.200881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6e024961-b71e-4eb0-b73f-414e097f32b3 req-96564ea0-f005-453c-bafe-8268b317ce58 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:15.202189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6e024961-b71e-4eb0-b73f-414e097f32b3 req-96564ea0-f005-453c-bafe-8268b317ce58 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:15.217277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6e024961-b71e-4eb0-b73f-414e097f32b3 req-96564ea0-f005-453c-bafe-8268b317ce58 service nova] Creating event network-vif-plugged:f7eaeef6-b225-4b8d-bcd9-6f0c59b35673 for instance 6d455417-c374-430d-bf9f-de887a476f22 on n-h2-847009-13 Aug 23 11:17:15.223512 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6e024961-b71e-4eb0-b73f-414e097f32b3 req-96564ea0-f005-453c-bafe-8268b317ce58 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048839 Aug 23 11:17:15.229445 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3423/6896] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:17:16.081573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:16.084965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:16.094379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:16.095619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:16.096872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:16.098018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:16.098864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:16.099782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:16.464186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:16.489943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-97f90921-8f10-4e44-b995-b90148ca89a2 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1315 microversion: 2.1 time: 0.419833 Aug 23 11:17:16.493256 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3474/6897] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:16 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:17.518762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:17.520129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:17.560945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:17.563254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:17.570142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:17.571500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:17.572480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:17.573231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:17.948012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:17.962148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-264c3838-f261-4554-a807-2c37a83b3c5d tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1465 microversion: 2.1 time: 0.449710 Aug 23 11:17:17.967137 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3424/6898] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:17 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1465 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:18.058917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:18.060437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:18.076350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:18.077207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:18.077825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:18.078786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:18.079849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:18.084298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:18.137313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:17:18.296456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-33e1bbf7-751b-440a-ab11-be67f93e7903 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 204 len: 0 microversion: 2.1 time: 0.243778 Aug 23 11:17:18.301725 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3475/6899] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:17:18 2022] DELETE /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:17:18.307657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:18.308495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:18.321071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:18.324063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:18.325344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:18.328587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:18.330243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:18.332810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:18.680299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:18.691646 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c89d51a-fad5-47e0-b26f-defacca0c074 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1471 microversion: 2.1 time: 0.388276 Aug 23 11:17:18.692302 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3425/6900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:18 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:19.715736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:19.716463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:19.727406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:19.736401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:19.737068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:19.741661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:19.742335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:19.745376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:20.466758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:20.481565 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7ef7ca45-f7e8-470e-a193-7a01eae94438 tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1471 microversion: 2.1 time: 0.769514 Aug 23 11:17:20.483327 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3476/6901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:19 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1471 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:21.237925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f1e65d55-ef5d-4316-ab4a-606c57a7e950 req-ba2eaf20-238b-4f9e-931d-7884b17c9f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d455417-c374-430d-bf9f-de887a476f22", "name": "network-vif-deleted", "tag": "f7eaeef6-b225-4b8d-bcd9-6f0c59b35673"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:17:21.257053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f1e65d55-ef5d-4316-ab4a-606c57a7e950 req-ba2eaf20-238b-4f9e-931d-7884b17c9f06 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:21.258306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f1e65d55-ef5d-4316-ab4a-606c57a7e950 req-ba2eaf20-238b-4f9e-931d-7884b17c9f06 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:21.260960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f1e65d55-ef5d-4316-ab4a-606c57a7e950 req-ba2eaf20-238b-4f9e-931d-7884b17c9f06 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:21.305023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f1e65d55-ef5d-4316-ab4a-606c57a7e950 req-ba2eaf20-238b-4f9e-931d-7884b17c9f06 service nova] Creating event network-vif-deleted:f7eaeef6-b225-4b8d-bcd9-6f0c59b35673 for instance 6d455417-c374-430d-bf9f-de887a476f22 on n-h2-847009-13 Aug 23 11:17:21.316279 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f1e65d55-ef5d-4316-ab4a-606c57a7e950 req-ba2eaf20-238b-4f9e-931d-7884b17c9f06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086830 Aug 23 11:17:21.317680 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3426/6902] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:17:21.511097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:21.512381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:21.521059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:21.522393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:21.523140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:21.524729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:21.526052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:21.526719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:21.636212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:21.636723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:21.637193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:21.637660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lazy-loading 'fault' on Instance uuid 6d455417-c374-430d-bf9f-de887a476f22 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:17:21.765450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '474d04afe1c844029bf9cb9469ac9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45189a1dfbd4149b1d8432b75955891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:17:21.776538 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e24629aa-f14f-4722-be09-89102649428b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 200 len: 1305 microversion: 2.1 time: 0.272629 Aug 23 11:17:21.777151 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3477/6903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:21 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 1305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:17:22.800216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:17:22.801655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] [instance: 6d455417-c374-430d-bf9f-de887a476f22] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:17:22.830642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:22.831255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:22.831838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:22.836336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:17:22.836868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:17:22.837323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:17:22.879494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] HTTP exception thrown: Instance 6d455417-c374-430d-bf9f-de887a476f22 could not be found. Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Request method failure captured: Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 HTTP/1.1 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLcnOwtzuidgszZ3tftiOYM030LWeEBOYyGh5OxJ8gn0mlOm4HdIQZZvCrTiIwu-rPMq-mPBW6Czoa2Xem7IgpvgWpjP4SS8vPP5v-DFtCqssXQUcSzuKU1ttjGHskauYKL6TKSH0GEtdavWtCnIgEeTM0TrgEscPpt-f5SWsd7K2zc Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d45189a1dfbd4149b1d8432b75955891 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-VolumesNegativeTest-696727045 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d45189a1dfbd4149b1d8432b75955891"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d45189a1dfbd4149b1d8432b75955891", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d45189a1dfbd4149b1d8432b75955891"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d45189a1dfbd4149b1d8432b75955891"}]}] Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-VolumesNegativeTest-696727045 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d45189a1dfbd4149b1d8432b75955891 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-VolumesNegativeTest-696727045 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-VolumesNegativeTest-696727045-project Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 474d04afe1c844029bf9cb9469ac9916 Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-VolumesNegativeTest-696727045-project Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 6d455417-c374-430d-bf9f-de887a476f22 could not be found. Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '6d455417-c374-430d-bf9f-de887a476f22'} Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d455417-c374-430d-bf9f-de887a476f22 could not be found. Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d455417-c374-430d-bf9f-de887a476f22 could not be found. Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:17:22.882542 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d455417-c374-430d-bf9f-de887a476f22 could not be found. Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] Returning 404 to user: Instance 6d455417-c374-430d-bf9f-de887a476f22 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d219f15-bfc4-4ecf-a338-716d6e1dcc0b tempest-VolumesNegativeTest-696727045 tempest-VolumesNegativeTest-696727045-project] 10.222.0.78 "GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22" status: 404 len: 111 microversion: 2.1 time: 0.089429 Aug 23 11:17:22.887437 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3427/6904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:17:22 2022] GET /compute/v2.1/servers/6d455417-c374-430d-bf9f-de887a476f22 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:18:28.584824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1728649231", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e60f650d-b102-4469-ab89-65bab5a37afb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:18:28.612027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:28.625930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:28.755361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:18:29.601894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:18:29.602739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:18:29.603373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:18:29.603893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:18:29.604699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:18:29.618363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:29.619178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:29.619853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:29.620886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:29.621639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:29.622515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:29.648940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:18:29.664525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:18:29.733885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:18:29.737106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e60f650d-b102-4469-ab89-65bab5a37afb',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:18:30.026674 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68d59215-5fa0-443f-bdb1-aff6c0eec533 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446906 Aug 23 11:18:30.030986 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3478/6905] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:18:30.067391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-84ad7689-0f4d-4ae3-ab8b-54007df44b7c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:30.068168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-84ad7689-0f4d-4ae3-ab8b-54007df44b7c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:30.078768 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:18:30.079670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=28 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:30.081222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=44 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:30.213589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-84ad7689-0f4d-4ae3-ab8b-54007df44b7c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:30.224777 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-84ad7689-0f4d-4ae3-ab8b-54007df44b7c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1057 microversion: 2.1 time: 0.182331 Aug 23 11:18:30.225394 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3428/6906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:30 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1057 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:31.248430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-719f93b7-51c8-4a7c-9243-da4ddd7b307e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:31.249452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-719f93b7-51c8-4a7c-9243-da4ddd7b307e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:31.419419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-719f93b7-51c8-4a7c-9243-da4ddd7b307e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:31.428336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-719f93b7-51c8-4a7c-9243-da4ddd7b307e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1057 microversion: 2.1 time: 0.185252 Aug 23 11:18:31.449858 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3479/6907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:31 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1057 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:32.451024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-099f00d7-8fbd-4e10-8f95-34f5a7687d89 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:32.453294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-099f00d7-8fbd-4e10-8f95-34f5a7687d89 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:32.504074 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 37422. Aug 23 11:18:32.713407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-099f00d7-8fbd-4e10-8f95-34f5a7687d89 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:32.727148 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-099f00d7-8fbd-4e10-8f95-34f5a7687d89 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1057 microversion: 2.1 time: 0.280152 Aug 23 11:18:32.732219 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3429/6908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:32 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1057 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:33.752350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5bdafee-1d67-4828-8dde-fde763490eef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:33.753710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5bdafee-1d67-4828-8dde-fde763490eef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:33.887316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5bdafee-1d67-4828-8dde-fde763490eef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:33.895633 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5bdafee-1d67-4828-8dde-fde763490eef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1057 microversion: 2.1 time: 0.147835 Aug 23 11:18:33.899023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3480/6909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:33 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1057 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:34.918823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:34.922653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:34.946477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:34.947786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:34.950337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:34.951308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:34.952213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:34.954817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:35.078680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:35.086936 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b9a3cbbd-dcd9-417f-828a-4c7638dd88af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1107 microversion: 2.1 time: 0.173113 Aug 23 11:18:35.090006 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3430/6910] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:34 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1107 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:36.113958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:36.114729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:36.127522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:36.128507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:36.129296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:36.130917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:36.135981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:36.144134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:36.327913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:36.340521 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-573391ff-ea25-4c94-a50b-6181e65b0629 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1155 microversion: 2.1 time: 0.232586 Aug 23 11:18:36.356806 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3481/6911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:36 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1155 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:37.367088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:37.367869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:37.384173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:37.384803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:37.387448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:37.388446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:37.389695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:37.396318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:37.511432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:37.531831 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9a900ca-0d3d-4d14-a7cd-8a244202398c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1173 microversion: 2.1 time: 0.169723 Aug 23 11:18:37.537938 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3431/6912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:37 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1173 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:38.558166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:38.558792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:38.578003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:38.578520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:38.578977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:38.579718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:38.580187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:38.580628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:39.153861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:39.166568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-48f91475-e946-4082-95f2-797876c099ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1215 microversion: 2.1 time: 0.612106 Aug 23 11:18:39.175021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3482/6913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:38 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1215 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:40.192668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:40.193396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:40.209779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:40.210660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:40.211302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:40.212258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:40.212936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:40.213565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:40.376706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:40.386910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e96ddbd5-9317-44cb-a1ad-841d7514dea9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1215 microversion: 2.1 time: 0.198273 Aug 23 11:18:40.388284 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3432/6914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:40 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:40.416173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-663ead6a-9c61-49ba-b030-77197a767a48 req-71393b1a-930e-4998-9621-128127ff7ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e41023-7e7f-4949-ad25-9a052cea29b0", "tag": "3b5ffac7-10af-42a4-bba5-694f736fd440"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:18:40.436982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:40.442386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-663ead6a-9c61-49ba-b030-77197a767a48 req-71393b1a-930e-4998-9621-128127ff7ab1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:40.444294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-663ead6a-9c61-49ba-b030-77197a767a48 req-71393b1a-930e-4998-9621-128127ff7ab1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:40.445660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-663ead6a-9c61-49ba-b030-77197a767a48 req-71393b1a-930e-4998-9621-128127ff7ab1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:40.494781 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-663ead6a-9c61-49ba-b030-77197a767a48 req-71393b1a-930e-4998-9621-128127ff7ab1 service nova] Creating event network-changed:3b5ffac7-10af-42a4-bba5-694f736fd440 for instance c8e41023-7e7f-4949-ad25-9a052cea29b0 on n-h2-847009-13 Aug 23 11:18:40.511449 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-663ead6a-9c61-49ba-b030-77197a767a48 req-71393b1a-930e-4998-9621-128127ff7ab1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101371 Aug 23 11:18:40.512645 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3483/6915] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:18:41.425700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:41.429198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:41.458860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:41.463084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:41.463588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:41.464322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:41.464798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:41.469574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:41.931597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:41.944514 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-89761c57-b5c0-4127-af65-769538793fb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1215 microversion: 2.1 time: 0.539979 Aug 23 11:18:41.945659 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3433/6916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:41 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1215 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:42.971198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:42.972454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:42.987010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:42.989513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:42.990185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:42.991136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:42.993744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:42.994421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:43.351096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:43.363895 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-35042c9d-e299-4f3e-a83f-5a1f74100f65 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1215 microversion: 2.1 time: 0.397587 Aug 23 11:18:43.364522 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3484/6917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:42 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:44.392774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:44.394478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:44.399727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:44.407622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:44.408414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:44.409130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:44.410034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:44.410757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:44.411710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:44.605500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:44.615957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39c311ae-411b-4157-a6f5-2a03167f7315 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1215 microversion: 2.1 time: 0.228319 Aug 23 11:18:44.628764 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3434/6918] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:44 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:45.643692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:45.645210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:45.649208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=10 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:45.668596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:45.671379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:45.672860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:45.676125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:45.676852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:45.677714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:45.964324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:45.971506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20a7cfec-ab7c-4e6d-b614-eb636ba98ca9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.335189 Aug 23 11:18:45.973589 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3485/6919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:45 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:46.996284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:46.996865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:47.005534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:47.006251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:47.007419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:47.008305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:47.009358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:47.009798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:47.198555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:47.207443 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5ca4c090-7ac0-4fde-a061-91ca6afcdea2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.216197 Aug 23 11:18:47.221466 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3435/6920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:46 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:48.228878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:48.230259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:48.238156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:48.238992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:48.239522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:48.240479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:48.241210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:48.241881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:48.503136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:48.535671 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a57e769d-8ad6-486c-bd0f-6b8185e6e21a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.310689 Aug 23 11:18:48.536280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3486/6921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:48 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:49.556866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:49.557598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:49.568479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:49.569278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:49.569880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:49.570789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:49.571299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:49.573170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:49.864583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:49.879375 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adc1c5df-24c1-4af7-855e-021a11f733ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.327284 Aug 23 11:18:49.883482 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3436/6922] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:49 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:50.906646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:50.907963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:50.933921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:50.934809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:50.937528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:50.938579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:50.939125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:50.939979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:51.140450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:51.152240 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15b2eb59-38dd-4604-97ac-653f7509edae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.249826 Aug 23 11:18:51.153697 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3487/6923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:50 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:52.178227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:52.178857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:52.195588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:52.196090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:52.196533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:52.197478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:52.199348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:52.199950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:52.429605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:52.439869 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4b696f9b-5591-4bfd-adc9-0a8ed37483a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.265416 Aug 23 11:18:52.440807 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3437/6924] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:52 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:53.461641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:53.463109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:53.476608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:53.477620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:53.478600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:53.479781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:53.480253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:53.481063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:53.779244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:53.788449 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7287e7af-21c3-49f9-9203-434b22d86499 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.330579 Aug 23 11:18:53.789647 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3488/6925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:53 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:54.489016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c120655d-322c-4f0f-a114-c7c054e642d5 req-af81ec0a-6521-4214-b73d-79052c2b6995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e41023-7e7f-4949-ad25-9a052cea29b0", "name": "network-vif-plugged", "status": "completed", "tag": "3b5ffac7-10af-42a4-bba5-694f736fd440"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:18:54.500834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c120655d-322c-4f0f-a114-c7c054e642d5 req-af81ec0a-6521-4214-b73d-79052c2b6995 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:54.501581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c120655d-322c-4f0f-a114-c7c054e642d5 req-af81ec0a-6521-4214-b73d-79052c2b6995 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:54.502172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c120655d-322c-4f0f-a114-c7c054e642d5 req-af81ec0a-6521-4214-b73d-79052c2b6995 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:54.515637 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c120655d-322c-4f0f-a114-c7c054e642d5 req-af81ec0a-6521-4214-b73d-79052c2b6995 service nova] Creating event network-vif-plugged:3b5ffac7-10af-42a4-bba5-694f736fd440 for instance c8e41023-7e7f-4949-ad25-9a052cea29b0 on n-h2-847009-13 Aug 23 11:18:54.521645 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c120655d-322c-4f0f-a114-c7c054e642d5 req-af81ec0a-6521-4214-b73d-79052c2b6995 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274440 Aug 23 11:18:54.522558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3438/6926] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:18:54.809292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:54.809908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:54.818025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:54.818763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:54.819211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:54.819916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:54.820376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:54.820988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:55.052511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:55.063774 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-587626bb-60c6-4e96-8315-be3165c5709c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1203 microversion: 2.1 time: 0.258265 Aug 23 11:18:55.073641 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3489/6927] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:54 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1203 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:56.089635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:56.090307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:56.100337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:56.101289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:56.101989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:56.103204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:56.104724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:56.105600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:56.660268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:56.675509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35f30c1a-3e61-48d1-beb8-18588ecc2c9e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1390 microversion: 2.1 time: 0.593984 Aug 23 11:18:56.677029 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3439/6928] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:56 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1390 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:56.698435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:56.700142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:56.727056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:56.727572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:56.728026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:56.729620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:56.730111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:56.730551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.105579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:57.120787 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c3cec32f-9245-46ee-8321-b8f8baa71a3f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1390 microversion: 2.1 time: 0.425417 Aug 23 11:18:57.121623 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3490/6929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:56 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1390 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:57.143275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:57.144497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:57.159944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:57.163269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:57.164690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.166634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:57.167269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:57.172112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.390329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:57.418460 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45b9fe4a-353e-4c1b-948e-96e3b899e4db tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1390 microversion: 2.1 time: 0.280206 Aug 23 11:18:57.421577 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3440/6930] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:57 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1390 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:18:57.442858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:57.443351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:57.454243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:57.454243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:57.454611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.455333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:57.455793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:57.456215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.522354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:18:57.702056 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90e9fa49-34c2-4ece-827a-8d4fd39277e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 204 len: 0 microversion: 2.1 time: 0.260396 Aug 23 11:18:57.707047 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3491/6931] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:18:57 2022] DELETE /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:18:57.715604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:57.716234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:57.724238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:57.724886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:57.726165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.728353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:57.728873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:57.729309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:57.952973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:57.964668 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e62da85e-9499-4e79-b5d3-0865447ee129 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1396 microversion: 2.1 time: 0.253196 Aug 23 11:18:57.965969 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3441/6932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:57 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1396 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:18:58.998255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:18:58.998972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:18:59.006462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:59.027686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:59.028202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:59.028654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:59.030021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:18:59.030488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:18:59.030918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:18:59.061708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:18:59.680994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:18:59.708219 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17311dd6-b787-4abd-879a-6da4b3504435 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1396 microversion: 2.1 time: 0.715163 Aug 23 11:18:59.708854 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3492/6933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:18:58 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1396 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:00.704075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cec4cb26-828c-4dc8-b6b1-138592901bdb req-b8b5318d-a84a-496b-9f93-66dfa5064ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e41023-7e7f-4949-ad25-9a052cea29b0", "name": "network-vif-deleted", "tag": "3b5ffac7-10af-42a4-bba5-694f736fd440"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:19:00.739102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cec4cb26-828c-4dc8-b6b1-138592901bdb req-b8b5318d-a84a-496b-9f93-66dfa5064ac7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:00.740557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cec4cb26-828c-4dc8-b6b1-138592901bdb req-b8b5318d-a84a-496b-9f93-66dfa5064ac7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:00.741029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cec4cb26-828c-4dc8-b6b1-138592901bdb req-b8b5318d-a84a-496b-9f93-66dfa5064ac7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:00.778030 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cec4cb26-828c-4dc8-b6b1-138592901bdb req-b8b5318d-a84a-496b-9f93-66dfa5064ac7 service nova] Creating event network-vif-deleted:3b5ffac7-10af-42a4-bba5-694f736fd440 for instance c8e41023-7e7f-4949-ad25-9a052cea29b0 on n-h2-847009-13 Aug 23 11:19:00.798282 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cec4cb26-828c-4dc8-b6b1-138592901bdb req-b8b5318d-a84a-496b-9f93-66dfa5064ac7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096566 Aug 23 11:19:00.799209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3493/6934] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:19:00.805169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:00.817180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:00.841240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:00.846264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:00.847586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:00.849714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:00.850538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:00.851961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:00.875347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:00.876002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:00.882147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=33 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:00.884082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:00.887038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:00.887038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:00.889333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:00.899006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:00.899861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:00.982614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=69 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:01.005417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:19:01.063489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:01.075515 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81edf5fe-8c9d-4032-a658-e41438274ecc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.274900 Aug 23 11:19:01.083614 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3494/6935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:00 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:01.214899 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b8bfb43-416f-4e32-8059-bfc740781683 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 204 len: 0 microversion: 2.1 time: 0.768849 Aug 23 11:19:01.216927 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3442/6936] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:19:00 2022] DELETE /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:19:01.227449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:01.228291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:01.243342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:01.246512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:01.247158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:01.250052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:01.250736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:01.254667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:01.934153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:01.943979 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc8a298f-51f0-4c7f-82a0-4ec1024cd768 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1731 microversion: 2.1 time: 0.721306 Aug 23 11:19:01.953947 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3495/6937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:01 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1731 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:02.105868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:02.108036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:02.120546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:02.123558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:02.125977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:02.127930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:02.131744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:02.132406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:02.296030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:02.309374 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-063b3472-a0e2-4be9-86be-57d3eee74ae2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.209169 Aug 23 11:19:02.313600 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3443/6938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:02 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:02.971679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:02.972337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:02.988903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:02.997423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:03.000299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:03.002717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:03.004414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:03.005074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:03.336467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:03.337309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:03.352294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:03.356598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:03.360672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:03.361828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:03.362345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:03.364896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:03.604533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:03.613821 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9b62966-549b-48ad-bb8e-b1706c6fce0e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.283249 Aug 23 11:19:03.625501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3444/6939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:03 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:19:03.666194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:03.679288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c44e74ac-3abb-4669-81d7-8ca463970a08 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1731 microversion: 2.1 time: 0.711781 Aug 23 11:19:03.687655 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3496/6940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:02 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1731 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:04.420481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fea7cd15-7090-4278-ad36-22c27601d405 req-7ade153c-63e8-4091-9997-d3fd905a6dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba9e199-7300-414c-b39a-0e142b20e27e", "name": "network-vif-deleted", "tag": "658645f7-52ac-4fac-a11b-bf36c7e937e5"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:19:04.461418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fea7cd15-7090-4278-ad36-22c27601d405 req-7ade153c-63e8-4091-9997-d3fd905a6dab service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:04.470317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fea7cd15-7090-4278-ad36-22c27601d405 req-7ade153c-63e8-4091-9997-d3fd905a6dab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:04.473183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fea7cd15-7090-4278-ad36-22c27601d405 req-7ade153c-63e8-4091-9997-d3fd905a6dab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:04.503681 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fea7cd15-7090-4278-ad36-22c27601d405 req-7ade153c-63e8-4091-9997-d3fd905a6dab service nova] Creating event network-vif-deleted:658645f7-52ac-4fac-a11b-bf36c7e937e5 for instance bba9e199-7300-414c-b39a-0e142b20e27e on n-h1-847009-13 Aug 23 11:19:04.510055 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fea7cd15-7090-4278-ad36-22c27601d405 req-7ade153c-63e8-4091-9997-d3fd905a6dab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093191 Aug 23 11:19:04.516095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3445/6941] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:19:04.648844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:04.650086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:04.667748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:04.668573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:04.671484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:04.672500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:04.673270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:04.673952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:04.710009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:04.710903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:04.729861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:04.730653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:04.732625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:04.736374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:04.738524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:04.740442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:04.849676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:04.855594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:04.857912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:04.858318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lazy-loading 'fault' on Instance uuid bba9e199-7300-414c-b39a-0e142b20e27e {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:19:04.991231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9669b751be524094a8b4f10d6b916dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec74398f86074c79af47f2b605e98823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:05.004223 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7d1c8f8-d8cc-498a-82cc-ce327daac20a tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 200 len: 1388 microversion: 2.1 time: 0.300551 Aug 23 11:19:05.006800 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3446/6942] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:04 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 1388 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:05.038421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:05.047995 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a23fc5fa-743c-4899-aee4-f743bd8c0bd2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.403101 Aug 23 11:19:05.068886 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3497/6943] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:04 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:06.032543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:06.033204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:06.048150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:06.050006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:06.050646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:06.052721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:06.053488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:06.054891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:06.080339 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] HTTP exception thrown: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:06.087566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:06.088998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Request method failure captured: Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e HTTP/1.1 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLZIF9tq_FednDgKcysyApwSqN6DOCwcf0YLkOD6lnxHS0VNyfAy58VKRQU5-j-gmC356AzoG-bJxcgX-cqRnRWezm-Ak8rOuc751h1fEjYe7bSUsIAxPtC56CRVboBVZkZ9Afxgjx-h1XmDvklC3okV9o2R6WRbos5hmqjE-h2P6rU Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: ec74398f86074c79af47f2b605e98823 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec74398f86074c79af47f2b605e98823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec74398f86074c79af47f2b605e98823", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec74398f86074c79af47f2b605e98823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec74398f86074c79af47f2b605e98823"}]}] Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: ec74398f86074c79af47f2b605e98823 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestServerBasicOps-1474694948-project Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9669b751be524094a8b4f10d6b916dee Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestServerBasicOps-1474694948-project Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'bba9e199-7300-414c-b39a-0e142b20e27e'} Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:06.099029 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:06.104467 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:06.107956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Returning 404 to user: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:19:06.117467 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28cd17f9-188b-42a8-bd99-faad21cfeb5c tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 404 len: 111 microversion: 2.1 time: 0.086742 Aug 23 11:19:06.122247 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3447/6944] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:06 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:19:06.122363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:06.122736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:06.123284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:06.124223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:06.125012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:06.126100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:06.387923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:06.405061 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dcc10ff1-bf38-4061-88f9-706d4a384ec0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.320702 Aug 23 11:19:06.409961 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3498/6945] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:06 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:19:07.421311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:07.422375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:07.431660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:07.433445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:07.452644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:07.457224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:07.458187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:07.458850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:07.459844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:07.460778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:07.461592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:07.462226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:07.465212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:07.465936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:07.472136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:07.473052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:07.538951 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] HTTP exception thrown: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Request method failure captured: Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e HTTP/1.1 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLZIF9tq_FednDgKcysyApwSqN6DOCwcf0YLkOD6lnxHS0VNyfAy58VKRQU5-j-gmC356AzoG-bJxcgX-cqRnRWezm-Ak8rOuc751h1fEjYe7bSUsIAxPtC56CRVboBVZkZ9Afxgjx-h1XmDvklC3okV9o2R6WRbos5hmqjE-h2P6rU Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: ec74398f86074c79af47f2b605e98823 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec74398f86074c79af47f2b605e98823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec74398f86074c79af47f2b605e98823", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec74398f86074c79af47f2b605e98823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec74398f86074c79af47f2b605e98823"}]}] Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: ec74398f86074c79af47f2b605e98823 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestServerBasicOps-1474694948-project Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9669b751be524094a8b4f10d6b916dee Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestServerBasicOps-1474694948-project Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'bba9e199-7300-414c-b39a-0e142b20e27e'} Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:19:07.545722 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.550481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Returning 404 to user: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:19:07.551516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ceacf64-59c3-4a19-b425-9fff43db18f0 tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 404 len: 111 microversion: 2.1 time: 0.137243 Aug 23 11:19:07.552117 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3448/6946] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:19:07 2022] DELETE /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:19:07.575338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:07.582051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [instance: bba9e199-7300-414c-b39a-0e142b20e27e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:07.595464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:07.600124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:07.600806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:07.601743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:07.603917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:07.605956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:07.639544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] HTTP exception thrown: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Request method failure captured: Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e HTTP/1.1 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLZIF9tq_FednDgKcysyApwSqN6DOCwcf0YLkOD6lnxHS0VNyfAy58VKRQU5-j-gmC356AzoG-bJxcgX-cqRnRWezm-Ak8rOuc751h1fEjYe7bSUsIAxPtC56CRVboBVZkZ9Afxgjx-h1XmDvklC3okV9o2R6WRbos5hmqjE-h2P6rU Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: ec74398f86074c79af47f2b605e98823 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec74398f86074c79af47f2b605e98823"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec74398f86074c79af47f2b605e98823", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec74398f86074c79af47f2b605e98823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec74398f86074c79af47f2b605e98823"}]}] Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: ec74398f86074c79af47f2b605e98823 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestServerBasicOps-1474694948 Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestServerBasicOps-1474694948-project Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9669b751be524094a8b4f10d6b916dee Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestServerBasicOps-1474694948-project Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'bba9e199-7300-414c-b39a-0e142b20e27e'} Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:07.643547 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. Aug 23 11:19:07.648613 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:19:07.651317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Returning 404 to user: Instance bba9e199-7300-414c-b39a-0e142b20e27e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:19:07.653866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3463dc35-030b-40ae-92dd-5c6e33bb610d tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e" status: 404 len: 111 microversion: 2.1 time: 0.092716 Aug 23 11:19:07.660018 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3449/6947] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:07 2022] GET /compute/v2.1/servers/bba9e199-7300-414c-b39a-0e142b20e27e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:19:07.710889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:07.733410 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b85324c7-b1b7-469b-8e2b-d6a520ca4385 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.297566 Aug 23 11:19:07.735520 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3499/6948] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:07 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:19:07.993390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-29d54071-9bbb-4f00-b78c-65cd5137c39f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] Calling method '.version_select at 0x7fdca1dacca0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:08.044096 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-29d54071-9bbb-4f00-b78c-65cd5137c39f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [d73e0466-0d6a-4291-a236-cccd3fdc3fb4] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:19:08.759627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:08.760180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:08.777131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:08.777711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:08.778301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:08.785325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:08.785847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:08.786305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:09.053909 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-29d54071-9bbb-4f00-b78c-65cd5137c39f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] [d73e0466-0d6a-4291-a236-cccd3fdc3fb4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 38440. Aug 23 11:19:09.070260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:09.079517 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b1e6db4-b546-4d5c-9e06-fd647566fe06 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.324320 Aug 23 11:19:09.080112 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3500/6949] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:08 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:09.111091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-29d54071-9bbb-4f00-b78c-65cd5137c39f tempest-TestServerBasicOps-1474694948 tempest-TestServerBasicOps-1474694948-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-835874224" status: 202 len: 0 microversion: 2.1 time: 1.123015 Aug 23 11:19:09.113834 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3450/6950] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 11:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-835874224 => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:19:10.108603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:10.110289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:10.126206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:10.127012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:10.127644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:10.128565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:10.130292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:10.134287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:10.324631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:10.336563 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a69263a1-6f48-46c2-b781-9652a2e64cbc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1188 microversion: 2.1 time: 0.234164 Aug 23 11:19:10.338651 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3501/6951] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:10 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1188 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:11.359890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:11.360536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:11.386117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:11.387801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:11.400420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:11.401044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:11.401564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:11.402020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:11.475449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:11.475965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:11.476988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:11.477453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lazy-loading 'fault' on Instance uuid c8e41023-7e7f-4949-ad25-9a052cea29b0 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:19:11.615449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:11.628216 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1410b9f4-7332-4022-8270-a6cd6c0b8b2b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 200 len: 1147 microversion: 2.1 time: 0.273202 Aug 23 11:19:11.631080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3451/6952] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:11 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 1147 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:12.652785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:12.653405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: c8e41023-7e7f-4949-ad25-9a052cea29b0] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:12.669007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:12.673990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:12.674258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:12.676531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:12.678130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:12.681273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:12.735540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance c8e41023-7e7f-4949-ad25-9a052cea29b0 could not be found. Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 HTTP/1.1 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c8e41023-7e7f-4949-ad25-9a052cea29b0 could not be found. Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c8e41023-7e7f-4949-ad25-9a052cea29b0'} Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e41023-7e7f-4949-ad25-9a052cea29b0 could not be found. Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e41023-7e7f-4949-ad25-9a052cea29b0 could not be found. Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:19:12.742811 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e41023-7e7f-4949-ad25-9a052cea29b0 could not be found. Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance c8e41023-7e7f-4949-ad25-9a052cea29b0 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:19:12.747826 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78e4e2a9-5aef-4616-8578-6e46694d40c0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0" status: 404 len: 111 microversion: 2.1 time: 0.098306 Aug 23 11:19:12.754261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3502/6953] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:12 2022] GET /compute/v2.1/servers/c8e41023-7e7f-4949-ad25-9a052cea29b0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:19:17.389733 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:19:17.390308 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:19:25.196133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:25.197208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:25.202314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1233831547", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b269d5f3-da58-4254-b6d3-60be9c0c5013", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:19:25.416104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:19:27.503004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:19:27.504350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:19:27.505556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:19:27.506221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:19:27.506830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:19:27.525949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:27.527757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:27.529683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:27.532066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:27.534448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:27.535931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:27.579516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:19:27.594978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:19:27.724869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:19:27.729803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b269d5f3-da58-4254-b6d3-60be9c0c5013',volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:19:28.109478 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a1b2debc-ce71-43ff-9bfb-e7f1473f7e42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.915553 Aug 23 11:19:28.119831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3452/6954] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:19:28.129883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2ee9432d-237d-4985-882e-14a14790b845 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:28.130721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2ee9432d-237d-4985-882e-14a14790b845 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:28.143603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=21 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:28.156834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=57 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:28.398016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ee9432d-237d-4985-882e-14a14790b845 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:28.407456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2ee9432d-237d-4985-882e-14a14790b845 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1057 microversion: 2.1 time: 0.282250 Aug 23 11:19:28.412130 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3503/6955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:28 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1057 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:29.436548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:29.442294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:29.466364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:29.470625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:29.474291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:29.476204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:29.477401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:29.480440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:29.754389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:29.782248 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2aa10e89-4436-4f1a-a9da-6d16a8a53db6 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1099 microversion: 2.1 time: 0.353317 Aug 23 11:19:29.783027 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3453/6956] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:29 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1099 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:30.814666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:30.815952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:30.836568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:30.837071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:30.837510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:30.838323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:30.838971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:30.839600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:31.076310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:31.104159 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5e6ea156-eca1-4f5e-b274-da4d436856f2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1173 microversion: 2.1 time: 0.294383 Aug 23 11:19:31.105416 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3504/6957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:30 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1173 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:32.128298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:32.129422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:32.138982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:32.139717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:32.140359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:32.141395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:32.142024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:32.142625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:32.244111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:32.258689 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c2590cdf-a1db-410e-a3fd-a43d28284b0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1173 microversion: 2.1 time: 0.134221 Aug 23 11:19:32.264160 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3454/6958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:32 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1173 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:33.286946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:33.288203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:33.316153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:33.333818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:33.334539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:33.335472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:33.336109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:33.337558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:34.180257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:34.192388 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ada70f7c-a05b-4161-a9d3-f94fa7e49266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1215 microversion: 2.1 time: 0.909480 Aug 23 11:19:34.193029 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3505/6959] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:33 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1215 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:34.989449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6faa7627-c11c-4fc9-b974-9f4fd694b3f5 req-7924b348-5799-42e7-819a-ba2712da8dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e46fff-bfb1-4f46-ae25-cf909944fdf5", "tag": "2dc8fdbd-4622-4ed8-b85a-4fac20b06ddc"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:19:35.014610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6faa7627-c11c-4fc9-b974-9f4fd694b3f5 req-7924b348-5799-42e7-819a-ba2712da8dbd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:35.015774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6faa7627-c11c-4fc9-b974-9f4fd694b3f5 req-7924b348-5799-42e7-819a-ba2712da8dbd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:35.019149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6faa7627-c11c-4fc9-b974-9f4fd694b3f5 req-7924b348-5799-42e7-819a-ba2712da8dbd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:35.074189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6faa7627-c11c-4fc9-b974-9f4fd694b3f5 req-7924b348-5799-42e7-819a-ba2712da8dbd service nova] Creating event network-changed:2dc8fdbd-4622-4ed8-b85a-4fac20b06ddc for instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 on n-h2-847009-13 Aug 23 11:19:35.100962 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6faa7627-c11c-4fc9-b974-9f4fd694b3f5 req-7924b348-5799-42e7-819a-ba2712da8dbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153235 Aug 23 11:19:35.102601 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3455/6960] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:19:35.228056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:35.230408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:35.262118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:35.269653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:35.271552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:35.273867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:35.275722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:35.279083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:35.675206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:35.696036 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1a1064b3-b14e-4af7-9d23-fdbe976810dd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1215 microversion: 2.1 time: 0.471985 Aug 23 11:19:35.703409 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3506/6961] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:35 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1215 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:36.749463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:36.750196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:36.764966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:36.765972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:36.768401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:36.769448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:36.773749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:36.774423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:37.348921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:37.365535 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-596cd02a-4d1c-474e-8a09-58c4f9798990 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1215 microversion: 2.1 time: 0.621350 Aug 23 11:19:37.366685 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3456/6962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:36 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1215 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:38.388000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:38.389004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:38.403624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:38.404620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:38.405208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:38.406047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:38.409283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:38.409854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:38.411077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:38.709144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:38.725118 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d16470dd-1194-428a-b01b-f99c620ddd6c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1215 microversion: 2.1 time: 0.341723 Aug 23 11:19:38.739224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3507/6963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:38 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1215 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:39.749312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:39.750171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:39.763364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:39.764312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:39.767361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:39.768299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:39.778991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:39.785123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:39.785685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:39.786148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:39.980591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:39.990276 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-65deb088-ec67-4a27-b0b2-f46cee544eff tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.245889 Aug 23 11:19:39.991428 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3457/6964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:39 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:41.014284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:41.015885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:41.025931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:41.026843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:41.027517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:41.030161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:41.031064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:41.031726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:41.344202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:41.360569 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-347fc0e6-0f87-4eab-948c-c206868059ad tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.352342 Aug 23 11:19:41.362772 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3508/6965] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:41 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:42.393998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:42.395211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:42.407575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:42.408210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:42.410222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:42.411097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:42.412301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:42.412883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:42.699684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:42.708875 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e9a147a-3959-41d5-b3f8-8566416a9751 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.318944 Aug 23 11:19:42.725761 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3458/6966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:42 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:43.734416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:43.735221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:43.743080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:43.744434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:43.745180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:43.746297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:43.748196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:43.748944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:44.053091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:44.067331 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c28b8300-aadc-49ae-ae1f-b816e3ba7626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.339394 Aug 23 11:19:44.077873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3509/6967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:43 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:45.102296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:45.102871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:45.115349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:45.115871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:45.116331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:45.122929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:45.123609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:45.124086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:45.860708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:45.870142 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46ba6cae-a2ad-4341-83e5-296349bb141c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.772462 Aug 23 11:19:45.871081 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3459/6968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:45 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:46.893420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:46.894786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:46.911183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:46.912083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:46.912808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:46.913783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:46.914485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:46.915151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:47.108438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:47.118623 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-388abb8d-b114-484c-8b1b-d18a3b54f46c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.228807 Aug 23 11:19:47.129738 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3510/6969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:46 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:48.152357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:48.154142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:48.165742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:48.166491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:48.167094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:48.167943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:48.169908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:48.170628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:48.443079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7809af7d-7262-450b-a20c-768faa2b24c1 req-f722bbfa-1d2b-44ce-901c-6a33fbd46ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e46fff-bfb1-4f46-ae25-cf909944fdf5", "name": "network-vif-plugged", "status": "completed", "tag": "2dc8fdbd-4622-4ed8-b85a-4fac20b06ddc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:19:48.462960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7809af7d-7262-450b-a20c-768faa2b24c1 req-f722bbfa-1d2b-44ce-901c-6a33fbd46ff3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:48.463853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7809af7d-7262-450b-a20c-768faa2b24c1 req-f722bbfa-1d2b-44ce-901c-6a33fbd46ff3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:48.464561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7809af7d-7262-450b-a20c-768faa2b24c1 req-f722bbfa-1d2b-44ce-901c-6a33fbd46ff3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:48.483784 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7809af7d-7262-450b-a20c-768faa2b24c1 req-f722bbfa-1d2b-44ce-901c-6a33fbd46ff3 service nova] Creating event network-vif-plugged:2dc8fdbd-4622-4ed8-b85a-4fac20b06ddc for instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 on n-h2-847009-13 Aug 23 11:19:48.499497 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7809af7d-7262-450b-a20c-768faa2b24c1 req-f722bbfa-1d2b-44ce-901c-6a33fbd46ff3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061275 Aug 23 11:19:48.504622 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3511/6970] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:19:48.516900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:48.528629 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cee66d6e-c0f7-43f2-8607-0f1e2d645b32 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.388234 Aug 23 11:19:48.529760 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3460/6971] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:48 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:49.552893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:49.554402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:49.563345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:49.564263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:49.565044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:49.566297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:49.567038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:49.567693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:49.865689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:49.889568 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c7d5fb6-e228-41a1-94b5-1b31d2fb1b75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1203 microversion: 2.1 time: 0.338896 Aug 23 11:19:49.891658 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3512/6972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:49 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1203 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:50.911428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:50.912058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:50.923561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:50.924052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:50.924500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:50.925246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:50.925710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:50.927335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.103581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:51.113899 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aae902d9-5ffc-4a31-9ea6-094c3f551063 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1390 microversion: 2.1 time: 0.206275 Aug 23 11:19:51.114501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3461/6973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:50 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1390 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:51.141489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:51.142829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:51.151354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.152174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.153534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.154732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.155508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.156244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.388825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:51.402666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a744383b-925e-402d-a716-bc973982693c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1390 microversion: 2.1 time: 0.269277 Aug 23 11:19:51.403312 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3513/6974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:51 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:51.424578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:51.434494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:51.446055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.446795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.447416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.448358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.449019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.449867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.680850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:51.691287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e313f6e7-a53c-45a3-b993-2a4f8122ab01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1390 microversion: 2.1 time: 0.270745 Aug 23 11:19:51.692289 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3462/6975] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:51 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:19:51.714808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:51.715705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:51.722694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.723418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.724035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.724934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.725555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.726144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.752992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:19:51.867686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-018ac528-c6ab-476d-b74a-5c5acebbed68 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 204 len: 0 microversion: 2.1 time: 0.156879 Aug 23 11:19:51.868296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3514/6976] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:19:51 2022] DELETE /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:19:51.878230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:51.879245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:51.902562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.908429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.913034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:51.915656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:51.915656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:51.915656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:52.133865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:52.144822 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24cb1db1-e562-4059-b9c7-651d5532ee71 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1396 microversion: 2.1 time: 0.270982 Aug 23 11:19:52.157439 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3463/6977] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:51 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1396 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:53.172172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:53.173769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:53.184586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:53.185467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:53.186136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:53.187127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:53.187982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:53.188569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:53.367404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:53.377894 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d19ee1e1-fcdc-44a8-a2ce-bb8f9a6d5f7b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1396 microversion: 2.1 time: 0.211143 Aug 23 11:19:53.378882 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3515/6978] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:53 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1396 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:54.415788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:54.418472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:54.460449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:54.482244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:54.485871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:54.486996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:54.488876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:54.493201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:54.753095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3d257800-f979-4aa7-abec-d3546dd7bb94 req-5a66bdf8-d336-4e86-a891-778313d46a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e46fff-bfb1-4f46-ae25-cf909944fdf5", "name": "network-vif-deleted", "tag": "2dc8fdbd-4622-4ed8-b85a-4fac20b06ddc"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:19:54.769768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3d257800-f979-4aa7-abec-d3546dd7bb94 req-5a66bdf8-d336-4e86-a891-778313d46a4f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:54.783065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3d257800-f979-4aa7-abec-d3546dd7bb94 req-5a66bdf8-d336-4e86-a891-778313d46a4f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:54.783519 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3d257800-f979-4aa7-abec-d3546dd7bb94 req-5a66bdf8-d336-4e86-a891-778313d46a4f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:54.790277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:54.810860 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9992b53-441b-42c5-8e4b-84e7d83fcbde tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1188 microversion: 2.1 time: 0.412519 Aug 23 11:19:54.811496 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3464/6979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:54 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1188 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:54.817842 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3d257800-f979-4aa7-abec-d3546dd7bb94 req-5a66bdf8-d336-4e86-a891-778313d46a4f service nova] Creating event network-vif-deleted:2dc8fdbd-4622-4ed8-b85a-4fac20b06ddc for instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 on n-h2-847009-13 Aug 23 11:19:54.823281 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3d257800-f979-4aa7-abec-d3546dd7bb94 req-5a66bdf8-d336-4e86-a891-778313d46a4f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.360953 Aug 23 11:19:54.824612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3516/6980] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:19:55.834146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:55.834794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:55.837657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:55.856667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:55.857218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:55.857679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:55.858432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:55.858911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:55.862539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:55.868913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=71 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:56.011431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:56.021873 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b90aadd-0d71-401d-b0fe-09c3875eb407 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1188 microversion: 2.1 time: 0.191494 Aug 23 11:19:56.035848 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3465/6981] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:55 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1188 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:57.049606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:57.050926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:57.057785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:57.058493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:57.059198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:57.060090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:57.061398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:57.062016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:57.157073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:57.166096 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6c53258-72e5-45bc-9294-d9106ce45c72 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1188 microversion: 2.1 time: 0.121544 Aug 23 11:19:57.166696 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3517/6982] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:57 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:58.188535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:58.189132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:58.208808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:58.209319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:58.209767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:58.210481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:58.210947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:58.211380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:58.312702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:58.323815 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ab17f152-1c08-422c-b8dd-27078fbf33f8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1188 microversion: 2.1 time: 0.140068 Aug 23 11:19:58.339271 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3466/6983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:58 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1188 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:19:59.347848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:19:59.349369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:19:59.357528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:59.359368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:59.360135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:59.360775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:59.362012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:19:59.362639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:19:59.363274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:19:59.367480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:19:59.455207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:19:59.463339 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-361bec25-3686-409d-b045-ba7b6cd51083 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1188 microversion: 2.1 time: 0.119489 Aug 23 11:19:59.464611 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3518/6984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:19:59 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:00.491737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:00.492490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:00.502346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:00.503081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:00.503703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:00.504620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:00.505196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:00.505628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:00.547043 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:00.547550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:00.547992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:00.548459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lazy-loading 'fault' on Instance uuid 18e46fff-bfb1-4f46-ae25-cf909944fdf5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:20:00.619110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:00.635496 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2820a310-cf2f-4555-9416-12333d58ec33 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 200 len: 1193 microversion: 2.1 time: 0.148701 Aug 23 11:20:00.636640 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3467/6985] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:00 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 1193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:01.667161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:01.669047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 18e46fff-bfb1-4f46-ae25-cf909944fdf5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:01.676848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:01.677572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:01.678219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:01.679159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:01.679831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:01.680612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:01.697524 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 could not be found. Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 HTTP/1.1 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 could not be found. Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '18e46fff-bfb1-4f46-ae25-cf909944fdf5'} Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 could not be found. Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 could not be found. Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:20:01.700322 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 could not be found. Aug 23 11:20:01.705056 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:20:01.707195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 18e46fff-bfb1-4f46-ae25-cf909944fdf5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:20:01.708310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88b74630-86e5-4738-bd42-2a0c570d9d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5" status: 404 len: 111 microversion: 2.1 time: 0.045572 Aug 23 11:20:01.709153 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3519/6986] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:01 2022] GET /compute/v2.1/servers/18e46fff-bfb1-4f46-ae25-cf909944fdf5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:20:32.290248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-689368240", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2ac378b4-611e-4bc2-b50d-3543d771b1d2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:20:32.302347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:32.303032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=19 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:32.396773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:20:32.838458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:20:32.838932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:20:32.840006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:20:32.840575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:20:32.841029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:20:32.851836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:32.852351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:32.852827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:32.853584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:32.854112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:32.854563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:32.873907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:20:32.879492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:20:32.893759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:20:32.896060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2ac378b4-611e-4bc2-b50d-3543d771b1d2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:20:32.986625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7c984999-3b1d-410f-96a4-3891e87b1055 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700176 Aug 23 11:20:32.988023 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3468/6987] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:20:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:20:32.998788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9624697e-ef4c-4767-b5c5-57494c488da5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:32.999382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9624697e-ef4c-4767-b5c5-57494c488da5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:33.005531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:33.006387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=7 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:33.075499 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9624697e-ef4c-4767-b5c5-57494c488da5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:33.083605 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9624697e-ef4c-4767-b5c5-57494c488da5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1056 microversion: 2.1 time: 0.088797 Aug 23 11:20:33.084195 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3520/6988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:32 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1056 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:34.107670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:34.108856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:34.118190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:34.119061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:34.119765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:34.120609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:34.122027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:34.122817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:34.198185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:34.208468 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-829a514c-cacf-470d-993b-a1da85c33032 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1108 microversion: 2.1 time: 0.105367 Aug 23 11:20:34.221270 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3469/6989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:34 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1108 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:35.232989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:35.233610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:35.243035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:35.243894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:35.244511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:35.246803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:35.247584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:35.248252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:35.536558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:35.547598 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19cc264b-4481-45a8-bd77-7fbe939d0171 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.319102 Aug 23 11:20:35.555482 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3521/6990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:35 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:36.000522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f246535a-7c91-4c82-9660-78576faf9f7b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Action: 'create', calling method: .version_select at 0x7fdca1e87430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-593520388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8A428XlePG02x6DE3tBdh1YPYVO+bWGLZRiqtCMkSNGcdFkH5Qa8MCikl0/zApN3hDgHLgnQaG8ZM233gpr3YliI52ATayiyLMP9Ed1Bd1MfuILGYt5ZboJjjn9gaWpA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:20:36.021383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f246535a-7c91-4c82-9660-78576faf9f7b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Getting quotas for project 8c3369da58dd4f35896552dad00a01eb. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:20:36.035615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f246535a-7c91-4c82-9660-78576faf9f7b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Getting quotas for user 6cd57b93d2ad4ec09f3e3086f991f964 and project 8c3369da58dd4f35896552dad00a01eb. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:20:36.075823 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f246535a-7c91-4c82-9660-78576faf9f7b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.079309 Aug 23 11:20:36.076448 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3470/6991] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:20:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:20:36.204636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-15e0c77c-dd88-4dc1-9c5b-5251528c3394 req-8105c05b-9473-4a13-965c-ef5267f80ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a77342-aaa0-49b3-9cab-aa803caca3fc", "tag": "1585888f-a49c-4f0b-a83d-ef551bbaee79"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:20:36.228480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15e0c77c-dd88-4dc1-9c5b-5251528c3394 req-8105c05b-9473-4a13-965c-ef5267f80ae8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:36.229014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15e0c77c-dd88-4dc1-9c5b-5251528c3394 req-8105c05b-9473-4a13-965c-ef5267f80ae8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:36.232056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15e0c77c-dd88-4dc1-9c5b-5251528c3394 req-8105c05b-9473-4a13-965c-ef5267f80ae8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:36.260800 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-15e0c77c-dd88-4dc1-9c5b-5251528c3394 req-8105c05b-9473-4a13-965c-ef5267f80ae8 service nova] Creating event network-changed:1585888f-a49c-4f0b-a83d-ef551bbaee79 for instance 62a77342-aaa0-49b3-9cab-aa803caca3fc on n-h2-847009-13 Aug 23 11:20:36.268506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-15e0c77c-dd88-4dc1-9c5b-5251528c3394 req-8105c05b-9473-4a13-965c-ef5267f80ae8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068708 Aug 23 11:20:36.269477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3522/6992] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:20:36.580145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:36.584441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:36.601143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:36.603565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:36.604297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:36.610407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:36.611129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:36.612423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:36.924786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:36.941211 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db4c5608-5522-4a97-bbb4-00489a0f797b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.368665 Aug 23 11:20:36.942491 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3471/6993] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:36 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:37.561384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1992289599", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "80570c13-4015-40ef-a4a0-482bdd7d1fa9", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-593520388", "security_groups": [{"name": "tempest-secgroup-smoke-483429369"}], "networks": [{"uuid": "bb48f01e-1c9d-409d-bb53-7f55aa70d634"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:20:37.797589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] validate_networks() for [('bb48f01e-1c9d-409d-bb53-7f55aa70d634', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:20:37.989695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:37.990863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:38.004202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:38.004917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:38.005365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:38.006081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:38.006544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:38.006974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:38.216559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:38.232116 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d8cc5ec-4bc0-48ce-91b8-09f45108d08d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.261900 Aug 23 11:20:38.245896 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3472/6994] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:37 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:38.402910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:20:38.403536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:20:38.404092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:20:38.404625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:20:38.405397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:20:38.414681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:38.415303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:38.416018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:38.416858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:38.417906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:38.418530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:38.438114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Getting quotas for project 8c3369da58dd4f35896552dad00a01eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:20:38.443815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Getting quotas for user 6cd57b93d2ad4ec09f3e3086f991f964 and project 8c3369da58dd4f35896552dad00a01eb. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:20:38.505001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:20:38.507267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80570c13-4015-40ef-a4a0-482bdd7d1fa9',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:20:38.690119 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-86efd0ec-e36c-4620-b3a8-8d626dbb3e15 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.135352 Aug 23 11:20:38.691815 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3523/6995] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:20:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:20:38.705348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e5cacd6-78ea-4fe6-aa95-42a565efd22d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:38.706402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e5cacd6-78ea-4fe6-aa95-42a565efd22d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:38.790403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e5cacd6-78ea-4fe6-aa95-42a565efd22d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:38.798468 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e5cacd6-78ea-4fe6-aa95-42a565efd22d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1098 microversion: 2.1 time: 0.098257 Aug 23 11:20:38.816554 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3473/6996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:38 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1098 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:39.262377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:39.263074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:39.290924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:39.291584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:39.292225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:39.292888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:39.293476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:39.293922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:39.584763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:39.594607 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a73993de-3e77-4d58-8d4f-f47fbc928ab1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.341936 Aug 23 11:20:39.609749 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3524/6997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:39 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:39.829403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:39.830160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:39.842926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:39.843694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:39.844310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:39.845249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:39.845883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:39.846472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:39.930182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:39.944049 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8eb6650e-e1d6-4736-8344-f39c662c3e35 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1196 microversion: 2.1 time: 0.120246 Aug 23 11:20:39.944853 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3474/6998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:39 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1196 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:20:40.619431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:40.621288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:40.633943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:40.634654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:40.635348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:40.636475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:40.637130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:40.637730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:40.974029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:40.975922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:41.022897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:41.023906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:41.026285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:41.030764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:41.033278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:41.039131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:41.051088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:41.083254 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c6b9f3af-95d7-40b6-a5bb-45f792833d28 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.461759 Aug 23 11:20:41.087769 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3525/6999] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:40 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:20:41.286493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:41.301929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b298012f-fd6a-4c79-8021-a589d3f8a5a5 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1214 microversion: 2.1 time: 0.335753 Aug 23 11:20:41.303870 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3475/7000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:40 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1214 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:42.146408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:42.150685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:42.171673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:42.175424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:42.176170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:42.179264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:42.184500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:42.185749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:42.337210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:42.347595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:42.390822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:42.395141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:42.396571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:42.406765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:42.407765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:42.412862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:42.578970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:42.596033 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8c3fb0c0-d105-4205-8126-34732877cbb1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.451635 Aug 23 11:20:42.612293 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3526/7001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:42 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:42.864451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:43.098882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:43.114978 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f90df703-ad06-4745-ab00-c96c98f57617 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1281 microversion: 2.1 time: 0.787803 Aug 23 11:20:43.128642 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3476/7002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:42 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1281 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:43.625387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:43.625999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:43.636596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:43.649773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:43.650503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:43.651428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:43.653770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:43.654424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:44.017934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:44.046426 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-206e8667-e9eb-4315-9dc8-0b1796bdb9c8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.418810 Aug 23 11:20:44.060774 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3477/7003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:43 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:20:44.140524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:44.141192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:44.158155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:44.158677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:44.165806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:44.173634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:44.176827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:44.177698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:44.265057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6efb96a5-675a-4b60-859e-b7994e932a63 req-7e19e1d1-09a1-491d-be55-9b3e44ff570d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:20:44.295206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6efb96a5-675a-4b60-859e-b7994e932a63 req-7e19e1d1-09a1-491d-be55-9b3e44ff570d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:44.297289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6efb96a5-675a-4b60-859e-b7994e932a63 req-7e19e1d1-09a1-491d-be55-9b3e44ff570d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:44.300316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6efb96a5-675a-4b60-859e-b7994e932a63 req-7e19e1d1-09a1-491d-be55-9b3e44ff570d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:44.336985 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6efb96a5-675a-4b60-859e-b7994e932a63 req-7e19e1d1-09a1-491d-be55-9b3e44ff570d service nova] Creating event network-changed:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:20:44.349043 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6efb96a5-675a-4b60-859e-b7994e932a63 req-7e19e1d1-09a1-491d-be55-9b3e44ff570d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.735245 Aug 23 11:20:44.353349 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3527/7004] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:20:44.600619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:44.630559 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-441efd18-5f46-451d-ad01-396806b1c60b tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1281 microversion: 2.1 time: 0.496028 Aug 23 11:20:44.633542 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3478/7005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:44 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1281 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:45.080588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:45.081347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:45.106629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:45.107423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:45.108591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:45.108946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:45.109683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:45.111268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:45.387902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:45.398069 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae591021-b9e0-4071-98c6-05d5c51566c3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.321860 Aug 23 11:20:45.399249 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3528/7006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:45 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:45.654612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:45.655264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:45.668873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:45.669378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:45.669826 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:45.671817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:45.674085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:45.675165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:45.855427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:45.864367 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-978c5b51-b477-45e3-97a7-9c462b4ccef3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1281 microversion: 2.1 time: 0.214870 Aug 23 11:20:45.865381 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3479/7007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:45 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1281 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:46.441139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:46.441766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:46.449793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:46.450686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:46.451469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:46.452437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:46.453190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:46.453864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:46.636254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:46.644456 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5578ab4b-6169-4eeb-8bd0-4fdc67c4ac85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.208085 Aug 23 11:20:46.645169 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3529/7008] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:46 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:46.890397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:46.891544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:46.899547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:46.900121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:46.900567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:46.902336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:46.902574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:46.902965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:47.064120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:47.073594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3dd2b53a-6051-4675-9a54-3753b441ac8e tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1281 microversion: 2.1 time: 0.187865 Aug 23 11:20:47.075157 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3480/7009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:46 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:20:47.668662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:47.669415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:47.683633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:47.684373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:47.685211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:47.687660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:47.688388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:47.689327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:47.844922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:47.854394 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5fe6df33-16cc-4f48-8d26-99e41c09c822 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.190941 Aug 23 11:20:47.856116 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3530/7010] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:47 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:48.095920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:48.096862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:48.104186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:48.104848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:48.105413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:48.106226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:48.106892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:48.107428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:48.256282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:48.264651 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b77de802-d310-44b5-9044-7ea846df1037 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.172771 Aug 23 11:20:48.265269 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3481/7011] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:48 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:48.875933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:48.876732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:48.880200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:48.881363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:48.888476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:48.889107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:48.889611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:48.890413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:48.890946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:48.891436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:49.049235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:49.057477 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae4d78c2-32dd-48c8-8927-ae23466c2434 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.185458 Aug 23 11:20:49.058702 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3531/7012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:48 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:49.285843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:49.286511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:49.289641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:49.297690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:49.298200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:49.299284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:49.300027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:49.300504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:49.300975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:49.443638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:49.454909 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7e9088b-40ac-4495-903a-78be078c02c0 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.173327 Aug 23 11:20:49.455767 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3482/7013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:49 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:50.087778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:50.088403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:50.101240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:50.105576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:50.106245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:50.107152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:50.107789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:50.110266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:50.313245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:50.323088 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-52ec9447-207c-475f-8b3f-2a25400ffa81 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.239628 Aug 23 11:20:50.325395 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3532/7014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:50 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:50.477591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:50.478850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:50.494498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:50.495023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:50.496148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:50.496858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:50.497330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:50.498215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:50.641810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:50.650212 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba5bcfa2-a358-4558-88f0-49946a7e076f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.176486 Aug 23 11:20:50.663506 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3483/7015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:50 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:51.346440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:51.347407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:51.355140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:51.355745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:51.356314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:51.357159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:51.357714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:51.358213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:51.511301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:51.522857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-760376bd-1d7b-4884-a7cb-2c1973402153 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.180369 Aug 23 11:20:51.523743 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3533/7016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:51 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:51.671588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:51.672217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:51.680085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:51.680592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:51.681061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:51.681776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:51.682241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:51.682677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:51.836427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:51.846078 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a27c7028-fb8d-4ba6-8a46-0e6b4e06acfa tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.178936 Aug 23 11:20:51.846681 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3484/7017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:51 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:52.549664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:52.550444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:52.560592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:52.561559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:52.562335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:52.563217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:52.563794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:52.564340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:52.724205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:52.732361 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9c8e2096-3f94-4d1e-84b2-c2ab0b095249 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1168 microversion: 2.1 time: 0.187954 Aug 23 11:20:52.732984 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3534/7018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:52 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1168 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:52.867786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:52.869251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:52.878634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:52.879417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:52.880051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:52.881615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:52.882378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:52.882854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:53.035507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:53.044488 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5309a60d-e708-46db-b73e-8ca621fc1c0f tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.180739 Aug 23 11:20:53.045116 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3485/7019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:52 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:53.754739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:53.758469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:53.763130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:53.763844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:53.764653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:53.765698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:53.766339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:53.766964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:53.911763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:53.921085 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-198d6628-6538-4f15-80fa-a62532c036be tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.171036 Aug 23 11:20:53.921763 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3535/7020] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:53 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:54.065615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:54.066398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:54.074211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:54.074851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:54.075393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:54.076244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:54.076831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:54.077365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:54.229796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:54.241293 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7f11d202-4547-467d-84cf-b217a79c6fb9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.180580 Aug 23 11:20:54.242233 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3486/7021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:54 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:54.948439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:54.949768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:54.956682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:54.957158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:54.964418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:54.965257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:54.965750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:54.966198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:55.116103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:55.125146 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b7e45d4-25fb-49ee-91e8-c0a9db833f8e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.180713 Aug 23 11:20:55.125735 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3536/7022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:54 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:55.269501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:55.270129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:55.277582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:55.278106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:55.278561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:55.279283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:55.279751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:55.280186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:55.284675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=100 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:55.420070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:55.428014 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-528cfd1e-4ff6-4248-9e07-c563d56d3b37 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.162584 Aug 23 11:20:55.428597 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3487/7023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:55 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:56.146671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:56.147389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:56.154733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:56.155246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:56.155693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:56.156409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:56.156908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:56.157349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:56.311168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:56.320500 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19307a0d-9d41-47ea-aef1-3283dd362070 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.177513 Aug 23 11:20:56.321963 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3537/7024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:56 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:56.448428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:56.449356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:56.456584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:56.457120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:56.457571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:56.458506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:56.458982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:56.459564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:56.605626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:56.613946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff0cc624-a4df-437c-8d54-74f71d579f36 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.169754 Aug 23 11:20:56.614538 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3488/7025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:56 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:57.344218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:57.345140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:57.352370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:57.352904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:57.353345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:57.354057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:57.354592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:57.355029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:57.499190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:57.508323 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74f7dc21-86c6-4a51-a21d-65f4167d7a74 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.167894 Aug 23 11:20:57.509525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3538/7026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:57 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:57.619751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5da54a3a-2719-4a87-a386-8d91b00e9cfc req-ebb9cf33-5d05-4d98-98ac-4deca92145b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "name": "network-vif-plugged", "status": "completed", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:20:57.634719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5da54a3a-2719-4a87-a386-8d91b00e9cfc req-ebb9cf33-5d05-4d98-98ac-4deca92145b4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:57.637339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5da54a3a-2719-4a87-a386-8d91b00e9cfc req-ebb9cf33-5d05-4d98-98ac-4deca92145b4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:57.637682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:57.638219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5da54a3a-2719-4a87-a386-8d91b00e9cfc req-ebb9cf33-5d05-4d98-98ac-4deca92145b4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:57.639892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:57.649679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:57.651285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:57.651948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:57.652546 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5da54a3a-2719-4a87-a386-8d91b00e9cfc req-ebb9cf33-5d05-4d98-98ac-4deca92145b4 service nova] Creating event network-vif-plugged:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:20:57.653232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:57.654285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:57.655072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:57.659043 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5da54a3a-2719-4a87-a386-8d91b00e9cfc req-ebb9cf33-5d05-4d98-98ac-4deca92145b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042241 Aug 23 11:20:57.659873 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3489/7027] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:20:57.677786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=100 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:20:57.812928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:57.821272 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b981d7c5-2dbd-48ab-a11e-444cc1c64541 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.189857 Aug 23 11:20:57.821873 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3539/7028] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:57 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:58.531957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:58.532678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:58.539107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:58.539605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:58.540055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:58.540778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:58.541253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:58.541692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:58.686873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:58.694886 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-945d7d2f-6861-4796-bbff-ec6070655fae tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.167835 Aug 23 11:20:58.695471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3490/7029] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:58 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:58.842443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:58.843053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:58.850464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:58.850995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:58.851448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:58.852165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:58.852638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:58.853127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:58.999914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:59.007832 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a54968a-dd7b-4330-bd19-f28885bf523a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1269 microversion: 2.1 time: 0.169569 Aug 23 11:20:59.008417 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3540/7030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:58 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1269 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:20:59.716773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:20:59.717725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:20:59.725738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:59.726244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:59.726693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:59.727446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:20:59.727921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:20:59.728359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:20:59.877423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:20:59.885487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3feaf52e-0fe2-41a2-a0dc-6240e51b4b15 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.173848 Aug 23 11:20:59.886322 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3491/7031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:20:59 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:00.028169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:00.029510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:00.036780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:00.037363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:00.037807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:00.038509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:00.038969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:00.039393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:00.195326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:00.203425 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e696d993-8086-4554-9e64-283379e26585 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1458 microversion: 2.1 time: 0.179768 Aug 23 11:21:00.204023 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3541/7032] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:00 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1458 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:00.223996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:00.224618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:00.231654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:00.232151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:00.232599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:00.233338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:00.233802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:00.234253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:00.371518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:00.379397 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-885bb6fd-2249-404d-8c29-1a529be9825d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1458 microversion: 2.1 time: 0.159645 Aug 23 11:21:00.379976 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3492/7033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:00 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:00.908991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:00.909980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:00.918141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:00.918727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:00.919248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:00.920074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:00.920659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:00.921189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:01.114618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:01.124759 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d63ef5f4-2e30-4cdf-b985-e26591fbd5bf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.220583 Aug 23 11:21:01.138704 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3542/7034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:00 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:02.149063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:02.149682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:02.157815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:02.158814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:02.159435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:02.160328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:02.160992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:02.161605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:02.481422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:02.493767 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05484222-31a0-4d1f-b24a-30fa53503a5c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.347817 Aug 23 11:21:02.495704 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3493/7035] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:02 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:02.659316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d46c6507-6a93-4a58-960b-cf8c4d4d951d req-7e005f6a-0bd9-49dd-bbb3-f5900ea1f786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a77342-aaa0-49b3-9cab-aa803caca3fc", "name": "network-vif-plugged", "status": "completed", "tag": "1585888f-a49c-4f0b-a83d-ef551bbaee79"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:02.670439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d46c6507-6a93-4a58-960b-cf8c4d4d951d req-7e005f6a-0bd9-49dd-bbb3-f5900ea1f786 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:02.670969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d46c6507-6a93-4a58-960b-cf8c4d4d951d req-7e005f6a-0bd9-49dd-bbb3-f5900ea1f786 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:02.671466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d46c6507-6a93-4a58-960b-cf8c4d4d951d req-7e005f6a-0bd9-49dd-bbb3-f5900ea1f786 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:02.688287 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d46c6507-6a93-4a58-960b-cf8c4d4d951d req-7e005f6a-0bd9-49dd-bbb3-f5900ea1f786 service nova] Creating event network-vif-plugged:1585888f-a49c-4f0b-a83d-ef551bbaee79 for instance 62a77342-aaa0-49b3-9cab-aa803caca3fc on n-h2-847009-13 Aug 23 11:21:02.694881 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d46c6507-6a93-4a58-960b-cf8c4d4d951d req-7e005f6a-0bd9-49dd-bbb3-f5900ea1f786 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039185 Aug 23 11:21:02.695538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3543/7036] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:21:02.829522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ac901caf-cde1-4cb3-99a5-e55725545ff7 req-2900e195-a0c2-4512-b63b-0b6ed20a6284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:02.841982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:02.844591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ac901caf-cde1-4cb3-99a5-e55725545ff7 req-2900e195-a0c2-4512-b63b-0b6ed20a6284 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:02.845229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ac901caf-cde1-4cb3-99a5-e55725545ff7 req-2900e195-a0c2-4512-b63b-0b6ed20a6284 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:02.845989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ac901caf-cde1-4cb3-99a5-e55725545ff7 req-2900e195-a0c2-4512-b63b-0b6ed20a6284 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:02.860256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ac901caf-cde1-4cb3-99a5-e55725545ff7 req-2900e195-a0c2-4512-b63b-0b6ed20a6284 service nova] Creating event network-changed:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:21:02.867319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ac901caf-cde1-4cb3-99a5-e55725545ff7 req-2900e195-a0c2-4512-b63b-0b6ed20a6284 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 Aug 23 11:21:02.868658 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3494/7037] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:21:03.516103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:03.517319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:03.527241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:03.529206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:03.529876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:03.530504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:03.531406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:03.532128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:03.532787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:03.708778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:03.722522 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08f352de-9447-44b4-b7f8-c960877c3c9a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1202 microversion: 2.1 time: 0.210209 Aug 23 11:21:03.723994 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3544/7038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:03 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1202 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:04.748600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:04.749956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:04.757588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:04.758086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:04.758537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:04.759250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:04.759716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:04.760149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:04.889725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}, {"name": "network-changed", "server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:04.901394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:04.902606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:04.903269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:04.916178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] Creating event network-changed:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:21:04.918341 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] Creating event network-changed:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:21:04.923319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:04.924611 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-64d0a940-4491-43a6-afb6-d3bb26d4671e req-c85929ac-be05-4bbb-8039-7a2721ca4852 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039521 Aug 23 11:21:04.925346 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3545/7039] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:21:04.934751 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0982a6ed-7a4c-4d74-97c0-6686f674ccbb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1388 microversion: 2.1 time: 0.191034 Aug 23 11:21:04.935339 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3495/7040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:04 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1388 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:04.957052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:04.958069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:04.965934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:04.967114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:04.967601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:04.968329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:04.970006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:04.972480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:05.167785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:05.177339 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b57a7051-8c1d-44b6-a5d6-9c2acea4faac tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1388 microversion: 2.1 time: 0.224847 Aug 23 11:21:05.177941 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3546/7041] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:04 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1388 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:05.198843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:05.199638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:05.211797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:05.212350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:05.212753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:05.213485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:05.214262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:05.214827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:05.466317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:05.478244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f3e31856-674b-4590-85c2-199f2d780e82 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1388 microversion: 2.1 time: 0.284115 Aug 23 11:21:05.479874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3496/7042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:05 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1388 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:05.564417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:05.564960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:05.571240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:05.572035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:05.572633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:05.573398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:05.574003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:05.574434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:05.603771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:21:05.692030 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0935ec25-d645-416b-9ba3-110652254f22 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 204 len: 0 microversion: 2.1 time: 0.131123 Aug 23 11:21:05.692548 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3547/7043] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:21:05 2022] DELETE /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:21:05.702665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:05.703299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:05.712505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:05.713966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:05.714778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:05.716042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:05.716853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:05.717580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:06.239655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:06.248433 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9415d4a9-27c5-4ac1-b28e-ad4727b0920f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1394 microversion: 2.1 time: 0.551287 Aug 23 11:21:06.261855 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3497/7044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:05 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1394 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:07.272128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:07.272765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:07.280771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:07.281154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:07.281604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:07.282312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:07.282776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:07.283231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:07.422858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:07.431294 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d92d904-1d73-4905-8294-ce2e6efcb14c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1394 microversion: 2.1 time: 0.163504 Aug 23 11:21:07.431990 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3548/7045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:07 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1394 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:08.031696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bd295569-da93-4ca1-ae26-5855d33b11d5 req-8a30bc2a-5871-4f69-aa6c-c3d0d1c585f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a77342-aaa0-49b3-9cab-aa803caca3fc", "name": "network-vif-deleted", "tag": "1585888f-a49c-4f0b-a83d-ef551bbaee79"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:08.044393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd295569-da93-4ca1-ae26-5855d33b11d5 req-8a30bc2a-5871-4f69-aa6c-c3d0d1c585f7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:08.044916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd295569-da93-4ca1-ae26-5855d33b11d5 req-8a30bc2a-5871-4f69-aa6c-c3d0d1c585f7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:08.045368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bd295569-da93-4ca1-ae26-5855d33b11d5 req-8a30bc2a-5871-4f69-aa6c-c3d0d1c585f7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:08.073741 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bd295569-da93-4ca1-ae26-5855d33b11d5 req-8a30bc2a-5871-4f69-aa6c-c3d0d1c585f7 service nova] Creating event network-vif-deleted:1585888f-a49c-4f0b-a83d-ef551bbaee79 for instance 62a77342-aaa0-49b3-9cab-aa803caca3fc on n-h2-847009-13 Aug 23 11:21:08.081591 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bd295569-da93-4ca1-ae26-5855d33b11d5 req-8a30bc2a-5871-4f69-aa6c-c3d0d1c585f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053465 Aug 23 11:21:08.086780 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3498/7046] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:21:08.451708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:08.452444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:08.459854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:08.460348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:08.460811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:08.461517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:08.461975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:08.462399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:08.531953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:08.540342 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84645573-72a2-48df-986e-d68c1ed6a495 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1187 microversion: 2.1 time: 0.092680 Aug 23 11:21:08.540959 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3549/7047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:08 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:09.563397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:09.564145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:09.571321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:09.571819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:09.572274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:09.573550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:09.574346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:09.574870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:09.648702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:09.658649 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-abae4c63-0e7e-49fe-bea7-08065fe04064 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1187 microversion: 2.1 time: 0.099739 Aug 23 11:21:09.659383 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3499/7048] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:09 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:10.680660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:10.681427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:10.688893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:10.689398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:10.690044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:10.690997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:10.691472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:10.691909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:10.764592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:10.774422 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f98836da-3651-4595-8c70-d7aa5ab45f75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1187 microversion: 2.1 time: 0.097406 Aug 23 11:21:10.776598 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3550/7049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:10 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:11.801149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:11.802525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:11.810756 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:11.811654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:11.812344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:11.813336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:11.814038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:11.815187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:11.900142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:11.910914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-56240c54-37d4-4a54-aca8-abefd32cd697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1187 microversion: 2.1 time: 0.113324 Aug 23 11:21:11.911827 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3500/7050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:11 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:12.934393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:12.935717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:12.943741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:12.944563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:12.945505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:12.946386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:12.947125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:12.947750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:13.000631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:13.001431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:13.002060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:13.002699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lazy-loading 'fault' on Instance uuid 62a77342-aaa0-49b3-9cab-aa803caca3fc {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:21:13.054587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:13.067212 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cea4cce5-42e0-4f21-be49-6a88410e6d44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 200 len: 1192 microversion: 2.1 time: 0.138391 Aug 23 11:21:13.068467 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3551/7051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:12 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 1192 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:14.094629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:14.096101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:14.103816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:14.105644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:14.106237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:14.107001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:14.107485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:14.108070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:14.125392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc HTTP/1.1 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '62a77342-aaa0-49b3-9cab-aa803caca3fc'} Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:14.127308 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db110477-c2f2-41f6-bd09-fefc11244f6e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 404 len: 111 microversion: 2.1 time: 0.038299 Aug 23 11:21:14.132303 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3501/7052] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:14 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:21:16.292198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:16.292831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:16.299733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:16.300221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:16.300656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:16.301381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:16.301837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:16.302260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:16.316027 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc HTTP/1.1 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '62a77342-aaa0-49b3-9cab-aa803caca3fc'} Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:21:16.317756 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-613e5550-786d-432a-b7c3-d546a68cb5c4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 404 len: 111 microversion: 2.1 time: 0.031447 Aug 23 11:21:16.325883 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3552/7053] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:21:16 2022] DELETE /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:21:16.333981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:16.333981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 62a77342-aaa0-49b3-9cab-aa803caca3fc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:16.341082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:16.341590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:16.342045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:16.342764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:16.343233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:16.343675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:16.358910 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc HTTP/1.1 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '62a77342-aaa0-49b3-9cab-aa803caca3fc'} Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:16.360494 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 62a77342-aaa0-49b3-9cab-aa803caca3fc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c191928b-38fb-4f99-b96c-fac29d130f0f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc" status: 404 len: 111 microversion: 2.1 time: 0.032900 Aug 23 11:21:16.366232 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3502/7054] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:16 2022] GET /compute/v2.1/servers/62a77342-aaa0-49b3-9cab-aa803caca3fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:21:39.134337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:39.135670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:39.144174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:39.147829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:39.150391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:39.151955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:39.153012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:39.156507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:39.156507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:39.156507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:39.157493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-accc1ff1-ea7c-4573-9610-d18773b97639 req-799ed470-e13d-4d11-b50c-d8d62496558f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:39.188049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=17 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:39.189639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=74 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:39.191814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-accc1ff1-ea7c-4573-9610-d18773b97639 req-799ed470-e13d-4d11-b50c-d8d62496558f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:39.193286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-accc1ff1-ea7c-4573-9610-d18773b97639 req-799ed470-e13d-4d11-b50c-d8d62496558f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:39.194254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:21:39.194416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-accc1ff1-ea7c-4573-9610-d18773b97639 req-799ed470-e13d-4d11-b50c-d8d62496558f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:39.225225 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-accc1ff1-ea7c-4573-9610-d18773b97639 req-799ed470-e13d-4d11-b50c-d8d62496558f service nova] Creating event network-changed:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:21:39.235756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-accc1ff1-ea7c-4573-9610-d18773b97639 req-799ed470-e13d-4d11-b50c-d8d62496558f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083305 Aug 23 11:21:39.237299 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3503/7055] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:21:39.356802 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3aee509-9068-45e6-bb5e-0a6fce9da68d tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 204 len: 0 microversion: 2.1 time: 0.226148 Aug 23 11:21:39.364651 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3553/7056] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:21:39 2022] DELETE /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:21:39.369999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:39.370849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:39.393244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:39.393764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:39.394213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:39.394957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:39.395432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:39.400118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:39.609349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:39.620716 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3924cdc5-cc1f-4c9b-9b08-765caeff7bd3 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1583 microversion: 2.1 time: 0.255745 Aug 23 11:21:39.621751 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3504/7057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:39 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1583 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:39.710269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-506415214", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6fbcd98a-aa76-4b80-963f-ff422f4ce026", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:39.796423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:21:40.262623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:21:40.263172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:21:40.263753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:21:40.264350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:21:40.264936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:21:40.276775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:40.277420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:40.277985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:40.278934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:40.279511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:40.280003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:40.299441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:21:40.304981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:21:40.379862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:21:40.382211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6fbcd98a-aa76-4b80-963f-ff422f4ce026',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:21:40.635712 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-94970508-bf1c-4a1f-ab9c-3281f66f0227 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930536 Aug 23 11:21:40.636465 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3554/7058] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:21:40.647815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:40.648768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:40.658655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:40.662610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d2ad2fa-d57e-4048-bd50-7bde3e1520ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:40.663361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:40.663914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:40.669062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d2ad2fa-d57e-4048-bd50-7bde3e1520ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:40.669201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:40.670597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:40.672411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:40.776848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d2ad2fa-d57e-4048-bd50-7bde3e1520ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:40.784632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d2ad2fa-d57e-4048-bd50-7bde3e1520ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1070 microversion: 2.1 time: 0.129002 Aug 23 11:21:40.787224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3555/7059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:40 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1070 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:40.968251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:40.985266 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-93ba393c-38d7-40b2-8b74-ee2db2435362 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1583 microversion: 2.1 time: 0.339786 Aug 23 11:21:41.001422 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3505/7060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:40 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1583 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:41.808635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:41.809460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:41.818326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:41.818883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:41.819339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:41.820213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:41.820685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:41.821165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:41.928382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:41.938688 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36a52b21-9772-49c9-96f5-e9bf976f3ce5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1168 microversion: 2.1 time: 0.134822 Aug 23 11:21:41.940049 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3556/7061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:41 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1168 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:42.011035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:42.012436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:42.021312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:42.021567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:42.022413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:42.023313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:42.023945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:42.024565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:42.217788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:42.228652 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f5ede52-75fb-4fab-be07-443424b3084a tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1464 microversion: 2.1 time: 0.222549 Aug 23 11:21:42.229968 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3506/7062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:42 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1464 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:42.250232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0786bbae-ea31-46a8-bcad-87c508a1afe6 req-a48d5ff5-6410-4b96-b347-590d0267bbae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4ec4d3-6680-43ed-bbf8-87c179f18be1", "name": "network-vif-deleted", "tag": "ad8f9de4-8479-4c3b-b7e3-0adf73bf6647"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:42.264427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0786bbae-ea31-46a8-bcad-87c508a1afe6 req-a48d5ff5-6410-4b96-b347-590d0267bbae service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:42.264980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0786bbae-ea31-46a8-bcad-87c508a1afe6 req-a48d5ff5-6410-4b96-b347-590d0267bbae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:42.265420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0786bbae-ea31-46a8-bcad-87c508a1afe6 req-a48d5ff5-6410-4b96-b347-590d0267bbae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:42.289533 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0786bbae-ea31-46a8-bcad-87c508a1afe6 req-a48d5ff5-6410-4b96-b347-590d0267bbae service nova] Creating event network-vif-deleted:ad8f9de4-8479-4c3b-b7e3-0adf73bf6647 for instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 on n-h1-847009-13 Aug 23 11:21:42.298742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0786bbae-ea31-46a8-bcad-87c508a1afe6 req-a48d5ff5-6410-4b96-b347-590d0267bbae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053176 Aug 23 11:21:42.300033 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3557/7063] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:21:42.960924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:42.961668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:42.972933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:42.973809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:42.974466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:42.975449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:42.976148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:42.977308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:43.126788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:43.141592 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6f722621-f3aa-4368-a646-e0c8ce7f504b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1186 microversion: 2.1 time: 0.184650 Aug 23 11:21:43.142761 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3507/7064] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:42 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1186 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:43.252291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:43.253630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:43.270564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:43.280256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:43.281012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:43.283791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:43.288789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:43.290067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:43.765722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:43.778388 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a76f1624-a590-4024-aaa7-0ce1057aacac tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1229 microversion: 2.1 time: 0.530848 Aug 23 11:21:43.779108 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3558/7065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:43 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1229 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:44.163796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:44.165331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:44.177004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:44.178863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:44.184882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:44.185793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:44.186353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:44.186908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:44.268959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:44.279318 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7033a94-53f0-4d2d-8d4b-0637ff2a287d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1186 microversion: 2.1 time: 0.119608 Aug 23 11:21:44.294063 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3508/7066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:44 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1186 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:44.800072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:44.800783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:44.813095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:44.813696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:44.814203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:44.823272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:44.823856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:44.824377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:45.100889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:45.112265 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f1bb2f70-d9b0-430f-8d38-5b4ef5848559 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1229 microversion: 2.1 time: 0.316102 Aug 23 11:21:45.129953 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3559/7067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:44 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1229 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:45.302935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:45.304312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:45.317015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:45.317636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:45.323036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:45.323708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:45.324225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:45.324936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:45.420865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-126c0d33-3171-49f1-997f-92c5519c08b2 req-2f36b1cd-5511-4e18-91d1-2e31f0e7dd88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "154d386d-cc4a-4300-851d-11f87a719622", "tag": "a448eb19-8577-46e9-bed0-95c832c7d247"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:21:45.440037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-126c0d33-3171-49f1-997f-92c5519c08b2 req-2f36b1cd-5511-4e18-91d1-2e31f0e7dd88 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:45.441055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-126c0d33-3171-49f1-997f-92c5519c08b2 req-2f36b1cd-5511-4e18-91d1-2e31f0e7dd88 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:45.441705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-126c0d33-3171-49f1-997f-92c5519c08b2 req-2f36b1cd-5511-4e18-91d1-2e31f0e7dd88 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:45.472124 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-126c0d33-3171-49f1-997f-92c5519c08b2 req-2f36b1cd-5511-4e18-91d1-2e31f0e7dd88 service nova] Creating event network-changed:a448eb19-8577-46e9-bed0-95c832c7d247 for instance 154d386d-cc4a-4300-851d-11f87a719622 on n-h2-847009-13 Aug 23 11:21:45.492685 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-126c0d33-3171-49f1-997f-92c5519c08b2 req-2f36b1cd-5511-4e18-91d1-2e31f0e7dd88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076526 Aug 23 11:21:45.493651 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3560/7068] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:21:45.605502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:45.615473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ebd9dc9e-cb5c-4804-8a32-50d83c43ef41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.316378 Aug 23 11:21:45.628499 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3509/7069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:45 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:46.142909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:46.144029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:46.160044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:46.160557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:46.161053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:46.161783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:46.162242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:46.162670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:46.251900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:46.265394 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d275bf1-2aea-4213-84b6-03758f8135b9 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1229 microversion: 2.1 time: 0.128734 Aug 23 11:21:46.276764 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3561/7070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:46 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1229 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:46.639524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:46.640246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:46.648583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:46.652021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:46.657037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:46.658263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:46.659056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:46.659819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:47.037362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:47.055025 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-681d3c92-0e78-4dfe-b366-3665b02213d8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.420115 Aug 23 11:21:47.084639 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3510/7071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:46 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:47.287771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:47.289009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:47.297002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:47.297494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:47.297935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:47.298981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:47.299645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:47.300065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:47.388039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd57b93d2ad4ec09f3e3086f991f964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3369da58dd4f35896552dad00a01eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:47.397392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8749f2b2-17e5-46bb-aaa3-a48f2d88db59 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 200 len: 1229 microversion: 2.1 time: 0.113510 Aug 23 11:21:47.412302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3562/7072] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:47 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:48.109787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:48.111772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:48.143979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:48.148236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:48.148694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:48.153516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:48.156844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:48.157312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:48.349706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:48.359348 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e087dd41-28ce-4849-8675-a5d0dc341ec9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.257558 Aug 23 11:21:48.360881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3511/7073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:48 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:48.420368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:48.421947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] [instance: bf4ec4d3-6680-43ed-bbf8-87c179f18be1] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:48.431429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:48.432835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:48.433685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:48.434601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:48.435245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:48.435870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:48.451901 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] HTTP exception thrown: Instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 could not be found. Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Request method failure captured: Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 HTTP/1.1 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLdLCPurLTNtqlOInhXxMxb4V7UUT6aGnhPNH3pkGr9YxZqoS1p80P4mD59WitUrk0k0h3nAQ70xZyWiguIDuhb4r7FdbAEspXnFA7-9FjQ7lZYslDXthaeeY7YfbTqL-4c0rqBSUbYW-EuR_2BKw7YxTfGijFyt-7RiU91h7cj-A5o Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8c3369da58dd4f35896552dad00a01eb Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBackupRestore-1358743922 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c3369da58dd4f35896552dad00a01eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c3369da58dd4f35896552dad00a01eb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3369da58dd4f35896552dad00a01eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3369da58dd4f35896552dad00a01eb"}]}] Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBackupRestore-1358743922 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8c3369da58dd4f35896552dad00a01eb Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1358743922 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBackupRestore-1358743922-project Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6cd57b93d2ad4ec09f3e3086f991f964 Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBackupRestore-1358743922-project Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 could not be found. Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'bf4ec4d3-6680-43ed-bbf8-87c179f18be1'} Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 could not be found. Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 could not be found. Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:21:48.454158 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 could not be found. Aug 23 11:21:48.459845 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:21:48.461763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Returning 404 to user: Instance bf4ec4d3-6680-43ed-bbf8-87c179f18be1 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:21:48.463636 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-805783cb-44ac-4213-9fca-8dcc52bd8f56 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1" status: 404 len: 111 microversion: 2.1 time: 0.047128 Aug 23 11:21:48.468253 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3563/7074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:48 2022] GET /compute/v2.1/servers/bf4ec4d3-6680-43ed-bbf8-87c179f18be1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:21:48.664785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-310a7909-96fb-4690-8713-765e55071fd4 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] Calling method '.version_select at 0x7fdca1dc7550>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:48.693748 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-310a7909-96fb-4690-8713-765e55071fd4 tempest-TestVolumeBackupRestore-1358743922 tempest-TestVolumeBackupRestore-1358743922-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-593520388" status: 202 len: 0 microversion: 2.1 time: 0.032945 Aug 23 11:21:48.694354 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3512/7075] 10.222.0.78 () {58 vars in 1266 bytes} [Tue Aug 23 11:21:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-593520388 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:21:48.771388 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:21:48.771669 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:21:49.386198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:49.386795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:49.393890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:49.394457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:49.394960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:49.395645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:49.396113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:49.396550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:49.577915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:49.586587 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19713393-a910-449a-bb5b-cc141825aed3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.205436 Aug 23 11:21:49.587162 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3564/7076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:49 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:50.611266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:50.612167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:50.620589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:50.621216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:50.621734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:50.622749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:50.623327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:50.623828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:50.775040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:50.786544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cc5bd7c-87ab-4378-98c2-eda3661ee104 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.179697 Aug 23 11:21:50.793305 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3513/7077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:50 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:51.810047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:51.810666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:51.812555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:51.814990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:21:51.822762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:51.823283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:51.823727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:51.824642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:51.825136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:51.825567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:51.992189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:52.004077 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a547c609-858a-41f2-8ddb-d3110e0033ef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.198792 Aug 23 11:21:52.005469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3565/7078] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:51 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:53.026790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:53.028111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:53.036023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:53.036859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:53.037513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:53.038435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:53.039081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:53.039692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:53.225804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:53.237226 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fa53109-116b-43c1-bd62-796a646933e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1228 microversion: 2.1 time: 0.214126 Aug 23 11:21:53.241872 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3514/7079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:53 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1228 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:54.265556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:54.266925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:54.278023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:54.278759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:54.279367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:54.281136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:54.281824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:54.283779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:54.474416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:54.484852 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6840ea14-2ba9-4db3-9b37-a981004bb80c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.223773 Aug 23 11:21:54.487162 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3566/7080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:54 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:55.512988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:55.513721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:55.523923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:55.525193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:55.526243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:55.527001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:55.527476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:55.527914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:55.761522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:55.769869 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2888edad-748e-4765-9ceb-527a7e0bb500 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.263112 Aug 23 11:21:55.770654 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3515/7081] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:55 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:56.794317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:56.794963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:56.802110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:56.802605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:56.803083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:56.803992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:56.804664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:56.805867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:56.984085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:56.992393 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-40afc501-75dc-4c30-9d55-9d31d750ea75 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.204761 Aug 23 11:21:56.993145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3567/7082] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:56 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:58.014703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:58.015333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:58.022605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:58.023104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:58.023664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:58.024389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:58.025003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:58.025734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:58.251235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:58.258969 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eadabbe2-56f0-4fbd-bb19-8d215f81242d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.248556 Aug 23 11:21:58.259637 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3516/7083] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:58 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:21:59.280574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:21:59.281486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:21:59.289312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:59.290197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:59.291363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:59.292459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:21:59.293035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:21:59.293684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:21:59.641958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:21:59.651310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9547426e-ea64-4865-9c7a-20b99c79fc02 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.373872 Aug 23 11:21:59.652505 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3568/7084] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:21:59 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:00.672897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:00.673589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:00.681168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:00.681868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:00.682408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:00.683183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:00.683814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:00.684248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:01.037527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:01.045421 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fd87a96c-c4a3-4226-b981-dcf9a979dc84 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.376438 Aug 23 11:22:01.046013 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3517/7085] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:00 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:02.066607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:02.067213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:02.073918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:02.074406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:02.074850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:02.075547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:02.076010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:02.076441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:02.209821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:02.218820 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8b95ed0d-a34e-48b2-9e47-d0fe56021451 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.156233 Aug 23 11:22:02.219346 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3569/7086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:02 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:02.865569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a5a117d2-2581-47f2-b871-55d421a588bb req-1949b72a-8967-47ce-93ff-88936960dd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154d386d-cc4a-4300-851d-11f87a719622", "name": "network-vif-plugged", "status": "completed", "tag": "a448eb19-8577-46e9-bed0-95c832c7d247"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:02.877193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a5a117d2-2581-47f2-b871-55d421a588bb req-1949b72a-8967-47ce-93ff-88936960dd20 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:02.878443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a5a117d2-2581-47f2-b871-55d421a588bb req-1949b72a-8967-47ce-93ff-88936960dd20 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:02.878885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a5a117d2-2581-47f2-b871-55d421a588bb req-1949b72a-8967-47ce-93ff-88936960dd20 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:02.893275 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a5a117d2-2581-47f2-b871-55d421a588bb req-1949b72a-8967-47ce-93ff-88936960dd20 service nova] Creating event network-vif-plugged:a448eb19-8577-46e9-bed0-95c832c7d247 for instance 154d386d-cc4a-4300-851d-11f87a719622 on n-h2-847009-13 Aug 23 11:22:02.899807 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a5a117d2-2581-47f2-b871-55d421a588bb req-1949b72a-8967-47ce-93ff-88936960dd20 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037522 Aug 23 11:22:02.901074 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3518/7087] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:22:03.241148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:03.241747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:03.249216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:03.249709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:03.250151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:03.250850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:03.251315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:03.251744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:03.382392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:03.390708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b1029a5-3777-442d-8701-3137648c51b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1216 microversion: 2.1 time: 0.153580 Aug 23 11:22:03.391282 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3570/7088] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:03 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:04.414783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:04.416049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:04.423790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:04.424287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:04.424731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:04.425509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:04.425976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:04.426418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:04.561803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:04.569769 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f0faee78-3311-4709-acc3-d589d20f9095 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1402 microversion: 2.1 time: 0.160815 Aug 23 11:22:04.570350 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3519/7089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:04 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1402 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:04.591873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:04.592496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:04.599593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:04.600085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:04.600533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:04.601267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:04.601730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:04.602159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:04.620983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:04.736509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:04.744324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ad90383-ed00-4921-ab05-53479a7bc24b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1402 microversion: 2.1 time: 0.157309 Aug 23 11:22:04.744929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3571/7090] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:04 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:04.765655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1934475058"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:04.768027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:04.774050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:04.774545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:04.775650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:04.776383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:04.776883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:04.777322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:04.873427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Attempting to quiesce instance before volume snapshot. Aug 23 11:22:04.941388 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 23 11:22:04.952220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:05.013630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Creating snapshot from volume 6fbcd98a-aa76-4b80-963f-ff422f4ce026. {{(pid=128860) snapshot_instance /opt/stack/nova/nova/compute/api.py:3496}} Aug 23 11:22:05.799241 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35632bc3-113d-4e88-8f8a-ec96bc5ead62 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622/action" status: 202 len: 0 microversion: 2.1 time: 1.037418 Aug 23 11:22:05.805085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3520/7091] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:22:04 2022] POST /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622/action => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 11:22:07.013562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1571420374", "imageRef": "665aee74-4b78-4736-ae01-e6c2e37ec0c6", "flavorRef": "452", "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:07.070359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:22:07.439138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:22:07.439566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:22:07.440045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:22:07.440456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:22:07.440915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:22:07.449849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:07.450276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:07.450710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:07.451434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:07.451888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:07.452311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:07.469368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:22:07.474786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:22:07.489162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:22:07.491685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bc0f8033-0b8a-43e0-adff-9bc4ca2269b8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:22:07.566583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b0937da9-285a-4560-b2b8-bb00624706b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557431 Aug 23 11:22:07.567435 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3572/7092] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:22:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:22:07.580199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ed66676-2e5e-4fd6-8408-2a8fe6afca3b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:07.581028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ed66676-2e5e-4fd6-8408-2a8fe6afca3b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:07.640697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1ed66676-2e5e-4fd6-8408-2a8fe6afca3b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:07.648826 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ed66676-2e5e-4fd6-8408-2a8fe6afca3b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1230 microversion: 2.1 time: 0.073548 Aug 23 11:22:07.649229 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3521/7093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:07 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1230 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:08.672316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:08.672892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:08.679121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:08.679629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:08.680074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:08.681886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:08.682010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:08.682572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:08.767317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:08.776247 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a1c5643-4278-4ac5-bd0d-8e0a02ea8f04 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1290 microversion: 2.1 time: 0.109064 Aug 23 11:22:08.781559 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3573/7094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:08 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:09.798062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:09.799882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:09.807242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:09.809916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:09.810426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:09.810881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:09.811647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:09.812121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:09.812535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:10.007782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:10.016464 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-58acbbdc-28b1-469a-b46f-48a21cc042a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.222604 Aug 23 11:22:10.018359 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3522/7095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:09 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:10.375133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-4234edf7-a0fc-447c-9847-add5701323bf req-a7af5f86-eee8-4ab1-9bc2-f5cc4172963c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e54d660-b273-44ea-afad-85f9894c8511", "tag": "17528fb4-2102-4fc5-908e-637102560c16"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:10.382040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:10.388265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4234edf7-a0fc-447c-9847-add5701323bf req-a7af5f86-eee8-4ab1-9bc2-f5cc4172963c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:10.388959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4234edf7-a0fc-447c-9847-add5701323bf req-a7af5f86-eee8-4ab1-9bc2-f5cc4172963c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:10.389632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4234edf7-a0fc-447c-9847-add5701323bf req-a7af5f86-eee8-4ab1-9bc2-f5cc4172963c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:10.403951 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-4234edf7-a0fc-447c-9847-add5701323bf req-a7af5f86-eee8-4ab1-9bc2-f5cc4172963c service nova] Creating event network-changed:17528fb4-2102-4fc5-908e-637102560c16 for instance 8e54d660-b273-44ea-afad-85f9894c8511 on n-h1-847009-13 Aug 23 11:22:10.419655 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-4234edf7-a0fc-447c-9847-add5701323bf req-a7af5f86-eee8-4ab1-9bc2-f5cc4172963c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048136 Aug 23 11:22:10.420849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3574/7096] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:22:11.039926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:11.040601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:11.048037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:11.048582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:11.049068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:11.049808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:11.050293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:11.050747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:11.199308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:11.209233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1b5e3ac2-cec1-4236-bc4f-4d9ac391fdef tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.173367 Aug 23 11:22:11.209911 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3523/7097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:11 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:12.234672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:12.235482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:12.249648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:12.251571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:12.252221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:12.253398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:12.253810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:12.254450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:12.425393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:12.434193 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6688a0a-4b3a-4e15-9f8f-f9e0e8be1f55 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.205602 Aug 23 11:22:12.445335 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3575/7098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:12 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:13.462694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:13.464009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:13.485131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:13.485895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:13.487054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:13.488319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:13.489818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:13.490375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:13.699982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:13.711770 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-97e002f4-e620-4d00-afae-3ddf70e0375a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.259139 Aug 23 11:22:13.714057 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3524/7099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:13 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:14.737013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:14.737619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:14.746124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:14.746615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:14.747054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:14.747809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:14.748426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:14.748902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:14.905212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:14.913906 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6558f8f4-dd78-403e-80a9-463dc958e266 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.181124 Aug 23 11:22:14.914488 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3576/7100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:14 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:15.940239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:15.940943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:15.949679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:15.950407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:15.950887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:15.951761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:15.952352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:15.952959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:16.094611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:16.102707 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-45127a9a-0bbb-45a6-9e8b-cecc7a1a7a6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.167664 Aug 23 11:22:16.104772 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3525/7101] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:15 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:17.123540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:17.124075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:17.131019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:17.131514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:17.131960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:17.132663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:17.133153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:17.133591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:17.263725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:17.271408 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b0e99cba-41bc-478a-a289-d63440d649a1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.151909 Aug 23 11:22:17.271979 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3577/7102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:17 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:22:18.293808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:18.294365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:18.297254 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:18.303409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:18.303925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:18.304631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:18.305448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:18.306447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:18.306911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:18.456105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:18.464494 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40fa6a95-0cfe-45b8-b08a-2dcc76c66e96 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.174745 Aug 23 11:22:18.465109 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3526/7103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:18 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:19.487732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:19.488242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:19.490217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:19.491056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:19.497925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:19.498410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:19.498847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:19.499544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:19.500022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:19.500445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:19.633603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:19.642341 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1d72139d-2e0d-4ea9-9190-55e233c38e8f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.158696 Aug 23 11:22:19.642915 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3578/7104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:19 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:20.664338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:20.665039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:20.672231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:20.672767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:20.673235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:20.673969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:20.674451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:20.674930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:20.818314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:20.827400 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3fcbd2f4-5204-4e76-950b-fc39a68c8941 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.167142 Aug 23 11:22:20.828003 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3527/7105] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:20 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:21.848149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:21.848827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:21.857981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:21.858874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:21.859455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:21.860253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:21.860986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:21.861465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:22.015430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:22.027247 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5224a1cb-8827-44e4-8fc9-689b201aa6a7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.183214 Aug 23 11:22:22.027846 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3579/7106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:21 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:23.048773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:23.049413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:23.056996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:23.057512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:23.057969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:23.058696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:23.059173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:23.059619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:23.196660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:23.205041 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-059066af-4aa3-4736-90d2-868a9c098c39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1342 microversion: 2.1 time: 0.160197 Aug 23 11:22:23.206557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3528/7107] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:23 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:24.228428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:24.228988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:24.235995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:24.236486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:24.236955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:24.237652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:24.238115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:24.238553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:24.373415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:24.381624 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-02658445-8d07-4ba1-8648-fc1ca8a13573 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.157682 Aug 23 11:22:24.382433 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3580/7108] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:24 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:22:25.404396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:25.405045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:25.412085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:25.412589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:25.413074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:25.413800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:25.414282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:25.414731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:25.548776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:25.558271 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74d0b2fa-dc7c-4cb2-8c01-ac98b829a803 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.158444 Aug 23 11:22:25.559183 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3529/7109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:25 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:26.579539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:26.580223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:26.587525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:26.588012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:26.588451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:26.589169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:26.589628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:26.590050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:26.727161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:26.734972 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e6ff6d6-54bf-47ba-ab0a-2e7a24312704 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.159365 Aug 23 11:22:26.735552 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3581/7110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:26 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:27.756999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:27.757556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:27.765280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:27.765779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:27.766230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:27.766936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:27.767409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:27.767890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:27.908309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:27.917167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-557531fb-cd1b-4c47-aaf9-b61ed712aa42 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.164325 Aug 23 11:22:27.917776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3530/7111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:27 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:28.940507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:28.941376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:28.948661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:28.948987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:28.949437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:28.950175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:28.950641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:28.951079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:29.095940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:29.106237 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d05cdca5-a037-41ff-8369-3b5961a6d06b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.169730 Aug 23 11:22:29.106867 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3582/7112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:28 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:30.130303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:30.130936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:30.137966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:30.138463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:30.138911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:30.139619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:30.140089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:30.140535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:30.275741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:30.283659 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7e75906f-999c-4c66-92e7-bca00236bebf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.157346 Aug 23 11:22:30.284480 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3531/7113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:30 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:31.305100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:31.305690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:31.312779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:31.313309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:31.313757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:31.314540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:31.315009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:31.315445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:31.453751 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:31.462198 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-753c4abd-d2cc-4ee5-b046-073df0aa18c2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.161176 Aug 23 11:22:31.462832 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3583/7114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:31 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:32.486480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:32.487143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:32.494230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:32.494769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:32.495518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:32.496380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:32.497098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:32.497734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:32.652611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:32.663410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50d675e3-2234-49f3-9d8b-bffdafced801 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.182995 Aug 23 11:22:32.666196 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3532/7115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:32 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:33.691212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:33.691854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:33.699728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:33.700256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:33.700728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:33.701523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:33.702070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:33.702603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:33.864003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:33.873327 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b41dd95-a4f2-464e-b3e3-5a93dea1ad80 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.185997 Aug 23 11:22:33.873988 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3584/7116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:33 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:34.101487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6ca9c02f-1874-4c7a-9ee9-341a8eefcda2 req-74041822-8ec2-4e34-92e3-61b6a324dfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e54d660-b273-44ea-afad-85f9894c8511", "name": "network-vif-plugged", "status": "completed", "tag": "17528fb4-2102-4fc5-908e-637102560c16"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:34.117458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6ca9c02f-1874-4c7a-9ee9-341a8eefcda2 req-74041822-8ec2-4e34-92e3-61b6a324dfda service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:34.117971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6ca9c02f-1874-4c7a-9ee9-341a8eefcda2 req-74041822-8ec2-4e34-92e3-61b6a324dfda service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:34.118434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6ca9c02f-1874-4c7a-9ee9-341a8eefcda2 req-74041822-8ec2-4e34-92e3-61b6a324dfda service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:34.132816 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6ca9c02f-1874-4c7a-9ee9-341a8eefcda2 req-74041822-8ec2-4e34-92e3-61b6a324dfda service nova] Creating event network-vif-plugged:17528fb4-2102-4fc5-908e-637102560c16 for instance 8e54d660-b273-44ea-afad-85f9894c8511 on n-h1-847009-13 Aug 23 11:22:34.140611 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6ca9c02f-1874-4c7a-9ee9-341a8eefcda2 req-74041822-8ec2-4e34-92e3-61b6a324dfda service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044047 Aug 23 11:22:34.141349 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3533/7117] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:22:34.898507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:34.899124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:34.906584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:34.907073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:34.907540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:34.908238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:34.908704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:34.909159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:34.913063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=73 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:35.068379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:35.076624 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-157a4901-ad54-447a-8d04-526872bb699d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1376 microversion: 2.1 time: 0.181977 Aug 23 11:22:35.077239 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3585/7118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:34 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:36.105588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:36.106773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:36.115296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.115807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.116262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.117007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.117642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.118207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.121293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SELECT=72 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:36.266528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:36.274615 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c380b47e-68a8-4f2d-9d38-d12457b8bf78 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1562 microversion: 2.1 time: 0.174306 Aug 23 11:22:36.275195 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3534/7119] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:36 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:36.295748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:36.296363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:36.303232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.303720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.304161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.304893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.305360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.305793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.441835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:36.449886 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bd4da21-a799-4e48-ab95-c3ed7d8631cf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1562 microversion: 2.1 time: 0.158462 Aug 23 11:22:36.451203 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3586/7120] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:36 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:36.527061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:36.527576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:36.533782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.534284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.534735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.535444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.535916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.536359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.562338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:22:36.640221 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fedd931-bb96-45e4-9808-0b14e44220b4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 204 len: 0 microversion: 2.1 time: 0.116641 Aug 23 11:22:36.641183 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3535/7121] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:22:36 2022] DELETE /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:22:36.649380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:36.649998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:36.656854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.657381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.657825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.658535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:36.659001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:36.659439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:36.795950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:36.803861 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-913473de-746f-497d-a51c-7d0c017fcd2e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1568 microversion: 2.1 time: 0.158388 Aug 23 11:22:36.804439 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3587/7122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:36 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:37.827115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:37.827833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:37.835064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:37.835568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:37.836022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:37.836758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:37.837231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:37.837674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:37.975785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:37.984616 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-674fb7e3-09d1-4e79-9705-972092a8c0e3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1568 microversion: 2.1 time: 0.162356 Aug 23 11:22:37.985252 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3536/7123] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:37 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:38.952407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d2d4e6d4-10f4-4285-a3d2-d9afd26bc695 req-ed6640dd-adb9-4ecd-95d1-51381d2cb6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e54d660-b273-44ea-afad-85f9894c8511", "name": "network-vif-deleted", "tag": "17528fb4-2102-4fc5-908e-637102560c16"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:38.964401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d2d4e6d4-10f4-4285-a3d2-d9afd26bc695 req-ed6640dd-adb9-4ecd-95d1-51381d2cb6b0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:38.964973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d2d4e6d4-10f4-4285-a3d2-d9afd26bc695 req-ed6640dd-adb9-4ecd-95d1-51381d2cb6b0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:38.967155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d2d4e6d4-10f4-4285-a3d2-d9afd26bc695 req-ed6640dd-adb9-4ecd-95d1-51381d2cb6b0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:38.984690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d2d4e6d4-10f4-4285-a3d2-d9afd26bc695 req-ed6640dd-adb9-4ecd-95d1-51381d2cb6b0 service nova] Creating event network-vif-deleted:17528fb4-2102-4fc5-908e-637102560c16 for instance 8e54d660-b273-44ea-afad-85f9894c8511 on n-h1-847009-13 Aug 23 11:22:38.996659 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d2d4e6d4-10f4-4285-a3d2-d9afd26bc695 req-ed6640dd-adb9-4ecd-95d1-51381d2cb6b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042520 Aug 23 11:22:38.998801 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3588/7124] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:22:39.006516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:39.007250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:39.015286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:39.015813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:39.016280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:39.017074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:39.017562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:39.018168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:39.097269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:39.109341 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-db1ddb7b-b17b-4589-b1dc-25b5e5d45550 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1361 microversion: 2.1 time: 0.106764 Aug 23 11:22:39.110522 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3537/7125] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:39 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1361 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:40.132893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:40.133525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:40.141002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:40.141348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:40.141791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:40.142578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:40.143124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:40.143621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:40.212691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:40.221922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a6a71cb-1cba-4794-8c29-a02eba383330 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1361 microversion: 2.1 time: 0.094020 Aug 23 11:22:40.222508 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3589/7126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:40 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:22:41.243537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:41.244096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:41.247221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:41.252886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:41.253405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:41.253860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:41.254585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:41.255064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:41.255510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:41.329442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:41.337540 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-60aec5ee-4a13-4a54-96e6-acf802819cf5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1361 microversion: 2.1 time: 0.098120 Aug 23 11:22:41.338129 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3538/7127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:41 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1361 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:42.361384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:42.362191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:42.365298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=32 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:22:42.370736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:42.371230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:42.371880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:42.372802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:42.373656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:42.373780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:42.443540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:42.451642 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6158c3f-006a-406d-a6f2-053209fa1f27 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1361 microversion: 2.1 time: 0.094045 Aug 23 11:22:42.452164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3590/7128] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:42 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:43.474023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:43.474862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:43.483721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:43.484243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:43.484816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:43.485551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:43.486031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:43.486643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:43.524721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:43.526028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:43.526597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:43.527309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lazy-loading 'fault' on Instance uuid 8e54d660-b273-44ea-afad-85f9894c8511 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:22:43.579986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:43.588901 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ce14f90-e343-4a39-a386-0379bd60ba01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 200 len: 1366 microversion: 2.1 time: 0.120289 Aug 23 11:22:43.589667 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3539/7129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:43 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:44.612278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:44.612949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:44.620142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:44.620856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:44.621304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:44.622676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:44.623354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:44.623781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:44.638595 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 HTTP/1.1 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '8e54d660-b273-44ea-afad-85f9894c8511'} Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:44.640244 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5db35961-d070-48b0-bd49-0a2d721c6795 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 404 len: 111 microversion: 2.1 time: 0.033453 Aug 23 11:22:44.644376 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3591/7130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:44 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:22:48.933547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:48.934444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:48.945148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:48.945677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:48.946166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:48.946920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:48.947406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:48.947860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:48.977048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:22:49.061594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c29f9cd1-a838-4c62-9c6c-d0248ee624f7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 204 len: 0 microversion: 2.1 time: 0.134007 Aug 23 11:22:49.064831 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3540/7131] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:22:48 2022] DELETE /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:22:49.070769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:49.071436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:49.078869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:49.079430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:49.080054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:49.080768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:49.081250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:49.081682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:49.219658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:49.227842 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-549bbd56-e184-4fba-b440-80d738d8eaee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1408 microversion: 2.1 time: 0.161043 Aug 23 11:22:49.228420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3592/7132] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:49 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:22:50.249436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:50.250189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:50.257316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:50.257816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:50.258270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:50.258988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:50.259462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:50.259929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:50.395395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:50.404104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddef30c0-5a6a-4b2f-9228-9b3809bf000c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1408 microversion: 2.1 time: 0.159411 Aug 23 11:22:50.404684 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3541/7133] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:50 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:51.331735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-91cc6559-78eb-4f05-b5df-9f237ac7d957 req-d574603f-470b-4c40-b614-dbf024ee11b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "154d386d-cc4a-4300-851d-11f87a719622", "name": "network-vif-deleted", "tag": "a448eb19-8577-46e9-bed0-95c832c7d247"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:51.343755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-91cc6559-78eb-4f05-b5df-9f237ac7d957 req-d574603f-470b-4c40-b614-dbf024ee11b2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:51.344397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-91cc6559-78eb-4f05-b5df-9f237ac7d957 req-d574603f-470b-4c40-b614-dbf024ee11b2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:51.344862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-91cc6559-78eb-4f05-b5df-9f237ac7d957 req-d574603f-470b-4c40-b614-dbf024ee11b2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:51.357587 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-91cc6559-78eb-4f05-b5df-9f237ac7d957 req-d574603f-470b-4c40-b614-dbf024ee11b2 service nova] Creating event network-vif-deleted:a448eb19-8577-46e9-bed0-95c832c7d247 for instance 154d386d-cc4a-4300-851d-11f87a719622 on n-h2-847009-13 Aug 23 11:22:51.363168 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-91cc6559-78eb-4f05-b5df-9f237ac7d957 req-d574603f-470b-4c40-b614-dbf024ee11b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035276 Aug 23 11:22:51.363780 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3593/7134] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:22:51.425237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:51.425875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:51.433219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:51.433736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:51.434694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:51.435414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:51.435891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:51.436333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:51.501728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:51.509853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ff3f1375-e054-4977-ba11-f3ca2671735e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1201 microversion: 2.1 time: 0.088601 Aug 23 11:22:51.510469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3542/7135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:51 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:52.532926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:52.533530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:52.539855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:52.540341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:52.540796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:52.541485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:52.541943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:52.542371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:52.606013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:52.613824 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f02dd23-518f-456f-861f-4d8e1b616374 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1201 microversion: 2.1 time: 0.086936 Aug 23 11:22:52.614397 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3594/7136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:52 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:53.634992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:53.635746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:53.643448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:53.643959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:53.644426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:53.645196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:53.645708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:53.646160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:53.712875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:53.722098 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-79a3a773-013f-404a-a53f-0f177d0a7953 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1201 microversion: 2.1 time: 0.091014 Aug 23 11:22:53.722683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3543/7137] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:53 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:54.743054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:54.743611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:54.750725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:54.751214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:54.751687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:54.752438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:54.752940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:54.753372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:54.816637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:54.825135 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-37788d01-1d04-4c03-b371-21eb18cf5651 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1201 microversion: 2.1 time: 0.085636 Aug 23 11:22:54.825711 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3595/7138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:54 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:55.847165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:55.847807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:55.854946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:55.855463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:55.856554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:55.857368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:55.857847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:55.858304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:55.894146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:55.894659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:55.895152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:55.895628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lazy-loading 'fault' on Instance uuid 154d386d-cc4a-4300-851d-11f87a719622 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:22:55.937689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:22:55.945659 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e497a362-4fb2-4310-ab62-d2712eee561e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 200 len: 1206 microversion: 2.1 time: 0.102793 Aug 23 11:22:55.946240 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3544/7139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:55 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 1206 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:22:56.966935 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:56.967561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:56.975355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:56.976128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:56.976764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:56.977673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:56.978300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:56.978897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:56.994304 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 HTTP/1.1 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '154d386d-cc4a-4300-851d-11f87a719622'} Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:56.995995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e93860c-f8ce-4c34-b76f-4215b6357c60 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 404 len: 111 microversion: 2.1 time: 0.035899 Aug 23 11:22:56.999868 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3596/7140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:56 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:22:59.143433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:59.143964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:59.151142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.151660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.152124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.153576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.154073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.154534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.169234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 HTTP/1.1 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8e54d660-b273-44ea-afad-85f9894c8511'} Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:22:59.171005 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ddf8a2be-2a31-4f18-af1f-e11ae48d4ec8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 404 len: 111 microversion: 2.1 time: 0.033006 Aug 23 11:22:59.174582 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3545/7141] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:22:59 2022] DELETE /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:22:59.181207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:59.181835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 8e54d660-b273-44ea-afad-85f9894c8511] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:59.188766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.189271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.189716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.190422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.190920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.191356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.205770 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 HTTP/1.1 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '8e54d660-b273-44ea-afad-85f9894c8511'} Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.207446 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 8e54d660-b273-44ea-afad-85f9894c8511 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f3e7eea-1cbc-43ad-8e3b-ff78bd94002b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511" status: 404 len: 111 microversion: 2.1 time: 0.031523 Aug 23 11:22:59.210566 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3597/7142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:59 2022] GET /compute/v2.1/servers/8e54d660-b273-44ea-afad-85f9894c8511 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:22:59.581893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:59.582415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:59.588701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.589256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.589711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.591235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.591718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.592160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.607162 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 HTTP/1.1 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '154d386d-cc4a-4300-851d-11f87a719622'} Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:22:59.608904 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cafa38e9-49ea-46cb-b218-54d110ac482e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 404 len: 111 microversion: 2.1 time: 0.032516 Aug 23 11:22:59.612251 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3546/7143] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:22:59 2022] DELETE /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:22:59.619497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:22:59.620124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 154d386d-cc4a-4300-851d-11f87a719622] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:22:59.627062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.627560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.628003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.628952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:22:59.629569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:22:59.630151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:22:59.645904 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 HTTP/1.1 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '154d386d-cc4a-4300-851d-11f87a719622'} Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:22:59.647470 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 154d386d-cc4a-4300-851d-11f87a719622 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ee91cffb-38ab-4f18-bdac-8b48466bc9b3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622" status: 404 len: 111 microversion: 2.1 time: 0.033400 Aug 23 11:22:59.650825 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3598/7144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:22:59 2022] GET /compute/v2.1/servers/154d386d-cc4a-4300-851d-11f87a719622 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:22:59.724451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb247063-ff0d-4156-8eb3-2a98caa8de48 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: .version_select at 0x7fdc9cdce940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-140011592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKErSqxkbwUtRvsoAtguZCFEoas6BUMmwWdvKLCq8sIHkjkS4/batleeuHxGx6fXuy/QyXdY6isYChaC96KvUUzfQxIsW7bVzhTwVB1bGyq+e4+0qAVJ9amKhP6G4MlnA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:22:59.740772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fb247063-ff0d-4156-8eb3-2a98caa8de48 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:22:59.745943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-fb247063-ff0d-4156-8eb3-2a98caa8de48 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:22:59.770015 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb247063-ff0d-4156-8eb3-2a98caa8de48 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.049758 Aug 23 11:22:59.770630 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3547/7145] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:22:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:23:16.014438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1132664155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140011592", "security_groups": [{"name": "tempest-secgroup-smoke-1771043330"}], "block_device_mapping_v2": [{"uuid": "1ea2bad7-61a2-4b5a-bfb3-679ef4bf4f2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:23:16.024708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=17 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:16.025472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=59 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:16.131477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:23:16.515141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:23:16.515577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:23:16.516062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:23:16.516479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:23:16.516929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:23:16.525783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:16.526276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:16.526719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:16.527525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:16.528608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:16.529025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:16.546100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:23:16.551605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:23:16.609749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:23:16.611907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ea2bad7-61a2-4b5a-bfb3-679ef4bf4f2a',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:23:16.741823 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adc19754-a130-48f1-bfbd-271c02e612f0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731669 Aug 23 11:23:16.742484 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3599/7146] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:23:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:23:16.752191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:16.753021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:16.753996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:16.758533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8dae6089-408f-40c4-82fc-e82cda87acfa tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:16.759207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8dae6089-408f-40c4-82fc-e82cda87acfa tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:16.823058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8dae6089-408f-40c4-82fc-e82cda87acfa tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:16.830835 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8dae6089-408f-40c4-82fc-e82cda87acfa tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1094 microversion: 2.1 time: 0.080764 Aug 23 11:23:16.831412 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3548/7147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:16 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:17.853881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:17.854423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:17.861574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:17.862070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:17.862508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:17.863238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:17.863675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:17.864149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:18.214869 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:18.224093 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-323f8101-37a8-4ae1-8d52-0328753ba268 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1200 microversion: 2.1 time: 0.375003 Aug 23 11:23:18.225068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3600/7148] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:17 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1200 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:19.246409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:19.247111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:19.253903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:19.254608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:19.255069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:19.255823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:19.256305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:19.256804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:19.398720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:19.409064 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ddf2d76-94c7-40d9-b627-e4b3e13042e5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1278 microversion: 2.1 time: 0.166398 Aug 23 11:23:19.409853 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3549/7149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:19 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:19.553893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8aad9040-e259-4be2-bdef-b5eaa4f1ee90 req-6ca0636a-d86e-4e36-8a76-84126b520cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea", "tag": "aa41f37f-8b0e-4074-87f0-9ab4160faf5f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:23:19.568347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aad9040-e259-4be2-bdef-b5eaa4f1ee90 req-6ca0636a-d86e-4e36-8a76-84126b520cac service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:19.569146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aad9040-e259-4be2-bdef-b5eaa4f1ee90 req-6ca0636a-d86e-4e36-8a76-84126b520cac service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:19.569752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8aad9040-e259-4be2-bdef-b5eaa4f1ee90 req-6ca0636a-d86e-4e36-8a76-84126b520cac service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:19.582407 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8aad9040-e259-4be2-bdef-b5eaa4f1ee90 req-6ca0636a-d86e-4e36-8a76-84126b520cac service nova] Creating event network-changed:aa41f37f-8b0e-4074-87f0-9ab4160faf5f for instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea on n-h2-847009-13 Aug 23 11:23:19.599467 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8aad9040-e259-4be2-bdef-b5eaa4f1ee90 req-6ca0636a-d86e-4e36-8a76-84126b520cac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051112 Aug 23 11:23:19.601427 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3601/7150] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:23:20.436356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:20.437175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:20.444627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:20.445405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:20.445877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:20.446616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:20.447141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:20.447592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:20.592800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:20.601029 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bd0a0cf-02bd-4a8d-a477-620b3592fc6d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1278 microversion: 2.1 time: 0.169224 Aug 23 11:23:20.601701 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3550/7151] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:20 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:21.623713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:21.624433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:21.631603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:21.632102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:21.632551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:21.633291 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:21.633758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:21.634194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:21.776526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:21.785346 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6cfe2da-47d7-477f-904a-b548ec4bb008 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1278 microversion: 2.1 time: 0.166431 Aug 23 11:23:21.786012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3602/7152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:21 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:22.806625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:22.807268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:22.815049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:22.815573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:22.816038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:22.816795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:22.817283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:22.817741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:22.965479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:22.973962 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1c4d5be2-3dcc-4b32-9ad4-e3981bbc7458 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1278 microversion: 2.1 time: 0.171303 Aug 23 11:23:22.974548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3551/7153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:22 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:23.995532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:23.996312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:24.003706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:24.004202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:24.004650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:24.005376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:24.005841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:24.006271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:24.146566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:24.155611 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54370239-4ff9-45d0-a0a2-04c9b5a69626 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.163968 Aug 23 11:23:24.156178 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3603/7154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:23 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:25.305711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:25.306352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:25.313137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:25.313646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:25.314107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:25.314822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:25.315303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:25.315753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:25.447728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:25.456353 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46d31cb5-ac53-4b15-98cb-93174c5faf00 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.283184 Aug 23 11:23:25.456974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3552/7155] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:25 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:26.477099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:26.477723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:26.484961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:26.485464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:26.485918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:26.486630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:26.487095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:26.487530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:26.535520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:26.558411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:26.625032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:26.632783 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bd3e0604-02b9-4781-abfb-e79912242347 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.159596 Aug 23 11:23:26.633365 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3604/7156] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:26 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:27.655422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:27.656061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:27.658854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:23:27.664354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:27.664884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:27.665342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:27.666057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:27.666533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:27.666975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:27.801705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:27.809566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e4f2f935-8b40-4477-88af-7b74f586803c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.158614 Aug 23 11:23:27.810148 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3553/7157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:27 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:28.831129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:28.831682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:28.838613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:28.839107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:28.839555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:28.840952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:28.841421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:28.841865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:28.983497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:28.991424 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cdc81c7b-f535-4bdf-b959-0c2fedd1c592 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.164361 Aug 23 11:23:28.991993 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3605/7158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:28 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:30.013211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:30.013856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:30.020939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:30.021449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:30.021942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:30.022658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:30.023138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:30.023586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:30.155991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:30.163760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2c9904d5-7fa7-4cdd-940d-3310c56565af tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.155611 Aug 23 11:23:30.164333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3554/7159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:30 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:31.184732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:31.185378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:31.191933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:31.192432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:31.192905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:31.193615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:31.194083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:31.194518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:31.333277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:31.341781 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4ab5c921-5a00-4282-8f63-7fc3f03ad186 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.160986 Aug 23 11:23:31.342361 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3606/7160] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:31 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:32.362876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:32.363439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:32.370418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:32.371050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:32.371512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:32.372239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:32.372719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:32.373198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:32.510675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:32.519071 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1fc8c3c-8a69-4c57-8253-bd66e2e4fe5f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.160271 Aug 23 11:23:32.519642 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3555/7161] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:32 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:33.270817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3b2ed352-9477-4ad5-9cca-4c9e516ebbc9 req-9597a6a3-acb4-49e9-850f-fb4d1c373926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea", "name": "network-vif-plugged", "status": "completed", "tag": "aa41f37f-8b0e-4074-87f0-9ab4160faf5f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:23:33.281455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3b2ed352-9477-4ad5-9cca-4c9e516ebbc9 req-9597a6a3-acb4-49e9-850f-fb4d1c373926 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:33.281933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3b2ed352-9477-4ad5-9cca-4c9e516ebbc9 req-9597a6a3-acb4-49e9-850f-fb4d1c373926 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:33.282375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3b2ed352-9477-4ad5-9cca-4c9e516ebbc9 req-9597a6a3-acb4-49e9-850f-fb4d1c373926 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:33.297791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3b2ed352-9477-4ad5-9cca-4c9e516ebbc9 req-9597a6a3-acb4-49e9-850f-fb4d1c373926 service nova] Creating event network-vif-plugged:aa41f37f-8b0e-4074-87f0-9ab4160faf5f for instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea on n-h2-847009-13 Aug 23 11:23:33.306488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3b2ed352-9477-4ad5-9cca-4c9e516ebbc9 req-9597a6a3-acb4-49e9-850f-fb4d1c373926 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039401 Aug 23 11:23:33.307117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3607/7162] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:23:33.540531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:33.541219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:33.551717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:33.552233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:33.552697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:33.553453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:33.554148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:33.554611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:33.719167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:33.728000 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-66809a78-b244-4045-89a6-8c0e141254e7 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1266 microversion: 2.1 time: 0.191200 Aug 23 11:23:33.728590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3556/7163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:33 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:34.751713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:34.752334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:34.758503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:34.758995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:34.759441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:34.760411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:34.760916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:34.761870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:34.898957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:34.908435 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ed92b784-ff27-4037-9b1b-f58aa22d040f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1453 microversion: 2.1 time: 0.162570 Aug 23 11:23:34.909056 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3608/7164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:34 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:34.929667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:23:34.930298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:23:34.937366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:34.937868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:34.938320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:34.939034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:34.939508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:34.939947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:35.071443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:23:35.079573 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e9138076-470a-4c12-bf29-38ff7d9ed724 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1453 microversion: 2.1 time: 0.153786 Aug 23 11:23:35.080157 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3557/7165] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:23:34 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:23:37.098868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d70a98a7-a54b-42f9-8913-a6bb0aaffae5 req-14eca0cc-f04c-4f18-8dfd-dcd0fbc7d78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea", "tag": "aa41f37f-8b0e-4074-87f0-9ab4160faf5f"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:23:37.110008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d70a98a7-a54b-42f9-8913-a6bb0aaffae5 req-14eca0cc-f04c-4f18-8dfd-dcd0fbc7d78b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:23:37.110576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d70a98a7-a54b-42f9-8913-a6bb0aaffae5 req-14eca0cc-f04c-4f18-8dfd-dcd0fbc7d78b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:23:37.111091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d70a98a7-a54b-42f9-8913-a6bb0aaffae5 req-14eca0cc-f04c-4f18-8dfd-dcd0fbc7d78b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:23:37.123256 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d70a98a7-a54b-42f9-8913-a6bb0aaffae5 req-14eca0cc-f04c-4f18-8dfd-dcd0fbc7d78b service nova] Creating event network-changed:aa41f37f-8b0e-4074-87f0-9ab4160faf5f for instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea on n-h2-847009-13 Aug 23 11:23:37.128977 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d70a98a7-a54b-42f9-8913-a6bb0aaffae5 req-14eca0cc-f04c-4f18-8dfd-dcd0fbc7d78b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033710 Aug 23 11:23:37.129583 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3609/7166] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:24:17.404444 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:24:17.405047 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:25:33.487540 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:25:33.488482 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:25:33.489123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=22 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:33.490042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=54 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:33.494571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:33.495105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:33.502872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:33.503768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:33.504432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:33.505708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:33.506324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:33.507090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:33.539119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:25:33.614663 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [9ef23931-b2d2-4aa9-b194-dc95e3c928b5] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:25:34.498497 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42372. Aug 23 11:25:34.499271 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42374. Aug 23 11:25:34.622199 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [9ef23931-b2d2-4aa9-b194-dc95e3c928b5] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42376. Aug 23 11:25:34.642841 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d619e19-24b2-4d34-b198-6c9bca8c896b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 204 len: 0 microversion: 2.1 time: 1.157707 Aug 23 11:25:34.643507 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3558/7167] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:25:33 2022] DELETE /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:25:34.649974 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:25:34.651096 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:25:34.651714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:34.652506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=50 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:34.657512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:34.658371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:34.665944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:34.666430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:34.666868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:34.667564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:34.668018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:34.668449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:34.812091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:34.820000 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6ebe13d-4dfe-4885-82e7-0d034ec3c809 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1578 microversion: 2.1 time: 0.172025 Aug 23 11:25:34.820572 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3610/7168] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:34 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:35.842091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:35.842812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:35.850070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:35.850571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:35.851021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:35.851727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:35.852199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:35.852640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:35.996083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:36.005500 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-150e428a-3c56-4527-ad6d-e3eb8fd8cced tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1578 microversion: 2.1 time: 0.167688 Aug 23 11:25:36.006080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3559/7169] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:35 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:37.027689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:37.028348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:37.044987 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42388. Aug 23 11:25:37.054391 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42390. Aug 23 11:25:37.057410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:37.057938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:37.058381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:37.059103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:37.059565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:37.060860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:37.297566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:37.306293 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c0b0bfee-567f-4e4b-9371-a9bba4f38679 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1510 microversion: 2.1 time: 0.282771 Aug 23 11:25:37.307100 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3611/7170] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:37 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:37.647462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b1fc06fd-9254-4db8-889a-7f3d7f7f1b52 req-babdb103-1034-4f04-bf54-8342db80c26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea", "name": "network-vif-deleted", "tag": "aa41f37f-8b0e-4074-87f0-9ab4160faf5f"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:25:37.659829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b1fc06fd-9254-4db8-889a-7f3d7f7f1b52 req-babdb103-1034-4f04-bf54-8342db80c26d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:37.660329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b1fc06fd-9254-4db8-889a-7f3d7f7f1b52 req-babdb103-1034-4f04-bf54-8342db80c26d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:37.660808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b1fc06fd-9254-4db8-889a-7f3d7f7f1b52 req-babdb103-1034-4f04-bf54-8342db80c26d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:37.672254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b1fc06fd-9254-4db8-889a-7f3d7f7f1b52 req-babdb103-1034-4f04-bf54-8342db80c26d service nova] Creating event network-vif-deleted:aa41f37f-8b0e-4074-87f0-9ab4160faf5f for instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea on n-h2-847009-13 Aug 23 11:25:37.677777 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b1fc06fd-9254-4db8-889a-7f3d7f7f1b52 req-babdb103-1034-4f04-bf54-8342db80c26d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171859 Aug 23 11:25:37.678738 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3560/7171] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:25:38.329516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:38.330321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:38.339930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:38.340437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:38.340909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:38.341801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:38.342266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:38.342725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:38.417926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:38.427678 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fac65c7b-8d6b-4736-b1ac-2ea4cd8245a2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1225 microversion: 2.1 time: 0.103948 Aug 23 11:25:38.433815 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3612/7172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:38 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:39.449607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:39.450360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:39.458854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:39.459364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:39.459822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:39.460542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:39.461051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:39.461501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:39.526313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:39.535572 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f269955-5fd4-4d1d-a55c-ea0db9ec46fd tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1225 microversion: 2.1 time: 0.090247 Aug 23 11:25:39.536064 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3561/7173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:39 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:40.556476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:40.557135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:40.564040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:40.564528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:40.565184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:40.565965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:40.566435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:40.566868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:40.632670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:40.640710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c22cc98-a340-413a-adcd-4f6257359893 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1225 microversion: 2.1 time: 0.088386 Aug 23 11:25:40.641366 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3613/7174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:40 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:41.661857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:41.662514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:41.669659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:41.670181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:41.670643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:41.671375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:41.671860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:41.672897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:41.741313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:41.749532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-99a9ad67-be52-4002-8cf3-eb1ff6388ec1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 200 len: 1225 microversion: 2.1 time: 0.091809 Aug 23 11:25:41.750108 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3562/7175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:41 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:42.771197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:42.771828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:42.778571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:42.779170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:42.779610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:42.780302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:42.780773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:42.781201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:42.797610 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea HTTP/1.1 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea'} Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:25:42.800222 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-158f8d9a-b980-4dbf-9cd5-eb28efb2f970 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 404 len: 111 microversion: 2.1 time: 0.034410 Aug 23 11:25:42.804545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3614/7176] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:42 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:25:42.849639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-342279875", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140011592", "security_groups": [{"name": "tempest-secgroup-smoke-1771043330"}], "block_device_mapping_v2": [{"uuid": "1ea2bad7-61a2-4b5a-bfb3-679ef4bf4f2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:25:42.977819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:25:43.461066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:25:43.461493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:25:43.461992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:25:43.462426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:25:43.462865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:25:43.472568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:43.473103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:43.473564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:43.474317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:43.474800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:43.475252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:43.492794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:25:43.498159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:25:43.556191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:25:43.558431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ea2bad7-61a2-4b5a-bfb3-679ef4bf4f2a',volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:25:43.687430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7ce9f451-8937-4c6c-9d79-fed02d2aef1b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842921 Aug 23 11:25:43.688080 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3563/7177] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:25:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:25:43.699325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-db104e91-4858-4680-972b-a6bedeeb5938 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:43.699938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-db104e91-4858-4680-972b-a6bedeeb5938 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:43.757418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-db104e91-4858-4680-972b-a6bedeeb5938 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:43.764491 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-db104e91-4858-4680-972b-a6bedeeb5938 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1093 microversion: 2.1 time: 0.068970 Aug 23 11:25:43.765170 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3615/7178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:43 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:44.788192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:44.789470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:44.796672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:44.797312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:44.797890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:44.798698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:44.799187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:44.799640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:44.869024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:44.877941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-857cc92c-4f48-452b-85e2-4784b09c12d9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1191 microversion: 2.1 time: 0.096305 Aug 23 11:25:44.878625 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3564/7179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:44 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:45.900038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:45.901310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:45.908623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:45.909462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:45.910127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:45.911149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:45.911957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:45.912615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:46.178058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:46.186559 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c5a0a68-90e3-4696-a817-e79b71fd3af5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1277 microversion: 2.1 time: 0.290692 Aug 23 11:25:46.187351 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3616/7180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:45 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1277 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:46.528960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-96de18f3-5333-41d7-b733-481a2140cf06 req-a9b6737a-43ce-40fb-afe3-d9b3b6965044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa731676-57de-486a-9237-a7ba9b5392ee", "tag": "c2e1618e-b6ab-4983-b741-25a776f28237"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:25:46.542767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-96de18f3-5333-41d7-b733-481a2140cf06 req-a9b6737a-43ce-40fb-afe3-d9b3b6965044 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:46.543565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-96de18f3-5333-41d7-b733-481a2140cf06 req-a9b6737a-43ce-40fb-afe3-d9b3b6965044 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:46.544022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-96de18f3-5333-41d7-b733-481a2140cf06 req-a9b6737a-43ce-40fb-afe3-d9b3b6965044 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:46.556842 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-96de18f3-5333-41d7-b733-481a2140cf06 req-a9b6737a-43ce-40fb-afe3-d9b3b6965044 service nova] Creating event network-changed:c2e1618e-b6ab-4983-b741-25a776f28237 for instance aa731676-57de-486a-9237-a7ba9b5392ee on n-h1-847009-13 Aug 23 11:25:46.575052 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-96de18f3-5333-41d7-b733-481a2140cf06 req-a9b6737a-43ce-40fb-afe3-d9b3b6965044 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051102 Aug 23 11:25:46.575714 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3565/7181] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:25:47.210426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:47.211303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:47.218679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:47.219230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:47.221212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:47.223289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:47.223845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:47.224353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:47.444086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:47.452228 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1ce5ebc0-a2cd-4d86-b2b8-2497c049ed6a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1277 microversion: 2.1 time: 0.245724 Aug 23 11:25:47.453174 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3617/7182] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:47 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:48.475020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:48.475672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:48.482905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:48.483417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:48.483880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:48.484607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:48.485117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:48.485569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:48.623194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:48.631347 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d74afe45-5162-4004-859c-e5d2d0f2e201 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1277 microversion: 2.1 time: 0.161545 Aug 23 11:25:48.631932 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3566/7183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:48 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:49.653293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:49.653912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:49.660997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:49.661490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:49.661933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:49.662643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:49.663113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:49.663545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:49.803236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:49.811861 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06349bf7-13c2-41ca-910e-efab9300e37f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1277 microversion: 2.1 time: 0.162535 Aug 23 11:25:49.812453 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3618/7184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:49 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:50.834425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:50.834981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:50.842186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:50.842691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:50.843147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:50.843859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:50.844331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:50.845039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:50.979659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:50.988305 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb6ef144-6a74-431d-99ef-4177e1f172ee tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.158438 Aug 23 11:25:50.988912 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3567/7185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:50 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:52.009307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:52.009915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:52.016876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:52.017983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:52.018493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:52.019226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:52.019683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:52.020108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:52.159209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:52.166914 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e467bbc4-30e9-441b-8e19-b8118f4ae7a0 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.161478 Aug 23 11:25:52.167490 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3619/7186] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:52 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:53.188870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:53.190040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:53.197016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:53.197523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:53.197989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:53.198797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:53.199280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:53.199731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:53.332589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:53.340470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22a4f64e-6bf4-4963-b6b4-f1cec8316ed9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.155578 Aug 23 11:25:53.341072 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3568/7187] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:53 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:54.361934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:54.362616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:54.365306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:54.371003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:54.371497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:54.371933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:54.372632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:54.373164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:54.373594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:54.506821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:54.514892 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d795a65e-26a9-4ffa-b6ba-0acda1330265 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.157465 Aug 23 11:25:54.515472 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3620/7188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:54 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:55.536853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:55.537528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:55.539576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:55.540400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:25:55.547413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:55.547922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:55.549172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:55.550014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:55.550496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:55.550951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:55.685873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:55.693783 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8acae8c9-e278-4b1c-8c9a-7e2e5967fc44 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.161498 Aug 23 11:25:55.694361 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3569/7189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:55 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:56.714729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:56.715351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:56.722755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:56.723251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:56.723698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:56.724439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:56.724937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:56.725375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:56.862242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:56.870026 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-962a01ad-7669-46aa-b004-0393d2bb2d70 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.159310 Aug 23 11:25:56.870621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3621/7190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:56 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:25:57.892871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:57.893555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:57.900590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:57.901122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:57.901648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:57.902414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:57.902892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:57.903340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:58.047465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:58.055284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a768889-e520-4b9a-ab3e-6f630909c338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.167296 Aug 23 11:25:58.055873 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3570/7191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:57 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:25:59.075871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:25:59.076497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:25:59.083878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:59.084381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:59.084857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:59.085571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:25:59.086036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:25:59.086472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:25:59.223692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:25:59.231556 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b11b2e9-40b2-4833-b735-5f314e7c78a8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.159671 Aug 23 11:25:59.232138 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3622/7192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:25:59 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:26:00.251330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:26:00.252314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:26:00.258870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:00.259373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:00.259828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:00.260535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:00.261031 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:00.261472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:00.396367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:26:00.404141 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9e2fad3-e81e-4819-9ade-611d213c6c0a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.156730 Aug 23 11:26:00.404709 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3571/7193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:26:00 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:26:01.154099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ad3a3e7f-816b-445f-ba5b-814a81503978 req-8ec61513-4a81-4946-9a02-28428f066191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa731676-57de-486a-9237-a7ba9b5392ee", "name": "network-vif-plugged", "status": "completed", "tag": "c2e1618e-b6ab-4983-b741-25a776f28237"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:26:01.164382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ad3a3e7f-816b-445f-ba5b-814a81503978 req-8ec61513-4a81-4946-9a02-28428f066191 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:01.164899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ad3a3e7f-816b-445f-ba5b-814a81503978 req-8ec61513-4a81-4946-9a02-28428f066191 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:01.165336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ad3a3e7f-816b-445f-ba5b-814a81503978 req-8ec61513-4a81-4946-9a02-28428f066191 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:01.177183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ad3a3e7f-816b-445f-ba5b-814a81503978 req-8ec61513-4a81-4946-9a02-28428f066191 service nova] Creating event network-vif-plugged:c2e1618e-b6ab-4983-b741-25a776f28237 for instance aa731676-57de-486a-9237-a7ba9b5392ee on n-h1-847009-13 Aug 23 11:26:01.182159 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ad3a3e7f-816b-445f-ba5b-814a81503978 req-8ec61513-4a81-4946-9a02-28428f066191 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104099 Aug 23 11:26:01.182742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3623/7194] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:26:01.426144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:26:01.426778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:26:01.433781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:01.434218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:01.434672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:01.435377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:01.435851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:01.436292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:01.567210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:26:01.575064 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd98fb1d-60fa-4082-89f8-106e75e0284e tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.152996 Aug 23 11:26:01.575648 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3572/7195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:26:01 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:26:02.598069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:26:02.598765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:26:02.604950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:02.605442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:02.605877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:02.606566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:02.607021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:02.607446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:02.754345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:26:02.764882 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b8bb8cb6-3ee6-40f3-9f24-067cac753ef2 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1265 microversion: 2.1 time: 0.172364 Aug 23 11:26:02.765497 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3624/7196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:26:02 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:26:03.787596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:26:03.788241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:26:03.791008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:26:03.796473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:03.797013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:03.797471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:03.798324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:03.799261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:03.799711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:03.804706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:26:03.935847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:26:03.944992 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f2ba2c3-1f40-4fac-b0a5-169e192a9c16 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1452 microversion: 2.1 time: 0.161426 Aug 23 11:26:03.945802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3573/7197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:26:03 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:26:03.965482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:26:03.966098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:26:03.974254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:03.974684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:03.975167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:03.975907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:03.976283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:03.976712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:04.114696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:26:04.122588 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b76bf55f-a2c9-4b25-9dc1-785448a84edf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1452 microversion: 2.1 time: 0.160950 Aug 23 11:26:04.123164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3625/7198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:26:03 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:26:06.133716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-87628bd8-a757-4c8d-94bd-ea451025dd97 req-893845a4-e25a-4453-870b-6f842b73c9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa731676-57de-486a-9237-a7ba9b5392ee", "tag": "c2e1618e-b6ab-4983-b741-25a776f28237"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:26:06.143682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-87628bd8-a757-4c8d-94bd-ea451025dd97 req-893845a4-e25a-4453-870b-6f842b73c9c2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:26:06.144287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-87628bd8-a757-4c8d-94bd-ea451025dd97 req-893845a4-e25a-4453-870b-6f842b73c9c2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:26:06.144849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-87628bd8-a757-4c8d-94bd-ea451025dd97 req-893845a4-e25a-4453-870b-6f842b73c9c2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:26:06.156159 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-87628bd8-a757-4c8d-94bd-ea451025dd97 req-893845a4-e25a-4453-870b-6f842b73c9c2 service nova] Creating event network-changed:c2e1618e-b6ab-4983-b741-25a776f28237 for instance aa731676-57de-486a-9237-a7ba9b5392ee on n-h1-847009-13 Aug 23 11:26:06.162360 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-87628bd8-a757-4c8d-94bd-ea451025dd97 req-893845a4-e25a-4453-870b-6f842b73c9c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Aug 23 11:26:06.163084 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3574/7199] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:26:47.332396 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:26:47.333276 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:26:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:26:48.781405 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:26:48.781859 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:26:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:26:48.871849 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:26:48.871984 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:26:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:27:46.706651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=34 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:46.707494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=82 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:46.711461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1743391385", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-140011592", "security_groups": [{"name": "tempest-secgroup-smoke-1771043330"}], "block_device_mapping_v2": [{"uuid": "9c445b41-c601-47b2-bc27-b9db5f84dccb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2abd1a56-8ef5-4857-9a10-3a937936371e"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:27:47.030797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] validate_networks() for [('2abd1a56-8ef5-4857-9a10-3a937936371e', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:27:47.470121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:27:47.470545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:27:47.471022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:27:47.471467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:27:47.471884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:27:47.481598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:47.482090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:47.482539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:47.483279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:47.483745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:47.484178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:47.500781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:27:47.506311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Getting quotas for user 58a1b5d0b7554edb95e5e994d7cc60d1 and project d50d08d128e9423b81be170a4ccd3fab. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:27:47.564313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:27:47.566682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c445b41-c601-47b2-bc27-b9db5f84dccb',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:27:47.695250 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b0340c12-8b82-437d-a0fa-1c6fa98156a3 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.991078 Aug 23 11:27:47.695895 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3626/7200] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:27:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:27:47.706868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:47.707643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:47.712293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-576233f0-9d95-4ed4-a319-bc452ef8003c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:47.713071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-576233f0-9d95-4ed4-a319-bc452ef8003c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:47.837354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-576233f0-9d95-4ed4-a319-bc452ef8003c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:47.845818 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-576233f0-9d95-4ed4-a319-bc452ef8003c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1094 microversion: 2.1 time: 0.142055 Aug 23 11:27:47.846539 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3575/7201] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:47 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1094 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:48.867885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:48.868622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:48.874781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:48.875206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:48.875644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:48.876377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:48.876862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:48.877813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:48.945268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:48.955042 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-adfb03e7-9cc6-424b-92e4-2a016fd9973f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1192 microversion: 2.1 time: 0.092280 Aug 23 11:27:48.955813 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3627/7202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:48 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:49.979438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:49.986380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:49.999575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:50.000099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:50.000562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:50.001342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:50.001825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:50.002318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:50.177385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:50.185847 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3eb5f645-4b37-45c1-9606-ea7bcec0ba1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1278 microversion: 2.1 time: 0.212972 Aug 23 11:27:50.186534 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3576/7203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:49 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1278 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:50.715314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9c5a50b3-0c73-4951-a45a-404eaafc7ca4 req-e24c2135-c621-4039-83c6-74a4e03cb3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79562e2f-386c-42bf-83c5-af7660e6f05c", "tag": "c43fe5eb-d445-44a2-a917-7871eca48b88"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:27:50.727534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9c5a50b3-0c73-4951-a45a-404eaafc7ca4 req-e24c2135-c621-4039-83c6-74a4e03cb3e9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:50.728430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9c5a50b3-0c73-4951-a45a-404eaafc7ca4 req-e24c2135-c621-4039-83c6-74a4e03cb3e9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:50.728962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9c5a50b3-0c73-4951-a45a-404eaafc7ca4 req-e24c2135-c621-4039-83c6-74a4e03cb3e9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:50.744646 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9c5a50b3-0c73-4951-a45a-404eaafc7ca4 req-e24c2135-c621-4039-83c6-74a4e03cb3e9 service nova] Creating event network-changed:c43fe5eb-d445-44a2-a917-7871eca48b88 for instance 79562e2f-386c-42bf-83c5-af7660e6f05c on n-h2-847009-13 Aug 23 11:27:50.750365 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9c5a50b3-0c73-4951-a45a-404eaafc7ca4 req-e24c2135-c621-4039-83c6-74a4e03cb3e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038762 Aug 23 11:27:50.751055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3628/7204] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:27:51.208396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:51.209239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:51.216138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:51.216636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:51.217129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:51.217849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:51.218300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:51.218744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:51.373531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:51.383100 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-05de56a0-51ac-4eab-9f3d-23060eca4c20 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1278 microversion: 2.1 time: 0.179340 Aug 23 11:27:51.384126 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3577/7205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:51 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:52.406881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:52.407589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:52.414546 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:52.415040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:52.415484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:52.416194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:52.416663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:52.417125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:52.556126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:52.564452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79f441d8-cafc-4af1-bf76-0140f22479a4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1278 microversion: 2.1 time: 0.162544 Aug 23 11:27:52.569146 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3629/7206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:52 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:53.585842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:53.586501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:53.593482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:53.594232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:53.594683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:53.595390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:53.595869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:53.597125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:53.735884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:53.743739 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3bf02f16-6a85-46a2-b8fb-d29393c022a5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1278 microversion: 2.1 time: 0.161788 Aug 23 11:27:53.744301 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3578/7207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:53 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:54.764100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:54.764634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:54.772180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:54.772675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:54.773159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:54.773864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:54.774334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:54.774770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:54.913486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:54.921254 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2dfd973-e982-4221-bf59-0b5f35b7dd85 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.161156 Aug 23 11:27:54.921844 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3630/7208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:54 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:55.943778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:55.944427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:55.951417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:55.951926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:55.952390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:55.953144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:55.953629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:55.954081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:56.090527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:56.098779 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-12d75abb-d798-4f4e-97f3-ec820a6519ca tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.159084 Aug 23 11:27:56.099343 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3579/7209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:55 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:57.119877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:57.120495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:57.128658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:57.129183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:57.129629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:57.130362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:57.130986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:57.131460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:57.277815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:57.288778 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-23894f9b-0f36-4392-869d-f78ce32d41ea tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.172773 Aug 23 11:27:57.289421 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3631/7210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:57 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:58.311073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:58.311774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:58.315124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:58.322078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:58.322599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:58.323064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:58.323796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:58.324532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:58.325210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:58.469791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:58.478418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bea4a6c0-a4f6-44e8-81ca-b42aebb44a9d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.171360 Aug 23 11:27:58.478991 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3580/7211] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:58 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:27:59.499819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:27:59.500444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:27:59.503191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:59.503867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:27:59.510952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:59.511434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:59.511873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:59.512654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:27:59.513159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:27:59.513587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:27:59.654260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:27:59.664575 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8dbc8b56-0c7d-46ed-99e7-27dd39cf6a1f tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.168989 Aug 23 11:27:59.665206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3632/7212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:27:59 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:28:00.687000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:00.687645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:00.695166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:00.695677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:00.696139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:00.696884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:00.697371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:00.697824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:00.828297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:00.836605 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d9f5f6e9-f874-4fb8-ad99-c1e2b2947be1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.153557 Aug 23 11:28:00.837310 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3581/7213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:00 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:28:01.857845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:01.858455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:01.865663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:01.866176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:01.866618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:01.867356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:01.867834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:01.868258 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:01.999164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:02.007513 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-245b7a2f-9736-4f8f-9044-b9e75b25f956 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.153628 Aug 23 11:28:02.008085 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3633/7214] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:01 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:28:03.028821 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:03.029475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:03.037084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:03.037580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:03.038030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:03.038735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:03.039256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:03.039695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:03.173663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:03.182121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-018b8849-d620-4b6c-9dea-0ef871b26ddc tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.157296 Aug 23 11:28:03.182690 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3582/7215] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:03 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:28:04.203628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:04.204234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:04.211457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:04.211948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:04.212383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:04.213103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:04.213563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:04.213986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:04.301366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fd8d9f45-a19c-4928-aa0f-19e74221b494 req-8a68609a-d613-44c4-b0a6-50991f837385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79562e2f-386c-42bf-83c5-af7660e6f05c", "name": "network-vif-plugged", "status": "completed", "tag": "c43fe5eb-d445-44a2-a917-7871eca48b88"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:28:04.313345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fd8d9f45-a19c-4928-aa0f-19e74221b494 req-8a68609a-d613-44c4-b0a6-50991f837385 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:04.314327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fd8d9f45-a19c-4928-aa0f-19e74221b494 req-8a68609a-d613-44c4-b0a6-50991f837385 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:04.315498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fd8d9f45-a19c-4928-aa0f-19e74221b494 req-8a68609a-d613-44c4-b0a6-50991f837385 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:04.327288 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fd8d9f45-a19c-4928-aa0f-19e74221b494 req-8a68609a-d613-44c4-b0a6-50991f837385 service nova] Creating event network-vif-plugged:c43fe5eb-d445-44a2-a917-7871eca48b88 for instance 79562e2f-386c-42bf-83c5-af7660e6f05c on n-h2-847009-13 Aug 23 11:28:04.332809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fd8d9f45-a19c-4928-aa0f-19e74221b494 req-8a68609a-d613-44c4-b0a6-50991f837385 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036944 Aug 23 11:28:04.333693 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3583/7216] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:28:04.357833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:04.367259 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b46d089e-cecd-4208-81f5-6c7c7469ad5a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.167548 Aug 23 11:28:04.368111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3634/7217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:04 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:28:05.390631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:05.391278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:05.397562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:05.398081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:05.398546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:05.399265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:05.399746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:05.400196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:05.541113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:05.549884 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f1819aed-3a36-45ee-9a95-f956a0ab9cf4 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1266 microversion: 2.1 time: 0.164547 Aug 23 11:28:05.550499 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3584/7218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:05 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:28:06.572031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:06.572717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:06.579489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:06.580604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:06.581336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:06.582044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:06.582516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:06.582948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:06.719158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:06.727391 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f0d6bad5-47ea-404c-90c1-3153a9b5233b tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1452 microversion: 2.1 time: 0.159292 Aug 23 11:28:06.727972 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3635/7219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:06 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:28:06.747818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:28:06.748464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:28:06.756034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:06.756543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:06.757039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:06.757761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:06.758244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:06.758696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:06.896433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:28:06.904202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a3695995-3107-4911-8e9d-447c1356984d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1452 microversion: 2.1 time: 0.160291 Aug 23 11:28:06.904776 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3585/7220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:28:06 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:28:08.602414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3ec9b986-31c7-44bf-887a-89e4b87aab47 req-20f7ab33-906b-4eca-82fc-f7742198aa35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79562e2f-386c-42bf-83c5-af7660e6f05c", "tag": "c43fe5eb-d445-44a2-a917-7871eca48b88"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:28:08.612469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ec9b986-31c7-44bf-887a-89e4b87aab47 req-20f7ab33-906b-4eca-82fc-f7742198aa35 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:28:08.613082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ec9b986-31c7-44bf-887a-89e4b87aab47 req-20f7ab33-906b-4eca-82fc-f7742198aa35 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:28:08.613525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3ec9b986-31c7-44bf-887a-89e4b87aab47 req-20f7ab33-906b-4eca-82fc-f7742198aa35 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:28:08.624540 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3ec9b986-31c7-44bf-887a-89e4b87aab47 req-20f7ab33-906b-4eca-82fc-f7742198aa35 service nova] Creating event network-changed:c43fe5eb-d445-44a2-a917-7871eca48b88 for instance 79562e2f-386c-42bf-83c5-af7660e6f05c on n-h2-847009-13 Aug 23 11:28:08.630141 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3ec9b986-31c7-44bf-887a-89e4b87aab47 req-20f7ab33-906b-4eca-82fc-f7742198aa35 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094637 Aug 23 11:28:08.630763 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3636/7221] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:29:17.412933 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:29:17.413516 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:29:37.053840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=24 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:29:37.058391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:29:37.059186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=56 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:29:37.060248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=54 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:29:37.064419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:37.069797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-eeacfdc7-75f3-4443-8907-a1e21b34221f req-deae165c-eb6e-4278-a1b2-5c691da7e38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79562e2f-386c-42bf-83c5-af7660e6f05c", "tag": "c43fe5eb-d445-44a2-a917-7871eca48b88"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:29:37.077476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:37.084690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:37.085236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:37.085708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:37.086444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:37.086929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:37.087384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:37.096985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeacfdc7-75f3-4443-8907-a1e21b34221f req-deae165c-eb6e-4278-a1b2-5c691da7e38b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:37.097482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeacfdc7-75f3-4443-8907-a1e21b34221f req-deae165c-eb6e-4278-a1b2-5c691da7e38b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:37.097923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eeacfdc7-75f3-4443-8907-a1e21b34221f req-deae165c-eb6e-4278-a1b2-5c691da7e38b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:37.109624 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-eeacfdc7-75f3-4443-8907-a1e21b34221f req-deae165c-eb6e-4278-a1b2-5c691da7e38b service nova] Creating event network-changed:c43fe5eb-d445-44a2-a917-7871eca48b88 for instance 79562e2f-386c-42bf-83c5-af7660e6f05c on n-h2-847009-13 Aug 23 11:29:37.114819 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-eeacfdc7-75f3-4443-8907-a1e21b34221f req-deae165c-eb6e-4278-a1b2-5c691da7e38b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058875 Aug 23 11:29:37.115621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3637/7222] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:29:37.117526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:29:37.210173 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1d035527-f588-4d61-89e0-01d67406ea01 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 204 len: 0 microversion: 2.1 time: 0.157943 Aug 23 11:29:37.211686 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3586/7223] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:29:37 2022] DELETE /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:29:37.222044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:37.222896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:37.232909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:37.233525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:37.233962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:37.235065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:37.235177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:37.235658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:37.371702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:37.379657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfba721c-fe22-46ce-9b24-de0cdf8412e9 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1576 microversion: 2.1 time: 0.162636 Aug 23 11:29:37.380230 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3638/7224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:37 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:38.402539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:38.403187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:38.411538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:38.412042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:38.412501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:38.413247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:38.414561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:38.415396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:38.557214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:38.565914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-feff281e-eacb-4597-87b9-0ea468adffdf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1576 microversion: 2.1 time: 0.167838 Aug 23 11:29:38.566488 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3587/7225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:38 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:39.587887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:39.588714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:39.597332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:39.597997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:39.599456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:39.600187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:39.600650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:39.601131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:39.791520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:39.802121 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ebec7101-8f0f-4142-8be1-7440f33f2010 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1458 microversion: 2.1 time: 0.218350 Aug 23 11:29:39.803146 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3639/7226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:39 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1458 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:29:40.050326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3cb81510-d6eb-4dac-a503-6616f9be5b0f req-56c5cb1b-ded5-4067-8b26-802a76879093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79562e2f-386c-42bf-83c5-af7660e6f05c", "name": "network-vif-deleted", "tag": "c43fe5eb-d445-44a2-a917-7871eca48b88"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:29:40.062198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3cb81510-d6eb-4dac-a503-6616f9be5b0f req-56c5cb1b-ded5-4067-8b26-802a76879093 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:40.062711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3cb81510-d6eb-4dac-a503-6616f9be5b0f req-56c5cb1b-ded5-4067-8b26-802a76879093 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:40.063169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3cb81510-d6eb-4dac-a503-6616f9be5b0f req-56c5cb1b-ded5-4067-8b26-802a76879093 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:40.074716 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3cb81510-d6eb-4dac-a503-6616f9be5b0f req-56c5cb1b-ded5-4067-8b26-802a76879093 service nova] Creating event network-vif-deleted:c43fe5eb-d445-44a2-a917-7871eca48b88 for instance 79562e2f-386c-42bf-83c5-af7660e6f05c on n-h2-847009-13 Aug 23 11:29:40.081160 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3cb81510-d6eb-4dac-a503-6616f9be5b0f req-56c5cb1b-ded5-4067-8b26-802a76879093 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034626 Aug 23 11:29:40.081773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3588/7227] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:29:40.830848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:40.831493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:40.838433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:40.838926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:40.839397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:40.840101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:40.840586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:40.842032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:40.906328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:40.914316 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61e24694-3828-4b06-bcc7-a4a7b8665cdb tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1225 microversion: 2.1 time: 0.087326 Aug 23 11:29:40.914907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3640/7228] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:40 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:41.937166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:41.938056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:41.944492 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:41.945032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:41.945489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:41.946199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:41.946680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:41.947288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:42.019898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:42.029523 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efeb88b5-23b2-4465-be58-9a68ac360f39 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1225 microversion: 2.1 time: 0.097137 Aug 23 11:29:42.030196 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3589/7229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:41 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:43.051205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:43.051824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:43.058951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:43.059441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:43.061151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:43.061882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:43.062351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:43.062790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:43.134645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:43.142720 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1375ee9-1ecb-4bcb-ae67-7f2557ed7a41 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1225 microversion: 2.1 time: 0.095351 Aug 23 11:29:43.143300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3641/7230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:43 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:44.164323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:44.165090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:44.173414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:44.173970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:44.174432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:44.175170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:44.175653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:44.176099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:44.246171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:44.257383 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f11f0f6-db78-4619-ab3f-9baf12761ebe tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 200 len: 1225 microversion: 2.1 time: 0.097050 Aug 23 11:29:44.257966 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3590/7231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:44 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:45.279700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:45.280230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: 79562e2f-386c-42bf-83c5-af7660e6f05c] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:45.287107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:45.287593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:45.288056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:45.288771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:45.289233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:45.289659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:45.303585 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance 79562e2f-386c-42bf-83c5-af7660e6f05c could not be found. Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c HTTP/1.1 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 79562e2f-386c-42bf-83c5-af7660e6f05c could not be found. Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '79562e2f-386c-42bf-83c5-af7660e6f05c'} Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79562e2f-386c-42bf-83c5-af7660e6f05c could not be found. Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79562e2f-386c-42bf-83c5-af7660e6f05c could not be found. Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:29:45.305247 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79562e2f-386c-42bf-83c5-af7660e6f05c could not be found. Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance 79562e2f-386c-42bf-83c5-af7660e6f05c could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af47baa9-4d81-45b2-a00c-18c6bbbdf1c5 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c" status: 404 len: 111 microversion: 2.1 time: 0.031579 Aug 23 11:29:45.310466 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3642/7232] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:45 2022] GET /compute/v2.1/servers/79562e2f-386c-42bf-83c5-af7660e6f05c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:29:51.553252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:51.553762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:51.555648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c14725fa-28d2-4996-8838-8b8d0cf524ca req-f1ee22d2-0376-4604-a38e-4eaf843835cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa731676-57de-486a-9237-a7ba9b5392ee", "tag": "c2e1618e-b6ab-4983-b741-25a776f28237"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:29:51.561633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:51.562309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:51.562762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:51.563483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:51.563954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:51.564397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:51.568059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c14725fa-28d2-4996-8838-8b8d0cf524ca req-f1ee22d2-0376-4604-a38e-4eaf843835cf service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:51.568618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c14725fa-28d2-4996-8838-8b8d0cf524ca req-f1ee22d2-0376-4604-a38e-4eaf843835cf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:51.569190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c14725fa-28d2-4996-8838-8b8d0cf524ca req-f1ee22d2-0376-4604-a38e-4eaf843835cf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:51.582186 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c14725fa-28d2-4996-8838-8b8d0cf524ca req-f1ee22d2-0376-4604-a38e-4eaf843835cf service nova] Creating event network-changed:c2e1618e-b6ab-4983-b741-25a776f28237 for instance aa731676-57de-486a-9237-a7ba9b5392ee on n-h1-847009-13 Aug 23 11:29:51.587841 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c14725fa-28d2-4996-8838-8b8d0cf524ca req-f1ee22d2-0376-4604-a38e-4eaf843835cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036242 Aug 23 11:29:51.588442 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3643/7233] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:29:51.591854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:29:51.676664 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7d8630d-c719-45c2-81f9-a28b8d8d153a tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 204 len: 0 microversion: 2.1 time: 0.127386 Aug 23 11:29:51.679078 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3591/7234] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:29:51 2022] DELETE /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:29:51.691143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:51.692306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:51.699128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:51.699623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:51.700134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:51.700866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:51.701325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:51.701756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:51.844320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:51.852209 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3d207fd-b2ea-468a-af45-ed9799cc1ca8 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1576 microversion: 2.1 time: 0.166295 Aug 23 11:29:51.852810 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3644/7235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:51 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:52.874964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:52.875712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:52.882476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:52.882975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:52.883428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:52.884132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:52.884602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:52.885100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:53.021460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:53.030314 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed58e3ee-b723-4db0-88d1-8e7e3c9a31ba tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1576 microversion: 2.1 time: 0.160190 Aug 23 11:29:53.030909 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3592/7236] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:52 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:54.004681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-34907155-044e-4662-b8f5-22a3c5852885 req-a7c7d140-2669-468d-b9d1-0605ba30b843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa731676-57de-486a-9237-a7ba9b5392ee", "name": "network-vif-deleted", "tag": "c2e1618e-b6ab-4983-b741-25a776f28237"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:29:54.016206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-34907155-044e-4662-b8f5-22a3c5852885 req-a7c7d140-2669-468d-b9d1-0605ba30b843 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:54.016691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-34907155-044e-4662-b8f5-22a3c5852885 req-a7c7d140-2669-468d-b9d1-0605ba30b843 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:54.017158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-34907155-044e-4662-b8f5-22a3c5852885 req-a7c7d140-2669-468d-b9d1-0605ba30b843 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:54.029296 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-34907155-044e-4662-b8f5-22a3c5852885 req-a7c7d140-2669-468d-b9d1-0605ba30b843 service nova] Creating event network-vif-deleted:c2e1618e-b6ab-4983-b741-25a776f28237 for instance aa731676-57de-486a-9237-a7ba9b5392ee on n-h1-847009-13 Aug 23 11:29:54.035119 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-34907155-044e-4662-b8f5-22a3c5852885 req-a7c7d140-2669-468d-b9d1-0605ba30b843 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034187 Aug 23 11:29:54.035749 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3645/7237] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:29:54.052415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:54.053074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:54.059960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:54.060456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:54.060934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:54.061648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:54.062126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:54.062568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:54.126799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:54.135105 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d2ca16e-485b-4e18-843a-999e698a2408 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1224 microversion: 2.1 time: 0.086455 Aug 23 11:29:54.135702 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3593/7238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:54 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:55.158192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:55.158940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:55.165246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:55.165681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:55.166124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:55.166826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:55.167327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:55.167723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:55.241495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:55.250288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4daf4d8-7d9c-4663-be6a-13172b1bb338 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1224 microversion: 2.1 time: 0.098245 Aug 23 11:29:55.251197 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3646/7239] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:55 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:56.271937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:56.272491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:56.280245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:56.280773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:56.281231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:56.281955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:56.282426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:56.282867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:56.345905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:56.354411 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-71f5b913-8d25-42a1-a13f-152650cc4ae1 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1224 microversion: 2.1 time: 0.086460 Aug 23 11:29:56.355262 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3594/7240] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:56 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:57.376365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:57.377023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:57.383916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:57.384433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:57.384895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:57.385591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:57.386047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:57.386470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:57.449033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:57.463766 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17c4d5ce-cba2-4622-9ba3-a761ce79929c tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1224 microversion: 2.1 time: 0.085691 Aug 23 11:29:57.464388 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3647/7241] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:57 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:58.486212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:58.486874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:58.494382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:58.494818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:58.495276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:58.496002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:58.496474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:58.496985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:58.529297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:58.529801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:58.530252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:58.530720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lazy-loading 'fault' on Instance uuid aa731676-57de-486a-9237-a7ba9b5392ee {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:29:58.577831 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58a1b5d0b7554edb95e5e994d7cc60d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd50d08d128e9423b81be170a4ccd3fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:29:58.585789 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b870f67-bc7b-4dec-b85f-3ca2411b93de tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 200 len: 1229 microversion: 2.1 time: 0.104450 Aug 23 11:29:58.586372 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3595/7242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:58 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:29:59.606411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:29:59.607177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: aa731676-57de-486a-9237-a7ba9b5392ee] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:29:59.614121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:59.614618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:59.615062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:59.615772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:29:59.616236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:29:59.616674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:29:59.632833 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance aa731676-57de-486a-9237-a7ba9b5392ee could not be found. Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee HTTP/1.1 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance aa731676-57de-486a-9237-a7ba9b5392ee could not be found. Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'aa731676-57de-486a-9237-a7ba9b5392ee'} Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa731676-57de-486a-9237-a7ba9b5392ee could not be found. Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa731676-57de-486a-9237-a7ba9b5392ee could not be found. Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:29:59.634481 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa731676-57de-486a-9237-a7ba9b5392ee could not be found. Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance aa731676-57de-486a-9237-a7ba9b5392ee could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4087e289-0a4f-4b6d-b9b9-c7e8872e9697 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee" status: 404 len: 111 microversion: 2.1 time: 0.033517 Aug 23 11:29:59.639015 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3648/7243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:29:59 2022] GET /compute/v2.1/servers/aa731676-57de-486a-9237-a7ba9b5392ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:30:00.085511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:00.086028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:00.093204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:00.093716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:00.094180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:00.094899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:00.095388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:00.095841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:00.112930 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea HTTP/1.1 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea'} Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:30:00.114637 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-18c1ab87-39cf-4fdb-905a-addf05224eaf tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 404 len: 111 microversion: 2.1 time: 0.034592 Aug 23 11:30:00.118839 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3596/7244] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:30:00 2022] DELETE /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:30:00.125526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:00.126139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [instance: fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:00.132037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:00.132531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:00.133011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:00.133709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:00.134173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:00.134629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:00.148402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] HTTP exception thrown: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Request method failure captured: Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea HTTP/1.1 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLd3dwYaIhM7xoeIDvF3BfKjkLTKYCvZ476b9n6bUnFPYu-89lch4YZxAh5omOKhDeB4kLwIRrJkfSWTppg-aWIkoEcATZwFWYr30cDW1lMF5GXwuCEp78lMjtyCCmvsaMeJ2kLBAwviXjGHX1jzRhHTfG59VbZ5NlzYqAr_nB3faXU Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d50d08d128e9423b81be170a4ccd3fab", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d50d08d128e9423b81be170a4ccd3fab"}]}] Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestVolumeBootPattern-642400909 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: d50d08d128e9423b81be170a4ccd3fab Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestVolumeBootPattern-642400909 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 58a1b5d0b7554edb95e5e994d7cc60d1 Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestVolumeBootPattern-642400909-project Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea'} Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:00.150429 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Returning 404 to user: Instance fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5fa5f03e-d00f-4bcd-bf71-286d8a430182 tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea" status: 404 len: 111 microversion: 2.1 time: 0.030815 Aug 23 11:30:00.155152 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3649/7245] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:00 2022] GET /compute/v2.1/servers/fc6edaf7-e2dc-4896-a6e7-9c5dc6bb3aea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:30:03.567269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae657689-76ef-4dea-8e8e-a50b0c42bb3d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] Calling method '.version_select at 0x7fdc9cd298b0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:03.571920 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae657689-76ef-4dea-8e8e-a50b0c42bb3d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [d73e0466-0d6a-4291-a236-cccd3fdc3fb4] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:30:04.579180 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae657689-76ef-4dea-8e8e-a50b0c42bb3d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] [d73e0466-0d6a-4291-a236-cccd3fdc3fb4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42812. Aug 23 11:30:04.599003 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae657689-76ef-4dea-8e8e-a50b0c42bb3d tempest-TestVolumeBootPattern-642400909 tempest-TestVolumeBootPattern-642400909-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-140011592" status: 202 len: 0 microversion: 2.1 time: 1.035816 Aug 23 11:30:04.599592 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3597/7246] 10.222.0.78 () {58 vars in 1260 bytes} [Tue Aug 23 11:30:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-140011592 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:30:23.143838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=26 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:23.144574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=54 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:23.256484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-793152687", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:23.313136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] validate_networks() for None {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:30:23.505400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:30:23.505855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:30:23.506340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:30:23.506760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:30:23.507182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:30:23.516142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:23.516634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:23.517115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:23.517856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:23.518323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:23.518756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:23.536580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Getting quotas for project f6a6042de1934a65894e0b8794f796bf. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:30:23.541876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Getting quotas for user ffd7af607de946b88f07b0ce64c2ff2e and project f6a6042de1934a65894e0b8794f796bf. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:30:23.554844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:30:23.557174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:30:23.599114 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:30:24.606780 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42910. Aug 23 11:30:24.611116 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1253aab4-b3b5-485d-81c4-504d4d5e24ff tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472253 Aug 23 11:30:24.611807 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3650/7247] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:30:24.622771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:24.623599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:24.628890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4eff2c23-27b2-4838-8b2d-a779c82d29c5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:24.629523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4eff2c23-27b2-4838-8b2d-a779c82d29c5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:24.694008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4eff2c23-27b2-4838-8b2d-a779c82d29c5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:24.703404 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4eff2c23-27b2-4838-8b2d-a779c82d29c5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1221 microversion: 2.1 time: 0.083055 Aug 23 11:30:24.704977 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3598/7248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:24 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:25.726135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:25.727614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:25.735643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:25.736226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:25.736778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:25.737565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:25.738733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:25.739172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:25.809842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:25.817856 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1deec43e-bc0a-4777-8b29-ac05d184fff5 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1291 microversion: 2.1 time: 0.096828 Aug 23 11:30:25.818429 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3651/7249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:25 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:26.842691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:26.843472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:26.850549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:26.851057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:26.851517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:26.852339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:26.852841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:26.853293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:27.060825 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:27.068868 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f0acc5e-7d1c-4a1e-87b5-7379632d575b tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.232097 Aug 23 11:30:27.069456 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3599/7250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:26 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:27.314468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3749c934-076f-4d11-8aac-623033cd0164 req-704f4b6d-aca6-4357-84b4-fbf4d0361e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf31bf86-0532-41c5-be0b-63fcb6ed663b", "tag": "36a56a9e-8e79-448e-83b7-768fcf9495b0"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:27.325090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3749c934-076f-4d11-8aac-623033cd0164 req-704f4b6d-aca6-4357-84b4-fbf4d0361e92 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:27.325777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3749c934-076f-4d11-8aac-623033cd0164 req-704f4b6d-aca6-4357-84b4-fbf4d0361e92 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:27.326255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3749c934-076f-4d11-8aac-623033cd0164 req-704f4b6d-aca6-4357-84b4-fbf4d0361e92 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:27.339943 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3749c934-076f-4d11-8aac-623033cd0164 req-704f4b6d-aca6-4357-84b4-fbf4d0361e92 service nova] Creating event network-changed:36a56a9e-8e79-448e-83b7-768fcf9495b0 for instance bf31bf86-0532-41c5-be0b-63fcb6ed663b on n-h2-847009-13 Aug 23 11:30:27.346382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3749c934-076f-4d11-8aac-623033cd0164 req-704f4b6d-aca6-4357-84b4-fbf4d0361e92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035600 Aug 23 11:30:27.347014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3652/7251] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:30:28.090057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:28.090961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:28.098066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:28.098568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:28.099021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:28.099730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:28.100200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:28.100642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:28.237880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:28.245992 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc3fce61-cc55-4b8c-b3a6-20a404dc5c3c tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.160029 Aug 23 11:30:28.247095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3600/7252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:28 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:30:29.268953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:29.269591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:29.276583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:29.277119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:29.277568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:29.278893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:29.279356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:29.279792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:29.412089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:29.419853 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b59676d-4d2b-4ecb-b7f3-4192e1198678 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.155204 Aug 23 11:30:29.420514 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3653/7253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:29 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:30.439973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:30.440604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:30.447625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:30.448123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:30.448577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:30.449314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:30.449949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:30.450393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:30.584952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:30.593844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8777a8a0-a531-4645-81ca-fd765ba211c7 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.158065 Aug 23 11:30:30.594412 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3601/7254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:30 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:31.614223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:31.614782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:31.621906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:31.622411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:31.622857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:31.623560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:31.624019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:31.624446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:31.758224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:31.766630 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-96b7ae68-d21f-4c1d-861d-06b3bd517e2f tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.156466 Aug 23 11:30:31.767209 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3654/7255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:31 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:32.788007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:32.788644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:32.796513 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:32.797046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:32.797503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:32.798218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:32.798697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:32.799143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:32.942165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:32.950730 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6670238b-8e09-4e11-bcf8-8873510e81aa tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.166731 Aug 23 11:30:32.951389 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3602/7256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:32 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:33.045137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d40f3ead-0dbd-4bfc-807a-22963f11e976 req-20f84dc2-e3d2-4843-968e-26f263d921a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf31bf86-0532-41c5-be0b-63fcb6ed663b", "name": "network-vif-plugged", "status": "completed", "tag": "36a56a9e-8e79-448e-83b7-768fcf9495b0"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:33.055777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d40f3ead-0dbd-4bfc-807a-22963f11e976 req-20f84dc2-e3d2-4843-968e-26f263d921a6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:33.056295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d40f3ead-0dbd-4bfc-807a-22963f11e976 req-20f84dc2-e3d2-4843-968e-26f263d921a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:33.056725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d40f3ead-0dbd-4bfc-807a-22963f11e976 req-20f84dc2-e3d2-4843-968e-26f263d921a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:33.067926 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d40f3ead-0dbd-4bfc-807a-22963f11e976 req-20f84dc2-e3d2-4843-968e-26f263d921a6 service nova] Creating event network-vif-plugged:36a56a9e-8e79-448e-83b7-768fcf9495b0 for instance bf31bf86-0532-41c5-be0b-63fcb6ed663b on n-h2-847009-13 Aug 23 11:30:33.072819 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d40f3ead-0dbd-4bfc-807a-22963f11e976 req-20f84dc2-e3d2-4843-968e-26f263d921a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Aug 23 11:30:33.073615 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3655/7257] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:33.972332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:33.972995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:33.979917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:33.980425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:33.981937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:33.982677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:33.983161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:33.983613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:34.113099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:34.120775 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b843b2e0-46df-4832-8e63-1965f90b58d8 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1321 microversion: 2.1 time: 0.152477 Aug 23 11:30:34.121719 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3603/7258] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:33 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:35.138850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:35.139639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:35.145004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:35.145714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:35.152462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.153611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.154197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.164025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.164503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.164971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.298718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:35.306481 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e51a4933-e4a5-4d87-8a59-55c6cea6fdbf tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1469 microversion: 2.1 time: 0.168624 Aug 23 11:30:35.307064 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3656/7259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:35 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:35.330917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:35.387652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbab4b34-81c6-4c00-864d-87d91216720e tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Calling method '.version_select at 0x7fdc9c3eb940>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:35.453558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbab4b34-81c6-4c00-864d-87d91216720e tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0b64d5d8598140b886614a166d0c3bda" status: 200 len: 371 microversion: 2.1 time: 0.127561 Aug 23 11:30:35.454135 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3604/7260] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 11:30:35 2022] GET /compute/v2.1/os-quota-sets/0b64d5d8598140b886614a166d0c3bda => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:35.466121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c32ff1b9-90e1-48da-82c7-1d2af6b077c2 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-69330534", "id": 2141565514, "os-flavor-access:is_public": "True"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:35.469296 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:30:35.469296 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:30:35.485102 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c32ff1b9-90e1-48da-82c7-1d2af6b077c2 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.023412 Aug 23 11:30:35.485679 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3657/7261] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:30:35 2022] POST /compute/v2.1/flavors => generated 436 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:35.497930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2141565514"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:35.500135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:35.506353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.506853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.507305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.508013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.508481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.508955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.597559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '358680b9e2d94b53bea515a2160d8ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b64d5d8598140b886614a166d0c3bda', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:35.604021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-69330534 {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:30:35.611564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.612064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.612521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.613315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.613794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.614232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.634360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Getting quotas for project f6a6042de1934a65894e0b8794f796bf. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:30:35.639925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Getting quotas for user ffd7af607de946b88f07b0ce64c2ff2e and project f6a6042de1934a65894e0b8794f796bf. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:30:35.651704 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.compute.api [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] ram quota exceeded for 0b64d5d8598140b886614a166d0c3bda, tried to resize instance. Aug 23 11:30:35.652256 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Request method failure captured: Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b/action HTTP/1.1 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 39 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLpO1tEqWijyBLoc2C0NZ5tXtBnD7FmQMl3TkCS_ZFtwtUHpY3refho21M5qoSgAdp1ixUhnrMdY0ImZOLdJpAuc_VGUpLToPddkkMBI_CPHbFHZ3U9rGe1TZTaNiyeGkeChOo-e5wMFBx7U9iwiZJr46T8T6gN7x0G9Zb_xF-Ulp64 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 0b64d5d8598140b886614a166d0c3bda Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-803889421 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader,admin Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader,admin Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0b64d5d8598140b886614a166d0c3bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0b64d5d8598140b886614a166d0c3bda", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0b64d5d8598140b886614a166d0c3bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0b64d5d8598140b886614a166d0c3bda"}]}] Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersAdminNegativeTestJSON-803889421 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 0b64d5d8598140b886614a166d0c3bda Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-803889421 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersAdminNegativeTestJSON-803889421-project-admin Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 358680b9e2d94b53bea515a2160d8ec0 Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersAdminNegativeTestJSON-803889421-project-admin Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: {"resize": {"flavorRef": "2141565514"}} Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'bf31bf86-0532-41c5-be0b-63fcb6ed663b', 'body': {'resize': {'flavorRef': '2141565514'}}} Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:30:35.662558 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5587fd4c-59aa-422e-be18-a2163abf3f53 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b/action" status: 403 len: 118 microversion: 2.1 time: 0.170736 Aug 23 11:30:35.667324 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3605/7262] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:30:35 2022] POST /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b/action => generated 118 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:30:35.673718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b97bf904-7404-4ac1-80f7-4b0ecffeff43 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:35.674500 n-d-847009-13 devstack@n-api.service[128859]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:30:35.674500 n-d-847009-13 devstack@n-api.service[128859]: warnings.warn(msg) Aug 23 11:30:35.690775 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b97bf904-7404-4ac1-80f7-4b0ecffeff43 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2141565514" status: 202 len: 0 microversion: 2.1 time: 0.020799 Aug 23 11:30:35.691380 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3658/7263] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 11:30:35 2022] DELETE /compute/v2.1/flavors/2141565514 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:30:35.699966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4e70a1ec-4854-415c-b4a0-6280aab52796 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:35.720633 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4e70a1ec-4854-415c-b4a0-6280aab52796 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024801 Aug 23 11:30:35.721220 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3606/7264] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 11:30:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:35.740753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0c3a2daa-bdbb-4a6c-9c98-89f35ffa8e15 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Calling method '.version_select at 0x7fdc8f51e550>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:35.810155 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0c3a2daa-bdbb-4a6c-9c98-89f35ffa8e15 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0b64d5d8598140b886614a166d0c3bda" status: 200 len: 371 microversion: 2.1 time: 0.073051 Aug 23 11:30:35.810754 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3659/7265] 10.222.0.78 () {58 vars in 1242 bytes} [Tue Aug 23 11:30:35 2022] GET /compute/v2.1/os-quota-sets/0b64d5d8598140b886614a166d0c3bda => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:35.821944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbae3cde-ee95-4ff6-aa66-90c67aacbcd9 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-724111271", "id": 1755165647, "os-flavor-access:is_public": "True"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:35.825051 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:30:35.825051 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:30:35.839907 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dbae3cde-ee95-4ff6-aa66-90c67aacbcd9 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021736 Aug 23 11:30:35.841029 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3607/7266] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:30:35 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:35.852527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1755165647"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:35.854856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:35.861713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.862203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.862648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.863350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.863816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.864251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.952815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '358680b9e2d94b53bea515a2160d8ec0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b64d5d8598140b886614a166d0c3bda', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:35.959296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-724111271 {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:30:35.967118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.967864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.968314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.969076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:35.969585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:35.970016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:35.990110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Getting quotas for project f6a6042de1934a65894e0b8794f796bf. Resources: {'ram', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:30:35.995179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Getting quotas for user ffd7af607de946b88f07b0ce64c2ff2e and project f6a6042de1934a65894e0b8794f796bf. Resources: {'ram', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:30:36.007189 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.compute.api [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] cores quota exceeded for 0b64d5d8598140b886614a166d0c3bda, tried to resize instance. Aug 23 11:30:36.007946 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Request method failure captured: Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b/action HTTP/1.1 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 39 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLpO1tEqWijyBLoc2C0NZ5tXtBnD7FmQMl3TkCS_ZFtwtUHpY3refho21M5qoSgAdp1ixUhnrMdY0ImZOLdJpAuc_VGUpLToPddkkMBI_CPHbFHZ3U9rGe1TZTaNiyeGkeChOo-e5wMFBx7U9iwiZJr46T8T6gN7x0G9Zb_xF-Ulp64 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0b64d5d8598140b886614a166d0c3bda Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-803889421 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader,admin Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader,admin Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0b64d5d8598140b886614a166d0c3bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0b64d5d8598140b886614a166d0c3bda", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0b64d5d8598140b886614a166d0c3bda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0b64d5d8598140b886614a166d0c3bda"}]}] Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-803889421 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0b64d5d8598140b886614a166d0c3bda Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-803889421 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-803889421-project-admin Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 358680b9e2d94b53bea515a2160d8ec0 Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-803889421-project-admin Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: {"resize": {"flavorRef": "1755165647"}} Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'bf31bf86-0532-41c5-be0b-63fcb6ed663b', 'body': {'resize': {'flavorRef': '1755165647'}}} Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:30:36.021135 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-760d74ab-cd73-4482-b8e4-e879f1f8fc52 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b/action" status: 403 len: 113 microversion: 2.1 time: 0.173847 Aug 23 11:30:36.024971 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3660/7267] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:30:35 2022] POST /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b/action => generated 113 bytes in 175 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:30:36.032017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54059386-8595-4510-a1ad-4e4d53cf5a34 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:36.032806 n-d-847009-13 devstack@n-api.service[128860]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 11:30:36.032806 n-d-847009-13 devstack@n-api.service[128860]: warnings.warn(msg) Aug 23 11:30:36.049108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54059386-8595-4510-a1ad-4e4d53cf5a34 tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1755165647" status: 202 len: 0 microversion: 2.1 time: 0.021570 Aug 23 11:30:36.049687 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3608/7268] 10.222.0.78 () {58 vars in 1161 bytes} [Tue Aug 23 11:30:36 2022] DELETE /compute/v2.1/flavors/1755165647 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:30:36.057408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-edc86193-b3de-40db-8d33-e3770eb9833c tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:36.078249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-edc86193-b3de-40db-8d33-e3770eb9833c tempest-ServersAdminNegativeTestJSON-803889421 tempest-ServersAdminNegativeTestJSON-803889421-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024428 Aug 23 11:30:36.078831 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3661/7269] 10.222.0.78 () {58 vars in 1146 bytes} [Tue Aug 23 11:30:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:36.099125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:36.099635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:36.106198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:36.106804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:36.107256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:36.107962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:36.108440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:36.108911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:36.134246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:30:36.209933 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb641b25-16ea-4d9a-98f6-3727310f0526 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 204 len: 0 microversion: 2.1 time: 0.114498 Aug 23 11:30:36.210710 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3609/7270] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:30:36 2022] DELETE /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:30:36.221735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:36.222441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:36.229746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:36.230229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:36.231182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:36.231881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:36.232344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:36.232781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:36.365970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:36.374686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f477689-eb84-47bb-b27d-9c7cbca02b46 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1475 microversion: 2.1 time: 0.159467 Aug 23 11:30:36.375259 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3662/7271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:36 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:30:37.397296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:37.397972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:37.405390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:37.405902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:37.406362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:37.407083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:37.407561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:37.408010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:37.542176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:37.550029 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1aa540ad-7eb4-4e4f-9a72-cb5563d6e141 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1475 microversion: 2.1 time: 0.157232 Aug 23 11:30:37.550602 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3610/7272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:37 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1475 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:38.157502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-224e4bcf-56dd-412f-b86c-ba2068653b4a req-9bbda858-240b-4d4f-837c-c6e1e0f4bf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf31bf86-0532-41c5-be0b-63fcb6ed663b", "name": "network-vif-deleted", "tag": "36a56a9e-8e79-448e-83b7-768fcf9495b0"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:38.174067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-224e4bcf-56dd-412f-b86c-ba2068653b4a req-9bbda858-240b-4d4f-837c-c6e1e0f4bf2b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:38.174654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-224e4bcf-56dd-412f-b86c-ba2068653b4a req-9bbda858-240b-4d4f-837c-c6e1e0f4bf2b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:38.175174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-224e4bcf-56dd-412f-b86c-ba2068653b4a req-9bbda858-240b-4d4f-837c-c6e1e0f4bf2b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:38.187423 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-224e4bcf-56dd-412f-b86c-ba2068653b4a req-9bbda858-240b-4d4f-837c-c6e1e0f4bf2b service nova] Creating event network-vif-deleted:36a56a9e-8e79-448e-83b7-768fcf9495b0 for instance bf31bf86-0532-41c5-be0b-63fcb6ed663b on n-h2-847009-13 Aug 23 11:30:38.192732 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-224e4bcf-56dd-412f-b86c-ba2068653b4a req-9bbda858-240b-4d4f-837c-c6e1e0f4bf2b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039994 Aug 23 11:30:38.193606 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3663/7273] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:38.570833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:38.571401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:38.579328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:38.579837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:38.580303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:38.581045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:38.581523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:38.581969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:38.613938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:38.614444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:38.614898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:38.615368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lazy-loading 'fault' on Instance uuid bf31bf86-0532-41c5-be0b-63fcb6ed663b {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:30:38.658676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd7af607de946b88f07b0ce64c2ff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a6042de1934a65894e0b8794f796bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:38.666717 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cb2372a-7eb8-4b02-9f6c-d53a7b9af6ca tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 200 len: 1311 microversion: 2.1 time: 0.099978 Aug 23 11:30:38.667913 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3611/7274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:38 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:39.688861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:39.689574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] [instance: bf31bf86-0532-41c5-be0b-63fcb6ed663b] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:39.695743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:39.696228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:39.696675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:39.697398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:39.697863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:39.698295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:39.712254 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] HTTP exception thrown: Instance bf31bf86-0532-41c5-be0b-63fcb6ed663b could not be found. Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Request method failure captured: Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b HTTP/1.1 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLpOqKafH1Z0gcl3VH0cGDPGXvUEPHGJKPD6epM6LKPwIek58TVVgKYR1gZ5FK2SJAoPHi44jHQFAabyIFYERG0MpdRTiJUhgC53H4IKuYsQN1Clw-GVKPO199fLYGoO-xJ2SC9_DYNC3tyMqvy7mPgeUQUnEtld0E4jNQvj6F80blk Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: f6a6042de1934a65894e0b8794f796bf Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-797273511 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f6a6042de1934a65894e0b8794f796bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f6a6042de1934a65894e0b8794f796bf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6a6042de1934a65894e0b8794f796bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f6a6042de1934a65894e0b8794f796bf"}]}] Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersAdminNegativeTestJSON-797273511 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: f6a6042de1934a65894e0b8794f796bf Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-797273511 Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersAdminNegativeTestJSON-797273511-project Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: ffd7af607de946b88f07b0ce64c2ff2e Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersAdminNegativeTestJSON-797273511-project Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance bf31bf86-0532-41c5-be0b-63fcb6ed663b could not be found. Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'bf31bf86-0532-41c5-be0b-63fcb6ed663b'} Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf31bf86-0532-41c5-be0b-63fcb6ed663b could not be found. Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf31bf86-0532-41c5-be0b-63fcb6ed663b could not be found. Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:39.713918 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf31bf86-0532-41c5-be0b-63fcb6ed663b could not be found. Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] Returning 404 to user: Instance bf31bf86-0532-41c5-be0b-63fcb6ed663b could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d780c227-16b9-4d81-a062-3623c75a1662 tempest-ServersAdminNegativeTestJSON-797273511 tempest-ServersAdminNegativeTestJSON-797273511-project] 10.222.0.78 "GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b" status: 404 len: 111 microversion: 2.1 time: 0.032096 Aug 23 11:30:39.718714 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3664/7275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:39 2022] GET /compute/v2.1/servers/bf31bf86-0532-41c5-be0b-63fcb6ed663b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:30:46.276559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:46.278221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:46.400072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1422902484", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "e5cca308-fba8-45d8-8c6f-668c1ef24fb0"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:46.471283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] validate_networks() for [('e5cca308-fba8-45d8-8c6f-668c1ef24fb0', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:30:46.919390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:30:46.919952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:30:46.920446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:30:46.920899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:30:46.921331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:30:46.930332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:46.930833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:46.931282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:46.932024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:46.932490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:46.932953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:46.951243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Getting quotas for project 18d4cf059e4c470a84dea398142a4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:30:46.959304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Getting quotas for user 6c0c1f9719894cc98ca5b059dc5339f1 and project 18d4cf059e4c470a84dea398142a4fc7. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:30:46.974022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:30:46.976604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:30:47.034891 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-acd5de06-4748-4518-9d2c-12c95897a7fc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763857 Aug 23 11:30:47.035602 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3612/7276] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:30:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:30:47.047574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9be22de3-c0dc-415e-84fb-36b5caf295de tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:47.048457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9be22de3-c0dc-415e-84fb-36b5caf295de tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:47.051623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:47.052323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:47.109195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9be22de3-c0dc-415e-84fb-36b5caf295de tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:47.116016 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9be22de3-c0dc-415e-84fb-36b5caf295de tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1215 microversion: 2.1 time: 0.073313 Aug 23 11:30:47.116592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3665/7277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:47 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:48.139152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-31af538a-1dc3-4c74-845a-aed7c2e5ac18 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:48.140556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-31af538a-1dc3-4c74-845a-aed7c2e5ac18 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:48.208429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-31af538a-1dc3-4c74-845a-aed7c2e5ac18 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:48.215909 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-31af538a-1dc3-4c74-845a-aed7c2e5ac18 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1215 microversion: 2.1 time: 0.082655 Aug 23 11:30:48.216507 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3613/7278] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:48 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:49.237128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-74ed6ea9-3383-47bc-aaad-f491aa6b1999 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:49.237755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-74ed6ea9-3383-47bc-aaad-f491aa6b1999 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:49.302211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-74ed6ea9-3383-47bc-aaad-f491aa6b1999 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:49.311041 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-74ed6ea9-3383-47bc-aaad-f491aa6b1999 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1215 microversion: 2.1 time: 0.077208 Aug 23 11:30:49.311560 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3666/7279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:49 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:50.332935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5b91097b-7fb4-4055-8a66-144745b96f3f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:50.333654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5b91097b-7fb4-4055-8a66-144745b96f3f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:50.394409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5b91097b-7fb4-4055-8a66-144745b96f3f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:50.401579 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5b91097b-7fb4-4055-8a66-144745b96f3f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1215 microversion: 2.1 time: 0.072986 Aug 23 11:30:50.402245 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3614/7280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:50 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:51.424642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:51.425328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:51.427171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=53 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:51.433380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:51.434023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:51.434579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:51.435286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:51.435754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:51.436217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:51.498003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:51.505783 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c5e46a7f-8f12-482b-947c-29e1024975a0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1219 microversion: 2.1 time: 0.085061 Aug 23 11:30:51.506362 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3667/7281] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:51 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:52.526687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:52.528397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:52.535608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:52.536105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:52.536558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:52.537290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:52.537761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:52.538206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:52.689136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:52.707809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b229c004-be44-4832-80c5-8fd55f1cf1d7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1275 microversion: 2.1 time: 0.176781 Aug 23 11:30:52.708503 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3615/7282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:52 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1275 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:53.729905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:53.730966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:53.736842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:53.738950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:53.739583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:53.740009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:53.740933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:53.741398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:53.742005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:53.879887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:53.888837 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d0ae295-7261-4607-8165-a2ef5bb3aa52 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1315 microversion: 2.1 time: 0.162853 Aug 23 11:30:53.893772 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3668/7283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:53 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:53.970228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e3bff360-f2e5-47b9-ac8d-20f6ab2ffe05 req-1d806306-b90c-4936-9f1b-11dd1cb34156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c90546-8598-4414-be2b-beccc7c9acfc", "tag": "1406bf63-eb10-49fb-ad07-717bee6191e4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:53.987264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e3bff360-f2e5-47b9-ac8d-20f6ab2ffe05 req-1d806306-b90c-4936-9f1b-11dd1cb34156 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:53.987855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e3bff360-f2e5-47b9-ac8d-20f6ab2ffe05 req-1d806306-b90c-4936-9f1b-11dd1cb34156 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:53.988320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e3bff360-f2e5-47b9-ac8d-20f6ab2ffe05 req-1d806306-b90c-4936-9f1b-11dd1cb34156 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:54.000197 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e3bff360-f2e5-47b9-ac8d-20f6ab2ffe05 req-1d806306-b90c-4936-9f1b-11dd1cb34156 service nova] Creating event network-changed:1406bf63-eb10-49fb-ad07-717bee6191e4 for instance 28c90546-8598-4414-be2b-beccc7c9acfc on n-h2-847009-13 Aug 23 11:30:54.005351 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e3bff360-f2e5-47b9-ac8d-20f6ab2ffe05 req-1d806306-b90c-4936-9f1b-11dd1cb34156 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039032 Aug 23 11:30:54.006346 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3616/7284] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:54.909807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:54.910348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:54.917298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:54.917793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:54.918240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:54.918948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:54.919415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:54.919853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:55.056758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:55.065048 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b9dd3506-7f3e-4e13-8bf9-3d74504f6fc7 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1315 microversion: 2.1 time: 0.159214 Aug 23 11:30:55.065617 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3669/7285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:54 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:56.087989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:56.088722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:56.091380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:56.097414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:56.097956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:56.098418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:56.099152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:56.099630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:56.100079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:56.106703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:56.243282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:56.251633 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-450697ac-439d-43ed-b38a-54b5d3c0e8bb tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1315 microversion: 2.1 time: 0.168885 Aug 23 11:30:56.252209 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3617/7286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:56 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:57.273470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:57.274082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:57.281509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:57.281990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:57.282422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:57.283115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:57.283569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:57.283991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:57.426092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:57.435359 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4cf1bc24-6b7a-4399-a567-e6e62638fb4a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1315 microversion: 2.1 time: 0.165679 Aug 23 11:30:57.435942 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3670/7287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:57 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:58.455909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:58.456549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:58.458667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:30:58.465244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:58.465783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:58.466243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:58.466964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:58.468300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:58.468802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:58.597433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:58.605102 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed0f9467-1d34-40fd-8294-f13c714392c2 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1315 microversion: 2.1 time: 0.153245 Aug 23 11:30:58.605675 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3618/7288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:58 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:30:59.141766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-79f57cee-1e96-4df5-ac37-7d6c9142d34d req-559ebc7d-ae0a-45e7-96b8-d0ac0fbf3c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c90546-8598-4414-be2b-beccc7c9acfc", "name": "network-vif-plugged", "status": "completed", "tag": "1406bf63-eb10-49fb-ad07-717bee6191e4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:30:59.155275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-79f57cee-1e96-4df5-ac37-7d6c9142d34d req-559ebc7d-ae0a-45e7-96b8-d0ac0fbf3c9d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:59.155857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-79f57cee-1e96-4df5-ac37-7d6c9142d34d req-559ebc7d-ae0a-45e7-96b8-d0ac0fbf3c9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:59.156785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-79f57cee-1e96-4df5-ac37-7d6c9142d34d req-559ebc7d-ae0a-45e7-96b8-d0ac0fbf3c9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:59.168930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-79f57cee-1e96-4df5-ac37-7d6c9142d34d req-559ebc7d-ae0a-45e7-96b8-d0ac0fbf3c9d service nova] Creating event network-vif-plugged:1406bf63-eb10-49fb-ad07-717bee6191e4 for instance 28c90546-8598-4414-be2b-beccc7c9acfc on n-h2-847009-13 Aug 23 11:30:59.174647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-79f57cee-1e96-4df5-ac37-7d6c9142d34d req-559ebc7d-ae0a-45e7-96b8-d0ac0fbf3c9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037401 Aug 23 11:30:59.175547 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3671/7289] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:30:59.626742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:30:59.627283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:30:59.635033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:59.635549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:59.636030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:59.636759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:30:59.637255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:30:59.637704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:30:59.767105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:30:59.774943 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4abf57ee-bc6e-43ce-9bf8-50ed34e6c660 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1315 microversion: 2.1 time: 0.152270 Aug 23 11:30:59.775527 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3619/7290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:30:59 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:00.796961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:00.797800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:00.799801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:00.806342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:00.806836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:00.807285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:00.808011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:00.808477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:00.808942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:00.942224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:00.949890 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b80b6754-8102-4360-b7fd-509c79dfd92b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1500 microversion: 2.1 time: 0.157692 Aug 23 11:31:00.950464 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3672/7291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:00 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:00.971536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:00.973929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:00.975787 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=10 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:00.982142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:00.982633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:00.983098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:00.983945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:00.984586 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:00.985070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:01.016664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:01.022480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Old instance type m1.heat2, new instance type m1.heat {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:31:01.028883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:31:01.029325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:31:01.029818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:31:01.030295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:31:01.030774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:31:01.093331 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-75188dfa-0ccc-4442-b8d2-85639191717b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "POST /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc/action" status: 202 len: 0 microversion: 2.1 time: 0.126426 Aug 23 11:31:01.093978 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3620/7292] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:31:00 2022] POST /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:31:01.102225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:01.102874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:01.109147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:01.109602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:01.110307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:01.111104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:01.112110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:01.112110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:01.253936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:01.261871 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46926c00-34e1-49a4-9661-8bbac230f368 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1509 microversion: 2.1 time: 0.163469 Aug 23 11:31:01.262592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3673/7293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:01 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:02.284525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:02.285290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:02.291333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:02.291858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:02.292356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:02.293074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:02.293545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:02.293984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:02.428495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:02.436304 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-505dc7b7-5b0b-4a40-a8d7-72a1fed00ce1 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1509 microversion: 2.1 time: 0.157143 Aug 23 11:31:02.436918 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3621/7294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:02 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:03.458353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:03.459000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:03.466309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:03.466805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:03.467500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:03.468193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:03.468652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:03.469365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:03.602652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:03.610829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4029033-2b5b-47d1-84e0-61425154c457 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.157465 Aug 23 11:31:03.611402 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3674/7295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:03 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:31:04.632580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:04.633239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:04.639483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:04.639982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:04.640439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:04.641967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:04.642514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:04.642909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:04.773388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:04.781091 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ba2ed840-7b91-42e3-821b-920c840de4c3 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.152702 Aug 23 11:31:04.782829 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3622/7296] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:04 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:05.803981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:05.804514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:05.811636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:05.812113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:05.812622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:05.813506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:05.813970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:05.814389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:05.946604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:05.955199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e94e85bc-115a-4070-8b32-f8ef467bcd31 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.155310 Aug 23 11:31:05.955775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3675/7297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:05 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:06.975850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:06.976964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:06.983924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:06.984452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:06.984931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:06.985723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:06.986195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:06.986638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:07.129904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:07.137760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-15d0dd2e-9f1b-4a3c-85f4-c125fc381055 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.166121 Aug 23 11:31:07.138338 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3623/7298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:06 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:08.160442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:08.161077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:08.167048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:08.167531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:08.167970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:08.168659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:08.169140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:08.169566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:08.302960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:08.310633 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f8c1036b-aa3d-410f-b59f-33bff55fa890 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.155027 Aug 23 11:31:08.311196 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3676/7299] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:08 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:09.332093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:09.332725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:09.339665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:09.340163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:09.340614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:09.341343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:09.341816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:09.342512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:09.472004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:09.479764 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1204e0f1-9c5c-4b36-8f7b-bf2eae9edccc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.152379 Aug 23 11:31:09.480346 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3624/7300] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:09 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:10.501871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:10.502523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:10.509615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:10.510109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:10.510554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:10.511268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:10.511732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:10.512163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:10.645679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:10.653465 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4c3f25bc-8114-4610-b9c4-6fb15d12a922 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.156588 Aug 23 11:31:10.654045 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3677/7301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:10 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:31:11.675012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:11.675649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:11.682841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:11.683352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:11.683819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:11.684540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:11.685041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:11.685491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:11.825774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:11.833896 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a1ea3b2-189a-4958-878c-d8306fe30117 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.163006 Aug 23 11:31:11.834479 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3625/7302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:11 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:12.855545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:12.856158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:12.863160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:12.863644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:12.864077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:12.864789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:12.865280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:12.865704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:13.006570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:13.014205 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3388c825-f94f-4a63-b1d3-53fb52d2fc7b tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.162679 Aug 23 11:31:13.014775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3678/7303] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:12 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:14.036341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:14.037000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:14.043919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:14.044422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:14.044899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:14.045597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:14.046066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:14.046503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:14.178691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:14.186352 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-46532a94-1a5b-4fd0-ae69-e2bdb93d435d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.154105 Aug 23 11:31:14.186924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3626/7304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:14 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:31:15.207916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:15.208524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:15.215331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:15.215814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:15.216246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:15.217233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:15.217693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:15.218115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:15.356577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:15.364529 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b937b50f-b47b-41ea-bb6d-39aa82eac744 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.161194 Aug 23 11:31:15.365145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3679/7305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:15 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:16.385754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:16.386285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:16.393598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:16.394096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:16.394544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:16.395247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:16.395715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:16.396154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:16.525988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:16.533967 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8aa0c9bd-23ed-4916-be12-a7730d7adec9 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.152168 Aug 23 11:31:16.534544 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3627/7306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:16 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:17.555311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:17.555919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:17.562761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:17.563244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:17.563681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:17.564379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:17.564866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:17.565297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:17.695772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:17.704077 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b5b28658-63b5-471b-8a80-bdcd72e08c89 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.152634 Aug 23 11:31:17.704655 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3680/7307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:17 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:18.725796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:18.726457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:18.733401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:18.733934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:18.734610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:18.735471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:18.736042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:18.736491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:18.870865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:18.878866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-51c87706-750c-4145-8003-f78f588117b0 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.157515 Aug 23 11:31:18.879444 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3628/7308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:18 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:19.900690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:19.901331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:19.909447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:19.909936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:19.910373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:19.911073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:19.911530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:19.912012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:20.046205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:20.054597 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f81ee77a-60af-4e60-8319-f7efb424721d tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.157806 Aug 23 11:31:20.055183 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3681/7309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:19 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:21.075550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:21.076179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:21.083688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:21.084184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:21.084633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:21.085436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:21.085908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:21.086344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:21.228863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:21.237495 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b32d22e9-85c9-4690-a1bb-82e1132e6021 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.165927 Aug 23 11:31:21.238095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3629/7310] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:21 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:22.260203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:22.260764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:22.268475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:22.268986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:22.269423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:22.270108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:22.270561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:22.270982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:22.273497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=87 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:22.408064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:22.416002 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aa77e681-cf2b-48da-8173-67aec71a689c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.159799 Aug 23 11:31:22.416584 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3682/7311] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:22 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:23.438146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:23.438938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:23.446059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:23.446569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:23.447037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:23.447754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:23.448231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:23.448681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:23.582766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:23.590635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39e411d8-1a13-4c9d-bd45-cf4db403660c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.157183 Aug 23 11:31:23.591214 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3630/7312] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:23 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:24.612111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:24.612837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:24.615595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=30 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:24.621264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:24.621754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:24.622196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:24.622890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:24.623348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:24.623775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:24.756794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:24.764533 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c41de124-d9bf-41f3-aa4d-911aa1e3dc95 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.156617 Aug 23 11:31:24.765145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3683/7313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:24 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:25.786211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:25.786848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:25.793764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:25.794271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:25.794730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:25.795446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:25.795928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:25.796384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:25.925581 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:25.933357 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0654d910-601b-4421-bc15-7b5c31027a51 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.151056 Aug 23 11:31:25.933934 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3631/7314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:25 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:26.955187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:26.955803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:26.962817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:26.963304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:26.963735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:26.964491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:26.964983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:26.965409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:27.102799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:27.111033 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5642377c-f7e7-4ff7-b988-92c81346d0e8 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.160285 Aug 23 11:31:27.111611 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3684/7315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:26 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:28.132261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:28.132952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:28.135755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=34 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:28.142589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:28.143098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:28.143616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:28.144335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:28.144838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:28.145287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:28.147875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:28.286055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:28.293904 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6a2b084-64b9-4aef-9b3b-4cb875e54a71 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.166009 Aug 23 11:31:28.294499 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3632/7316] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:28 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:29.315798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:29.316406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:29.323195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:29.323675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:29.324109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:29.324826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:29.325283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:29.325706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:29.459620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:29.467928 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef938ace-df6e-409f-b412-1ea114621d8c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1514 microversion: 2.1 time: 0.156614 Aug 23 11:31:29.469050 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3685/7317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:29 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:30.490070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:30.490701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:30.497636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:30.498142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:30.498602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:30.499317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:30.500957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:30.501422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:30.709330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:30.717317 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b10433d-6ea9-4e4d-a8ca-7ef46f4b7ef6 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1513 microversion: 2.1 time: 0.230954 Aug 23 11:31:30.717894 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3633/7318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:30 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:31.268333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c90546-8598-4414-be2b-beccc7c9acfc", "name": "network-vif-unplugged", "status": "completed", "tag": "1406bf63-eb10-49fb-ad07-717bee6191e4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:31.278446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:31.279013 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:31.279352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:31.291587 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] Creating event network-vif-unplugged:1406bf63-eb10-49fb-ad07-717bee6191e4 for instance 28c90546-8598-4414-be2b-beccc7c9acfc on n-h1-847009-13 Aug 23 11:31:31.297719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] Instance 28c90546-8598-4414-be2b-beccc7c9acfc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:31:31.308269 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-14e6743e-f452-422e-a04b-8a5ac03f1df2 req-9506243b-86ef-4534-ab92-65da81fcc870 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043642 Aug 23 11:31:31.309206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3686/7319] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:31:31.740213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:31.740884 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:31.747955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:31.748478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:31.749145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:31.750240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:31.750490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:31.750748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:31.959187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:31.968874 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-885303bb-9ffe-4e8f-9384-ae53395f1d40 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1513 microversion: 2.1 time: 0.232237 Aug 23 11:31:31.969463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3634/7320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:31 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:32.991741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:32.992386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:32.998597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:32.999087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:33.000173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:33.000998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:33.001466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:33.001900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:33.144094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:33.152086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef9a8f02-4d26-4090-b42c-58ce1dc3a098 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1511 microversion: 2.1 time: 0.165504 Aug 23 11:31:33.152709 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3687/7321] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:32 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:33.323685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c90546-8598-4414-be2b-beccc7c9acfc", "tag": "1406bf63-eb10-49fb-ad07-717bee6191e4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:33.334647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:33.335140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:33.335582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:33.347364 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] Creating event network-changed:1406bf63-eb10-49fb-ad07-717bee6191e4 for instance 28c90546-8598-4414-be2b-beccc7c9acfc on n-h1-847009-13 Aug 23 11:31:33.352572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] Instance 28c90546-8598-4414-be2b-beccc7c9acfc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:31:33.363527 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-25a121e0-c68a-416f-9784-0ce190e20133 req-59c9336f-c966-4f0c-984c-19a8ea600b91 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043486 Aug 23 11:31:33.364114 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3635/7322] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:31:34.174819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:34.175431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:34.182182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:34.182661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:34.183097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:34.183785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:34.184242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:34.184663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:34.322703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:34.330952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e45d86d5-73dc-4963-82e1-09b6dae848cc tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1511 microversion: 2.1 time: 0.160613 Aug 23 11:31:34.331525 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3688/7323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:34 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:35.354310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:35.354954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:35.361688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:35.362198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:35.362660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:35.363377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:35.363857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:35.364306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:35.577261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:35.585884 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28d44f5d-f07c-4fbd-9e8c-79ca4de66000 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1508 microversion: 2.1 time: 0.237100 Aug 23 11:31:35.586486 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3636/7324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:35 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:35.606702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:35.607191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:35.614069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:35.614558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:35.615003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:35.615700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:35.616164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:35.616595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:35.643033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:31:35.692756 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.compute.api [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Found an unconfirmed migration during delete, id: 16, status: finished Aug 23 11:31:37.195544 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b05c4191-22d1-49cb-85fd-923275ceec14 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "DELETE /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 204 len: 0 microversion: 2.1 time: 1.592413 Aug 23 11:31:37.196257 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3689/7325] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:31:35 2022] DELETE /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 0 bytes in 1594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:31:37.204936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:37.205569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:37.212358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:37.212898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:37.213357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:37.214063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:37.214531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:37.214970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:37.350343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:37.358173 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-337b2e70-8364-42e6-9124-33a4b72e9a78 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1500 microversion: 2.1 time: 0.157574 Aug 23 11:31:37.358754 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3637/7326] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:37 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:38.380430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:38.381166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:38.388126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:38.388621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:38.389094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:38.389796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:38.391011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:38.391465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:38.535940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:38.544918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-55ea55f5-dd6d-4747-8079-1845de24873f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1500 microversion: 2.1 time: 0.168270 Aug 23 11:31:38.545656 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3690/7327] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:38 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:38.590117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-14251975-1be0-4b6c-a69e-f05e5662ff00 req-b160f0fa-9859-4b37-bc73-15f64c73b6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c90546-8598-4414-be2b-beccc7c9acfc", "name": "network-vif-plugged", "status": "completed", "tag": "1406bf63-eb10-49fb-ad07-717bee6191e4"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:38.600141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-14251975-1be0-4b6c-a69e-f05e5662ff00 req-b160f0fa-9859-4b37-bc73-15f64c73b6f3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:38.600580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-14251975-1be0-4b6c-a69e-f05e5662ff00 req-b160f0fa-9859-4b37-bc73-15f64c73b6f3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:38.601065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-14251975-1be0-4b6c-a69e-f05e5662ff00 req-b160f0fa-9859-4b37-bc73-15f64c73b6f3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:38.612246 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-14251975-1be0-4b6c-a69e-f05e5662ff00 req-b160f0fa-9859-4b37-bc73-15f64c73b6f3 service nova] Creating event network-vif-plugged:1406bf63-eb10-49fb-ad07-717bee6191e4 for instance 28c90546-8598-4414-be2b-beccc7c9acfc on n-h1-847009-13 Aug 23 11:31:38.617354 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-14251975-1be0-4b6c-a69e-f05e5662ff00 req-b160f0fa-9859-4b37-bc73-15f64c73b6f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112422 Aug 23 11:31:38.617945 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3638/7328] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:31:39.317152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e12c73d3-95b9-4863-9c8c-81f50600109a req-fc68a925-71de-472b-b1ab-b98f9a70debf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c90546-8598-4414-be2b-beccc7c9acfc", "name": "network-vif-deleted", "tag": "1406bf63-eb10-49fb-ad07-717bee6191e4"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:39.328940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e12c73d3-95b9-4863-9c8c-81f50600109a req-fc68a925-71de-472b-b1ab-b98f9a70debf service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:39.329428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e12c73d3-95b9-4863-9c8c-81f50600109a req-fc68a925-71de-472b-b1ab-b98f9a70debf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:39.329856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e12c73d3-95b9-4863-9c8c-81f50600109a req-fc68a925-71de-472b-b1ab-b98f9a70debf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:39.342133 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e12c73d3-95b9-4863-9c8c-81f50600109a req-fc68a925-71de-472b-b1ab-b98f9a70debf service nova] Creating event network-vif-deleted:1406bf63-eb10-49fb-ad07-717bee6191e4 for instance 28c90546-8598-4414-be2b-beccc7c9acfc on n-h1-847009-13 Aug 23 11:31:39.348611 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e12c73d3-95b9-4863-9c8c-81f50600109a req-fc68a925-71de-472b-b1ab-b98f9a70debf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035553 Aug 23 11:31:39.349791 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3691/7329] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:31:39.566895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:39.567627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:39.573896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:39.574397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:39.574848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:39.575567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:39.576029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:39.576469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:39.613406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:39.614052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:39.614366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:39.614817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lazy-loading 'fault' on Instance uuid 28c90546-8598-4414-be2b-beccc7c9acfc {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:31:39.664462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c0c1f9719894cc98ca5b059dc5339f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d4cf059e4c470a84dea398142a4fc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:39.671625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8ce45ff9-61af-4163-9bcc-7374a162589a tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 200 len: 1305 microversion: 2.1 time: 0.110228 Aug 23 11:31:39.672644 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3639/7330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:39 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:40.694512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:40.695206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:40.701339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:40.701819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:40.702254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:40.703047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:40.703500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:40.703918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:40.717379 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] HTTP exception thrown: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Request method failure captured: Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc HTTP/1.1 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLpmVaJtMBFMVGTM49ylqucAZMYFSt32RruBHijsl367RuSn8HGmWhexGImhnr20lC1fbLS7ZI_MJJ5roHH6CJ9o8fRikk8Eh89uoeXso_qQYM1yrx2nd1B_j3rs-MTV8sNusmBlYz0_AlzE4MJO5B0i6iYckorjTCcsfcqGsW-KpWI Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 18d4cf059e4c470a84dea398142a4fc7 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/18d4cf059e4c470a84dea398142a4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_18d4cf059e4c470a84dea398142a4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/18d4cf059e4c470a84dea398142a4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/18d4cf059e4c470a84dea398142a4fc7"}]}] Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 18d4cf059e4c470a84dea398142a4fc7 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1100674865-project Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6c0c1f9719894cc98ca5b059dc5339f1 Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1100674865-project Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '28c90546-8598-4414-be2b-beccc7c9acfc'} Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:31:40.719601 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Returning 404 to user: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c6c817e-4c3e-4a7c-a5e2-2d1a43ce3f2f tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 404 len: 111 microversion: 2.1 time: 0.031613 Aug 23 11:31:40.724578 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3692/7331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:40 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:31:40.735546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:40.736055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:40.743016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:40.743528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:40.744116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:40.744693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:40.745205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:40.745657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:40.760042 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] HTTP exception thrown: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Request method failure captured: Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: request: DELETE /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc HTTP/1.1 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLpmVaJtMBFMVGTM49ylqucAZMYFSt32RruBHijsl367RuSn8HGmWhexGImhnr20lC1fbLS7ZI_MJJ5roHH6CJ9o8fRikk8Eh89uoeXso_qQYM1yrx2nd1B_j3rs-MTV8sNusmBlYz0_AlzE4MJO5B0i6iYckorjTCcsfcqGsW-KpWI Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 18d4cf059e4c470a84dea398142a4fc7 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/18d4cf059e4c470a84dea398142a4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_18d4cf059e4c470a84dea398142a4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/18d4cf059e4c470a84dea398142a4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/18d4cf059e4c470a84dea398142a4fc7"}]}] Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 18d4cf059e4c470a84dea398142a4fc7 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-DeleteServersTestJSON-1100674865-project Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 6c0c1f9719894cc98ca5b059dc5339f1 Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-DeleteServersTestJSON-1100674865-project Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '28c90546-8598-4414-be2b-beccc7c9acfc'} Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:31:40.761716 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Returning 404 to user: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca6f6120-6ec0-420a-8478-b9c7daffcd2c tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "DELETE /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 404 len: 111 microversion: 2.1 time: 0.032150 Aug 23 11:31:40.765424 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3640/7332] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:31:40 2022] DELETE /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:31:40.771975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:40.772590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] [instance: 28c90546-8598-4414-be2b-beccc7c9acfc] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:40.778508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:40.778987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:40.779419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:40.780103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:40.781070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:40.781601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:40.794813 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] HTTP exception thrown: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Request method failure captured: Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc HTTP/1.1 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLpmVaJtMBFMVGTM49ylqucAZMYFSt32RruBHijsl367RuSn8HGmWhexGImhnr20lC1fbLS7ZI_MJJ5roHH6CJ9o8fRikk8Eh89uoeXso_qQYM1yrx2nd1B_j3rs-MTV8sNusmBlYz0_AlzE4MJO5B0i6iYckorjTCcsfcqGsW-KpWI Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 18d4cf059e4c470a84dea398142a4fc7 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/18d4cf059e4c470a84dea398142a4fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_18d4cf059e4c470a84dea398142a4fc7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/18d4cf059e4c470a84dea398142a4fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/18d4cf059e4c470a84dea398142a4fc7"}]}] Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 18d4cf059e4c470a84dea398142a4fc7 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1100674865 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-DeleteServersTestJSON-1100674865-project Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 6c0c1f9719894cc98ca5b059dc5339f1 Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-DeleteServersTestJSON-1100674865-project Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '28c90546-8598-4414-be2b-beccc7c9acfc'} Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:31:40.797006 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] Returning 404 to user: Instance 28c90546-8598-4414-be2b-beccc7c9acfc could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4faac52f-6b96-4b1f-bbfc-241e6badb325 tempest-DeleteServersTestJSON-1100674865 tempest-DeleteServersTestJSON-1100674865-project] 10.222.0.78 "GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc" status: 404 len: 111 microversion: 2.1 time: 0.030451 Aug 23 11:31:40.800638 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3693/7333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:40 2022] GET /compute/v2.1/servers/28c90546-8598-4414-be2b-beccc7c9acfc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:31:48.789697 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:31:48.790379 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:31:49.659943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-527351993", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "52358c30-e3a4-44fc-8f01-649169bbd54a"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:49.718919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] validate_networks() for [('52358c30-e3a4-44fc-8f01-649169bbd54a', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:31:50.097232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:31:50.097690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:31:50.098442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:31:50.098875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:31:50.099314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:31:50.109400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:50.109905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:50.110366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:50.111125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:50.111635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:50.112083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:50.129540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Getting quotas for project 6b0790625a184c43bec4fd65ca88d5bc. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:31:50.134983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Getting quotas for user 35fac266225d4408a503822a5a5dd055 and project 6b0790625a184c43bec4fd65ca88d5bc. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:31:50.147715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:31:50.150118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:31:50.196653 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cc4a6dff-b15d-4218-9a0b-a090ed417630 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660956 Aug 23 11:31:50.197270 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3641/7334] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:31:50.208249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d974ca04-182e-4a0f-88bf-d07f5ebad41c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:50.208978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d974ca04-182e-4a0f-88bf-d07f5ebad41c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:50.273772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d974ca04-182e-4a0f-88bf-d07f5ebad41c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:50.284411 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d974ca04-182e-4a0f-88bf-d07f5ebad41c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1217 microversion: 2.1 time: 0.079983 Aug 23 11:31:50.285025 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3694/7335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:50 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:51.306222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:51.306861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:51.314371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:51.314880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:51.315366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:51.316087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:51.316568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:51.317064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:51.387454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:51.396570 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0b8230ca-6dd1-4176-a1c5-924cfb62819e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1269 microversion: 2.1 time: 0.095066 Aug 23 11:31:51.397832 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3642/7336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:51 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:31:52.418773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:52.419965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:52.426459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:52.429391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:52.430081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:52.430669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:52.431547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:52.432332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:52.432948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:52.626806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:52.635580 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-600af2dd-1954-4aa9-80a2-89d4d6190f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.220809 Aug 23 11:31:52.636419 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3695/7337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:52 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:31:52.834421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c8afc1f6-9628-492c-b731-8eb6a99eb377 req-192ea6d8-0360-4be2-befc-8a8e230f4d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443a057b-8bda-4a6a-99e2-870d7aef5831", "tag": "f57840be-7e7f-4468-a5a9-23f8f28eb721"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:52.848165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8afc1f6-9628-492c-b731-8eb6a99eb377 req-192ea6d8-0360-4be2-befc-8a8e230f4d1e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:52.848638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8afc1f6-9628-492c-b731-8eb6a99eb377 req-192ea6d8-0360-4be2-befc-8a8e230f4d1e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:52.849311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8afc1f6-9628-492c-b731-8eb6a99eb377 req-192ea6d8-0360-4be2-befc-8a8e230f4d1e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:52.862679 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c8afc1f6-9628-492c-b731-8eb6a99eb377 req-192ea6d8-0360-4be2-befc-8a8e230f4d1e service nova] Creating event network-changed:f57840be-7e7f-4468-a5a9-23f8f28eb721 for instance 443a057b-8bda-4a6a-99e2-870d7aef5831 on n-h1-847009-13 Aug 23 11:31:52.869163 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c8afc1f6-9628-492c-b731-8eb6a99eb377 req-192ea6d8-0360-4be2-befc-8a8e230f4d1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038349 Aug 23 11:31:52.870177 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3643/7338] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:31:53.658475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:53.659082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:53.665870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:53.666359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:53.666799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:53.667489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:53.667949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:53.668379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:53.805774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:53.813964 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c56d598-0213-4c45-9dde-a396bc01b0c0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.159571 Aug 23 11:31:53.814539 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3696/7339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:53 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:54.835425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:54.836380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:54.844934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:54.845524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:54.846048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:54.846973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:54.847537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:54.848058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:54.982105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:54.989926 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ec4bb39-f15e-4f93-846a-150bfb6c5e77 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.158955 Aug 23 11:31:54.990506 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3644/7340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:54 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:56.011053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:56.011662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:56.014378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:56.020428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:56.020942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:56.021381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:56.022091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:56.022543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:56.022964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:56.156641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:56.164426 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-116f4324-1fc1-41aa-aab5-d55e8783ccad tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.157257 Aug 23 11:31:56.165035 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3697/7341] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:56 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:57.185795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:57.186440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:57.193916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:57.194429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:57.194911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:57.195632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:57.196112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:57.196562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:57.344111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:57.351761 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b69b2b57-1a0a-4758-b95f-ff135693cf9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.169950 Aug 23 11:31:57.352328 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3645/7342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:57 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:58.372904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:58.373526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:58.381390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:58.381881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:58.382322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:58.383022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:58.383482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:58.383920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:58.519373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:58.527508 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd3ee213-26a9-4d90-be7c-d9e6466f6313 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.158449 Aug 23 11:31:58.528114 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3698/7343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:58 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:31:58.713792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-47a6b3cf-32fa-456b-8ec6-df64fbec9f5a req-4ebdb47b-69ee-49c3-a3b0-23f90292e470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443a057b-8bda-4a6a-99e2-870d7aef5831", "name": "network-vif-plugged", "status": "completed", "tag": "f57840be-7e7f-4468-a5a9-23f8f28eb721"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:31:58.721376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:58.727706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-47a6b3cf-32fa-456b-8ec6-df64fbec9f5a req-4ebdb47b-69ee-49c3-a3b0-23f90292e470 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:58.728208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-47a6b3cf-32fa-456b-8ec6-df64fbec9f5a req-4ebdb47b-69ee-49c3-a3b0-23f90292e470 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:58.728660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-47a6b3cf-32fa-456b-8ec6-df64fbec9f5a req-4ebdb47b-69ee-49c3-a3b0-23f90292e470 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:58.733930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=68 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:31:58.741811 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-47a6b3cf-32fa-456b-8ec6-df64fbec9f5a req-4ebdb47b-69ee-49c3-a3b0-23f90292e470 service nova] Creating event network-vif-plugged:f57840be-7e7f-4468-a5a9-23f8f28eb721 for instance 443a057b-8bda-4a6a-99e2-870d7aef5831 on n-h1-847009-13 Aug 23 11:31:58.746830 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-47a6b3cf-32fa-456b-8ec6-df64fbec9f5a req-4ebdb47b-69ee-49c3-a3b0-23f90292e470 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Aug 23 11:31:58.747554 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3646/7344] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:31:59.549054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:31:59.549676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:31:59.556547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:59.557072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:59.557516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:59.558225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:31:59.558687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:31:59.559120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:31:59.710297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:31:59.718952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-67ef60e6-60ba-446c-a201-d3e1b0a8ea12 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1317 microversion: 2.1 time: 0.174115 Aug 23 11:31:59.719606 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3699/7345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:31:59 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:00.738334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:00.739135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:00.743269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:00.743997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:00.752054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:00.752662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:00.753060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:00.753784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:00.754260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:00.754709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:00.892011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:00.899866 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d35e095a-ac22-4cfb-ba26-78f3a3843675 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1508 microversion: 2.1 time: 0.163386 Aug 23 11:32:00.900467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3647/7346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:00 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:00.921112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:00.922011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:00.923949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:00.930440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:00.930923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:00.931363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:00.932057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:00.932518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:00.932974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.072398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:01.080244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9eb84bf-c036-4b84-89f4-e7ff1dca0a54 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1508 microversion: 2.1 time: 0.163000 Aug 23 11:32:01.080840 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3700/7347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:00 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:01.100464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:01.102890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:01.109561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.110171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.110663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.111387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.111864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.112304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.174914 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e214059e-6d5b-44af-a2c8-0d7a456e19dd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "PUT /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1080 microversion: 2.1 time: 0.078321 Aug 23 11:32:01.175554 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3648/7348] 10.222.0.78 () {60 vars in 1256 bytes} [Tue Aug 23 11:32:01 2022] PUT /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1080 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:01.192831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:01.193444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:01.199402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.199890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.200328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.201050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.201509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.201938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.338819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:01.347229 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5d171f42-226f-4118-baac-bf7bbccfbd03 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1506 microversion: 2.1 time: 0.158288 Aug 23 11:32:01.347813 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3701/7349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:01 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:01.367283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:01.367924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:01.374178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.375235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.375777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.376401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.376911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.377362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.506638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:01.514509 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83361d6d-5095-451a-bf62-b272fe26e25e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1506 microversion: 2.1 time: 0.151130 Aug 23 11:32:01.515633 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3649/7350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:01 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:01.535877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:01.538252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:01.544093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.544581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.545071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.545764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.546253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.546657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.574448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:01.580726 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Old instance type m1.heat2, new instance type m1.heat {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:32:01.587248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:32:01.587670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:32:01.588149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:32:01.588561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:32:01.589008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:32:01.652040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c49497ab-069f-436c-aaae-6fd7c9dd9c18 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831/action" status: 202 len: 0 microversion: 2.1 time: 0.120091 Aug 23 11:32:01.652798 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3702/7351] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:32:01 2022] POST /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:32:01.661673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:01.662406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:01.669027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.669570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.670032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.670754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:01.671255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:01.672079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:01.832479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:01.841386 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb81806d-7696-4de3-b806-de853b0d71e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1517 microversion: 2.1 time: 0.183553 Aug 23 11:32:01.842217 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3650/7352] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:01 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:02.863832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:02.864479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:02.871402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:02.871830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:02.872270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:02.873007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:02.873466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:02.873895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:03.017343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:03.025469 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31d56b25-313e-429f-b9a9-c26a638c0952 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1517 microversion: 2.1 time: 0.166520 Aug 23 11:32:03.026062 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3703/7353] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:02 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:04.047053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:04.047709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:04.055057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:04.055644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:04.056174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:04.057024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:04.057577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:04.058105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:04.186979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:04.195299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59780073-239e-43cc-958c-11a9fce18b48 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.152365 Aug 23 11:32:04.195872 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3651/7354] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:04 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:05.217292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:05.217829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:05.225438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:05.225929 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:05.226372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:05.227071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:05.227535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:05.227967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:05.363983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:05.371757 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eba1b54f-352a-42e7-b165-21d01e4e2988 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.158752 Aug 23 11:32:05.372328 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3704/7355] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:05 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:06.394461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:06.395009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:06.401280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:06.401779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:06.402230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:06.402933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:06.403430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:06.403873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:06.537150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:06.544940 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11795562-9a37-4190-81ee-a84b1ce3c1cb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155269 Aug 23 11:32:06.545515 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3652/7356] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:06 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:07.567176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:07.567813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:07.574296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:07.574777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:07.575214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:07.575899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:07.576352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:07.576805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:07.707904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:07.715579 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe952d85-5972-4bdb-91b9-a5764fbac184 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.152486 Aug 23 11:32:07.716145 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3705/7357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:07 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:08.736768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:08.737414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:08.744251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:08.744771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:08.745228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:08.745934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:08.746404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:08.746874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:08.878252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:08.886064 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c664edfb-91a7-4aff-9f8a-e55dfcdcabbd tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.153965 Aug 23 11:32:08.886841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3653/7358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:08 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:09.908861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:09.909375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:09.916161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:09.916647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:09.917121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:09.917817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:09.918277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:09.918703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:10.051390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:10.059348 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7b417f16-f2cd-4e6f-838b-eb90d084724a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155314 Aug 23 11:32:10.059929 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3706/7359] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:09 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:11.080305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:11.080882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:11.088067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:11.088577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:11.089073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:11.089791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:11.090273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:11.090724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:11.223730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:11.231452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e75a598b-c74b-498d-8b86-c9dd67512b5a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155303 Aug 23 11:32:11.232018 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3654/7360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:11 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:12.254192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:12.254813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:12.263353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:12.263829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:12.264268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:12.264958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:12.265416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:12.265867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:12.418678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:12.426458 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ae9e3b61-23a1-46e1-bf20-4b347123765b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.177438 Aug 23 11:32:12.427247 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3707/7361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:12 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:13.448265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:13.448966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:13.456555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:13.457086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:13.457546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:13.458265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:13.458742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:13.459190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:13.591356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:13.599694 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a461336-56a8-4b24-9f6e-66331f25345a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155420 Aug 23 11:32:13.600265 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3655/7362] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:13 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:14.621604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:14.622218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:14.629589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:14.630085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:14.630527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:14.631229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:14.631697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:14.632128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:14.764608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:14.773716 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b392f1e4-cc92-452e-b898-4acff5d9f93a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155923 Aug 23 11:32:14.774302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3708/7363] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:14 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:15.794688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:15.795343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:15.802553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:15.803051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:15.803505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:15.804208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:15.804679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:15.805143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:15.939868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:15.947771 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0bb134d8-0737-4b8a-b011-836d65419386 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.156983 Aug 23 11:32:15.948361 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3656/7364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:15 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:16.968553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:16.969201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:16.976360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:16.976879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:16.977325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:16.978032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:16.978495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:16.978928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:17.111908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:17.119548 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9a1e4af4-91f7-4f55-b1b5-9259a8f3546e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155239 Aug 23 11:32:17.120125 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3709/7365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:16 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:18.140622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:18.141286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:18.149244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:18.149757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:18.150214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:18.150926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:18.151404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:18.151851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:18.286541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:18.294247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8bf0bc3c-8a8b-4aa7-990f-5559f6fdef7e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.157545 Aug 23 11:32:18.294812 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3657/7366] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:18 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:19.315704 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:19.316311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:19.323487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:19.324014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:19.324468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:19.325221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:19.325694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:19.326131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:19.330697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:19.457873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:19.465603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-31dbc59f-ad91-4e3e-a252-e804ff345579 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.154007 Aug 23 11:32:19.466223 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3710/7367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:19 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:20.488446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:20.489100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:20.495926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:20.496422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:20.496904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:20.497609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:20.498081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:20.498517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:20.628920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:20.636894 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-69f6f209-d368-4d80-af2b-5947f59c165a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.153194 Aug 23 11:32:20.637469 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3658/7368] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:20 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:21.658490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:21.659116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:21.666093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:21.666581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:21.667021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:21.667711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:21.668171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:21.668594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:21.806686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:21.814509 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-88f8154b-afa0-4c90-933f-b59b1c9675c6 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.160918 Aug 23 11:32:21.815086 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3711/7369] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:21 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:22.836050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:22.836681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:22.843887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:22.844385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:22.844890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:22.845729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:22.846199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:22.846639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:22.975529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:22.983480 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-706519be-1141-460e-9f3f-54343b83b200 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.151338 Aug 23 11:32:22.984055 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3659/7370] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:22 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:24.005278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:24.005893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:24.012845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:24.013332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:24.013788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:24.014467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:24.014926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:24.015353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:24.155677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:24.163964 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf18d68d-bb6c-456a-bace-1c2e3401b72e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.162795 Aug 23 11:32:24.164550 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3712/7371] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:24 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:25.185217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:25.185888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:25.193638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:25.194137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:25.194587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:25.195297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:25.195766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:25.196203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:25.333055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:25.340858 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91f1ded4-1035-473a-877d-42482edcbea0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.159811 Aug 23 11:32:25.341708 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3660/7372] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:25 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:26.362267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:26.362798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:26.365921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=36 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:26.371133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:26.371626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:26.372063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:26.372785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:26.373273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:26.373696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:26.506062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:26.513808 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6fefe448-b873-44b5-a473-0745ba6c6909 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.155620 Aug 23 11:32:26.514382 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3713/7373] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:26 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:27.535714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:27.536345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:27.543228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:27.543725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:27.544169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:27.544905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:27.545374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:27.545815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:27.674990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:27.682700 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cf266aa2-4154-4cb2-9a92-e343376535a0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.151646 Aug 23 11:32:27.683273 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3661/7374] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:27 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:28.704633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:28.705833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:28.712886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:28.713378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:28.713819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:28.714524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:28.714986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:28.715416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:28.852958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:28.861443 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4a8ba3dc-0b72-4459-8acc-abddf54bb6c5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.160451 Aug 23 11:32:28.862022 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3714/7375] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:28 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:29.883330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:29.883969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:29.886862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=32 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:29.893928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:29.894453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:29.894932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:29.895694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:29.896166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:29.896638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:29.904611 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:30.041272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:30.049372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86b811e3-2aef-477e-bd75-4d2328c61c42 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1522 microversion: 2.1 time: 0.170075 Aug 23 11:32:30.049956 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3662/7376] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:29 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:31.071466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:31.072003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:31.077953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:31.078437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:31.078866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:31.079574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:31.080098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:31.080451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:31.226050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:31.233832 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ecd488b5-04e3-40fe-a767-d2b0fee5c9d2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1521 microversion: 2.1 time: 0.167213 Aug 23 11:32:31.234414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3715/7377] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:31 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:32:31.566594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443a057b-8bda-4a6a-99e2-870d7aef5831", "name": "network-vif-unplugged", "status": "completed", "tag": "f57840be-7e7f-4468-a5a9-23f8f28eb721"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:31.576764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:31.577505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:31.577962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:31.591733 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] Creating event network-vif-unplugged:f57840be-7e7f-4468-a5a9-23f8f28eb721 for instance 443a057b-8bda-4a6a-99e2-870d7aef5831 on n-h2-847009-13 Aug 23 11:32:31.597959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:32:31.609078 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-188dd09d-37d6-4903-90e9-36681e038598 req-c147ef1f-6793-476e-97ac-f90973b84070 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047069 Aug 23 11:32:31.609755 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3663/7378] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:32:32.256436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:32.257001 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:32.263943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:32.264441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:32.264925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:32.265630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:32.266092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:32.267080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:32.408055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:32.416014 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2aaee974-abb7-463c-b636-a93397d242f1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1521 microversion: 2.1 time: 0.163772 Aug 23 11:32:32.416592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3716/7379] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:32 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:33.438677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:33.439507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:33.445873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:33.446389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:33.446852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:33.447573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:33.448049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:33.448495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:33.588553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:33.597279 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-039b9a9d-35b4-489c-a9b1-0a5d90745821 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1519 microversion: 2.1 time: 0.164015 Aug 23 11:32:33.597860 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3664/7380] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:33 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:33.626478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "443a057b-8bda-4a6a-99e2-870d7aef5831", "tag": "f57840be-7e7f-4468-a5a9-23f8f28eb721"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:33.636603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:33.637119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:33.637559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:33.649494 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] Creating event network-changed:f57840be-7e7f-4468-a5a9-23f8f28eb721 for instance 443a057b-8bda-4a6a-99e2-870d7aef5831 on n-h2-847009-13 Aug 23 11:32:33.654723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:32:33.666230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ee9bcfaf-4c1f-443d-89a5-c82c4229c5ec req-670f2191-b86b-4c1a-b39a-5718ec59350b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043558 Aug 23 11:32:33.666809 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3717/7381] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:32:34.619564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:34.620195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:34.626875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:34.627389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:34.627842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:34.628871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:34.629058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:34.629530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:34.765858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:34.774006 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ce804c68-7ad3-4fdb-b08a-5a6065859af9 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1516 microversion: 2.1 time: 0.158851 Aug 23 11:32:34.774585 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3665/7382] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:34 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:34.796293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:34.796960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:34.803611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:34.804092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:34.804542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:34.805270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:34.805725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:34.806147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:34.862151 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-15141b86-81f1-4046-9765-55e1fc7c6b83 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831/action" status: 204 len: 0 microversion: 2.1 time: 0.070775 Aug 23 11:32:34.862710 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3718/7383] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:32:34 2022] POST /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:32:34.870879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:34.871591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:34.877914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:34.878411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:34.878859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:34.879568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:34.880039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:34.880483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:35.088504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:35.097449 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d74ba0d-66db-4dd7-b99a-a466243d8835 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1516 microversion: 2.1 time: 0.230396 Aug 23 11:32:35.098973 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3666/7384] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:34 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:36.120832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:36.121553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:36.128899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:36.129578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:36.130098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:36.131158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:36.131651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:36.132172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:36.274776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:36.283082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d36143a-84d2-4411-9f7c-4a2890ad1928 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1516 microversion: 2.1 time: 0.166789 Aug 23 11:32:36.283683 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3719/7385] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:36 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:37.304640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:37.305316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:37.313185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:37.313753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:37.314218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:37.314943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:37.315424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:37.315873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:37.454863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:37.463272 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0da68677-751c-4c9a-9aad-ef3b547a7e91 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1508 microversion: 2.1 time: 0.162484 Aug 23 11:32:37.463859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3667/7386] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:37 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:37.484533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:37.485245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:37.491552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:37.492072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:37.492516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:37.493290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:37.493761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:37.494224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:37.515003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-38e5e0d6-4c8a-4f5c-a890-197aa44bba25 req-bf68bc17-734b-4a5b-a55f-a5ca90837bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443a057b-8bda-4a6a-99e2-870d7aef5831", "name": "network-vif-plugged", "status": "completed", "tag": "f57840be-7e7f-4468-a5a9-23f8f28eb721"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:37.525907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-38e5e0d6-4c8a-4f5c-a890-197aa44bba25 req-bf68bc17-734b-4a5b-a55f-a5ca90837bf8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:37.526407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-38e5e0d6-4c8a-4f5c-a890-197aa44bba25 req-bf68bc17-734b-4a5b-a55f-a5ca90837bf8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:37.526861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-38e5e0d6-4c8a-4f5c-a890-197aa44bba25 req-bf68bc17-734b-4a5b-a55f-a5ca90837bf8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:37.539263 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-38e5e0d6-4c8a-4f5c-a890-197aa44bba25 req-bf68bc17-734b-4a5b-a55f-a5ca90837bf8 service nova] Creating event network-vif-plugged:f57840be-7e7f-4468-a5a9-23f8f28eb721 for instance 443a057b-8bda-4a6a-99e2-870d7aef5831 on n-h2-847009-13 Aug 23 11:32:37.544989 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-38e5e0d6-4c8a-4f5c-a890-197aa44bba25 req-bf68bc17-734b-4a5b-a55f-a5ca90837bf8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033855 Aug 23 11:32:37.545972 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3668/7387] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:32:37.640715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:37.649332 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5c809614-789c-42b2-826b-3246837e6c60 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1508 microversion: 2.1 time: 0.168979 Aug 23 11:32:37.649907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3720/7388] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:37 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:37.672975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed8dbf70-2cbf-4c31-bce1-a1d6f3e22ef3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'create', calling method: .version_select at 0x7fdc9caf5d30>, body: {"keypair": {"name": "tempest-keypair-836917112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs4cFCzhngoyp7pzY4AB36w+7OnCBm1KR/MLvMQIkeDFKABWem8ODhA1tPVdfkSU/GKTXcKt9eh4hJeHzRkdj9pv5xUcJJ86JiLPGb3bqNb/QFJeoOQYI1SrIjkySsrbQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:37.688866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ed8dbf70-2cbf-4c31-bce1-a1d6f3e22ef3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Getting quotas for project 6b0790625a184c43bec4fd65ca88d5bc. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:32:37.694034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ed8dbf70-2cbf-4c31-bce1-a1d6f3e22ef3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Getting quotas for user 35fac266225d4408a503822a5a5dd055 and project 6b0790625a184c43bec4fd65ca88d5bc. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:32:37.719726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed8dbf70-2cbf-4c31-bce1-a1d6f3e22ef3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051018 Aug 23 11:32:37.720365 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3669/7389] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:32:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:32:38.927238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:38.927858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:38.935916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:38.936401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:38.936873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:38.937581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:38.938044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:38.939231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:39.080517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:39.088329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-761777d2-04ee-4d11-bd8b-648dd7fad9ff tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 200 len: 1508 microversion: 2.1 time: 0.168292 Aug 23 11:32:39.088940 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3721/7390] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:38 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:39.109534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:39.110731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:39.117537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:39.118040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:39.118495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:39.119206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:39.119682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:39.120128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:39.145696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:32:39.220520 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-090d1f95-d726-4177-9e20-775fe1a040a5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "DELETE /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 204 len: 0 microversion: 2.1 time: 0.114770 Aug 23 11:32:39.221140 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3670/7391] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:32:39 2022] DELETE /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:32:39.288906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1251251115", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "52358c30-e3a4-44fc-8f01-649169bbd54a"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:39.340558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] validate_networks() for [('52358c30-e3a4-44fc-8f01-649169bbd54a', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:32:39.723786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:32:39.724297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:32:39.724818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:32:39.725243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:32:39.725666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:32:39.734573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:39.735108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:39.735857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:39.736489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:39.736995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:39.737433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:39.754381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Getting quotas for project 6b0790625a184c43bec4fd65ca88d5bc. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:32:39.759635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Getting quotas for user 35fac266225d4408a503822a5a5dd055 and project 6b0790625a184c43bec4fd65ca88d5bc. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:32:39.772584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:32:39.774889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:32:39.819930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1c43e258-35c1-43d6-9117-ec32dbf5cde3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535024 Aug 23 11:32:39.820590 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3722/7392] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:32:39.832693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dd4b2be6-07c5-47cd-9f27-81e5936db3f3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:39.833530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dd4b2be6-07c5-47cd-9f27-81e5936db3f3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:39.893763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dd4b2be6-07c5-47cd-9f27-81e5936db3f3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:39.900882 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dd4b2be6-07c5-47cd-9f27-81e5936db3f3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1218 microversion: 2.1 time: 0.073174 Aug 23 11:32:39.901455 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3671/7393] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:39 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:40.924613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:40.925378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:40.932620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:40.933177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:40.933652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:40.934395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:40.935092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:40.935565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:41.001403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:41.009455 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90520e7d-a714-4322-843a-7ae9a8ca7190 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1270 microversion: 2.1 time: 0.091539 Aug 23 11:32:41.010264 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3723/7394] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:40 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:41.336133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d9959890-ab1b-4983-aca8-2f0e03c7a8e4 req-e5c67a9d-8378-4208-a55d-590eddd256b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "443a057b-8bda-4a6a-99e2-870d7aef5831", "name": "network-vif-deleted", "tag": "f57840be-7e7f-4468-a5a9-23f8f28eb721"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:41.352807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9959890-ab1b-4983-aca8-2f0e03c7a8e4 req-e5c67a9d-8378-4208-a55d-590eddd256b5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:41.353504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9959890-ab1b-4983-aca8-2f0e03c7a8e4 req-e5c67a9d-8378-4208-a55d-590eddd256b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:41.354123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9959890-ab1b-4983-aca8-2f0e03c7a8e4 req-e5c67a9d-8378-4208-a55d-590eddd256b5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:41.383612 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d9959890-ab1b-4983-aca8-2f0e03c7a8e4 req-e5c67a9d-8378-4208-a55d-590eddd256b5 service nova] Creating event network-vif-deleted:f57840be-7e7f-4468-a5a9-23f8f28eb721 for instance 443a057b-8bda-4a6a-99e2-870d7aef5831 on n-h2-847009-13 Aug 23 11:32:41.390649 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d9959890-ab1b-4983-aca8-2f0e03c7a8e4 req-e5c67a9d-8378-4208-a55d-590eddd256b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058023 Aug 23 11:32:41.392085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3672/7395] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:32:42.032006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:42.032621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:42.040088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:42.040581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:42.041059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:42.041770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:42.042231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:42.042663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:42.274444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:42.285189 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ac02477-7986-46c6-a941-1d7663c00c9a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1318 microversion: 2.1 time: 0.256730 Aug 23 11:32:42.286014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3724/7396] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:42 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:32:42.889470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fbaa86a4-2fea-4667-891b-d76fdc225542 req-92f41a99-185b-4f8b-b1c5-462abd860fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d447b742-5d60-4949-8eae-a50f6fb7f455", "tag": "df3a8e68-b495-4f54-a957-9486da1df0e8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:42.900175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fbaa86a4-2fea-4667-891b-d76fdc225542 req-92f41a99-185b-4f8b-b1c5-462abd860fa3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:42.900664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fbaa86a4-2fea-4667-891b-d76fdc225542 req-92f41a99-185b-4f8b-b1c5-462abd860fa3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:42.901149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fbaa86a4-2fea-4667-891b-d76fdc225542 req-92f41a99-185b-4f8b-b1c5-462abd860fa3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:42.912544 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fbaa86a4-2fea-4667-891b-d76fdc225542 req-92f41a99-185b-4f8b-b1c5-462abd860fa3 service nova] Creating event network-changed:df3a8e68-b495-4f54-a957-9486da1df0e8 for instance d447b742-5d60-4949-8eae-a50f6fb7f455 on n-h2-847009-13 Aug 23 11:32:42.917387 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fbaa86a4-2fea-4667-891b-d76fdc225542 req-92f41a99-185b-4f8b-b1c5-462abd860fa3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105551 Aug 23 11:32:42.917955 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3673/7397] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:32:43.306320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:43.306960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:43.313853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:43.315176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:43.315634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:43.316346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:43.316839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:43.317278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:43.452253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:43.460160 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1b724a9b-8ff5-4db0-8feb-5038b22fa1c3 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1318 microversion: 2.1 time: 0.158058 Aug 23 11:32:43.460765 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3725/7398] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:43 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:44.483044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:44.483772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:44.490854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:44.491343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:44.491801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:44.492523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:44.493028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:44.493475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:44.633086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:44.641099 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f204d74d-5b52-482a-ad7e-72051c4feef2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1318 microversion: 2.1 time: 0.163234 Aug 23 11:32:44.641686 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3674/7399] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:44 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:45.661720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:45.662292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:45.669322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:45.669821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:45.670268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:45.670976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:45.671443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:45.671908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:45.804251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:45.806624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:45.813350 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3cfb5b43-545e-43bf-95af-78478ceb8253 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1318 microversion: 2.1 time: 0.155594 Aug 23 11:32:45.813935 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3726/7400] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:45 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:46.835177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:46.835817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:46.843126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:46.843630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:46.844084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:46.844818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:46.845293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:46.846047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:46.975558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:46.983430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca2bae1b-8bcc-4e1a-9d42-7e2b79e25174 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1318 microversion: 2.1 time: 0.152212 Aug 23 11:32:46.984000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3675/7401] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:46 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:47.593954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e4a79ec1-ccfd-48e0-a21d-2bce5353e569 req-4a8cb395-e4fb-4a35-9f09-e11d8a16c344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d447b742-5d60-4949-8eae-a50f6fb7f455", "name": "network-vif-plugged", "status": "completed", "tag": "df3a8e68-b495-4f54-a957-9486da1df0e8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:47.607368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e4a79ec1-ccfd-48e0-a21d-2bce5353e569 req-4a8cb395-e4fb-4a35-9f09-e11d8a16c344 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:47.607875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e4a79ec1-ccfd-48e0-a21d-2bce5353e569 req-4a8cb395-e4fb-4a35-9f09-e11d8a16c344 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:47.608312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e4a79ec1-ccfd-48e0-a21d-2bce5353e569 req-4a8cb395-e4fb-4a35-9f09-e11d8a16c344 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:47.619816 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e4a79ec1-ccfd-48e0-a21d-2bce5353e569 req-4a8cb395-e4fb-4a35-9f09-e11d8a16c344 service nova] Creating event network-vif-plugged:df3a8e68-b495-4f54-a957-9486da1df0e8 for instance d447b742-5d60-4949-8eae-a50f6fb7f455 on n-h2-847009-13 Aug 23 11:32:47.624968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e4a79ec1-ccfd-48e0-a21d-2bce5353e569 req-4a8cb395-e4fb-4a35-9f09-e11d8a16c344 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034877 Aug 23 11:32:47.625850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3727/7402] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:32:48.004164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:48.004834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:48.011946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:48.012451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:48.012947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:48.013668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:48.014147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:48.014600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:48.205303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:48.212996 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e833fcf9-bfcb-4a08-b4e6-12902e34628e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1318 microversion: 2.1 time: 0.213382 Aug 23 11:32:48.213574 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3676/7403] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:47 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:49.234639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:49.235343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:49.243028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:49.243515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:49.243956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:49.244649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:49.245134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:49.245564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:49.714697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:49.723478 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-37e398df-ee85-4f16-bbfe-5289d07bdefa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1509 microversion: 2.1 time: 0.493077 Aug 23 11:32:49.724055 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3728/7404] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:49 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:49.744179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:49.744851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:49.751777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:49.752282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:49.752832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:49.753478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:49.753958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:49.754409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:49.881574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:49.889499 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6e95477-9035-4aaa-bc78-c77c2550fd3e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1509 microversion: 2.1 time: 0.149193 Aug 23 11:32:49.890069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3677/7405] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:49 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:49.910572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:32:49.912936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:49.914942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:49.915568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:49.921162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:49.921651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:49.922091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:49.922783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:49.923252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:49.924880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:49.958553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:49.965893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Old instance type m1.heat2, new instance type m1.heat {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:32:49.973662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:32:49.974092 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:32:49.974572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:32:49.974986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:32:49.975404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:32:50.038299 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a79814c7-fe96-40d1-bfb7-81e02898aa9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455/action" status: 202 len: 0 microversion: 2.1 time: 0.132610 Aug 23 11:32:50.038935 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3729/7406] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:32:49 2022] POST /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:32:50.046960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:50.047608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:50.050885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:50.056255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:50.056779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:50.057235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:50.057962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:50.058438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:50.058882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:50.221523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:50.230408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eceb9338-bb23-4653-8fcc-f8267bb019fa tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1516 microversion: 2.1 time: 0.187067 Aug 23 11:32:50.231458 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3678/7407] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:50 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:51.254351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:51.255021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:51.261080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:51.261571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:51.262009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:51.262702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:51.263160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:51.263585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:51.409503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:51.417397 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c74360dc-354c-4f26-9932-30082271977c tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1516 microversion: 2.1 time: 0.169559 Aug 23 11:32:51.418229 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3730/7408] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:51 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:52.439316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:52.439949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:52.448620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:52.449276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:52.449890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:52.450615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:52.451301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:52.451584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:52.592095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:52.600452 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de1952b6-56e9-4934-882a-dea9cee9c64f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.166066 Aug 23 11:32:52.601059 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3679/7409] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:52 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:53.621860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:53.622492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:53.629954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:53.630441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:53.630882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:53.631581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:53.632041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:53.632471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:53.765711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:53.773430 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3c8171f8-405e-4339-ab20-532680ac655b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.155507 Aug 23 11:32:53.774004 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3731/7410] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:53 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:54.794256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:54.794917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:54.802436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:54.802943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:54.803398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:54.804114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:54.804587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:54.805056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:54.934480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:54.943155 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d2dc43a7-5a31-4f1c-b527-0a8a30982f9d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.152881 Aug 23 11:32:54.943820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3680/7411] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:54 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:55.964279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:55.965356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:55.972180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:55.973309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:55.973924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:55.974682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:55.975147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:55.975578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:56.113838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:56.121629 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da8c5e85-d050-40d2-ad78-7abc32523ba4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.161330 Aug 23 11:32:56.122236 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3732/7412] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:55 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:57.142805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:57.143361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:57.150466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:57.150962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:57.151412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:57.152127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:57.152603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:57.153077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:57.168305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:57.286576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:57.294335 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2397e4ac-4ca9-41b8-a130-2f54b8a2933e tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.155580 Aug 23 11:32:57.294908 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3681/7413] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:57 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:58.315496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:58.316029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:58.319555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:32:58.324681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:58.325193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:58.325626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:58.326321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:58.326776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:58.327200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:58.458858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:58.466867 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-888ae057-0888-4556-a070-f4f623fb929a tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.155357 Aug 23 11:32:58.467442 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3733/7414] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:58 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:32:59.487555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:32:59.488275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:32:59.495809 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:59.496317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:59.496811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:59.497531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:32:59.498009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:32:59.498458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:32:59.633995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:32:59.642380 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-da02e0ff-4934-4c04-b724-106e435923c8 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.158833 Aug 23 11:32:59.642959 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3682/7415] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:32:59 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:00.664577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:00.665251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:00.673516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:00.674050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:00.674524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:00.675318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:00.675904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:00.676355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:00.820167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:00.827906 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc17a900-5083-4cc6-b380-e7a753ed69e2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.167758 Aug 23 11:33:00.828474 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3734/7416] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:00 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:01.850735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:01.851296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:01.854142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:01.859583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:01.860093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:01.860555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:01.861308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:01.861793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:01.862242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:02.002320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:02.010885 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fde23dd-c826-4f5d-b2da-3f5ddc8bed20 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.164354 Aug 23 11:33:02.011459 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3683/7417] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:01 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:03.031430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:03.032199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:03.039741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:03.040221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:03.040657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:03.041374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:03.041828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:03.042252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:03.177113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:03.185159 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c8427552-a0bc-474f-b72a-1810601cd886 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.157586 Aug 23 11:33:03.185732 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3735/7418] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:03 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:04.206602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:04.207708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:04.214184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:04.214744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:04.215130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:04.215832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:04.216555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:04.217142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:04.350962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:04.358864 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-baf25dc1-1fad-4d58-ba9e-6229ce061dcb tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.156210 Aug 23 11:33:04.359448 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3684/7419] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:04 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:05.380566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:05.381207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:05.387964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:05.388451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:05.388941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:05.389640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:05.390101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:05.390525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:05.522677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:05.530526 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-92c4f381-8c35-4544-b488-b929add8358b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.154398 Aug 23 11:33:05.531101 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3736/7420] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:05 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:06.552508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:06.553173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:06.559313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:06.559817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:06.560272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:06.561010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:06.561490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:06.561939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:06.692455 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:06.700287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f9480ddc-57bd-4102-994b-1523d7bd1af2 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.152608 Aug 23 11:33:06.700888 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3685/7421] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:06 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:07.721466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:07.722074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:07.728945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:07.729431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:07.729866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:07.730555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:07.731008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:07.731438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:07.865515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:07.873130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0a111712-7c64-4a1f-b2f6-90a20d12273f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.155510 Aug 23 11:33:07.873705 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3737/7422] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:07 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:08.894328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:08.895921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:08.902901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:08.903399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:08.903851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:08.904561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:08.905067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:08.905509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:09.059891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:09.068887 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a2757b4-eada-4893-af9d-56f82a007448 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.178457 Aug 23 11:33:09.069481 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3686/7423] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:08 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:10.090325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:10.091247 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:10.098205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:10.098697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:10.099139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:10.099842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:10.100306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:10.100757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:10.234617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:10.243057 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d28b839f-e722-45a9-b339-4260e630d77f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.156646 Aug 23 11:33:10.243637 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3738/7424] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:10 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:11.265164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:11.265804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:11.273814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:11.274322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:11.274782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:11.275510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:11.275990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:11.276441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:11.407944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:11.416045 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91e3a4e2-2946-40be-83f8-f5f30256bf50 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.154834 Aug 23 11:33:11.416628 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3687/7425] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:11 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:12.444186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:12.444815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:12.451776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:12.452259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:12.452698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:12.453417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:12.453871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:12.454298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:12.595518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:12.603458 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d6724a3-c6fa-4655-bbd9-4bd7e66f51bf tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.163813 Aug 23 11:33:12.604032 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3739/7426] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:12 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:13.624500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:13.625180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:13.632690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:13.633230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:13.633685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:13.634399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:13.634879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:13.635329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:13.769168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:13.777592 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3399bed7-c05a-4172-be97-4cbdca6f8858 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.157017 Aug 23 11:33:13.778175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3688/7427] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:13 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:14.799246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:14.799870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:14.808681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:14.809383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:14.810198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:14.811479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:14.812115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:14.812556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:14.945463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:14.953170 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47f36d6a-ed51-4a21-826a-39d3710230e1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.157831 Aug 23 11:33:14.953740 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3740/7428] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:14 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:15.974501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:15.975133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:15.982091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:15.982589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:15.983037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:15.983753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:15.984224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:15.984660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:16.122083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:16.130825 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e37be6f1-0e19-4e01-aefc-7320859bb54b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.160373 Aug 23 11:33:16.131411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3689/7429] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:15 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:17.151628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:17.152155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:17.159115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:17.159601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:17.160071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:17.160957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:17.161430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:17.161858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:17.295476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:17.304270 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2123335c-6336-4f89-8d0f-2464e18dc9df tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.156637 Aug 23 11:33:17.304937 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3741/7430] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:17 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:18.324692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:18.325305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:18.333034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:18.333536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:18.333980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:18.334684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:18.335148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:18.335584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:18.473736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:18.481606 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2bba0a45-b7df-4ca6-9409-d4e7258e4b5d tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1521 microversion: 2.1 time: 0.160910 Aug 23 11:33:18.482185 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3690/7431] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:18 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:19.503767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:19.505002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:19.512140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:19.512638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:19.513190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:19.513934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:19.514404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:19.514838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:19.517575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:19.652435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:19.660975 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-25e2489d-e049-4c46-a6d4-7b21793fd60b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1520 microversion: 2.1 time: 0.160757 Aug 23 11:33:19.661555 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3742/7432] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:19 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:19.937593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d447b742-5d60-4949-8eae-a50f6fb7f455", "name": "network-vif-unplugged", "status": "completed", "tag": "df3a8e68-b495-4f54-a957-9486da1df0e8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:19.947200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:19.949897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:19.949897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:19.961190 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] Creating event network-vif-unplugged:df3a8e68-b495-4f54-a957-9486da1df0e8 for instance d447b742-5d60-4949-8eae-a50f6fb7f455 on n-h1-847009-13 Aug 23 11:33:19.968484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] Instance d447b742-5d60-4949-8eae-a50f6fb7f455 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:33:19.981868 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d9061651-977b-4399-a8b0-fff6ed612ff2 req-84a38828-10e1-4e95-9596-b2ddb2f6d7ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112252 Aug 23 11:33:19.982726 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3691/7433] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:20.683122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:20.683742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:20.691355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:20.692363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:20.693122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:20.693846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:20.694317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:20.694757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:20.836718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:20.845108 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0f3d0792-ca88-4084-ac4d-618a6b1215b5 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1518 microversion: 2.1 time: 0.165986 Aug 23 11:33:20.845829 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3743/7434] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:20 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:21.868096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:21.868755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:21.874973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:21.875468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:21.875921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:21.876622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:21.877111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:21.877553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:22.005740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d447b742-5d60-4949-8eae-a50f6fb7f455", "tag": "df3a8e68-b495-4f54-a957-9486da1df0e8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:22.014442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:22.015883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:22.016384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:22.016846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:22.023081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-337a2907-27c2-4615-99e4-977f9b0656d4 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1518 microversion: 2.1 time: 0.160241 Aug 23 11:33:22.023669 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3692/7435] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:21 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:22.032432 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] Creating event network-changed:df3a8e68-b495-4f54-a957-9486da1df0e8 for instance d447b742-5d60-4949-8eae-a50f6fb7f455 on n-h1-847009-13 Aug 23 11:33:22.038571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] Instance d447b742-5d60-4949-8eae-a50f6fb7f455 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:33:22.049679 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9b838c52-f1db-4212-b7e9-4d30fb3f3a0d req-47a7c04f-838f-4a65-8c3e-b6943d9a8ff7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048846 Aug 23 11:33:22.050292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3744/7436] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:23.044252 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:23.044947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:23.052059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:23.052510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:23.053006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:23.053724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:23.054207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:23.054682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:23.183671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:23.191934 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-514c09d1-d7be-4e80-860f-baac37c7e165 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1518 microversion: 2.1 time: 0.151133 Aug 23 11:33:23.192514 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3693/7437] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:23 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:24.214622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:24.215322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:24.221743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:24.222235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:24.222774 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:24.223477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:24.223936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:24.224368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:24.358599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:24.366922 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73f38150-b134-4325-b408-134d23630c23 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1515 microversion: 2.1 time: 0.157676 Aug 23 11:33:24.367493 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3745/7438] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:24 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:24.388187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:24.388793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:24.396655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:24.397196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:24.397655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:24.398369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:24.398842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:24.399290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:24.459682 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-059923bf-3fc8-4e21-a005-61d55772b6e0 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "POST /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455/action" status: 204 len: 0 microversion: 2.1 time: 0.075100 Aug 23 11:33:24.460879 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3694/7439] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:33:24 2022] POST /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:33:24.470768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:24.471530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:24.479958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:24.480463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:24.480948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:24.481667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:24.482136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:24.482569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:24.745536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:24.753628 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-110eaba5-b111-45da-908d-83142c080f24 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1515 microversion: 2.1 time: 0.286724 Aug 23 11:33:24.754818 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3746/7440] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:24 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1515 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:25.777443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:25.778164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:25.784358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:25.784939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:25.785415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:25.786116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:25.786588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:25.787023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:25.925201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:25.933253 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-43bd1d0b-079a-4864-b386-ff0419dac2ce tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1515 microversion: 2.1 time: 0.160853 Aug 23 11:33:25.933841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3695/7441] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:25 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:26.954406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:26.955238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:26.964070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:26.964575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:26.965048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:26.966250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:26.966871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:26.967300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.032601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-dd908bdc-69df-418f-bdb7-f725a5f40c27 req-a0eb5e14-898b-4985-a4f0-1f3c2fd3ce3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d447b742-5d60-4949-8eae-a50f6fb7f455", "name": "network-vif-plugged", "status": "completed", "tag": "df3a8e68-b495-4f54-a957-9486da1df0e8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:27.044896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dd908bdc-69df-418f-bdb7-f725a5f40c27 req-a0eb5e14-898b-4985-a4f0-1f3c2fd3ce3a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.045410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dd908bdc-69df-418f-bdb7-f725a5f40c27 req-a0eb5e14-898b-4985-a4f0-1f3c2fd3ce3a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.045921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-dd908bdc-69df-418f-bdb7-f725a5f40c27 req-a0eb5e14-898b-4985-a4f0-1f3c2fd3ce3a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.060643 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-dd908bdc-69df-418f-bdb7-f725a5f40c27 req-a0eb5e14-898b-4985-a4f0-1f3c2fd3ce3a service nova] Creating event network-vif-plugged:df3a8e68-b495-4f54-a957-9486da1df0e8 for instance d447b742-5d60-4949-8eae-a50f6fb7f455 on n-h1-847009-13 Aug 23 11:33:27.065682 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-dd908bdc-69df-418f-bdb7-f725a5f40c27 req-a0eb5e14-898b-4985-a4f0-1f3c2fd3ce3a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037237 Aug 23 11:33:27.067271 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3696/7442] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:27.108528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:27.116583 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6af5b8db-94f3-4ff4-ad5d-ca7612efe156 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1507 microversion: 2.1 time: 0.166595 Aug 23 11:33:27.117231 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3747/7443] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:26 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:27.137690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:27.138426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:27.145269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.145780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.146262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.146986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.147464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.147913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.282231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:27.284562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:27.292184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2798c0fe-5ec1-4fb4-a3dd-a40c49cb2a45 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1507 microversion: 2.1 time: 0.158692 Aug 23 11:33:27.292781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3697/7444] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:27 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:27.312263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:27.312840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:27.318915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.319401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.319839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.320531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.321015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.321445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.448863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:27.456641 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47ff609f-8689-49de-887e-13d19fa6ed36 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1507 microversion: 2.1 time: 0.148246 Aug 23 11:33:27.457742 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3748/7445] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:27 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:27.478757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:27.479277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:27.486643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.487152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.487612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.488376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.488992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.489444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.515804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:33:27.591825 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a2fadcf3-58a9-4c46-9cb9-b21534e48736 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 204 len: 0 microversion: 2.1 time: 0.116609 Aug 23 11:33:27.592798 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3698/7446] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:33:27 2022] DELETE /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:33:27.607142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:27.607820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:27.613931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.614427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.614872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.615578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.616042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.616477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.640639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:33:27.685855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.compute.api [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Instance is already in deleting state, ignoring this request Aug 23 11:33:27.686710 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-daeb6569-9ab5-41e4-8371-79e914c8ca8b tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 204 len: 0 microversion: 2.1 time: 0.083502 Aug 23 11:33:27.687272 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3749/7447] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:33:27 2022] DELETE /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:33:27.696076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:27.696853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:27.702877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.703384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.703840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.704552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:27.705062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:27.705511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:27.839815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:27.848392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f7e52cf-5867-423c-8fe8-f828cd6eeee1 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1513 microversion: 2.1 time: 0.156461 Aug 23 11:33:27.848986 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3699/7448] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:27 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:28.870265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:28.870873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:28.873641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=34 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:28.878941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:28.879426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:28.879858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:28.880572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:28.881058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:28.881478 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:29.012764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35fac266225d4408a503822a5a5dd055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b0790625a184c43bec4fd65ca88d5bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:29.020441 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4d849268-0ce4-4306-943a-74a2d84ba2ea tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 200 len: 1513 microversion: 2.1 time: 0.154340 Aug 23 11:33:29.021032 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3750/7449] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:28 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:29.662760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-09872792-6515-4cdd-a096-21ff488a5ebb req-a47ddaf8-d7a8-4b1a-91bc-3764e219a4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d447b742-5d60-4949-8eae-a50f6fb7f455", "name": "network-vif-deleted", "tag": "df3a8e68-b495-4f54-a957-9486da1df0e8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:29.673469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-09872792-6515-4cdd-a096-21ff488a5ebb req-a47ddaf8-d7a8-4b1a-91bc-3764e219a4fb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:29.674101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-09872792-6515-4cdd-a096-21ff488a5ebb req-a47ddaf8-d7a8-4b1a-91bc-3764e219a4fb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:29.674626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-09872792-6515-4cdd-a096-21ff488a5ebb req-a47ddaf8-d7a8-4b1a-91bc-3764e219a4fb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:29.686674 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-09872792-6515-4cdd-a096-21ff488a5ebb req-a47ddaf8-d7a8-4b1a-91bc-3764e219a4fb service nova] Creating event network-vif-deleted:df3a8e68-b495-4f54-a957-9486da1df0e8 for instance d447b742-5d60-4949-8eae-a50f6fb7f455 on n-h1-847009-13 Aug 23 11:33:29.692950 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-09872792-6515-4cdd-a096-21ff488a5ebb req-a47ddaf8-d7a8-4b1a-91bc-3764e219a4fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Aug 23 11:33:29.693662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3700/7450] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:30.041886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:30.042527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: d447b742-5d60-4949-8eae-a50f6fb7f455] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:30.049695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:30.050184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:30.051055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:30.052323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:30.052803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:30.053230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:30.070084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] HTTP exception thrown: Instance d447b742-5d60-4949-8eae-a50f6fb7f455 could not be found. Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Request method failure captured: Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 HTTP/1.1 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLqlf1Mc5k70UsiTuRIsMBtOXHSjCrhOymwy0eWRe8LmIyCLtkLXbu16A_c7aAHr4SEHn_z7nWtOzUzy9FxjEt4CSKsjUVLjMRiLxXJJ3tpLjCBpEcyrkiuy7VUSM_E_OuCIGUJwrUAMk8XRJvMmyfxJs-MqybP2dz4CntD1tKScb_k Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6b0790625a184c43bec4fd65ca88d5bc Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b0790625a184c43bec4fd65ca88d5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b0790625a184c43bec4fd65ca88d5bc", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b0790625a184c43bec4fd65ca88d5bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b0790625a184c43bec4fd65ca88d5bc"}]}] Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6b0790625a184c43bec4fd65ca88d5bc Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiskConfigTestJSON-1504548215-project Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 35fac266225d4408a503822a5a5dd055 Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiskConfigTestJSON-1504548215-project Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d447b742-5d60-4949-8eae-a50f6fb7f455 could not be found. Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd447b742-5d60-4949-8eae-a50f6fb7f455'} Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d447b742-5d60-4949-8eae-a50f6fb7f455 could not be found. Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d447b742-5d60-4949-8eae-a50f6fb7f455 could not be found. Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:33:30.071678 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d447b742-5d60-4949-8eae-a50f6fb7f455 could not be found. Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Returning 404 to user: Instance d447b742-5d60-4949-8eae-a50f6fb7f455 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59d58c9c-e300-4868-8aed-b1437a7ffe08 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455" status: 404 len: 111 microversion: 2.1 time: 0.035277 Aug 23 11:33:30.076058 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3751/7451] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:30 2022] GET /compute/v2.1/servers/d447b742-5d60-4949-8eae-a50f6fb7f455 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:33:30.082822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a9d61fcf-0e64-4cf7-8738-7326ddb1774f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '.version_select at 0x7fdc8f7eec10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:30.103212 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a9d61fcf-0e64-4cf7-8738-7326ddb1774f tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836917112" status: 202 len: 0 microversion: 2.1 time: 0.024710 Aug 23 11:33:30.103796 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3701/7452] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 11:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836917112 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:33:30.750301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:30.750822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:30.757856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:30.758341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:30.758778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:30.759472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:30.759932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:30.760405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:30.774576 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] HTTP exception thrown: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Request method failure captured: Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 HTTP/1.1 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLqlf1Mc5k70UsiTuRIsMBtOXHSjCrhOymwy0eWRe8LmIyCLtkLXbu16A_c7aAHr4SEHn_z7nWtOzUzy9FxjEt4CSKsjUVLjMRiLxXJJ3tpLjCBpEcyrkiuy7VUSM_E_OuCIGUJwrUAMk8XRJvMmyfxJs-MqybP2dz4CntD1tKScb_k Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 6b0790625a184c43bec4fd65ca88d5bc Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b0790625a184c43bec4fd65ca88d5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b0790625a184c43bec4fd65ca88d5bc", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b0790625a184c43bec4fd65ca88d5bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b0790625a184c43bec4fd65ca88d5bc"}]}] Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 6b0790625a184c43bec4fd65ca88d5bc Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerDiskConfigTestJSON-1504548215-project Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 35fac266225d4408a503822a5a5dd055 Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerDiskConfigTestJSON-1504548215-project Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '443a057b-8bda-4a6a-99e2-870d7aef5831'} Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:33:30.776113 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Returning 404 to user: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2e263220-05b6-42a8-abf0-3f40a92eb429 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "DELETE /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 404 len: 111 microversion: 2.1 time: 0.031135 Aug 23 11:33:30.780314 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3752/7453] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:33:30 2022] DELETE /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:33:30.786631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:30.787442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] [instance: 443a057b-8bda-4a6a-99e2-870d7aef5831] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:30.794952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:30.795450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:30.795900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:30.796606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:30.797103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:30.797547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:30.810968 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] HTTP exception thrown: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Request method failure captured: Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 HTTP/1.1 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLqlf1Mc5k70UsiTuRIsMBtOXHSjCrhOymwy0eWRe8LmIyCLtkLXbu16A_c7aAHr4SEHn_z7nWtOzUzy9FxjEt4CSKsjUVLjMRiLxXJJ3tpLjCBpEcyrkiuy7VUSM_E_OuCIGUJwrUAMk8XRJvMmyfxJs-MqybP2dz4CntD1tKScb_k Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 6b0790625a184c43bec4fd65ca88d5bc Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b0790625a184c43bec4fd65ca88d5bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b0790625a184c43bec4fd65ca88d5bc", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b0790625a184c43bec4fd65ca88d5bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b0790625a184c43bec4fd65ca88d5bc"}]}] Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 6b0790625a184c43bec4fd65ca88d5bc Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1504548215 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerDiskConfigTestJSON-1504548215-project Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 35fac266225d4408a503822a5a5dd055 Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerDiskConfigTestJSON-1504548215-project Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '443a057b-8bda-4a6a-99e2-870d7aef5831'} Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:33:30.812795 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] Returning 404 to user: Instance 443a057b-8bda-4a6a-99e2-870d7aef5831 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c5b19167-a34f-4c9a-81df-17746c86f233 tempest-ServerDiskConfigTestJSON-1504548215 tempest-ServerDiskConfigTestJSON-1504548215-project] 10.222.0.78 "GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831" status: 404 len: 111 microversion: 2.1 time: 0.031879 Aug 23 11:33:30.823483 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3702/7454] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:30 2022] GET /compute/v2.1/servers/443a057b-8bda-4a6a-99e2-870d7aef5831 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:33:39.527507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fd9ba3f5-8f0c-42aa-b08f-772c371fa43f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'create', calling method: .version_select at 0x7fdc8f43d5e0>, body: {"keypair": {"name": "tempest-keypair-304059490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8Fsxw3cI+MBQzHBY9tfdiARZuWfWKLiBpbN2h2zjcqdeYuYzxXnOX7weojqHtSD6JQWbuJqFav8xKHR5ozHyLEau30IvkkHrbiJVFz1cd4EhyjTgaWK+ANenLww1pXFg=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:39.543457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-fd9ba3f5-8f0c-42aa-b08f-772c371fa43f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:33:39.549010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-fd9ba3f5-8f0c-42aa-b08f-772c371fa43f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:33:39.579998 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fd9ba3f5-8f0c-42aa-b08f-772c371fa43f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189505 Aug 23 11:33:39.580855 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3753/7455] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:33:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:41.213643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-941774494", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2ef433d-5566-4fa0-a5bd-e65a9e9a0459"}], "security_groups": [{"name": "tempest-securitygroup--1345270865"}], "key_name": "tempest-keypair-304059490", "user_data": "}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:41.224032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:41.224778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:41.337807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] validate_networks() for [('b2ef433d-5566-4fa0-a5bd-e65a9e9a0459', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:33:41.734114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:33:41.734563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:33:41.735061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:33:41.735528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:33:41.736003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:33:41.746023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:41.746531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:41.746994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:41.747749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:41.748231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:41.748714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:41.767580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:33:41.773142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:33:41.786010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:33:41.788381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:33:41.836227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dec47741-81b3-4f0c-a0e9-b9658d47d0b6 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.627354 Aug 23 11:33:41.837283 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3703/7456] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:33:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:33:41.845893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:41.850776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-abd1499d-264c-4c13-870a-522d6ae07e1e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:41.851399 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-abd1499d-264c-4c13-870a-522d6ae07e1e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:41.939563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-abd1499d-264c-4c13-870a-522d6ae07e1e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:41.949768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-abd1499d-264c-4c13-870a-522d6ae07e1e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1237 microversion: 2.1 time: 0.105541 Aug 23 11:33:41.950528 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3754/7457] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:41 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:42.974283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:42.976442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:42.989078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:42.989593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:42.990056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:42.990773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:42.991245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:42.991686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:43.060441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:43.069432 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-348fbf65-6a00-476d-b512-8a0d41c082ca tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1289 microversion: 2.1 time: 0.101615 Aug 23 11:33:43.070228 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3704/7458] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:42 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:44.091756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:44.092368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:44.099565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:44.100060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:44.100509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:44.101256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:44.101716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:44.102148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:44.244267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:44.252472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6acf55bc-edd5-4ec4-90d9-edf0cb079137 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.164875 Aug 23 11:33:44.253093 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3755/7459] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:44 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:44.716053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ca1fd805-ca00-451c-b6d0-ebf70c621171 req-ade9801d-ddab-46e4-b691-d0c9e136da74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:44.728016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca1fd805-ca00-451c-b6d0-ebf70c621171 req-ade9801d-ddab-46e4-b691-d0c9e136da74 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:44.728516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca1fd805-ca00-451c-b6d0-ebf70c621171 req-ade9801d-ddab-46e4-b691-d0c9e136da74 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:44.728992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca1fd805-ca00-451c-b6d0-ebf70c621171 req-ade9801d-ddab-46e4-b691-d0c9e136da74 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:44.743066 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ca1fd805-ca00-451c-b6d0-ebf70c621171 req-ade9801d-ddab-46e4-b691-d0c9e136da74 service nova] Creating event network-changed:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h1-847009-13 Aug 23 11:33:44.747939 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ca1fd805-ca00-451c-b6d0-ebf70c621171 req-ade9801d-ddab-46e4-b691-d0c9e136da74 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036053 Aug 23 11:33:44.748557 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3705/7460] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:33:45.274592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:45.275205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:45.282037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:45.282523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:45.282964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:45.283656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:45.284115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:45.285186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:45.415871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:45.423487 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-922f12f0-9033-40a1-a180-69617305fd14 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.152845 Aug 23 11:33:45.424065 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3756/7461] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:45 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:46.445312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:46.446037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:46.452369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:46.453059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:46.453389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:46.454627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:46.455288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:46.455965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:46.601567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:46.609257 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cadf71fb-b432-4ef6-ba2c-ed7da0d0b220 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.169112 Aug 23 11:33:46.609834 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3706/7462] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:46 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:47.631314 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:47.631851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:47.638558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:47.639059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:47.639477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:47.640182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:47.640636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:47.641088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:47.777857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:47.786202 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f64e518-2933-4bb7-9939-52d727fe74de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.159751 Aug 23 11:33:47.786778 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3757/7463] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:47 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:33:48.811035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:48.811610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:48.818665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:48.819203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:48.819651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:48.820357 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:48.820862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:48.821304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:48.953447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:48.961671 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b379335-668b-42b2-a9fd-5de5a2456f97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.154538 Aug 23 11:33:48.962543 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3707/7464] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:48 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:49.983528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:49.984135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:49.991586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:49.992069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:49.992503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:49.993214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:49.993670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:49.994094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:50.136549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:50.144241 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3c854b0-1e0b-4b93-99ed-f07849b48b0f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.164550 Aug 23 11:33:50.144823 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3758/7465] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:49 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:51.147280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-bbbdb726-8965-4069-9b3e-2a02333c8034 req-e877d28a-b490-43a9-ad86-e23cf1954d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "name": "network-vif-plugged", "status": "completed", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:51.160144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bbbdb726-8965-4069-9b3e-2a02333c8034 req-e877d28a-b490-43a9-ad86-e23cf1954d1b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:51.160144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bbbdb726-8965-4069-9b3e-2a02333c8034 req-e877d28a-b490-43a9-ad86-e23cf1954d1b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:51.160144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-bbbdb726-8965-4069-9b3e-2a02333c8034 req-e877d28a-b490-43a9-ad86-e23cf1954d1b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:51.165413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:51.165932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:51.173073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:51.173554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:51.173996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:51.174710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:51.175989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:51.176256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:51.183855 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-bbbdb726-8965-4069-9b3e-2a02333c8034 req-e877d28a-b490-43a9-ad86-e23cf1954d1b service nova] Creating event network-vif-plugged:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h1-847009-13 Aug 23 11:33:51.189723 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-bbbdb726-8965-4069-9b3e-2a02333c8034 req-e877d28a-b490-43a9-ad86-e23cf1954d1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046958 Aug 23 11:33:51.191395 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3708/7466] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:51.314062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:51.321987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ed95235c-8a17-45a1-b176-fed08b81ce8d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.160614 Aug 23 11:33:51.322506 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3759/7467] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:51 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:52.340311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:52.341353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:52.346208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:52.347057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:52.354082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:52.354578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:52.355032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:52.355732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:52.356202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:52.356639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:52.494253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:52.508974 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b479d0f1-e889-4ec4-a768-9dbbee61e465 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1363 microversion: 2.1 time: 0.169590 Aug 23 11:33:52.510089 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3709/7468] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:52 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:53.533580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:53.534830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:53.536719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:33:53.542858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:53.543351 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:53.543797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:53.544497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:53.544999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:53.545441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:53.678100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:33:53.685952 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2dbf79b7-9ebd-4d91-acd4-203208620c96 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1550 microversion: 2.1 time: 0.156277 Aug 23 11:33:53.686616 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3760/7469] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:33:53 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:33:53.706810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:33:53.707485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:33:53.714356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:53.714855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:53.715310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:53.716360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:53.716868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:53.717314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:53.795837 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d6073b1a-8356-4d17-8183-591a90404236 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093471 Aug 23 11:33:53.796489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3710/7470] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:33:53 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:33:54.728789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c5340e0a-8e96-493b-8293-f451706139b7 req-399c62d0-6b1b-494a-8df7-90ed4336f203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:33:54.739561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c5340e0a-8e96-493b-8293-f451706139b7 req-399c62d0-6b1b-494a-8df7-90ed4336f203 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:33:54.740049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c5340e0a-8e96-493b-8293-f451706139b7 req-399c62d0-6b1b-494a-8df7-90ed4336f203 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:33:54.740488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c5340e0a-8e96-493b-8293-f451706139b7 req-399c62d0-6b1b-494a-8df7-90ed4336f203 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:33:54.751689 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c5340e0a-8e96-493b-8293-f451706139b7 req-399c62d0-6b1b-494a-8df7-90ed4336f203 service nova] Creating event network-changed:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h1-847009-13 Aug 23 11:33:54.757788 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c5340e0a-8e96-493b-8293-f451706139b7 req-399c62d0-6b1b-494a-8df7-90ed4336f203 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032810 Aug 23 11:33:54.758394 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3761/7471] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:35:10.063490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:10.064276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=34 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:10.069734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:10.070371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:10.078040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.078541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.078999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.079711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.080182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.080630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.360654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:10.368979 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74e9a7d0-3aff-4afd-89a8-6b85f36152cd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1668 microversion: 2.1 time: 0.309047 Aug 23 11:35:10.369545 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3711/7472] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:10 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:10.389479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:10.390268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=38 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:10.394861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:10.395573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:10.403268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.403759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.404210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.404944 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.405440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.405874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.668808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:10.676467 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b868919c-60b9-4953-a746-0318bff92e35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1668 microversion: 2.1 time: 0.289862 Aug 23 11:35:10.677688 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3762/7473] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:10 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1668 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:10.696608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:10.697308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:10.703435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.703942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.704402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.705144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.705624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.706072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.834934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:10.842879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-06295537-c9a2-4aac-8147-7a51e41d31a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1668 microversion: 2.1 time: 0.150180 Aug 23 11:35:10.843448 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3712/7474] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:10 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:10.863645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:10.866143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:10.872118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.872613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.873098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.873798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.874262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.874693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.902566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:10.908223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:35:10.915418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:35:10.915845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:35:10.916324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:35:10.916758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:35:10.917181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:35:10.979990 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce18b41f-de8f-4b6f-b9a7-d9384da7cd5e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d/action" status: 202 len: 0 microversion: 2.1 time: 0.120265 Aug 23 11:35:10.980616 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3763/7475] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:35:10 2022] POST /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:35:10.988683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:10.989352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:10.995422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.995956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.996418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:10.997210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:10.997698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:10.998144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:11.166535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:11.174684 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-633d3345-16f3-4111-b345-456a2857e922 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1677 microversion: 2.1 time: 0.189839 Aug 23 11:35:11.175268 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3713/7476] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:10 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:12.198898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:12.199516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:12.206413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:12.206901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:12.207340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:12.208033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:12.209018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:12.209503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:12.394219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:12.403038 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-731574d2-36b2-416d-acd1-41b033d43eea tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1677 microversion: 2.1 time: 0.208969 Aug 23 11:35:12.403851 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3764/7477] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:12 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:13.425229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:13.425868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:13.433564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:13.434070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:13.434524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:13.435234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:13.435710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:13.436153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:13.571616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:13.579620 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73256715-1687-451e-9dc0-dacf4cd381b8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.158307 Aug 23 11:35:13.580233 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3714/7478] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:13 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:14.601164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:14.601809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:14.608658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:14.609179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:14.609622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:14.610323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:14.610788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:14.611242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:14.742279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:14.750034 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bbcba4f5-aee8-4e14-8195-aea02c4c15a9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.152902 Aug 23 11:35:14.750610 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3765/7479] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:14 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:15.772418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:15.773123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:15.779980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:15.780477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:15.780958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:15.781665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:15.782134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:15.782578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:15.914788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:15.922704 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a23e095-1780-4b1c-88fa-ffd66d778722 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.154931 Aug 23 11:35:15.923282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3715/7480] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:15 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:16.943966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:16.944573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:16.951313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:16.951793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:16.952231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:16.952959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:16.953414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:16.953838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:17.356838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:17.365097 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9663ddfc-bc08-4cce-aab5-a275cd50d93c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.424964 Aug 23 11:35:17.365925 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3766/7481] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:16 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:18.386105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:18.386689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:18.393644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:18.394152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:18.394609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:18.395338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:18.395845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:18.396348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:18.534486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:18.542786 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ffa0aa61-6cf8-4220-b154-1908583b044a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.160779 Aug 23 11:35:18.543356 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3716/7482] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:18 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:19.564165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:19.564793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:19.571864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:19.572359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:19.572865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:19.573573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:19.574036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:19.574469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:19.707039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:19.715527 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f3f4834-7881-4566-a038-34c29418e53a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.155273 Aug 23 11:35:19.716081 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3767/7483] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:19 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:20.737421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:20.738055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:20.746146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:20.746670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:20.747113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:20.747828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:20.748305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:20.748767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:20.880206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:20.888173 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1454d373-ff23-4444-9720-4acde92d811c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.154759 Aug 23 11:35:20.888769 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3717/7484] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:20 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:21.909287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:21.909818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:21.917574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:21.918106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:21.918551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:21.919367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:21.919831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:21.920261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:22.053696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:22.061415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c2b45f5-0347-4fc6-be3f-9b58112fa13c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.156057 Aug 23 11:35:22.061993 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3768/7485] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:21 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:23.083149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:23.083776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:23.091079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:23.091576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:23.092026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:23.092759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:23.093219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:23.093657 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:23.222143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:23.231003 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-283b3591-b729-4a70-91d4-0dcdaa77c5a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.151795 Aug 23 11:35:23.231578 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3718/7486] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:23 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:24.253126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:24.253694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:24.261540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:24.262039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:24.262488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:24.263293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:24.263874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:24.264422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:24.399976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:24.407738 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d5f9ba11-cb04-4fc4-8c4d-454295594700 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1682 microversion: 2.1 time: 0.158656 Aug 23 11:35:24.408308 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3769/7487] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:24 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:25.429060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:25.429702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:25.436606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:25.437774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:25.438246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:25.438976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:25.439460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:25.439940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:25.577724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:25.586322 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-902b8c32-4ceb-4f73-9a32-968df0bbcfe4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1681 microversion: 2.1 time: 0.161194 Aug 23 11:35:25.586933 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3719/7488] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:25 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:25.943081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "name": "network-vif-unplugged", "status": "completed", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:25.954925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:25.954925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:25.954925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:25.966415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] Creating event network-vif-unplugged:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h2-847009-13 Aug 23 11:35:25.972189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:35:25.984987 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-14d637a8-91cf-460a-a29b-d63dbb8264bd req-e1fa4771-8a0b-4255-8418-54cbc6486bc1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099949 Aug 23 11:35:25.986243 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3770/7489] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:26.607844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:26.608512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:26.615695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:26.616253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:26.616723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:26.617479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:26.617960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:26.618411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:26.757185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:26.765231 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-502b62f3-b3b6-42bc-bc4d-f673f8b6d1b5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1681 microversion: 2.1 time: 0.161478 Aug 23 11:35:26.765813 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3720/7490] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:26 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:27.787936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:27.788661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:27.796073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:27.796568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:27.797053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:27.797761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:27.798232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:27.798671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:27.937883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:27.946286 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8028506e-8380-4ad8-b03b-e7b52e3461b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1679 microversion: 2.1 time: 0.163165 Aug 23 11:35:27.946856 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3771/7491] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:27 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:28.028555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:28.039652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:28.040095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:28.040552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:28.052082 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] Creating event network-changed:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h2-847009-13 Aug 23 11:35:28.057790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:35:28.068517 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-26663404-55fb-4049-b74d-edafff2c01c6 req-028618be-bf35-44cb-a04e-3a1555f6c9e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043695 Aug 23 11:35:28.069235 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3721/7492] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:28.968146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:28.968817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:28.976416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:28.976942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:28.977420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:28.978132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:28.978590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:28.979025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:29.113794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:29.122183 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e06f9154-6673-4d4a-af91-a16b177aaf9c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1676 microversion: 2.1 time: 0.158157 Aug 23 11:35:29.122774 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3772/7493] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:28 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:29.145430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:29.146165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:29.153035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:29.153549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:29.154009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:29.154724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:29.155202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:29.155650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:29.213479 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-468b87f7-eb3b-41a2-bdc5-25ee8eee1d7a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d/action" status: 204 len: 0 microversion: 2.1 time: 0.072990 Aug 23 11:35:29.214180 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3722/7494] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:35:29 2022] POST /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:35:29.222540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:29.223157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:29.229200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:29.229688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:29.230132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:29.230907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:29.231467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:29.231903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:29.370442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:29.378348 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ce89dcd6-f99c-4f84-9541-21cb56d44b9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1676 microversion: 2.1 time: 0.159700 Aug 23 11:35:29.378927 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3773/7495] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:29 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:30.403631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:30.404234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:30.411265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:30.411780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:30.412664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:30.413495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:30.414004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:30.414456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:30.560094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:30.567851 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bd0d9203-3ded-4cc4-a1fb-a1f0934f3dba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1676 microversion: 2.1 time: 0.171062 Aug 23 11:35:30.568492 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3723/7496] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:30 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:31.592441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:31.593164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:31.600453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:31.601082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:31.601534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:31.602245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:31.602712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:31.603144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:31.733669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:31.742045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-63994192-44fa-4628-8882-c19e17016d8e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1668 microversion: 2.1 time: 0.154429 Aug 23 11:35:31.742617 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3774/7497] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:31 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:31.761987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:31.762622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:31.769575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:31.770068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:31.770515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:31.771219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:31.772207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:31.772685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:31.903830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:31.911487 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88738dc8-393b-4264-8696-f6a42a09fd37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1668 microversion: 2.1 time: 0.153379 Aug 23 11:35:31.912048 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3724/7498] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:31 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:31.931911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:31.932565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:31.938725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:31.939226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:31.939677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:31.940393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:31.940902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:31.941344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:32.085947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:32.093971 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-baf7556d-2312-40c2-be41-617d1b563ec2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1668 microversion: 2.1 time: 0.165999 Aug 23 11:35:32.094859 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3775/7499] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:31 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:32.114902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:32.115346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:32.121686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:32.122202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:32.122666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:32.123394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:32.123875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:32.124327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:32.150451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:35:32.184763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:32.229813 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-61d3cabb-d079-40cd-816b-09ce6ebc81c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 204 len: 0 microversion: 2.1 time: 0.118619 Aug 23 11:35:32.230518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3725/7500] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:35:32 2022] DELETE /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:35:32.238677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:32.239373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:32.245643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:32.246241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:32.246718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:32.247512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:32.247976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:32.248405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:32.388060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:32.397443 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-303108c5-d7b2-4332-be77-2705dd036d4b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1674 microversion: 2.1 time: 0.161927 Aug 23 11:35:32.398482 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3776/7501] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:32 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:32.512263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1e658f84-88d3-4292-a257-5ce57a75f834 req-21ed0516-a4cd-4cb3-9d2d-3e934a8a5689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "name": "network-vif-plugged", "status": "completed", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:32.521747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1e658f84-88d3-4292-a257-5ce57a75f834 req-21ed0516-a4cd-4cb3-9d2d-3e934a8a5689 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:32.522365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1e658f84-88d3-4292-a257-5ce57a75f834 req-21ed0516-a4cd-4cb3-9d2d-3e934a8a5689 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:32.522820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1e658f84-88d3-4292-a257-5ce57a75f834 req-21ed0516-a4cd-4cb3-9d2d-3e934a8a5689 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:32.533803 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1e658f84-88d3-4292-a257-5ce57a75f834 req-21ed0516-a4cd-4cb3-9d2d-3e934a8a5689 service nova] Creating event network-vif-plugged:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h2-847009-13 Aug 23 11:35:32.540390 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1e658f84-88d3-4292-a257-5ce57a75f834 req-21ed0516-a4cd-4cb3-9d2d-3e934a8a5689 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089179 Aug 23 11:35:32.541662 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3726/7502] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:33.419459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:33.420080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:33.426973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:33.427471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:33.427949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:33.428667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:33.429155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:33.429592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:33.447559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:33.562188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:33.570225 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3a66a17-695f-48e2-9c70-89e7f3a2b13a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1674 microversion: 2.1 time: 0.154658 Aug 23 11:35:33.570808 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3777/7503] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:33 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:34.593299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:34.594024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:34.600543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:34.601089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:34.601551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:34.602269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:34.602749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:34.603199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:34.671247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:34.680467 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d5b251b7-ad68-409b-8544-367fbf4cfe7b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 200 len: 1606 microversion: 2.1 time: 0.092741 Aug 23 11:35:34.681190 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3727/7504] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:34 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 1606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:34.684100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d4fb89dc-4a17-44e4-9f45-385f6ba0d69a req-203938e5-a227-449e-9819-4cf1c222c6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d", "name": "network-vif-deleted", "tag": "667f5fdc-6fef-46b5-90ae-78b9a55edf82"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:34.696117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4fb89dc-4a17-44e4-9f45-385f6ba0d69a req-203938e5-a227-449e-9819-4cf1c222c6cd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:34.696977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4fb89dc-4a17-44e4-9f45-385f6ba0d69a req-203938e5-a227-449e-9819-4cf1c222c6cd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:34.697706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4fb89dc-4a17-44e4-9f45-385f6ba0d69a req-203938e5-a227-449e-9819-4cf1c222c6cd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:34.710812 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d4fb89dc-4a17-44e4-9f45-385f6ba0d69a req-203938e5-a227-449e-9819-4cf1c222c6cd service nova] Creating event network-vif-deleted:667f5fdc-6fef-46b5-90ae-78b9a55edf82 for instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d on n-h2-847009-13 Aug 23 11:35:34.717142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d4fb89dc-4a17-44e4-9f45-385f6ba0d69a req-203938e5-a227-449e-9819-4cf1c222c6cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037424 Aug 23 11:35:34.718584 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3778/7505] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:35.702708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:35.703261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:35.710168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:35.710660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:35.711116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:35.711815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:35.712282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:35.712718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:35.726766 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d HTTP/1.1 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d'} Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:35:35.728434 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-02a8721f-c8a3-4b5d-aad6-bb4757e43b5a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 404 len: 111 microversion: 2.1 time: 0.031246 Aug 23 11:35:35.734224 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3728/7506] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:35 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:35:35.745914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:35.746627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:35.753848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:35.754343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:35.754790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:35.755494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:35.756558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:35.757024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:35.771037 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d HTTP/1.1 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d'} Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:35:35.773073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c8a6b992-23cc-43ff-9473-cb2efbdf6b5d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 404 len: 111 microversion: 2.1 time: 0.032921 Aug 23 11:35:35.777700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3779/7507] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:35 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:35:35.827631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1726904931", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "b2ef433d-5566-4fa0-a5bd-e65a9e9a0459"}], "security_groups": [{"name": "tempest-securitygroup--1345270865"}], "key_name": "tempest-keypair-304059490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:35.933539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] validate_networks() for [('b2ef433d-5566-4fa0-a5bd-e65a9e9a0459', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:35:36.323039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:35:36.323515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:35:36.324020 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:35:36.324463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:35:36.324942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:35:36.334475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:36.335196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:36.335677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:36.336442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:36.336961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:36.337411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:36.355156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:35:36.360524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:35:36.373072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:35:36.375399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:35:36.422035 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-910c7c50-7db5-41c4-b6f2-c25dec87671a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.598484 Aug 23 11:35:36.422689 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3729/7508] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:35:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:35:36.434152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c682941c-c38f-4443-baa4-d3f86f708025 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:36.434923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c682941c-c38f-4443-baa4-d3f86f708025 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:36.501299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c682941c-c38f-4443-baa4-d3f86f708025 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:36.508468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c682941c-c38f-4443-baa4-d3f86f708025 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1238 microversion: 2.1 time: 0.078366 Aug 23 11:35:36.512338 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3780/7509] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:36 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:37.531502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:37.532798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:37.541628 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:37.542182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:37.542639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:37.543424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:37.543908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:37.544400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:37.637350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:37.645691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ed7fbb2-014c-43d6-9b3e-dac64d7a7697 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1298 microversion: 2.1 time: 0.119206 Aug 23 11:35:37.656779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3730/7510] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:37 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:38.668804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:38.669412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:38.678808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:38.679312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:38.679766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:38.680483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:38.681007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:38.681453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:38.817629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:38.826753 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-073ed7ef-e454-4d14-ab92-0b36dabf247c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.161916 Aug 23 11:35:38.827405 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3781/7511] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:38 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:39.213157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-fbbebd67-ad0f-47c5-a296-8b884efed2a7 req-6cad0862-9f3d-4a1b-b6b2-d249c4a1dc71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:39.223418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fbbebd67-ad0f-47c5-a296-8b884efed2a7 req-6cad0862-9f3d-4a1b-b6b2-d249c4a1dc71 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:39.223925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fbbebd67-ad0f-47c5-a296-8b884efed2a7 req-6cad0862-9f3d-4a1b-b6b2-d249c4a1dc71 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:39.224380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-fbbebd67-ad0f-47c5-a296-8b884efed2a7 req-6cad0862-9f3d-4a1b-b6b2-d249c4a1dc71 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:39.237181 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-fbbebd67-ad0f-47c5-a296-8b884efed2a7 req-6cad0862-9f3d-4a1b-b6b2-d249c4a1dc71 service nova] Creating event network-changed:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h1-847009-13 Aug 23 11:35:39.243244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-fbbebd67-ad0f-47c5-a296-8b884efed2a7 req-6cad0862-9f3d-4a1b-b6b2-d249c4a1dc71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108358 Aug 23 11:35:39.243852 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3731/7512] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:39.849547 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:39.850142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:39.856997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:39.857480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:39.857921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:39.858612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:39.859073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:39.859501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:39.991097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:39.998931 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5602fafa-d327-42d2-b0c3-f44d8aaf6c9e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.153453 Aug 23 11:35:39.999494 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3782/7513] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:39 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:41.025551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:41.026282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:41.028275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:41.033824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:41.034317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:41.034774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:41.035488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:41.035972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:41.036414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:41.172860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:41.181155 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bad31a12-9245-4b11-aac5-60d177740060 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.161331 Aug 23 11:35:41.181865 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3732/7514] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:41 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:42.202296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:42.202978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:42.205915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=49 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:42.212083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:42.212583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:42.213061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:42.213772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:42.214262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:42.214943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:42.345955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:42.354384 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d55fef5-dacc-4932-a6b7-10c3e6214d52 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.156104 Aug 23 11:35:42.354971 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3783/7515] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:42 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:43.375522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:43.376157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:43.383260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:43.383762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:43.384217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:43.384977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:43.385456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:43.385902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:43.516465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:43.524326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9162632e-9688-47da-b5f7-9c8298f58885 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.152735 Aug 23 11:35:43.524944 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3733/7516] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:43 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:35:44.546686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:44.547308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:44.555802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:44.556663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:44.557152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:44.558171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:44.558960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:44.559411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:44.718987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:44.727794 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b2c2c915-07b8-42ed-89d6-386ea6271822 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.185072 Aug 23 11:35:44.728370 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3784/7517] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:44 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:45.692670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-1d9c81f2-2c49-44a2-a140-930b4d6fe9de req-7382fc50-b6d2-4134-b8e6-2bc952c83126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "name": "network-vif-plugged", "status": "completed", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:45.703677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d9c81f2-2c49-44a2-a140-930b4d6fe9de req-7382fc50-b6d2-4134-b8e6-2bc952c83126 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:45.704210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d9c81f2-2c49-44a2-a140-930b4d6fe9de req-7382fc50-b6d2-4134-b8e6-2bc952c83126 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:45.704880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-1d9c81f2-2c49-44a2-a140-930b4d6fe9de req-7382fc50-b6d2-4134-b8e6-2bc952c83126 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:45.717999 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-1d9c81f2-2c49-44a2-a140-930b4d6fe9de req-7382fc50-b6d2-4134-b8e6-2bc952c83126 service nova] Creating event network-vif-plugged:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h1-847009-13 Aug 23 11:35:45.723044 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-1d9c81f2-2c49-44a2-a140-930b4d6fe9de req-7382fc50-b6d2-4134-b8e6-2bc952c83126 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Aug 23 11:35:45.723634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3734/7518] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:45.751554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:45.752223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:45.759554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:45.760063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:45.760951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:45.761241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:45.761707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:45.762539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:45.898998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:45.907047 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb031252-c59c-4fa4-bd0e-2ca0e01c4959 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.159392 Aug 23 11:35:45.907633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3785/7519] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:45 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:46.930410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:46.931166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:46.933337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:46.934023 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:46.941079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:46.941582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:46.942037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:46.942753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:46.943420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:46.944040 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:47.075570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:47.083318 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c507c02f-3b5c-46c8-8b63-8da4ec4f3db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1364 microversion: 2.1 time: 0.157774 Aug 23 11:35:47.084428 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3735/7520] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:46 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:48.104965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:48.105584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:48.107434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:35:48.113408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:48.113898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:48.114336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:48.115466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:48.115937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:48.116369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:48.532614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:35:48.541635 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dd3b3e39-2808-4b8f-95af-d22ea6f8a909 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1552 microversion: 2.1 time: 0.440710 Aug 23 11:35:48.542206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3786/7521] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:35:48 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1552 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:35:48.562309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:35:48.562893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:35:48.569890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:48.570387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:48.570840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:48.571540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:48.572015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:48.572453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:48.649551 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d88cc16-719f-498e-a019-dc7a26d2b2fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091045 Aug 23 11:35:48.650147 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3736/7522] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:35:48 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:35:49.873997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e3a6713e-7223-4077-8493-2d86fb42affd req-664aff77-85be-4f0f-a671-f16a5722d551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:35:49.884897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e3a6713e-7223-4077-8493-2d86fb42affd req-664aff77-85be-4f0f-a671-f16a5722d551 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:35:49.885386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e3a6713e-7223-4077-8493-2d86fb42affd req-664aff77-85be-4f0f-a671-f16a5722d551 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:35:49.885824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e3a6713e-7223-4077-8493-2d86fb42affd req-664aff77-85be-4f0f-a671-f16a5722d551 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:35:49.900867 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e3a6713e-7223-4077-8493-2d86fb42affd req-664aff77-85be-4f0f-a671-f16a5722d551 service nova] Creating event network-changed:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h1-847009-13 Aug 23 11:35:49.905897 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e3a6713e-7223-4077-8493-2d86fb42affd req-664aff77-85be-4f0f-a671-f16a5722d551 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035620 Aug 23 11:35:49.906538 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3787/7523] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:36:47.346079 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:36:47.346753 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:36:48.800228 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:36:48.800933 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:36:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:37:01.917666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=9 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:01.918842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:01.924383 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4bf4daac-2158-421f-97a5-7ea4eb7652c7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:01.936034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bf4daac-2158-421f-97a5-7ea4eb7652c7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:01.936544 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bf4daac-2158-421f-97a5-7ea4eb7652c7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:01.937041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4bf4daac-2158-421f-97a5-7ea4eb7652c7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:01.962147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4bf4daac-2158-421f-97a5-7ea4eb7652c7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 11:37:02.004957 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4bf4daac-2158-421f-97a5-7ea4eb7652c7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action" status: 202 len: 0 microversion: 2.1 time: 0.090034 Aug 23 11:37:02.005649 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3737/7524] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:37:01 2022] POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:37:02.013197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=9 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:02.014518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=44 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:02.019213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:02.020032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:02.027719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:02.028290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:02.028760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:02.029476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:02.029952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:02.030392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:02.167510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:02.176294 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcb46b50-129f-457f-93c5-5e21eeb8d565 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.166098 Aug 23 11:37:02.176934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3788/7525] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:02 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:03.199958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:03.201885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:03.210561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:03.211068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:03.211526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:03.212240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:03.212714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:03.213179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:03.349806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:03.357726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a199c44-e9a0-481f-b090-e425299079f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.162996 Aug 23 11:37:03.358292 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3738/7526] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:03 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:04.379739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:04.380307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:04.389431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:04.389931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:04.390382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:04.391099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:04.391571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:04.392010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:04.532319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:04.540173 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dff0673b-b706-473c-8e6a-cc619766af81 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.164434 Aug 23 11:37:04.540765 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3789/7527] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:04 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:05.562699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:05.563365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:05.569396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:05.569896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:05.570352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:05.571058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:05.571532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:05.571972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:05.707933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:05.715879 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fcfa1ddc-9e1c-4105-b1b2-2ae0d1f42f43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.158385 Aug 23 11:37:05.716500 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3739/7528] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:05 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:06.737243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:06.737931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:06.745089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:06.745578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:06.746027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:06.746730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:06.747189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:06.747679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:06.883395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:06.892143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ad667e21-798c-4dff-8e7a-4610e0c28c13 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.159100 Aug 23 11:37:06.892731 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3790/7529] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:06 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:07.913469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:07.914096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:07.921012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:07.921503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:07.921951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:07.922659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:07.923129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:07.923563 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:08.056073 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:08.064538 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-80dd516c-9227-441c-829c-e17f38006824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.155043 Aug 23 11:37:08.065163 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3740/7530] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:07 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:09.086274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:09.086899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:09.094579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:09.095079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:09.095528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:09.096233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:09.096698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:09.097164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:09.225440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:09.233335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d0dca19e-7334-46aa-a506-044b119333fe tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.150980 Aug 23 11:37:09.233907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3791/7531] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:09 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:10.253613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:10.254168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:10.260932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:10.261427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:10.261875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:10.262577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:10.263045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:10.263487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:10.403682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:10.412412 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8b624bf4-c51d-4243-9607-ebf0b2d04113 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.162850 Aug 23 11:37:10.413015 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3741/7532] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:10 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:11.433757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:11.434375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:11.443836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:11.444336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:11.444810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:11.445524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:11.445994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:11.446431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:11.580483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:11.588958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c24a8e8f-ed78-42b3-bf1e-7a7077a46ecd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.158896 Aug 23 11:37:11.589884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3792/7533] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:11 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:12.611933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:12.612454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:12.619580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:12.620083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:12.620538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:12.621282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:12.621758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:12.622206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:12.760409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:12.768392 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7d45936a-d2bb-41ab-9f79-d97b2a99ea3c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1657 microversion: 2.1 time: 0.161172 Aug 23 11:37:12.768993 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3742/7534] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:12 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1657 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:12.789549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:12.791767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:12.799238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:12.799728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:12.800167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:12.800895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:12.801358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:12.801785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:12.829151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:12.835179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Old instance type m1.heat2, new instance type m1.heat {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:37:12.842517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:37:12.842949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:37:12.843425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:37:12.843928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:37:12.844348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:37:12.919666 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-90a45c5b-9ca8-4ae7-a0b1-c44132f96442 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action" status: 202 len: 0 microversion: 2.1 time: 0.133581 Aug 23 11:37:12.921039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3793/7535] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:37:12 2022] POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:37:12.929112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:12.929782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:12.936095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:12.936824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:12.937289 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:12.938016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:12.938494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:12.938940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:13.083376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:13.093348 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dda269c8-9a31-406d-b327-70da365f2ab2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.168142 Aug 23 11:37:13.094053 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3743/7536] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:12 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:14.115256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:14.115859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:14.124576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:14.125107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:14.125554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:14.126272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:14.126741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:14.127176 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:14.263310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:14.271150 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-698de625-6dfd-46ef-8815-98ba0ed37611 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1680 microversion: 2.1 time: 0.159862 Aug 23 11:37:14.271725 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3794/7537] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:14 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:15.293403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:15.294082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:15.301720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:15.302216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:15.302668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:15.303374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:15.303843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:15.304279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:15.440759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:15.448663 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5548b668-f713-4a1e-81fa-29fea0f48052 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1685 microversion: 2.1 time: 0.159178 Aug 23 11:37:15.449274 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3744/7538] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:15 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:16.471237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:16.471972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:16.480813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:16.481681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:16.482365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:16.484161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:16.484926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:16.485600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:16.627005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:16.634708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1a0cca3e-f699-4fd0-a312-736286ad8a03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1685 microversion: 2.1 time: 0.168108 Aug 23 11:37:16.635273 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3795/7539] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:16 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:17.531850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "name": "network-vif-unplugged", "status": "completed", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:17.543505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:17.544008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:17.544458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:17.556991 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] Creating event network-vif-unplugged:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h2-847009-13 Aug 23 11:37:17.563143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] Instance 862e606f-d680-4cd5-9d4c-385130e98b87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:37:17.574146 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4c404a19-21c7-44df-96c2-dd2fe68af575 req-a9a0b9a7-19e3-4530-969d-d63da5d9cf54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046223 Aug 23 11:37:17.574762 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3745/7540] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:37:17.657689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:17.658317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:17.665731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:17.666226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:17.666674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:17.667413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:17.667872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:17.668298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:17.883273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:17.891648 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-944d2f8a-bb4d-4c70-943a-91220097b312 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1684 microversion: 2.1 time: 0.240082 Aug 23 11:37:17.892225 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3796/7541] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:17 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1684 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:18.914742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:18.915450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:18.921623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:18.922124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:18.922570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:18.923275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:18.923766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:18.924206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:19.061807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:19.069726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21e8e0ad-26c8-401e-ab1c-b41160da45d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1682 microversion: 2.1 time: 0.160231 Aug 23 11:37:19.070295 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3746/7542] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:18 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:19.591409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:19.601897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:19.602381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:19.602820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:19.614848 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] Creating event network-changed:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h2-847009-13 Aug 23 11:37:19.620208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] Instance 862e606f-d680-4cd5-9d4c-385130e98b87 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:37:19.631541 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7aa86d93-93a6-4d01-af0c-568b7b9ad8b1 req-e97ca50f-f32b-4dfa-8298-2c3e51d6af6e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044071 Aug 23 11:37:19.632117 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3797/7543] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:37:20.091980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:20.093234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:20.100574 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:20.101134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:20.101600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:20.102398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:20.102815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:20.103265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:20.273922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:20.282621 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-520599b3-fb6f-4a99-ba3e-5caf7ee41110 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1678 microversion: 2.1 time: 0.194939 Aug 23 11:37:20.283489 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3747/7544] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:20 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:20.304021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:20.304692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:20.310809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:20.311328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:20.311778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:20.312498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:20.313029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:20.313470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:20.372096 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9b17e5fd-35e8-4d77-adb8-a23f2251a46e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action" status: 204 len: 0 microversion: 2.1 time: 0.072153 Aug 23 11:37:20.372800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3798/7545] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:37:20 2022] POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:37:20.381715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:20.382349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:20.388427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:20.388956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:20.389996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:20.391516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:20.392005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:20.392452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:20.619530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:20.628121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3cc2df7b-ad60-46c4-ae8d-5234c82a87a3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1678 microversion: 2.1 time: 0.250243 Aug 23 11:37:20.628697 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3748/7546] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:20 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:21.651330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:21.651951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:21.658387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:21.658884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:21.659337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:21.660044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:21.660510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:21.660972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:21.799610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:21.808426 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4144a9c-1506-4975-828d-f19af0fc175e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1657 microversion: 2.1 time: 0.162799 Aug 23 11:37:21.809034 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3799/7547] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:21 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1657 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:21.830064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:21.830703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:21.837670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:21.838186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:21.838902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:21.839619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:21.840100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:21.840549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:21.976197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:21.984773 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-90569097-7355-4a0d-863b-2438e9b2a50a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1657 microversion: 2.1 time: 0.159237 Aug 23 11:37:21.985343 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3749/7548] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:21 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:37:22.006807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8ea9f4bf-7dad-43f9-bf35-2f8c0120f317 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:22.012964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ea9f4bf-7dad-43f9-bf35-2f8c0120f317 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:22.013458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ea9f4bf-7dad-43f9-bf35-2f8c0120f317 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:22.013900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8ea9f4bf-7dad-43f9-bf35-2f8c0120f317 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:22.039016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8ea9f4bf-7dad-43f9-bf35-2f8c0120f317 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Going to try to start instance {{(pid=128859) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 11:37:22.082059 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8ea9f4bf-7dad-43f9-bf35-2f8c0120f317 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action" status: 202 len: 0 microversion: 2.1 time: 0.080058 Aug 23 11:37:22.082669 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3800/7549] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:37:22 2022] POST /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:37:22.091256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:22.092460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:22.098152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:22.098860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:22.099373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:22.100128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:22.100620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:22.101102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:22.243790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:22.251852 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5aff3f31-d87d-4b1c-94c7-1df14334f071 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1666 microversion: 2.1 time: 0.164845 Aug 23 11:37:22.252437 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3750/7550] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:22 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:23.275930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:23.276856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:23.283513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:23.284108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:23.284562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:23.285341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:23.286031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:23.286504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:23.302927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:23.429808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:23.437687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0e5d4e93-c13a-461a-9a96-537d50e6a780 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1670 microversion: 2.1 time: 0.168145 Aug 23 11:37:23.438268 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3801/7551] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:23 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:37:23.458001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:23.458517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:23.465894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:23.466393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:23.466843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:23.467613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:23.468786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:23.469049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:23.493893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:37:23.527930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:23.570300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d818b868-440a-4b41-b23a-0392e1ee6824 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 204 len: 0 microversion: 2.1 time: 0.115828 Aug 23 11:37:23.571491 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3751/7552] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:37:23 2022] DELETE /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:37:23.581838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:23.582472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:23.588784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:23.589396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:23.589824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:23.590516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:23.590976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:23.591401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:23.721308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:23.729062 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-68e0a579-e7fd-45ed-8987-7f82d2c9d237 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1676 microversion: 2.1 time: 0.152669 Aug 23 11:37:23.729627 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3802/7553] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:23 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:24.752597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:24.753481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:24.762621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:24.763146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:24.763614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:24.764359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:24.764873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:24.765326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:24.913467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:24.921686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-100eb778-dd39-4e5d-8c4e-0bc8b93c41d1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1676 microversion: 2.1 time: 0.174761 Aug 23 11:37:24.922438 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3752/7554] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:24 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:25.071655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7f8b250c-d413-4b12-8de5-43f6ec74925c req-a1e30ce3-74fd-4817-bfc0-3b81e19e1b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "name": "network-vif-plugged", "status": "completed", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:25.082821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7f8b250c-d413-4b12-8de5-43f6ec74925c req-a1e30ce3-74fd-4817-bfc0-3b81e19e1b05 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:25.083363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7f8b250c-d413-4b12-8de5-43f6ec74925c req-a1e30ce3-74fd-4817-bfc0-3b81e19e1b05 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:25.083811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7f8b250c-d413-4b12-8de5-43f6ec74925c req-a1e30ce3-74fd-4817-bfc0-3b81e19e1b05 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:25.097249 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7f8b250c-d413-4b12-8de5-43f6ec74925c req-a1e30ce3-74fd-4817-bfc0-3b81e19e1b05 service nova] Creating event network-vif-plugged:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h2-847009-13 Aug 23 11:37:25.102487 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7f8b250c-d413-4b12-8de5-43f6ec74925c req-a1e30ce3-74fd-4817-bfc0-3b81e19e1b05 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Aug 23 11:37:25.103095 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3803/7555] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:37:25.952219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:25.952720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b5d93cb2-a792-43fa-ab51-811e850574d5 req-95d786b1-f35d-4db8-b5c8-4efdd67e3f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862e606f-d680-4cd5-9d4c-385130e98b87", "name": "network-vif-deleted", "tag": "44b69ad3-e0e9-481a-ab6e-1d8fd0d59243"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:25.952930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:25.964191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:25.965126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:25.965908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:25.966910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:25.967654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:25.968321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:25.975233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b5d93cb2-a792-43fa-ab51-811e850574d5 req-95d786b1-f35d-4db8-b5c8-4efdd67e3f08 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:25.975747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b5d93cb2-a792-43fa-ab51-811e850574d5 req-95d786b1-f35d-4db8-b5c8-4efdd67e3f08 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:25.976998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b5d93cb2-a792-43fa-ab51-811e850574d5 req-95d786b1-f35d-4db8-b5c8-4efdd67e3f08 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:25.990401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b5d93cb2-a792-43fa-ab51-811e850574d5 req-95d786b1-f35d-4db8-b5c8-4efdd67e3f08 service nova] Creating event network-vif-deleted:44b69ad3-e0e9-481a-ab6e-1d8fd0d59243 for instance 862e606f-d680-4cd5-9d4c-385130e98b87 on n-h2-847009-13 Aug 23 11:37:25.996115 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b5d93cb2-a792-43fa-ab51-811e850574d5 req-95d786b1-f35d-4db8-b5c8-4efdd67e3f08 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047671 Aug 23 11:37:25.997266 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3804/7556] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:37:26.044889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:26.054535 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef98af8a-390d-46cd-a730-31918022e4a2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 200 len: 1608 microversion: 2.1 time: 0.114624 Aug 23 11:37:26.055217 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3753/7557] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:25 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 1608 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:27.077915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:27.078539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:27.084658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:27.085182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:27.085625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:27.086324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:27.086785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:27.087244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:27.100851 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 HTTP/1.1 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '862e606f-d680-4cd5-9d4c-385130e98b87'} Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:37:27.102479 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-452928e9-5464-4a4e-90e4-4b0df4d95db8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 404 len: 111 microversion: 2.1 time: 0.031166 Aug 23 11:37:27.107260 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3805/7558] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:27 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:37:27.120429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:27.121077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:27.128514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:27.129065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:27.129520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:27.130228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:27.130703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:27.131138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:27.146418 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 HTTP/1.1 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '862e606f-d680-4cd5-9d4c-385130e98b87'} Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:37:27.148062 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-88228ed2-bcfc-43d1-be9a-9423c3f46106 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 404 len: 111 microversion: 2.1 time: 0.032992 Aug 23 11:37:27.152231 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3754/7559] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:27 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:37:27.212960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-948943878", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "b2ef433d-5566-4fa0-a5bd-e65a9e9a0459"}], "security_groups": [{"name": "tempest-securitygroup--1345270865"}], "key_name": "tempest-keypair-304059490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:27.321746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] validate_networks() for [('b2ef433d-5566-4fa0-a5bd-e65a9e9a0459', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:37:27.773050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:37:27.773537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:37:27.774038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:37:27.774490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:37:27.774917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:37:27.786881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:27.787377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:27.787825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:27.788572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:27.789065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:27.789505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:27.808998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:37:27.814458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:37:27.828003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:37:27.830931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:37:27.878518 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b160f9d3-e115-4142-8dfb-64fa6af71c43 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.669835 Aug 23 11:37:27.879170 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3806/7560] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:37:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:37:27.890070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5187b51c-abbe-48e1-afb3-72588905479f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:27.891422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5187b51c-abbe-48e1-afb3-72588905479f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:27.945674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5187b51c-abbe-48e1-afb3-72588905479f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:27.956731 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5187b51c-abbe-48e1-afb3-72588905479f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1237 microversion: 2.1 time: 0.070433 Aug 23 11:37:27.962000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3755/7561] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:27 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:28.981225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:28.984332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:28.998610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:28.999698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:29.000669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:29.001672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:29.002403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:29.003545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:29.083133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:29.091462 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a41a2f77-2d1a-4007-a49b-d813bb13d26f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1297 microversion: 2.1 time: 0.115781 Aug 23 11:37:29.092241 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3807/7562] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:28 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:30.114140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:30.114947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:30.122807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:30.123446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:30.123979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:30.124902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:30.125965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:30.126420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:30.354331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:30.362039 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6808cce5-1945-4a8a-b306-1fa2b1a4a954 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.252582 Aug 23 11:37:30.362848 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3756/7563] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:30 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:30.451196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6bf447da-db66-4f39-b256-9211d0e15a94 req-db9f4fee-9110-433c-b0ad-cc58ee16f3ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:30.463858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6bf447da-db66-4f39-b256-9211d0e15a94 req-db9f4fee-9110-433c-b0ad-cc58ee16f3ae service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:30.463858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6bf447da-db66-4f39-b256-9211d0e15a94 req-db9f4fee-9110-433c-b0ad-cc58ee16f3ae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:30.464505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6bf447da-db66-4f39-b256-9211d0e15a94 req-db9f4fee-9110-433c-b0ad-cc58ee16f3ae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:30.479130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6bf447da-db66-4f39-b256-9211d0e15a94 req-db9f4fee-9110-433c-b0ad-cc58ee16f3ae service nova] Creating event network-changed:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h1-847009-13 Aug 23 11:37:30.483958 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6bf447da-db66-4f39-b256-9211d0e15a94 req-db9f4fee-9110-433c-b0ad-cc58ee16f3ae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036522 Aug 23 11:37:30.484835 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3808/7564] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:37:31.383487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:31.384121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:31.391676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:31.392181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:31.392660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:31.393400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:31.393875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:31.394324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:31.523475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:31.531154 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6060db7-2354-4e0d-b462-622589ec0369 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.151591 Aug 23 11:37:31.531920 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3757/7565] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:31 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:32.554281 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:32.554990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:32.557038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:32.564312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:32.564881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:32.565322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:32.566021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:32.566482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:32.566911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:32.702550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:32.711058 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a950568a-b8bb-45da-8d12-345059f72c9d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.161983 Aug 23 11:37:32.711644 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3809/7566] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:32 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:33.733101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:33.733746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:33.737946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:33.744227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:33.744747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:33.745226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:33.745947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:33.746458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:33.746910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:33.884331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:33.892802 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-987fca5b-6f5d-45dd-a6e1-61185b681cbd tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.162970 Aug 23 11:37:33.893361 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3758/7567] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:33 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:34.914816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:34.915423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:34.922457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:34.923002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:34.923684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:34.924150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:34.924618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:34.925094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:35.060463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:35.068383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e224a4cb-c18e-4aad-99b1-8db655780aa2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.157608 Aug 23 11:37:35.069013 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3810/7568] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:34 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:36.090424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:36.091065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:36.097295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:36.097811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:36.098274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:36.098999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:36.099481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:36.099933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:36.198222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-416406f9-9eaf-43f1-ba19-bf13002da3ea req-41fa94c8-30c8-4c96-8b01-547bd2b1a8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "name": "network-vif-plugged", "status": "completed", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:36.211660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-416406f9-9eaf-43f1-ba19-bf13002da3ea req-41fa94c8-30c8-4c96-8b01-547bd2b1a8fc service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:36.212490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-416406f9-9eaf-43f1-ba19-bf13002da3ea req-41fa94c8-30c8-4c96-8b01-547bd2b1a8fc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:36.212970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-416406f9-9eaf-43f1-ba19-bf13002da3ea req-41fa94c8-30c8-4c96-8b01-547bd2b1a8fc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:36.226066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-416406f9-9eaf-43f1-ba19-bf13002da3ea req-41fa94c8-30c8-4c96-8b01-547bd2b1a8fc service nova] Creating event network-vif-plugged:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h1-847009-13 Aug 23 11:37:36.231419 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-416406f9-9eaf-43f1-ba19-bf13002da3ea req-41fa94c8-30c8-4c96-8b01-547bd2b1a8fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037516 Aug 23 11:37:36.232382 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3811/7569] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:37:36.241294 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:36.248944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-efd64d36-8c87-4a65-887c-74605f0872ef tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.163183 Aug 23 11:37:36.249537 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3759/7570] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:36 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:37.270800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:37.271514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:37.278353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:37.278852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:37.279303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:37.280016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:37.280491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:37.280966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:37.412011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:37.419750 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-362fdd7c-b2fd-410b-9ec4-0c873c19ab71 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1363 microversion: 2.1 time: 0.154147 Aug 23 11:37:37.420319 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3812/7571] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:37 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:38.441842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:38.442482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:38.445529 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:38.451533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:38.452052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:38.452514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:38.453378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:38.453983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:38.454536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:38.590701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:37:38.600232 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2930a855-48d4-43bf-b523-1b7db73e0f91 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1550 microversion: 2.1 time: 0.162632 Aug 23 11:37:38.600938 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3760/7572] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:37:38 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:37:38.622398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:37:38.623017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:37:38.625024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:38.625782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:37:38.632378 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:38.632901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:38.633348 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:38.634053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:38.634525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:38.634957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:38.715907 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-43e09dc2-d6dd-4169-be94-fc7a91b3bc1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097621 Aug 23 11:37:38.716516 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3813/7573] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:37:38 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:37:39.659433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5ce3da18-6f5f-4d3a-a00e-d327bac4fa31 req-bebfc2b0-6240-447b-8292-cb96af74fb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:37:39.670274 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5ce3da18-6f5f-4d3a-a00e-d327bac4fa31 req-bebfc2b0-6240-447b-8292-cb96af74fb0e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:37:39.670777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5ce3da18-6f5f-4d3a-a00e-d327bac4fa31 req-bebfc2b0-6240-447b-8292-cb96af74fb0e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:37:39.671233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5ce3da18-6f5f-4d3a-a00e-d327bac4fa31 req-bebfc2b0-6240-447b-8292-cb96af74fb0e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:37:39.682856 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5ce3da18-6f5f-4d3a-a00e-d327bac4fa31 req-bebfc2b0-6240-447b-8292-cb96af74fb0e service nova] Creating event network-changed:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h1-847009-13 Aug 23 11:37:39.688504 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5ce3da18-6f5f-4d3a-a00e-d327bac4fa31 req-bebfc2b0-6240-447b-8292-cb96af74fb0e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032877 Aug 23 11:37:39.689365 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3761/7574] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:38:43.173847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=9 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:38:43.174719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=49 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:38:43.238732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:38:43.238732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:43.241512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:43.242006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:43.243071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:43.243848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:43.244317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:43.244771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:43.274667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:43.283125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Old instance type m1.heat2, new instance type m1.heat {{(pid=128859) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:38:43.290889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:38:43.291322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:38:43.291810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:38:43.292233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:38:43.292660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:38:43.359335 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fbd96f19-c0db-4fa3-abed-1b35bbcac03c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5/action" status: 202 len: 0 microversion: 2.1 time: 0.187748 Aug 23 11:38:43.359954 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3814/7575] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:38:43 2022] POST /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:38:43.366740 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:38:43.368221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:38:43.372590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:43.373343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:43.380556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:43.381098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:43.381551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:43.382264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:43.382732 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:43.383399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:43.552105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:43.561220 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-55024aae-421a-4e67-8225-3770bf1bd658 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1677 microversion: 2.1 time: 0.196516 Aug 23 11:38:43.562065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3762/7576] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:43 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:44.583505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:44.584129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:44.595248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:44.595666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:44.596110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:44.596852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:44.597469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:44.599046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:44.753667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:44.762428 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30510a53-5d6e-4b37-9d42-b72c76c693d4 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1677 microversion: 2.1 time: 0.183736 Aug 23 11:38:44.763028 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3815/7577] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:44 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:45.783862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:45.784519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:45.791632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:45.792129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:45.792580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:45.793317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:45.793786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:45.794225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:45.926007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:45.934399 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f2f5c59-3eb1-4b87-b4a6-df060a653edc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.154636 Aug 23 11:38:45.934978 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3763/7578] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:45 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:46.957303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:46.957930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:46.966346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:46.966868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:46.967311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:46.968019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:46.968480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:46.968937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:47.117825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:47.125771 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54034195-6124-47a7-8867-77e9ef6ed40e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.172441 Aug 23 11:38:47.126359 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3816/7579] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:46 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:48.146399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:48.147247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:48.154840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:48.155352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:48.155808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:48.156530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:48.157028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:48.157478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:48.304516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:48.317128 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf6d8ed9-4b14-41cd-89cb-2ca3025cdc03 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.174129 Aug 23 11:38:48.318227 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3764/7580] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:48 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:49.341483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:49.342010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:49.349234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:49.349728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:49.350168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:49.350881 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:49.351340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:49.351769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:49.484064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:49.491936 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c78d4769-d636-430d-85d3-263eb25ba4fa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.155386 Aug 23 11:38:49.492516 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3817/7581] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:49 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:50.513303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:50.513942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:50.520876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:50.521385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:50.521874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:50.522592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:50.523075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:50.523523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:50.652919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:50.660561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea886777-409c-4cf3-ba1a-816287a2a6de tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.151332 Aug 23 11:38:50.661169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3765/7582] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:50 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:38:51.682616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:51.683262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:51.691405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:51.691998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:51.692696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:51.693996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:51.694790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:51.695567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:51.829043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:51.837876 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4db886f7-b31b-4957-871f-396769c875b0 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.158931 Aug 23 11:38:51.838457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3818/7583] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:51 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:52.860115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:52.860774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:52.867647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:52.868152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:52.868632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:52.869359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:52.869843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:52.870290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:53.005050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:53.012942 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8be92b3d-36d3-4d5c-9400-2894cd43999f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.156777 Aug 23 11:38:53.013520 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3766/7584] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:52 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:54.034494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:54.035110 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:54.042114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:54.042602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:54.043040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:54.043743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:54.044206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:54.044632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:54.185016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:54.193321 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3267520-6eb4-4b6b-be4e-b8d74a95f552 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.163488 Aug 23 11:38:54.193908 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3819/7585] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:54 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:55.215171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:55.215709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:55.223255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:55.223762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:55.224218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:55.224962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:55.225442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:55.225906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:55.362401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:55.370227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c66b9f81-d447-46ed-87ba-a9d31beca8bc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.159340 Aug 23 11:38:55.370800 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3767/7586] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:55 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:56.391520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:56.392104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:56.400523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:56.401044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:56.401489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:56.402194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:56.402667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:56.403098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:56.537807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:56.545721 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5635f455-c564-4400-80cb-d605b93140c1 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1682 microversion: 2.1 time: 0.158206 Aug 23 11:38:56.546301 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3820/7587] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:56 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:57.567193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:57.567820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:57.574870 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:57.575374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:57.575897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:57.576599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:57.577095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:57.577536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:57.720680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:57.732690 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2988a49f-0547-4dd7-8db2-43ef7bdf1743 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1681 microversion: 2.1 time: 0.169911 Aug 23 11:38:57.733312 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3768/7588] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:57 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:57.792558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "name": "network-vif-unplugged", "status": "completed", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:38:57.803962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:57.804484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:57.804972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:57.820894 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] Creating event network-vif-unplugged:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h2-847009-13 Aug 23 11:38:57.826415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:38:57.837986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cdd9f197-9e2e-4fce-b2a3-b12a852688d8 req-6e9d30cf-f099-43bd-bfbe-0823ffab1281 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049005 Aug 23 11:38:57.838824 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3821/7589] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:38:58.755381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:58.756125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:58.764246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:58.765275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:58.765743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:58.766467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:58.767390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:58.768111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:58.898200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:38:58.906124 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b909705a-9a0c-4a08-8c29-669785db9a9f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1681 microversion: 2.1 time: 0.154852 Aug 23 11:38:58.906709 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3769/7590] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:58 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:38:59.873555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:38:59.883629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:59.884119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:59.884559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:59.896130 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] Creating event network-changed:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h2-847009-13 Aug 23 11:38:59.901370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:38:59.912224 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-7e836faf-20ba-44a3-9c51-aa5fc0de05bc req-507668c8-57b4-462b-8044-9c5cd80237ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043560 Aug 23 11:38:59.912833 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3822/7591] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:38:59.927887 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:38:59.928532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:38:59.935425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:59.935932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:59.936392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:38:59.937137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:38:59.937614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:38:59.938064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:00.172764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:00.181440 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8fdf3abf-71cb-408f-b2b6-804f66971017 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1679 microversion: 2.1 time: 0.257899 Aug 23 11:39:00.182025 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3770/7592] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:38:59 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:01.204116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:01.205430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:01.212891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.213395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.213847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.214560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.215031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.215470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.418020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:01.426045 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f367a13-82d0-4786-aa3a-e312c4f3b092 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1676 microversion: 2.1 time: 0.226288 Aug 23 11:39:01.426634 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3823/7593] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:01 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:01.447688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:01.448280 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:01.455771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.456204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.456667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.457468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.457972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.458425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.496001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.496504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.496999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.497758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.498231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.498680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.522476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:39:01.527747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:39:01.629023 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26985342-6e5c-45a7-809b-bbc603013d6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5/action" status: 202 len: 0 microversion: 2.1 time: 0.185080 Aug 23 11:39:01.629781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3771/7594] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:39:01 2022] POST /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:39:01.638007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:01.638632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:01.645443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.645974 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.646423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.647354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:01.647930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:01.648475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:01.851580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:01.859439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-182133d0-15f3-47c5-9d59-473403a48df8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.225336 Aug 23 11:39:01.860021 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3824/7595] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:01 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:02.881520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:02.882238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:02.889192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:02.889685 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:02.890133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:02.890830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:02.891296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:02.891739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:03.022287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:03.030094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7bc3ff6-2d62-4ceb-b775-5a5dc9e5565b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.154350 Aug 23 11:39:03.030671 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3772/7596] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:02 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:04.051485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:04.052139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:04.059136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:04.059646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:04.060098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:04.060844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:04.061316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:04.061755 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:04.215011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:04.223615 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54a51533-a1a8-4f6e-8edf-9d08661e3543 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.176655 Aug 23 11:39:04.224206 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3825/7597] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:04 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:05.245507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:05.246090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:05.252805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:05.253307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:05.253759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:05.254463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:05.254928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:05.255364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:05.517995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:05.526266 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-37f58ce0-ebed-4a92-9e53-dd86c489f9c8 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.284877 Aug 23 11:39:05.526850 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3773/7598] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:05 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:05.659638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:05.669837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:05.670320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:05.670760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:05.683317 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] Creating event network-changed:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h1-847009-13 Aug 23 11:39:05.688960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:39:05.699607 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-764501e8-c1f2-4ea4-96c5-adf4d6b3c664 req-56eb694c-f10c-4575-972f-80a4d82f1e9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044350 Aug 23 11:39:05.700406 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3826/7599] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:39:06.547832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:06.548774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:06.555642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:06.556148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:06.556607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:06.557350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:06.557827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:06.558270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:06.697100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:06.705524 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7055dc2-8023-4784-8555-b7910d6c1479 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.161626 Aug 23 11:39:06.706132 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3774/7600] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:06 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:07.728689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:07.729425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:07.735614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:07.736868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:07.737277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:07.737992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:07.738464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:07.738903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:07.876166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:07.884415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-78d079e9-d1c9-4b18-92ca-67ae42006d35 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.160967 Aug 23 11:39:07.885032 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3827/7601] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:07 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:08.906967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:08.907597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:08.915949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:08.915949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:08.916240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:08.917017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:08.917488 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:08.917929 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:08.936216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:09.057070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:09.065560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-73dfed54-3a2f-4e42-b587-cfc108cca726 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1675 microversion: 2.1 time: 0.162545 Aug 23 11:39:09.066190 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3775/7602] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:08 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:10.087186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:10.088054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:10.095135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.095825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.096283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.097041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.097518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.097960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.229062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:10.237715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ff26fa2-046e-49cd-8522-e0cae7b73bc5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1668 microversion: 2.1 time: 0.154541 Aug 23 11:39:10.238301 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3828/7603] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:10 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:10.259092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:10.259733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:10.267208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.267901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.268372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.269133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.269615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.270150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.400420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:10.408326 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e358170-4bb3-4b92-9f3c-fcbaf4323329 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1668 microversion: 2.1 time: 0.153152 Aug 23 11:39:10.408939 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3776/7604] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:10 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:39:10.428460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:10.429114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:10.435010 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.435509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.435957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.436663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.437157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.437596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.572541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:10.580956 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89110f0a-a57b-45bb-8560-d2f6f2998f37 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1668 microversion: 2.1 time: 0.156318 Aug 23 11:39:10.587741 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3829/7605] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:10 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:10.604078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:10.604609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:10.610907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.612057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.612527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.613283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.613785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.614220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.639788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:39:10.709836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-36b5b573-8c90-41a1-b3da-807c52445983 req-af1161b5-a079-4a34-9761-6b8fb395d670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "name": "network-vif-plugged", "status": "completed", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:10.720945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-36b5b573-8c90-41a1-b3da-807c52445983 req-af1161b5-a079-4a34-9761-6b8fb395d670 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.721592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-36b5b573-8c90-41a1-b3da-807c52445983 req-af1161b5-a079-4a34-9761-6b8fb395d670 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.722150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-36b5b573-8c90-41a1-b3da-807c52445983 req-af1161b5-a079-4a34-9761-6b8fb395d670 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.724245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a7a26a2-2cd1-480f-8649-ee228a1437c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 204 len: 0 microversion: 2.1 time: 0.125305 Aug 23 11:39:10.725169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3777/7606] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:39:10 2022] DELETE /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:39:10.734243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:10.734979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:10.735681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:10.738490 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-36b5b573-8c90-41a1-b3da-807c52445983 req-af1161b5-a079-4a34-9761-6b8fb395d670 service nova] Creating event network-vif-plugged:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h1-847009-13 Aug 23 11:39:10.742859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.743378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.743842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.743968 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-36b5b573-8c90-41a1-b3da-807c52445983 req-af1161b5-a079-4a34-9761-6b8fb395d670 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039117 Aug 23 11:39:10.744577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:10.744849 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3830/7607] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:39:10.745152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:10.745600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:10.883989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:10.891663 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f23d37c3-8cc7-4873-994e-248500e3301b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1674 microversion: 2.1 time: 0.161696 Aug 23 11:39:10.892954 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3778/7608] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:10 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:11.915610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:11.916241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:11.924434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:11.924950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:11.925405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:11.926115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:11.926592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:11.927030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:12.074595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:12.083365 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d7a3de1e-08ed-4355-9aa6-f94cce674c8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1674 microversion: 2.1 time: 0.172631 Aug 23 11:39:12.084178 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3831/7609] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:11 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:13.103122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:13.107456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:13.108103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:13.115496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:13.116026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:13.116487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:13.117342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:13.117827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:13.118282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:13.174111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-020096e5-8cf6-4431-97d2-bfbe3e24d8ca req-e519b3ab-112d-4c8e-a29e-d458cee8bcd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc23f48-4e2c-42e1-aed7-43e971acccb5", "name": "network-vif-deleted", "tag": "38a6caf9-f7a7-4ce3-9556-6e718df23211"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:13.182423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=41 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:13.190544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-020096e5-8cf6-4431-97d2-bfbe3e24d8ca req-e519b3ab-112d-4c8e-a29e-d458cee8bcd3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:13.191330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-020096e5-8cf6-4431-97d2-bfbe3e24d8ca req-e519b3ab-112d-4c8e-a29e-d458cee8bcd3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:13.191953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-020096e5-8cf6-4431-97d2-bfbe3e24d8ca req-e519b3ab-112d-4c8e-a29e-d458cee8bcd3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:13.207842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:13.213307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-020096e5-8cf6-4431-97d2-bfbe3e24d8ca req-e519b3ab-112d-4c8e-a29e-d458cee8bcd3 service nova] Creating event network-vif-deleted:38a6caf9-f7a7-4ce3-9556-6e718df23211 for instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 on n-h1-847009-13 Aug 23 11:39:13.216598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f4f0226-e822-4f15-b223-42a1a4f4d594 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 200 len: 1606 microversion: 2.1 time: 0.115098 Aug 23 11:39:13.217533 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3779/7610] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:13 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 1606 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:13.218441 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-020096e5-8cf6-4431-97d2-bfbe3e24d8ca req-e519b3ab-112d-4c8e-a29e-d458cee8bcd3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049002 Aug 23 11:39:13.220274 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3832/7611] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:39:14.239351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:14.240240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:14.242763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:14.248975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:14.249425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:14.249885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:14.250615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:14.251100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:14.251573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:14.270344 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 HTTP/1.1 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'fcc23f48-4e2c-42e1-aed7-43e971acccb5'} Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:39:14.272054 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6f6a89e-8fac-4316-a7d9-cccdf5a928e9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 404 len: 111 microversion: 2.1 time: 0.039387 Aug 23 11:39:14.276796 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3780/7612] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:14 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:39:14.289996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:14.290858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:14.300643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:14.301173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:14.301615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:14.302329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:14.302790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:14.303219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:14.317996 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 HTTP/1.1 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fcc23f48-4e2c-42e1-aed7-43e971acccb5'} Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:39:14.319701 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-456cd2ac-9a89-49af-aec0-c7f06b563347 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 404 len: 111 microversion: 2.1 time: 0.036725 Aug 23 11:39:14.324171 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3833/7613] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:14 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:39:14.370952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-979229720", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "b2ef433d-5566-4fa0-a5bd-e65a9e9a0459"}], "security_groups": [{"name": "tempest-securitygroup--1345270865"}], "key_name": "tempest-keypair-304059490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:14.475652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] validate_networks() for [('b2ef433d-5566-4fa0-a5bd-e65a9e9a0459', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:39:14.956466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:39:14.956967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:39:14.957467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:39:14.957930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:39:14.958369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:39:14.967838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:14.968347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:14.968856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:14.969614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:14.970683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:14.971149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:14.988833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:39:14.994111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:39:15.006580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:39:15.008965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:39:15.054298 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [f75758f0-8a4f-4ebe-852c-33ce9fc4ad2c] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:39:16.061990 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [f75758f0-8a4f-4ebe-852c-33ce9fc4ad2c] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 44336. Aug 23 11:39:16.066108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef9b9a5d-56b6-49b0-abf8-f7f1d3d856da tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.699038 Aug 23 11:39:16.066925 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3781/7614] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:39:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:39:16.078059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d5de22f-556d-4800-b5b8-11958a0d66c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:16.078687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d5de22f-556d-4800-b5b8-11958a0d66c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:16.139151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7d5de22f-556d-4800-b5b8-11958a0d66c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:16.147603 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d5de22f-556d-4800-b5b8-11958a0d66c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1237 microversion: 2.1 time: 0.073430 Aug 23 11:39:16.148261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3834/7615] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:16 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:17.169676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:17.180983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:17.188481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:17.189688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:17.190154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:17.190993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:17.191473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:17.191919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:17.258149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:17.267103 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82e63f61-6d90-4390-a4e5-4fb25c3a543e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1297 microversion: 2.1 time: 0.102034 Aug 23 11:39:17.268071 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3782/7616] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:17 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1297 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:18.291065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:18.291798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:18.299341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:18.299912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:18.300461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:18.301259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:18.301788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:18.302286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:18.540403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:18.548859 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b37f4ac-9dce-4e88-a2bb-e8371fb2eeda tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1363 microversion: 2.1 time: 0.262211 Aug 23 11:39:18.549454 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3835/7617] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:18 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:18.720849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-393fb7a4-1540-4321-b1e6-bc792fe29d5a req-9794714d-d64e-46be-87d8-10b4e6d5cf6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:18.731116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-393fb7a4-1540-4321-b1e6-bc792fe29d5a req-9794714d-d64e-46be-87d8-10b4e6d5cf6f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:18.731613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-393fb7a4-1540-4321-b1e6-bc792fe29d5a req-9794714d-d64e-46be-87d8-10b4e6d5cf6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:18.732068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-393fb7a4-1540-4321-b1e6-bc792fe29d5a req-9794714d-d64e-46be-87d8-10b4e6d5cf6f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:18.750424 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-393fb7a4-1540-4321-b1e6-bc792fe29d5a req-9794714d-d64e-46be-87d8-10b4e6d5cf6f service nova] Creating event network-changed:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:39:18.756060 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-393fb7a4-1540-4321-b1e6-bc792fe29d5a req-9794714d-d64e-46be-87d8-10b4e6d5cf6f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039725 Aug 23 11:39:18.756844 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3783/7618] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:39:19.570713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:19.571337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:19.578171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:19.578705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:19.579151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:19.580462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:19.580967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:19.581410 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:19.723028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:19.730934 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e483a45d-7877-4312-8ffd-da557f464bcf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1363 microversion: 2.1 time: 0.164171 Aug 23 11:39:19.731510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3836/7619] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:19 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:20.754661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:20.755453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:20.761681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:20.762186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:20.762686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:20.763401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:20.763881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:20.764325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:20.895409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:20.903130 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8c71e38-b009-48ed-80cd-231cee58eedb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1363 microversion: 2.1 time: 0.154485 Aug 23 11:39:20.903694 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3784/7620] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:20 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:21.924899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:21.925525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:21.932525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:21.933058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:21.933512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:21.934238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:21.934714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:21.935151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:22.073141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:22.081542 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4006d63d-3371-42d6-a09d-307b02445e6e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1363 microversion: 2.1 time: 0.160704 Aug 23 11:39:22.082140 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3837/7621] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:21 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:23.102792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:23.103456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:23.110264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:23.111644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:23.111832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:23.112528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:23.113022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:23.113458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:23.247836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:23.256096 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4ca9e887-a9dc-4d2a-a9f3-24987e4fbf50 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1363 microversion: 2.1 time: 0.157203 Aug 23 11:39:23.256671 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3785/7622] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:23 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:23.585277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8b6d2922-e4f3-4243-b4cf-60f094413729 req-4cdde434-f00b-466c-bdb9-e161f6f76dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "name": "network-vif-plugged", "status": "completed", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:23.598340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8b6d2922-e4f3-4243-b4cf-60f094413729 req-4cdde434-f00b-466c-bdb9-e161f6f76dee service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:23.598833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8b6d2922-e4f3-4243-b4cf-60f094413729 req-4cdde434-f00b-466c-bdb9-e161f6f76dee service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:23.599274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8b6d2922-e4f3-4243-b4cf-60f094413729 req-4cdde434-f00b-466c-bdb9-e161f6f76dee service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:23.611833 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8b6d2922-e4f3-4243-b4cf-60f094413729 req-4cdde434-f00b-466c-bdb9-e161f6f76dee service nova] Creating event network-vif-plugged:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:39:23.617051 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8b6d2922-e4f3-4243-b4cf-60f094413729 req-4cdde434-f00b-466c-bdb9-e161f6f76dee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036157 Aug 23 11:39:23.617818 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3838/7623] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:39:24.277759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:24.278413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:24.286469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:24.287250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:24.287857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:24.288869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:24.289647 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:24.290149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:24.422376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:24.431277 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dc1201c-8f8a-47fd-b4c1-d2caa7c6ad42 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1363 microversion: 2.1 time: 0.157460 Aug 23 11:39:24.431859 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3786/7624] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:24 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:25.452824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:25.453559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:25.460733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:25.461249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:25.461692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:25.462638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:25.463098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:25.463526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:25.603817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:39:25.613244 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-26282ade-3c44-433f-93a6-1c23e23c69c5 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1551 microversion: 2.1 time: 0.163974 Aug 23 11:39:25.613850 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3839/7625] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:39:25 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:39:25.635573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:39:25.636148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:39:25.638206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:25.639062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:25.646350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:25.646862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:25.647326 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:25.648055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:25.648531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:25.649009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:25.731441 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d24de4f-bfc5-42a0-9ce1-2a43df00c2f9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099817 Aug 23 11:39:25.732048 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3787/7626] 10.222.0.78 () {58 vars in 1275 bytes} [Tue Aug 23 11:39:25 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:39:26.958416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ab4ff97f-08d0-4276-93ba-fa73b94520fd req-9f1018d9-aaf4-4311-b111-b1695dda8c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:39:26.963841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:39:26.972215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ab4ff97f-08d0-4276-93ba-fa73b94520fd req-9f1018d9-aaf4-4311-b111-b1695dda8c9d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:39:26.972425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ab4ff97f-08d0-4276-93ba-fa73b94520fd req-9f1018d9-aaf4-4311-b111-b1695dda8c9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:39:26.972827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ab4ff97f-08d0-4276-93ba-fa73b94520fd req-9f1018d9-aaf4-4311-b111-b1695dda8c9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:39:26.984615 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ab4ff97f-08d0-4276-93ba-fa73b94520fd req-9f1018d9-aaf4-4311-b111-b1695dda8c9d service nova] Creating event network-changed:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:39:26.989719 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ab4ff97f-08d0-4276-93ba-fa73b94520fd req-9f1018d9-aaf4-4311-b111-b1695dda8c9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035874 Aug 23 11:39:26.990392 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3840/7627] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:01.499190 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:01.500099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:01.505112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:01.505734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:01.513061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:01.513624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:01.514143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:01.514872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:01.515344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:01.515783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:01.649662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:01.657426 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-28d70870-e635-4ad5-a54a-cd4f33ea8b8b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1669 microversion: 2.1 time: 0.160814 Aug 23 11:40:01.658558 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3788/7628] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:01 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:01.677335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=19 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:01.678149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=38 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:01.682644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59baa1e-0c3b-4e21-8c6f-4fe34f648a4d"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:01.685124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:01.692590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:01.693113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:01.693567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:01.694273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:01.694742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:01.695261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:01.958501 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4e057f1-214f-440e-953b-7376c4e27130 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283001 Aug 23 11:40:01.964787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3841/7629] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:40:01 2022] POST /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:12.668335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:12.670761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:12.672986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:12.673670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:12.680365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:12.680923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:12.681388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:12.682119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:12.682600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:12.683049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:12.712064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:12.718424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:40:12.727025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:40:12.727473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:40:12.727972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:40:12.728406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:40:12.728864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:40:12.794202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-21f41ca1-ef01-4e6e-9e85-21aefe95ea3f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/action" status: 202 len: 0 microversion: 2.1 time: 0.129751 Aug 23 11:40:12.795146 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3789/7630] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:40:12 2022] POST /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:40:12.801840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:12.804169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:12.809952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:12.810785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:12.820272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:12.820902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:12.821789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:12.822861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:12.823431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:12.824228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:13.018727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:13.027608 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-378f74e7-a0df-4571-abaf-85b332eef73a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1724 microversion: 2.1 time: 0.227866 Aug 23 11:40:13.028200 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3842/7631] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:12 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:14.050886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:14.051691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:14.059658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:14.060237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:14.060705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:14.061531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:14.062042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:14.062606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:14.245514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:14.254841 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c9ecaaf-d037-4fe7-bd02-daddddbcb02f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1724 microversion: 2.1 time: 0.208975 Aug 23 11:40:14.255773 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3790/7632] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:14 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:15.277467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:15.278031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:15.285374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:15.285863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:15.286308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:15.287012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:15.287474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:15.287908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:15.425200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:15.433451 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3e240dcc-679c-4a88-aa26-bb6a69989b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.159993 Aug 23 11:40:15.434038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3843/7633] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:15 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:16.455412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:16.456140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:16.463118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:16.463613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:16.464063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:16.464792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:16.465267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:16.465702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:16.598047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:16.606427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1534fb5e-2862-4291-a143-2113f6a67404 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.155243 Aug 23 11:40:16.607004 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3791/7634] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:16 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:17.628651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:17.629297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:17.636163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:17.636659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:17.637137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:17.637846 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:17.638313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:17.638750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:17.775040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:17.783199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-09a62805-fe6a-4c80-a142-86528b060cc2 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.158971 Aug 23 11:40:17.783963 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3844/7635] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:17 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:40:18.803842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:18.804477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:18.813107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:18.813614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:18.814070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:18.815516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:18.815997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:18.816448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:18.943963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:18.952283 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ccb355bc-5a3b-4857-9878-6dde8bfb3b88 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.152675 Aug 23 11:40:18.952876 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3792/7636] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:18 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:19.974930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:19.975557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:19.982501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:19.982998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:19.983449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:19.984165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:19.984633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:19.985098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:20.115918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:20.124236 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ca4cd7f3-d9b8-4265-b3c7-f3d2f0d22074 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.153860 Aug 23 11:40:20.124837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3845/7637] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:19 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:21.145421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:21.146078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:21.152894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:21.153395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:21.153850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:21.154555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:21.155025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:21.155465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:21.291050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:21.300439 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb8f92a8-8bd6-47b5-aa50-13121425e361 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.158998 Aug 23 11:40:21.301058 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3793/7638] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:21 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:22.322155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:22.322700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:22.329652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:22.330171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:22.330621 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:22.331343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:22.331814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:22.332257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:22.468141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:22.477060 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ebdeb79d-963b-4b74-a92b-82f7023ec713 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.158881 Aug 23 11:40:22.477644 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3846/7639] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:22 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:23.498996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:23.499626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:23.507256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:23.507754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:23.508202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:23.508994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:23.509420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:23.509859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:23.639851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:23.648814 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-684e6a48-ca57-4fe1-8e9d-4f46da09cf45 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.153562 Aug 23 11:40:23.649442 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3794/7640] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:23 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:24.671066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:24.671692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:24.679427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:24.679922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:24.680370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:24.681111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:24.681579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:24.682014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:24.821775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:24.830275 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-58b604d9-4b29-402a-a62c-0dfeadb11f1a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.163409 Aug 23 11:40:24.831602 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3847/7641] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:24 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:25.852428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:25.853095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:25.859973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:25.860483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:25.860982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:25.862458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:25.863094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:25.863550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:25.997984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:26.006805 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e80d3f9-9388-4f4d-a02f-14b2d3559999 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.158455 Aug 23 11:40:26.007380 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3795/7642] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:25 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:27.027447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:27.028069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:27.036451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:27.036982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:27.037432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:27.038165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:27.038630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:27.039328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:27.177814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:27.186794 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d58fb13e-f249-4170-a04d-18f81192f9d7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.163199 Aug 23 11:40:27.187390 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3848/7643] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:27 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:28.209469 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:28.210107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:28.217263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:28.217703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:28.218160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:28.218883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:28.219358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:28.219799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:28.356969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:28.366081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-701fc948-5b6f-4b89-a988-10422e6fd9c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.161172 Aug 23 11:40:28.366660 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3796/7644] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:28 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:29.387916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:29.388471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:29.395827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:29.396325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:29.396801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:29.397524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:29.397996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:29.398435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:29.546388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:29.555690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-265faf5f-d5d8-4711-a098-c8468f6bafbf tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.171856 Aug 23 11:40:29.556286 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3849/7645] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:29 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:40:30.577906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:30.578600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:30.586168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:30.586942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:30.587374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:30.588096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:30.588569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:30.589029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:30.726591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:30.735014 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c7208ccb-6666-4d9c-9720-fcf87c54dc97 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.161134 Aug 23 11:40:30.735764 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3797/7646] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:30 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:31.757161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:31.758123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:31.766866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:31.767377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:31.767829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:31.768563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:31.769059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:31.769501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:31.911105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:31.919461 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04feaf92-1c01-44c9-9fa4-9c8146062ae9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.166353 Aug 23 11:40:31.920051 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3850/7647] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:31 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:32.941788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:32.942427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:32.949629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:32.950142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:32.950618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:32.951361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:32.951861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:32.952332 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:33.101851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:33.110367 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-111ba03f-2ae5-48ea-b714-0c709268b47d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1729 microversion: 2.1 time: 0.172673 Aug 23 11:40:33.110926 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3798/7648] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:32 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:34.134648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:34.135280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:34.141913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:34.142411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:34.143374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:34.144096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:34.144582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:34.145035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:34.304635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:34.318792 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bad5630f-f9fb-47e4-b478-6f39ec2e95fc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1728 microversion: 2.1 time: 0.187965 Aug 23 11:40:34.319767 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3851/7649] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:34 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:34.456022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "name": "network-vif-unplugged", "status": "completed", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:34.467784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:34.468321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:34.468783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:34.483760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] Creating event network-vif-unplugged:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h1-847009-13 Aug 23 11:40:34.490080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:40:34.501189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-7318775b-7fdc-412c-a649-7da08334680b req-97109fb1-f531-4fdd-afd7-a11f892747bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049485 Aug 23 11:40:34.502525 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3799/7650] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:35.347672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:35.348299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:35.355534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:35.356030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:35.356473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:35.357223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:35.357689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:35.358123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:35.497753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:35.507300 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e8f9d7f-e716-4759-93d0-6e7eca82fe38 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1728 microversion: 2.1 time: 0.164010 Aug 23 11:40:35.507904 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3852/7651] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:35 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:36.532316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:36.533607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:36.541136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:36.541720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:36.542245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:36.543045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:36.543585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:36.544094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:36.556835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:36.571904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:36.572506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:36.573041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:36.591463 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] Creating event network-changed:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h1-847009-13 Aug 23 11:40:36.601850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:40:36.625311 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-02a8d5c9-2b1d-4ce6-bfbf-3c2d16738a55 req-ec446775-1227-41e3-ad9d-28cfaaa1496e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077156 Aug 23 11:40:36.626545 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3853/7652] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:37.109016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:37.120050 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0852d14-1583-4a31-a47e-68e17912574b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.593537 Aug 23 11:40:37.133716 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3800/7653] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:36 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:38.146251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:38.146999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:38.153322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:38.153826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:38.154273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:38.154984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:38.155455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:38.155888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:38.301489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:38.309933 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5a0eb1a7-a58a-4308-a519-8f139d9b515b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.169661 Aug 23 11:40:38.310520 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3854/7654] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:38 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:39.332086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:39.332729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:39.340300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:39.340865 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:39.341327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:39.342045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:39.342520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:39.342967 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:39.478044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:39.487015 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ea713afc-6b1f-4ba1-9b9a-d64c55155c27 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.159621 Aug 23 11:40:39.487796 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3801/7655] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:39 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:40.508711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:40.509376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:40.516189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:40.516921 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:40.517163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:40.517901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:40.518372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:40.518809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:40.653186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:40.662025 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a9447127-6b5e-46b4-a4bc-228504fc7f94 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.157338 Aug 23 11:40:40.662607 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3855/7656] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:40 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:40:41.683866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:41.684505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:41.691968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:41.692477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:41.692965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:41.693686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:41.694171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:41.694622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:41.827916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:41.836594 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83121fc5-e44e-45c2-b22e-ac11c4736abb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.156501 Aug 23 11:40:41.837193 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3802/7657] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:41 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:42.858226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:42.858845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:42.861714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=29 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:42.868165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:42.868660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:42.869129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:42.869838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:42.870306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:42.870744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:42.874792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=83 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:43.009312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:43.017658 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7510dd89-6026-467f-bd17-3c2405458eee tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.163429 Aug 23 11:40:43.018294 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3856/7658] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:42 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:44.038406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:44.039046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:44.041888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=33 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:44.047388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:44.047901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:44.048370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:44.049123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:44.050200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:44.050653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:44.053342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:40:44.183617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:44.192508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-038fc483-d961-4356-b748-44f54c4bef0d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.158062 Aug 23 11:40:44.193114 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3803/7659] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:44 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:45.214262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:45.214811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:45.222485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:45.222990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:45.223433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:45.224142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:45.224612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:45.225076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:45.367536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:45.375864 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aadfd7f0-7dc2-4e77-8514-1e431d3f6f25 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.165936 Aug 23 11:40:45.376449 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3857/7660] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:45 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:46.396954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:46.397512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:46.404449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:46.404996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:46.405460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:46.406227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:46.406715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:46.407161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:46.540630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:46.549018 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7aaba65-22dd-4139-b516-cc4399be58eb tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.156123 Aug 23 11:40:46.550347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3804/7661] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:46 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:47.573875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:47.574500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:47.581978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:47.582466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:47.582912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:47.583615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:47.584075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:47.584502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:47.716884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:47.725506 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2140beaa-40b3-4e8f-bb70-8d8862baa816 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.155636 Aug 23 11:40:47.726010 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3858/7662] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:47 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:40:48.748074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:48.748697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:48.758489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:48.758920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:48.759386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:48.760118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:48.760700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:48.761173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:48.926373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:48.937253 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb7b5ee6-674e-40aa-a1a9-22e48af75d55 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1726 microversion: 2.1 time: 0.193221 Aug 23 11:40:48.938046 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3805/7663] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:48 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:49.958906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:49.959534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:49.966771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:49.967274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:49.967727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:49.968447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:49.968953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:49.969394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.104864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:50.113144 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e169dc53-47f9-4325-93a2-998bd0c26353 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1723 microversion: 2.1 time: 0.158866 Aug 23 11:40:50.113716 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3859/7664] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:49 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:50.133335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:50.133875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:50.140600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:50.141133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:50.141587 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.142291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:50.142758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:50.143693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.182223 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:50.182721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:50.183171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.183910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:50.184382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:50.184848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.204771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:40:50.210566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Getting quotas for user 89737a9ae0744826ada2d422e4eb4955 and project b90dbe2d5fd949fd9ae79c80ddfc5bf1. Resources: {'ram', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:40:50.314228 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-36da4e23-b26f-455d-ab32-ef7e7370dcb7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "POST /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/action" status: 202 len: 0 microversion: 2.1 time: 0.184564 Aug 23 11:40:50.318517 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3806/7665] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:40:50 2022] POST /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:40:50.323535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:50.324166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:50.333360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:50.333927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:50.334411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.335191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:50.335689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:50.336157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:50.474804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:50.483491 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1750ab06-0ed2-4526-83fa-7b38a397b323 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.163904 Aug 23 11:40:50.484099 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3860/7666] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:50 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:51.212925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "name": "network-vif-plugged", "status": "completed", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:51.224878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:51.225506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:51.225965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:51.237841 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] Creating event network-vif-plugged:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h1-847009-13 Aug 23 11:40:51.243060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-847009-13', 'n-h1-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:40:51.253575 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-382659ba-6366-4319-bf2c-b29eb532919e req-d913a2d6-d69e-45fd-81ec-cf295778a96e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097582 Aug 23 11:40:51.254169 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3807/7667] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:51.504959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:51.505588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:51.512472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:51.513004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:51.513459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:51.514165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:51.514634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:51.515072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:51.648545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:51.656933 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d1634845-b63c-4700-a156-1ae8f8a19056 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.156298 Aug 23 11:40:51.657520 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3861/7668] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:51 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:52.683654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:52.684216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:52.691017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:52.691558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:52.692017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:52.692763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:52.693236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:52.693684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:52.848575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:52.857049 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dbb61be6-75f4-4475-80c3-ce48e152281a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.178546 Aug 23 11:40:52.857658 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3808/7669] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:52 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:53.880086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:53.880609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:53.887509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:53.888002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:53.888447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:53.889182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:53.889650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:53.890084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:54.042248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:54.051589 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d23058fc-b0b2-4584-bbe2-e3f1ebda6bcc tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.176342 Aug 23 11:40:54.052461 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3862/7670] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:53 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:55.071862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:55.072520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:55.080429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:55.081595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:55.082214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:55.082989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:55.083501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:55.083932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:55.220911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:55.229881 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a5476aea-8cc7-4a6a-98be-cd53039a0e1b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.161850 Aug 23 11:40:55.230936 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3809/7671] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:55 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:55.659053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "name": "network-vif-unplugged", "status": "completed", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:55.668425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:55.668936 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:55.669375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:55.682010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] Creating event network-vif-unplugged:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:40:55.687409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:40:55.699040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-f4191238-737c-4a2a-9af2-9c7f5ceb55a6 req-af9e0422-6dbd-4af8-8148-6e57f00e784a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096773 Aug 23 11:40:55.699832 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3863/7672] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:56.252860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:56.253644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:56.260660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:56.261221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:56.261683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:56.262410 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:56.262891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:56.263339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:56.409612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:56.418388 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a41bf200-5a6a-42f7-a164-b2ae8af2e39b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.169905 Aug 23 11:40:56.418990 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3810/7673] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:56 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:57.440701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:57.441431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:57.448575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:57.449111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:57.449542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:57.450249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:57.450709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:57.451140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:57.589090 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:57.598195 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49b4537f-2f38-4b18-b279-80045014d737 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.162390 Aug 23 11:40:57.598775 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3864/7674] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:57 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:57.714828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:40:57.726135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:57.726710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:57.727248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:57.739018 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] Creating event network-changed:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:40:57.744382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:40:57.755939 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b7b75194-f999-45b3-b97b-c6902bed5d0a req-ee03ee5a-ed37-42b0-9c74-9a87d900cf1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045077 Aug 23 11:40:57.756555 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3811/7675] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:40:58.619374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:58.620086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:58.627984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:58.628516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:58.629077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:58.629804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:58.630274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:58.630855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:58.772805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:58.781471 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf9f1614-68d7-45c5-aef4-f1c23793067d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.166005 Aug 23 11:40:58.782069 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3865/7676] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:58 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:40:59.804640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:40:59.805452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:40:59.811839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:59.812351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:59.812866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:59.813610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:40:59.814076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:40:59.814538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:40:59.951644 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:40:59.961371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dff5ee4c-ba1d-4116-9715-9069954ffb93 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.161947 Aug 23 11:40:59.961975 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3812/7677] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:40:59 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:00.983298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:00.984035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:00.991740 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:00.992242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:00.992699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:00.993469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:00.993964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:00.994434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:01.149872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:01.159472 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-af5f96e4-508f-4d66-9ab3-ad160b87485f tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.179276 Aug 23 11:41:01.160103 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3866/7678] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:00 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:02.181346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:02.181991 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:02.183989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:02.190290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:02.190798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:02.191265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:02.191988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:02.192490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:02.192957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:02.329562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:02.339270 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a597aaad-4abd-4788-b80c-84a10225448d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.162003 Aug 23 11:41:02.339881 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3813/7679] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:02 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:03.359679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:03.360264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:03.368322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:03.368865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:03.369310 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:03.370025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:03.370491 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:03.370925 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:03.504815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:03.513535 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d2ea7d64-d88a-4f9f-a2d7-65dc573b3254 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.157955 Aug 23 11:41:03.514129 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3867/7680] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:03 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:04.535392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:04.536019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:04.542265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:04.542780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:04.543234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:04.543942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:04.544417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:04.544883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:04.676721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:04.685202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac8bbbd3-1bf3-4386-a3ae-1302ce705540 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.154317 Aug 23 11:41:04.685790 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3814/7681] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:04 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:05.707664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:05.708286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:05.715592 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:05.716088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:05.716536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:05.717275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:05.717747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:05.718189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:05.852930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:05.861234 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-667e9cb1-bb0e-407f-8c2b-143c9a3d1c3b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.158040 Aug 23 11:41:05.861869 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3868/7682] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:05 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:06.882479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:06.883118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:06.890125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:06.890634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:06.891114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:06.891818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:06.892297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:06.892956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:07.025014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:07.034470 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e422397a-aac1-4f35-8769-a71aafc93251 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.154879 Aug 23 11:41:07.034620 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3815/7683] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:06 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:08.055826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:08.056448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:08.062891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:08.063414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:08.063862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:08.065220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:08.065698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:08.066134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:08.543133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:08.564067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6264aa77-b3cf-4ce4-b360-48c70522b0e7 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1722 microversion: 2.1 time: 0.512096 Aug 23 11:41:08.565863 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3869/7684] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:08 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1722 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:09.586549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:09.587178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:09.594054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:09.594564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:09.595024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:09.595750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:09.596226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:09.596676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:09.727731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:09.736234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50e03730-3128-4d12-ad0b-deb04284f809 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1715 microversion: 2.1 time: 0.153812 Aug 23 11:41:09.737399 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3816/7685] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:09 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:09.756931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:09.757557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:09.764599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:09.765134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:09.765588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:09.766307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:09.766782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:09.767273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:09.903893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:09.912938 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3e56630-b501-4328-bb3e-1ec65f418882 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1715 microversion: 2.1 time: 0.159894 Aug 23 11:41:09.913519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3870/7686] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:09 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:41:09.934353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:09.934994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:09.941434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:09.941947 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:09.942406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:09.943129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:09.943621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:09.944059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:09.960530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:10.079978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:10.090260 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98261165-f5a9-4e32-b309-73cb3737f73d tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1715 microversion: 2.1 time: 0.159750 Aug 23 11:41:10.090841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3817/7687] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:09 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:10.112522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:10.113276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:10.119270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:10.119757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:10.120195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:10.120931 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:10.121394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:10.121827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:10.149028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:41:10.195129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:10.229397 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2cdd608-160f-49c9-b1b6-6a2955a87cfa tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 204 len: 0 microversion: 2.1 time: 0.121276 Aug 23 11:41:10.229875 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3871/7688] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:41:10 2022] DELETE /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:41:10.238986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:10.239705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:10.246273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:10.246889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:10.247358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:10.248087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:10.248573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:10.249061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:10.385390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:10.394207 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b6bdd34e-4482-475a-bd8f-db71c85f3222 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1721 microversion: 2.1 time: 0.159769 Aug 23 11:41:10.394795 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3818/7689] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:10 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:11.415888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:11.416787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:11.424325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:11.424958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:11.425419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:11.426129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:11.426600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:11.427038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:11.564046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:11.572549 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d51586e-3b91-4ae9-93d6-e7ce86d0b5ce tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1721 microversion: 2.1 time: 0.160964 Aug 23 11:41:11.573169 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3872/7690] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:11 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:12.086802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4ca4cb99-ab7e-43f4-bf31-50eb3cd712e3 req-4233fdef-a9c2-49fa-a80d-1c347bc504a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "name": "network-vif-plugged", "status": "completed", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:12.104996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4ca4cb99-ab7e-43f4-bf31-50eb3cd712e3 req-4233fdef-a9c2-49fa-a80d-1c347bc504a3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:12.106413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4ca4cb99-ab7e-43f4-bf31-50eb3cd712e3 req-4233fdef-a9c2-49fa-a80d-1c347bc504a3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:12.107117 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4ca4cb99-ab7e-43f4-bf31-50eb3cd712e3 req-4233fdef-a9c2-49fa-a80d-1c347bc504a3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:12.123844 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4ca4cb99-ab7e-43f4-bf31-50eb3cd712e3 req-4233fdef-a9c2-49fa-a80d-1c347bc504a3 service nova] Creating event network-vif-plugged:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:41:12.131824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4ca4cb99-ab7e-43f4-bf31-50eb3cd712e3 req-4233fdef-a9c2-49fa-a80d-1c347bc504a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048899 Aug 23 11:41:12.132800 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3819/7691] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:41:12.594232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:12.595616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:12.602698 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:12.603197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:12.603640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:12.604354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:12.604850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:12.605423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:12.696453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:12.709038 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dab71d65-9320-41c3-a04c-66389799c10b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1653 microversion: 2.1 time: 0.118707 Aug 23 11:41:12.710266 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3873/7692] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:12 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1653 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:12.993202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-754cb3ee-e68d-4083-8c20-acf82cbb8df7 req-98ccbd24-3aec-4ca1-865c-88a215c646be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2", "name": "network-vif-deleted", "tag": "03deb6f3-3af2-41f1-8214-d11f91f6114a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:13.003629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-754cb3ee-e68d-4083-8c20-acf82cbb8df7 req-98ccbd24-3aec-4ca1-865c-88a215c646be service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:13.004051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-754cb3ee-e68d-4083-8c20-acf82cbb8df7 req-98ccbd24-3aec-4ca1-865c-88a215c646be service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:13.004506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-754cb3ee-e68d-4083-8c20-acf82cbb8df7 req-98ccbd24-3aec-4ca1-865c-88a215c646be service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:13.021254 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-754cb3ee-e68d-4083-8c20-acf82cbb8df7 req-98ccbd24-3aec-4ca1-865c-88a215c646be service nova] Creating event network-vif-deleted:03deb6f3-3af2-41f1-8214-d11f91f6114a for instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 on n-h2-847009-13 Aug 23 11:41:13.027501 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-754cb3ee-e68d-4083-8c20-acf82cbb8df7 req-98ccbd24-3aec-4ca1-865c-88a215c646be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038659 Aug 23 11:41:13.028122 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3820/7693] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:41:13.731164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:13.731791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:13.735035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:13.741304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:13.741812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:13.742263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:13.743170 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:13.743853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:13.744300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:13.810703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:13.819973 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c52c1052-3568-4ff5-9c4f-eedeb5eae393 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1368 microversion: 2.1 time: 0.092522 Aug 23 11:41:13.828783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3874/7694] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:13 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:14.842729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:14.843479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:14.845593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:14.852098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:14.852649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:14.853160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:14.853920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:14.854437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:14.854888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:14.919598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:14.928961 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0eddf1b0-7e4b-4979-9e77-6ce9da545c87 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1368 microversion: 2.1 time: 0.091617 Aug 23 11:41:14.929540 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3821/7695] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:14 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:15.950534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:15.951156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:15.959484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:15.960107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:15.960664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:15.961770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:15.962342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:15.962912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:16.034685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:16.043362 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34e16040-1fc4-44e2-8d5d-fe55d7002c9b tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1368 microversion: 2.1 time: 0.096791 Aug 23 11:41:16.044090 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3875/7696] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:15 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:17.067293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:17.068415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:17.077515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:17.078025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:17.078478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:17.079204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:17.079677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:17.080127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:17.149788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89737a9ae0744826ada2d422e4eb4955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90dbe2d5fd949fd9ae79c80ddfc5bf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:17.159070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8a40112c-64fc-42d2-b5a0-46ded75fa532 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 200 len: 1368 microversion: 2.1 time: 0.097475 Aug 23 11:41:17.159657 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3822/7697] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:17 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:18.180088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:18.180707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:18.187665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:18.188155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:18.188603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:18.189480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:18.190008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:18.190524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:18.205117 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 HTTP/1.1 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2'} Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:18.207618 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da546300-e9d8-4c5a-84f1-5a5b98fad1c9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 404 len: 111 microversion: 2.1 time: 0.033247 Aug 23 11:41:18.212285 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3876/7698] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:18 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:18.287255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:18.289549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:18.297099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:18.297675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:18.298167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:18.299804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:18.300293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:18.300771 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:18.313332 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-volume_attachments HTTP/1.1 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'server_id': 'ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2'} Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:18.315583 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e76e46c0-390c-402c-9e3c-f06dd52f9764 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034623 Aug 23 11:41:18.320047 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3823/7699] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:41:18 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.633271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.633770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.640521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.641046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.641486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.642233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.642821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.643252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.656450 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 HTTP/1.1 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2'} Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.658032 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f74763f7-615f-4238-863f-45ddedd8fd67 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 404 len: 111 microversion: 2.1 time: 0.030023 Aug 23 11:41:21.662398 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3877/7700] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:41:21 2022] DELETE /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.668531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.669222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.677273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.677791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.678264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.679014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.679497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.679950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.696080 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 HTTP/1.1 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2'} Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.697736 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6084c1bf-c0bb-4d3e-8917-e430fd62c3df tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2" status: 404 len: 111 microversion: 2.1 time: 0.034610 Aug 23 11:41:21.702193 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3824/7701] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:21 2022] GET /compute/v2.1/servers/ed49a20d-ae1d-44d3-8db6-72a6d8b8bfa2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.708107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.708619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.715193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.715703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.716175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.716957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.717416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.717854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.733032 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 HTTP/1.1 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'fcc23f48-4e2c-42e1-aed7-43e971acccb5'} Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.734641 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-007cb3b4-9713-474f-a36a-e9f677d10cf3 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 404 len: 111 microversion: 2.1 time: 0.032063 Aug 23 11:41:21.739073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3878/7702] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:41:21 2022] DELETE /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.747008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.747677 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: fcc23f48-4e2c-42e1-aed7-43e971acccb5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.754141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.754661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.755330 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.756078 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.756560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.757032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.771354 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 HTTP/1.1 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'fcc23f48-4e2c-42e1-aed7-43e971acccb5'} Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.772978 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance fcc23f48-4e2c-42e1-aed7-43e971acccb5 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-25d865e6-bcbd-4985-961e-474e17d98b2c tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5" status: 404 len: 111 microversion: 2.1 time: 0.031874 Aug 23 11:41:21.777028 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3825/7703] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:21 2022] GET /compute/v2.1/servers/fcc23f48-4e2c-42e1-aed7-43e971acccb5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.783675 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.784470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.790594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.791076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.791541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.792238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.792700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.793149 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.806854 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 HTTP/1.1 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '862e606f-d680-4cd5-9d4c-385130e98b87'} Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.808415 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7bc1883c-6a84-4ad6-aab0-9ed424d3a6b9 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 404 len: 111 microversion: 2.1 time: 0.030754 Aug 23 11:41:21.813002 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3879/7704] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:41:21 2022] DELETE /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.818899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.819524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: 862e606f-d680-4cd5-9d4c-385130e98b87] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.825575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.826077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.826530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.827237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.827706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.828145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.842691 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 HTTP/1.1 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '862e606f-d680-4cd5-9d4c-385130e98b87'} Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.844243 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance 862e606f-d680-4cd5-9d4c-385130e98b87 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-364d8332-239f-4dca-ac06-9b7386e179ba tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87" status: 404 len: 111 microversion: 2.1 time: 0.030686 Aug 23 11:41:21.849227 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3826/7705] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:21 2022] GET /compute/v2.1/servers/862e606f-d680-4cd5-9d4c-385130e98b87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.855363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.855874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.862484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.862919 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.863368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.864082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.864559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.865084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.879463 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d HTTP/1.1 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d'} Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.881084 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d38617c7-8119-421d-8cbe-5e82ed3c1d2a tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 404 len: 111 microversion: 2.1 time: 0.031079 Aug 23 11:41:21.885591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3880/7706] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:41:21 2022] DELETE /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.891287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.891963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [instance: eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:21.898719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.899232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.899698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.900420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:21.900938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:21.901390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:21.915089 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] HTTP exception thrown: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Request method failure captured: Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d HTTP/1.1 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLsT5omQBtPWhFHO-HtbNDsfcnzgjiLwkvmIdpCZ9HdtNjsphUdE2JFsmcSPu5ERd5PjDJCfx_iDEmLx0ifRHNWGKoA72oF7ZTiPlE9pVTVV43hZhOubTmKwJyTfLXNCUPAOKShojzxKokHkySrHQjAue406v6L1WNWUKXC0mHkKmjM Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b90dbe2d5fd949fd9ae79c80ddfc5bf1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b90dbe2d5fd949fd9ae79c80ddfc5bf1"}]}] Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: b90dbe2d5fd949fd9ae79c80ddfc5bf1 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServerActionsTestJSON-274995596 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 89737a9ae0744826ada2d422e4eb4955 Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServerActionsTestJSON-274995596-project Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d'} Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:21.916678 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Returning 404 to user: Instance eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:21.921070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17e5c1c2-a56c-41ba-a932-1e78f6ff7258 tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d" status: 404 len: 111 microversion: 2.1 time: 0.030766 Aug 23 11:41:21.922503 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3827/7707] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:21 2022] GET /compute/v2.1/servers/eb6aa815-af0b-4dd7-a482-e2c62c4f1c9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:21.927286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-716aacb9-a90b-4671-84e0-cccb1a5c702e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] Calling method '.version_select at 0x7fdc9cbb9790>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:21.931948 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-716aacb9-a90b-4671-84e0-cccb1a5c702e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:41:22.939468 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-716aacb9-a90b-4671-84e0-cccb1a5c702e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 44636. Aug 23 11:41:22.960315 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-716aacb9-a90b-4671-84e0-cccb1a5c702e tempest-ServerActionsTestJSON-274995596 tempest-ServerActionsTestJSON-274995596-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-304059490" status: 202 len: 0 microversion: 2.1 time: 1.036884 Aug 23 11:41:22.961367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3881/7708] 10.222.0.78 () {58 vars in 1218 bytes} [Tue Aug 23 11:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-304059490 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:41:32.397896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=13 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:32.399662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=35 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:32.534507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1913299598", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "ad6c3b7a-ac93-4937-abc7-93e9135d345a"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:32.590403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] validate_networks() for [('ad6c3b7a-ac93-4937-abc7-93e9135d345a', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:41:32.991306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:41:32.991751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:41:32.992269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:41:32.992726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:41:32.993185 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:41:33.002635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:33.003129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:33.003578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:33.004630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:33.005136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:33.005585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:33.023534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Getting quotas for project cc8bf75b544642439ab458c84b70db3f. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:41:33.029065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Getting quotas for user e2431ef36aa74efeba3bc51e632716b5 and project cc8bf75b544642439ab458c84b70db3f. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:41:33.042379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:41:33.044692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:41:33.097098 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f32f80bc-b50d-4f9f-aa1e-fa7cf0b501a2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705420 Aug 23 11:41:33.098065 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3828/7709] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 11:41:33.106911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:33.108200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:33.114242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-54257fd5-bf4b-458b-be26-00ed32452697 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:33.115117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-54257fd5-bf4b-458b-be26-00ed32452697 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:33.196347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-54257fd5-bf4b-458b-be26-00ed32452697 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:33.203763 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-54257fd5-bf4b-458b-be26-00ed32452697 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1217 microversion: 2.1 time: 0.099022 Aug 23 11:41:33.204435 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3882/7710] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:33 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:41:34.227178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:34.227932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:34.236918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:34.237824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:34.238567 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:34.239711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:34.240505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:34.241226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:34.331377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:34.342900 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0cd3df8e-27f6-4547-810a-05b01b5bbac1 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1277 microversion: 2.1 time: 0.122552 Aug 23 11:41:34.343835 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3829/7711] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:34 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:35.368270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:35.369077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:35.377459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:35.381312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:35.381798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:35.383828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:35.384316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:35.384772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:35.641584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:35.656385 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b2eb8c9-bb4b-4579-a29a-789ea79add41 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.292722 Aug 23 11:41:35.658510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3883/7712] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:35 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:41:35.813313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b770d89e-8c78-4afd-998d-11d3865b9a35 req-6c003cc5-e03f-4c95-b835-06b8a07f4bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecad1d3-9b66-4f27-8b13-837acb052b3e", "tag": "aaa4fc7c-5bcf-4664-b6e6-4526ff5c6531"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:35.823783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b770d89e-8c78-4afd-998d-11d3865b9a35 req-6c003cc5-e03f-4c95-b835-06b8a07f4bf5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:35.825137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b770d89e-8c78-4afd-998d-11d3865b9a35 req-6c003cc5-e03f-4c95-b835-06b8a07f4bf5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:35.825976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b770d89e-8c78-4afd-998d-11d3865b9a35 req-6c003cc5-e03f-4c95-b835-06b8a07f4bf5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:35.838751 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b770d89e-8c78-4afd-998d-11d3865b9a35 req-6c003cc5-e03f-4c95-b835-06b8a07f4bf5 service nova] Creating event network-changed:aaa4fc7c-5bcf-4664-b6e6-4526ff5c6531 for instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e on n-h2-847009-13 Aug 23 11:41:35.845735 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b770d89e-8c78-4afd-998d-11d3865b9a35 req-6c003cc5-e03f-4c95-b835-06b8a07f4bf5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037600 Aug 23 11:41:35.846350 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3830/7713] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:41:36.679838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:36.680470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:36.687333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:36.687828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:36.688272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:36.689886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:36.690431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:36.690874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:36.828959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:36.837392 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcc069e7-29be-41a7-bf1e-993395f8f865 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.162002 Aug 23 11:41:36.837977 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3884/7714] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:36 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:37.858618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:37.859339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:37.867276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:37.867780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:37.868233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:37.868984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:37.869462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:37.869913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:38.006404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:38.014275 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7eed907a-7cf5-4291-87f2-e304c2dcd8ca tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.159930 Aug 23 11:41:38.014845 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3831/7715] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:37 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:39.035280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:39.035895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:39.042376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:39.042871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:39.043315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:39.044019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:39.044486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:39.044948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:39.191538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:39.201981 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e117db9c-5b76-4473-8ae4-6bf8119483d8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.171113 Aug 23 11:41:39.202621 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3885/7716] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:39 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:40.228003 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:40.228648 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:40.235746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:40.236262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:40.237420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:40.238208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:40.238696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:40.239180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:40.370982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:40.379430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2b73f638-3128-454e-b7ad-a87fb94bc8da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.155451 Aug 23 11:41:40.380000 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3832/7717] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:40 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:41.401190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:41.401812 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:41.409026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:41.409603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:41.410051 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:41.410756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:41.411217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:41.411650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:41.547657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:41.555373 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ac3af318-f3c1-4032-bc14-60cbce3a0786 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.158213 Aug 23 11:41:41.555955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3886/7718] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:41 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:42.125147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-df405ddd-dc72-49cd-b9cf-27a409c70601 req-b6e73e8c-bf7c-42dc-8dcd-f2285b54dcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecad1d3-9b66-4f27-8b13-837acb052b3e", "name": "network-vif-plugged", "status": "completed", "tag": "aaa4fc7c-5bcf-4664-b6e6-4526ff5c6531"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:42.137601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-df405ddd-dc72-49cd-b9cf-27a409c70601 req-b6e73e8c-bf7c-42dc-8dcd-f2285b54dcf0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:42.138468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-df405ddd-dc72-49cd-b9cf-27a409c70601 req-b6e73e8c-bf7c-42dc-8dcd-f2285b54dcf0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:42.138922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-df405ddd-dc72-49cd-b9cf-27a409c70601 req-b6e73e8c-bf7c-42dc-8dcd-f2285b54dcf0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:42.151530 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-df405ddd-dc72-49cd-b9cf-27a409c70601 req-b6e73e8c-bf7c-42dc-8dcd-f2285b54dcf0 service nova] Creating event network-vif-plugged:aaa4fc7c-5bcf-4664-b6e6-4526ff5c6531 for instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e on n-h2-847009-13 Aug 23 11:41:42.156824 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-df405ddd-dc72-49cd-b9cf-27a409c70601 req-b6e73e8c-bf7c-42dc-8dcd-f2285b54dcf0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Aug 23 11:41:42.157439 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3833/7719] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:41:42.577100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:42.577724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:42.585368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:42.586121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:42.586562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:42.587263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:42.587724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:42.588158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:42.723940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:42.731687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-04304dae-f87b-40bb-b043-129faffa8431 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1317 microversion: 2.1 time: 0.158637 Aug 23 11:41:42.732264 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3887/7720] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:42 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:43.754165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:43.754891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:43.756943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:43.757729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:43.765175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:43.765689 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:43.766152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:43.766877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:43.767361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:43.768465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:43.901301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:43.909430 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1e4aa97d-e695-423e-aed4-b50250e881c6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.160244 Aug 23 11:41:43.910007 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3834/7721] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:43 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:43.968540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2038781563", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "ad6c3b7a-ac93-4937-abc7-93e9135d345a"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:43.977032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:44.023394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] validate_networks() for [('ad6c3b7a-ac93-4937-abc7-93e9135d345a', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:41:44.395969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:41:44.396400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:41:44.396917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:41:44.397336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:41:44.397762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:41:44.406708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:44.407200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:44.407650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:44.409192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:44.409804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:44.410248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:44.427966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Getting quotas for project cc8bf75b544642439ab458c84b70db3f. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:41:44.433404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Getting quotas for user e2431ef36aa74efeba3bc51e632716b5 and project cc8bf75b544642439ab458c84b70db3f. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:41:44.446608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:41:44.448971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:41:44.492554 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:41:45.500881 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 44762. Aug 23 11:41:45.505533 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-46e06ab0-53e1-442c-b243-d82e624efff7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.540871 Aug 23 11:41:45.506389 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3888/7722] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:41:45.517054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8b72bc0-de31-44e6-8b49-cff1f062ea9b tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:45.518222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8b72bc0-de31-44e6-8b49-cff1f062ea9b tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:45.576436 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8b72bc0-de31-44e6-8b49-cff1f062ea9b tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:45.584756 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8b72bc0-de31-44e6-8b49-cff1f062ea9b tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1217 microversion: 2.1 time: 0.071494 Aug 23 11:41:45.585417 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3835/7723] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:45 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:46.607614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:46.608164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:46.615363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:46.616097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:46.616552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:46.617657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:46.618346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:46.619097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:46.694789 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:46.703082 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc869e38-3258-4706-a87f-4d155ea4dcd5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1287 microversion: 2.1 time: 0.100558 Aug 23 11:41:46.704777 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3889/7724] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:46 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:47.355430 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:41:47.355998 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:41:47.725250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:47.725807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:47.733370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:47.733881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:47.734349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:47.735077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:47.735576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:47.736011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:47.931978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:47.940810 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1763978-3ad2-40f4-8a28-16f63a0fec91 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.220174 Aug 23 11:41:47.941590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3836/7725] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:47 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:48.040359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6f260463-1c99-4706-bf2e-f282a6f749d3 req-862a502e-5a16-4b6b-b62e-c6d44d0cfaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7", "tag": "876e8e1d-317d-41e2-8cb3-6ef580b3caef"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:48.050496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6f260463-1c99-4706-bf2e-f282a6f749d3 req-862a502e-5a16-4b6b-b62e-c6d44d0cfaa5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:48.050997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6f260463-1c99-4706-bf2e-f282a6f749d3 req-862a502e-5a16-4b6b-b62e-c6d44d0cfaa5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:48.051472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6f260463-1c99-4706-bf2e-f282a6f749d3 req-862a502e-5a16-4b6b-b62e-c6d44d0cfaa5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:48.062770 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6f260463-1c99-4706-bf2e-f282a6f749d3 req-862a502e-5a16-4b6b-b62e-c6d44d0cfaa5 service nova] Creating event network-changed:876e8e1d-317d-41e2-8cb3-6ef580b3caef for instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 on n-h1-847009-13 Aug 23 11:41:48.068730 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6f260463-1c99-4706-bf2e-f282a6f749d3 req-862a502e-5a16-4b6b-b62e-c6d44d0cfaa5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106028 Aug 23 11:41:48.069375 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3890/7726] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:41:48.963709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:48.964704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:48.972197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:48.972713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:48.973233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:48.973969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:48.974454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:48.974908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:49.114808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:49.122555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2f8ce1c8-9d55-49e9-9bdc-cb059375c3c7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.163732 Aug 23 11:41:49.123151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3837/7727] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:48 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:50.143948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:50.144689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:50.151762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:50.152249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:50.152697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:50.153425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:50.153900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:50.154337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:50.305624 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:50.314962 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2946bfd7-ee6e-48b8-a128-205e73798c31 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.175326 Aug 23 11:41:50.315647 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3891/7728] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:50 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:51.340111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:51.340918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:51.347953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:51.348470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:51.348977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:51.349735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:51.350216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:51.350673 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:51.492515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:51.500591 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a0993fbc-a2bb-4631-bc94-2695f34b1a72 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.167539 Aug 23 11:41:51.501221 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3838/7729] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:51 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:52.521579 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:52.522191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:52.529057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:52.529549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:52.529987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:52.530684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:52.531143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:52.531569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:52.668690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:52.679143 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-81bcf727-4929-45e8-92c1-f03f8b7c671f tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.161647 Aug 23 11:41:52.679757 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3892/7730] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:52 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:53.475211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8f63c51c-5359-44b9-9bbb-f05e51e07de5 req-0b82d12b-f8b4-437c-8248-914b2f9e1f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7", "name": "network-vif-plugged", "status": "completed", "tag": "876e8e1d-317d-41e2-8cb3-6ef580b3caef"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:53.485744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f63c51c-5359-44b9-9bbb-f05e51e07de5 req-0b82d12b-f8b4-437c-8248-914b2f9e1f55 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:53.486876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f63c51c-5359-44b9-9bbb-f05e51e07de5 req-0b82d12b-f8b4-437c-8248-914b2f9e1f55 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:53.487317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8f63c51c-5359-44b9-9bbb-f05e51e07de5 req-0b82d12b-f8b4-437c-8248-914b2f9e1f55 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:53.498559 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8f63c51c-5359-44b9-9bbb-f05e51e07de5 req-0b82d12b-f8b4-437c-8248-914b2f9e1f55 service nova] Creating event network-vif-plugged:876e8e1d-317d-41e2-8cb3-6ef580b3caef for instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 on n-h1-847009-13 Aug 23 11:41:53.503516 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8f63c51c-5359-44b9-9bbb-f05e51e07de5 req-0b82d12b-f8b4-437c-8248-914b2f9e1f55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Aug 23 11:41:53.504112 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3839/7731] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:41:53.704504 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:53.705743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:53.712940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:53.713436 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:53.713889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:53.714601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:53.715069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:53.715506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:53.845440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:53.853682 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0ae9d718-d862-4307-ab44-7344dbfad4bf tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.153113 Aug 23 11:41:53.854260 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3893/7732] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:53 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:54.875221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:54.875940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:54.882210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:54.882712 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:54.883163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:54.883896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:54.884370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:54.884842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:55.017045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:55.025598 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbc4d4f6-bf86-4baa-9864-37f5666f0d20 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1317 microversion: 2.1 time: 0.155567 Aug 23 11:41:55.026177 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3840/7733] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:54 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:56.046450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:56.047072 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:56.049600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:56.051243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:56.058493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:56.058988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:56.059426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:56.060128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:56.060586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:56.061036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:56.200393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:56.208605 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2d6cf165-8632-4d50-bad9-dd54e936beb7 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1505 microversion: 2.1 time: 0.166091 Aug 23 11:41:56.209435 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3894/7734] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:56 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:56.229440 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:56.230041 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:56.232159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:41:56.239284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:56.239804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:56.240272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:56.241055 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:56.241540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:56.241994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:56.267545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:41:56.348193 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5993bd42-8457-42b1-a299-b1e59e18cca6 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "DELETE /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 204 len: 0 microversion: 2.1 time: 0.122317 Aug 23 11:41:56.348969 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3841/7735] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:41:56 2022] DELETE /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:41:56.356990 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:56.357616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:56.365008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:56.365506 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:56.365951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:56.366665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:56.367129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:56.367561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:56.504135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:56.512054 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1bfe1cf4-2370-45f4-b1ae-de84d0338be9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1511 microversion: 2.1 time: 0.159004 Aug 23 11:41:56.512642 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3895/7736] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:56 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:41:57.535329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:57.536090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:57.543032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:57.543547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:57.544018 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:57.544765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:57.545260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:57.545717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:57.679514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:57.687445 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7ec7e40-c79f-4326-a60c-d77c48d4bc5a tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1511 microversion: 2.1 time: 0.157119 Aug 23 11:41:57.688009 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3842/7737] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:57 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:58.388069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-01c4f4e4-f930-4495-ba3f-6f6175b59e51 req-9f1d84a2-fc90-4e25-b82c-4a1e5d9a6968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7", "name": "network-vif-deleted", "tag": "876e8e1d-317d-41e2-8cb3-6ef580b3caef"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:41:58.399233 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-01c4f4e4-f930-4495-ba3f-6f6175b59e51 req-9f1d84a2-fc90-4e25-b82c-4a1e5d9a6968 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:58.399719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-01c4f4e4-f930-4495-ba3f-6f6175b59e51 req-9f1d84a2-fc90-4e25-b82c-4a1e5d9a6968 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:58.400242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-01c4f4e4-f930-4495-ba3f-6f6175b59e51 req-9f1d84a2-fc90-4e25-b82c-4a1e5d9a6968 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:58.417262 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-01c4f4e4-f930-4495-ba3f-6f6175b59e51 req-9f1d84a2-fc90-4e25-b82c-4a1e5d9a6968 service nova] Creating event network-vif-deleted:876e8e1d-317d-41e2-8cb3-6ef580b3caef for instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 on n-h1-847009-13 Aug 23 11:41:58.424609 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-01c4f4e4-f930-4495-ba3f-6f6175b59e51 req-9f1d84a2-fc90-4e25-b82c-4a1e5d9a6968 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040322 Aug 23 11:41:58.425543 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3896/7738] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:41:58.708127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:58.708786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:58.716390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:58.716949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:58.717441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:58.718197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:58.718682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:58.719164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:58.754155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:58.754659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:58.755123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:58.755597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lazy-loading 'fault' on Instance uuid 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:41:58.797394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:41:58.807929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b089be06-0583-461c-a7da-6b08dcfa2cef tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 200 len: 1307 microversion: 2.1 time: 0.103784 Aug 23 11:41:58.808526 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3843/7739] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:58 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:41:59.829200 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:59.832323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:59.837859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:59.837859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:59.838257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:59.838967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:59.839432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:59.839871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:59.853424 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] HTTP exception thrown: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 HTTP/1.1 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7'} Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:41:59.855074 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 404 to user: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6c69d2ef-3381-417a-8570-4a4630c844e9 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 404 len: 111 microversion: 2.1 time: 0.031641 Aug 23 11:41:59.860208 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3897/7740] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:59 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:41:59.866817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:41:59.867466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:41:59.874409 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:59.874916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:59.875378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:41:59.876095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:41:59.876576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:41:59.877607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.007789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.015643 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-591f1ab8-5de0-4301-8bb9-17135084f2e5 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.152919 Aug 23 11:42:00.016154 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3844/7741] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:41:59 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:00.038284 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c63a66a3-711c-4124-aa8c-de4293262957 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:00.040539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c63a66a3-711c-4124-aa8c-de4293262957 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: a1250af1-e164-4e99-b753-f7c117fc11d7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.046220 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-c63a66a3-711c-4124-aa8c-de4293262957 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] HTTP exception thrown: Instance a1250af1-e164-4e99-b753-f7c117fc11d7 could not be found. Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c63a66a3-711c-4124-aa8c-de4293262957 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/a1250af1-e164-4e99-b753-f7c117fc11d7/action HTTP/1.1 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 32 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: {"resize": {"flavorRef": "452"}} Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance a1250af1-e164-4e99-b753-f7c117fc11d7 could not be found. Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'a1250af1-e164-4e99-b753-f7c117fc11d7', 'body': {'resize': {'flavorRef': '452'}}} Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1250af1-e164-4e99-b753-f7c117fc11d7 could not be found. Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:42:00.047802 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1250af1-e164-4e99-b753-f7c117fc11d7 could not be found. Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1250af1-e164-4e99-b753-f7c117fc11d7 could not be found. Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c63a66a3-711c-4124-aa8c-de4293262957 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 404 to user: Instance a1250af1-e164-4e99-b753-f7c117fc11d7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c63a66a3-711c-4124-aa8c-de4293262957 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "POST /compute/v2.1/servers/a1250af1-e164-4e99-b753-f7c117fc11d7/action" status: 404 len: 111 microversion: 2.1 time: 0.018965 Aug 23 11:42:00.052452 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3898/7742] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:42:00 2022] POST /compute/v2.1/servers/a1250af1-e164-4e99-b753-f7c117fc11d7/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:42:00.059269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:00.059906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.070145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.070655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.071120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.071844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.072325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.072805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.214470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.222956 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2fd6114-fc5a-4a09-92c8-07edfe575efd tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.167578 Aug 23 11:42:00.223524 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3845/7743] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:00 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:00.243860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:00.244479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.251427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.252584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.253076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.253778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.254246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.254681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.391046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.399435 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0aef859a-227a-45b3-a388-0a92c051d7eb tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.159372 Aug 23 11:42:00.400066 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3899/7744] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:00 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:00.420392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9fdaa09f-eae0-4084-9368-7146e018edef"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:00.422710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.429013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.429524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.429983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.430692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.431155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.431606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.435794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:00.475336 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.481044 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] HTTP exception thrown: Flavor 9fdaa09f-eae0-4084-9368-7146e018edef could not be found. Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: request: POST /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e/action HTTP/1.1 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 65 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: {"resize": {"flavorRef": "9fdaa09f-eae0-4084-9368-7146e018edef"}} Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: exception: Flavor 9fdaa09f-eae0-4084-9368-7146e018edef could not be found. Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '4ecad1d3-9b66-4f27-8b13-837acb052b3e', 'body': {'resize': {'flavorRef': '9fdaa09f-eae0-4084-9368-7146e018edef'}}} Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4185, in resize Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:00.485909 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9fdaa09f-eae0-4084-9368-7146e018edef could not be found. Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9fdaa09f-eae0-4084-9368-7146e018edef could not be found. Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9fdaa09f-eae0-4084-9368-7146e018edef could not be found. Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 400 to user: Flavor 9fdaa09f-eae0-4084-9368-7146e018edef could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-823e6aa3-0601-4825-b187-095b9282efc4 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "POST /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e/action" status: 400 len: 107 microversion: 2.1 time: 0.071163 Aug 23 11:42:00.490370 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3846/7745] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:42:00 2022] POST /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e/action => generated 107 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 11:42:00.496162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:00.496804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.502927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.503414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.503854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.504550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.505042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.505470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.636788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.645494 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-053d29ff-8cb0-41b1-be72-04f97e501ba8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.153141 Aug 23 11:42:00.646083 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3900/7746] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:00 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:00.666639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:00.667307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.673346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.674150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.674716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.675441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.675919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.676368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.806899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.815145 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ceaa5ebe-eabb-4b06-a995-4f984f944318 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.152587 Aug 23 11:42:00.815789 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3847/7747] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:00 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:00.835720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a981cc05-5e17-4314-859a-69d3df2de813 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a981cc05-5e17-4314-859a-69d3df2de813 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: request: POST /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e/action HTTP/1.1 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 29 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: {"resize": {"flavorRef": ""}} Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '4ecad1d3-9b66-4f27-8b13-837acb052b3e', 'body': {'resize': {'flavorRef': ''}}} Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise error Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi '' Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.839421 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a981cc05-5e17-4314-859a-69d3df2de813 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a981cc05-5e17-4314-859a-69d3df2de813 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "POST /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e/action" status: 400 len: 113 microversion: 2.1 time: 0.009355 Aug 23 11:42:00.844068 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3901/7748] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:42:00 2022] POST /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 11:42:00.848946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:00.849583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:00.855507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.856007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.856460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.857195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:00.857663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:00.858103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:00.987773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:00.996298 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c9b05cf8-d3a7-4d55-b614-621572ea61da tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1506 microversion: 2.1 time: 0.151131 Aug 23 11:42:00.997130 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3848/7749] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:00 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:01.022088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:01.022597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:01.029772 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.030308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.030759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.031469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.031942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.032380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.045631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] HTTP exception thrown: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 HTTP/1.1 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7'} Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:42:01.047213 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 404 to user: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfae83a0-eb4f-4d23-8299-19fc50ee65e2 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "DELETE /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 404 len: 111 microversion: 2.1 time: 0.031944 Aug 23 11:42:01.052920 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3902/7750] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:42:01 2022] DELETE /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:42:01.057741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:01.058387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:01.065049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.065560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.066116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.066845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.067328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.067779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.081755 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] HTTP exception thrown: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 HTTP/1.1 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7'} Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:01.083310 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 404 to user: Instance 08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c95a8bd6-d184-4a51-9f81-a0927d7731ba tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7" status: 404 len: 111 microversion: 2.1 time: 0.030926 Aug 23 11:42:01.088610 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3849/7751] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:01 2022] GET /compute/v2.1/servers/08cc2256-2d26-4610-b1e5-4ca9ffe0b3a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:42:01.094468 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:01.094973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:01.101617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.102107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.102551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.103254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.103720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.104161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.132007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:42:01.165583 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:01.213163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9f89062-9381-4881-8798-c5c543d03cc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 204 len: 0 microversion: 2.1 time: 0.121790 Aug 23 11:42:01.213916 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3903/7752] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:42:01 2022] DELETE /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:42:01.222703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:01.223342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:01.229406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.229899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.230358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.231077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:01.231558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:01.232009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:01.370711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:01.379323 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ed2b1f8f-c307-46c2-a553-605911866a5d tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1512 microversion: 2.1 time: 0.160691 Aug 23 11:42:01.379932 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3850/7753] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:01 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:02.401383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:02.402002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:02.409253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:02.409736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:02.410174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:02.410863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:02.411320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:02.411744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:02.546173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:02.554844 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e6e3a07a-7f20-4223-94c4-32f2cd3a3a24 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1512 microversion: 2.1 time: 0.157869 Aug 23 11:42:02.555433 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3904/7754] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:02 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:03.576030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:03.576715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:03.579577 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:03.585438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:03.586205 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:03.586658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:03.587631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:03.588150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:03.588775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:03.738337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2431ef36aa74efeba3bc51e632716b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8bf75b544642439ab458c84b70db3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:03.746262 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc8d7504-db0e-468e-b01c-6c9e65ddaed3 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 200 len: 1512 microversion: 2.1 time: 0.174194 Aug 23 11:42:03.746920 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3851/7755] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:03 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:03.830309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-9a01947e-1ab3-4269-968e-5000872dcff8 req-ddc30170-04f8-4e14-af34-73ff5b6de708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecad1d3-9b66-4f27-8b13-837acb052b3e", "name": "network-vif-deleted", "tag": "aaa4fc7c-5bcf-4664-b6e6-4526ff5c6531"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:03.837413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:03.844031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9a01947e-1ab3-4269-968e-5000872dcff8 req-ddc30170-04f8-4e14-af34-73ff5b6de708 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:03.844626 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9a01947e-1ab3-4269-968e-5000872dcff8 req-ddc30170-04f8-4e14-af34-73ff5b6de708 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:03.845156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-9a01947e-1ab3-4269-968e-5000872dcff8 req-ddc30170-04f8-4e14-af34-73ff5b6de708 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:03.858481 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-9a01947e-1ab3-4269-968e-5000872dcff8 req-ddc30170-04f8-4e14-af34-73ff5b6de708 service nova] Creating event network-vif-deleted:aaa4fc7c-5bcf-4664-b6e6-4526ff5c6531 for instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e on n-h2-847009-13 Aug 23 11:42:03.863771 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-9a01947e-1ab3-4269-968e-5000872dcff8 req-ddc30170-04f8-4e14-af34-73ff5b6de708 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Aug 23 11:42:03.864518 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3905/7756] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:42:04.768380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:04.769099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] [instance: 4ecad1d3-9b66-4f27-8b13-837acb052b3e] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:04.775260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:04.775761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:04.776219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:04.776960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:04.777437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:04.777886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:04.792111 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] HTTP exception thrown: Instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e could not be found. Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Request method failure captured: Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e HTTP/1.1 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBLzsaxJ57JMMvzQ-ApbFdaaiDof5pxDcBp4JCS5a6Uy6W3hPp5NBZVnL6X6LipR98sGODpu5Q13mjdWXpMcPxtKHfGt99aaSYecWofrIUd_uPsba7O7CUn3EVj-9LetTR1VPnXwBz-2I0JywzTirh4KipqAZqvBCM41xP0mCQ5OHz_c Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc8bf75b544642439ab458c84b70db3f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc8bf75b544642439ab458c84b70db3f"}]}] Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: cc8bf75b544642439ab458c84b70db3f Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-ServersNegativeTestJSON-930990320 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: e2431ef36aa74efeba3bc51e632716b5 Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-ServersNegativeTestJSON-930990320-project Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e could not be found. Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '4ecad1d3-9b66-4f27-8b13-837acb052b3e'} Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e could not be found. Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e could not be found. Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:42:04.793717 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e could not be found. Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] Returning 404 to user: Instance 4ecad1d3-9b66-4f27-8b13-837acb052b3e could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d19b03cc-128d-42f8-a175-8281dff6ffc8 tempest-ServersNegativeTestJSON-930990320 tempest-ServersNegativeTestJSON-930990320-project] 10.222.0.78 "GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e" status: 404 len: 111 microversion: 2.1 time: 0.030989 Aug 23 11:42:04.797994 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3852/7757] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:04 2022] GET /compute/v2.1/servers/4ecad1d3-9b66-4f27-8b13-837acb052b3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:42:35.675220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:35.911844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4768f85-0b98-4775-ba7d-5c0a4e585b8b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: .version_select at 0x7fdc9cc9b940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1920279287", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLunAE6bsWHkP9AODLEU1YzGzPkncu/KUdGB8lfLgxdWvBnywAXp7lnZb9WCCuU/OIh8wJRSLyaEcxTFU1CnWrGq1Lz4kpgvTP/FY7Pcl/2Esl7J3VQ7wOxA3mqFq/RKfA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:35.933158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-f4768f85-0b98-4775-ba7d-5c0a4e585b8b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:42:35.944834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-f4768f85-0b98-4775-ba7d-5c0a4e585b8b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for user dae5e32b87c44e2e97be8e546ef930ab and project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:42:35.979184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4768f85-0b98-4775-ba7d-5c0a4e585b8b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.306762 Aug 23 11:42:35.979813 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3906/7758] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:42:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:42:36.036480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-133582023", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1920279287", "networks": [{"uuid": "1bac9124-ef90-4f6e-b847-3a923ea150e7"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:36.049701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:36.051174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=30 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:36.101322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] validate_networks() for [('1bac9124-ef90-4f6e-b847-3a923ea150e7', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:42:36.504785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:42:36.505458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:42:36.506366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:42:36.507118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:42:36.507763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:42:36.518271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:36.518790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:36.519255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:36.520009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:36.520585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:36.520995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:36.539151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:42:36.544453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for user dae5e32b87c44e2e97be8e546ef930ab and project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:42:36.557402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:42:36.559733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:42:36.606521 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b26ef2eb-73fc-4ff0-9611-56b06cff648f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574722 Aug 23 11:42:36.607182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3853/7759] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:42:36.618958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b4bc34d6-dd0a-4168-8297-4e736df3e020 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:36.619709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b4bc34d6-dd0a-4168-8297-4e736df3e020 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:36.683253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b4bc34d6-dd0a-4168-8297-4e736df3e020 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:36.691444 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b4bc34d6-dd0a-4168-8297-4e736df3e020 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1262 microversion: 2.1 time: 0.076807 Aug 23 11:42:36.692054 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3907/7760] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:36 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:37.713858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:37.714716 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:37.722790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:37.723311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:37.723781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:37.724512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:37.725026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:37.725483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:37.793846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:37.803200 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c33b2406-adb8-4587-92ec-037844bfec6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1322 microversion: 2.1 time: 0.095403 Aug 23 11:42:37.806707 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3854/7761] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:37 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:38.827471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:38.828267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:38.835867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:38.836764 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:38.837227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:38.838091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:38.838564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:38.839005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:39.072786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:39.081709 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-114c337f-7fd7-4702-8849-bebaed381dec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1362 microversion: 2.1 time: 0.258667 Aug 23 11:42:39.082227 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3908/7762] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:38 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:39.195885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-958d4110-730f-4b1f-acac-905ddbc50419 req-cd022389-39b3-478f-bb3f-4435a599e315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c300af56-110e-4054-b2cb-2bb4fde508e3", "tag": "07ac349e-6b9b-48ff-8372-0cbeddcbf3d8"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:39.211946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-958d4110-730f-4b1f-acac-905ddbc50419 req-cd022389-39b3-478f-bb3f-4435a599e315 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:39.212822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-958d4110-730f-4b1f-acac-905ddbc50419 req-cd022389-39b3-478f-bb3f-4435a599e315 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:39.213640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-958d4110-730f-4b1f-acac-905ddbc50419 req-cd022389-39b3-478f-bb3f-4435a599e315 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:39.239599 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-958d4110-730f-4b1f-acac-905ddbc50419 req-cd022389-39b3-478f-bb3f-4435a599e315 service nova] Creating event network-changed:07ac349e-6b9b-48ff-8372-0cbeddcbf3d8 for instance c300af56-110e-4054-b2cb-2bb4fde508e3 on n-h2-847009-13 Aug 23 11:42:39.253229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-958d4110-730f-4b1f-acac-905ddbc50419 req-cd022389-39b3-478f-bb3f-4435a599e315 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070967 Aug 23 11:42:39.254745 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3855/7763] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:42:40.103449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:40.104083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:40.112022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:40.112520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:40.112993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:40.113720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:40.114189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:40.114630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:40.251786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:40.260187 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b1cf2eea-7c68-44fe-9b77-6de301577a10 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1362 microversion: 2.1 time: 0.160752 Aug 23 11:42:40.260791 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3909/7764] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:40 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:41.284052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:41.285168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:41.293519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:41.294039 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:41.294665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:41.295402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:41.295885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:41.296333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:41.460915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:41.468759 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3702dc22-dbbc-4fe2-930f-23f0b33d844c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1362 microversion: 2.1 time: 0.190381 Aug 23 11:42:41.469288 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3856/7765] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:41 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:42:42.488715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:42.489362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:42.496230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:42.496800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:42.497220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:42.497927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:42.498396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:42.498832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:42.636362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:42.645929 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ed1d5d7-71d9-4e7e-9919-ae04c3f3f711 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1362 microversion: 2.1 time: 0.161251 Aug 23 11:42:42.646649 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3910/7766] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:42 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:43.667670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:43.668310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:43.675510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:43.676019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:43.676477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:43.677225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:43.677705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:43.678151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:43.809378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:43.817739 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fb2152e7-5067-4d9e-96ec-538fec1da38b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1362 microversion: 2.1 time: 0.154068 Aug 23 11:42:43.818313 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3857/7767] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:43 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:44.307218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-67437e01-a514-458c-9fa7-0627f2d35cff req-a7fe0efb-5547-4188-af71-fab41578667f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c300af56-110e-4054-b2cb-2bb4fde508e3", "name": "network-vif-plugged", "status": "completed", "tag": "07ac349e-6b9b-48ff-8372-0cbeddcbf3d8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:44.319459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-67437e01-a514-458c-9fa7-0627f2d35cff req-a7fe0efb-5547-4188-af71-fab41578667f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:44.319952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-67437e01-a514-458c-9fa7-0627f2d35cff req-a7fe0efb-5547-4188-af71-fab41578667f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:44.320389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-67437e01-a514-458c-9fa7-0627f2d35cff req-a7fe0efb-5547-4188-af71-fab41578667f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:44.333378 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-67437e01-a514-458c-9fa7-0627f2d35cff req-a7fe0efb-5547-4188-af71-fab41578667f service nova] Creating event network-vif-plugged:07ac349e-6b9b-48ff-8372-0cbeddcbf3d8 for instance c300af56-110e-4054-b2cb-2bb4fde508e3 on n-h2-847009-13 Aug 23 11:42:44.338649 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-67437e01-a514-458c-9fa7-0627f2d35cff req-a7fe0efb-5547-4188-af71-fab41578667f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035825 Aug 23 11:42:44.339253 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3911/7768] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:42:44.839034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:44.839659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:44.847421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:44.847930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:44.848395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:44.849149 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:44.849635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:44.850089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:44.981406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:44.989911 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0ce4bb3f-b066-4ea8-90e1-72e1cb618c59 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1362 microversion: 2.1 time: 0.154997 Aug 23 11:42:44.990495 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3858/7769] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:44 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:46.012232 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:46.012996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:46.019863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:46.020356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:46.020838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:46.021541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:46.022009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:46.022442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:46.156089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:46.164640 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-71801fb2-f09a-4e9f-af35-28b6c01f7c18 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1555 microversion: 2.1 time: 0.157681 Aug 23 11:42:46.165245 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3912/7770] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:46 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:46.185069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:46.185708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:46.192848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:46.193364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:46.193827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:46.194635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:46.195119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:46.195578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:46.327853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:42:46.337038 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5bdf9081-54bb-42f5-9b21-f7ad506c136e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1555 microversion: 2.1 time: 0.155930 Aug 23 11:42:46.337618 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3859/7771] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:42:46 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:42:47.968615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f782b752-b323-4661-99de-3d206e8e33e3"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:42:47.971709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:47.973761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:47.980386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:47.980909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:47.981356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:47.982067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:47.982534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:47.982969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:48.248366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c3eee1da-3d10-4594-a46b-ba9ad2cdf909 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283548 Aug 23 11:42:48.249029 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3913/7772] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:42:47 2022] POST /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:42:58.972723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:58.973313 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:58.975235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:58.976057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:58.977666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:58.978366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=34 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:58.986341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:58.986846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:58.987303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:58.988026 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:58.988495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:58.988969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:59.071456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lazy-loading 'services' on Instance uuid c300af56-110e-4054-b2cb-2bb4fde508e3 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:42:59.142689 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6d224148-c507-48a5-b86a-9d65c0c255af tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments/f782b752-b323-4661-99de-3d206e8e33e3" status: 202 len: 0 microversion: 2.1 time: 0.173928 Aug 23 11:42:59.143302 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3860/7773] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:42:58 2022] DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments/f782b752-b323-4661-99de-3d206e8e33e3 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:42:59.149913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:59.150861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:42:59.155521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:42:59.158034 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:42:59.166632 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:59.167214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:59.167666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:59.168387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:42:59.168884 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:42:59.169323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:42:59.202442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e934e3f4-9e24-4a02-96d4-e98d7fc1a87c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054454 Aug 23 11:42:59.203041 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3914/7774] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:42:59 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:00.216050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:00.218471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:00.225964 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:00.226480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:00.226944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:00.227674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:00.228182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:00.228631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:00.260583 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a39b39ec-d21f-4643-9104-bb6d238a4e74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049024 Aug 23 11:43:00.261188 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3861/7775] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:00 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:01.273313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:01.275439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:01.282752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:01.283248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:01.283686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:01.284405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:01.284902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:01.285333 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:01.321735 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00860630-e0fa-412b-8781-b478348f5381 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052550 Aug 23 11:43:01.322334 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3915/7776] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:01 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:02.335450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:02.337743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:02.344808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:02.345321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:02.345783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:02.346503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:02.346982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:02.347433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:02.378381 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b5e4ae0-bf83-4a63-add7-752a45826b37 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047396 Aug 23 11:43:02.379146 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3862/7777] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:02 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:03.391007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:03.393353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:03.400107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:03.400595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:03.401060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:03.401766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:03.402219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:03.402650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:03.433097 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5cd1b3e8-86ea-4a66-8d7b-cf1566124a90 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 Aug 23 11:43:03.433660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3916/7778] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:03 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:04.445094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:04.447450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:04.454741 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:04.455473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:04.455940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:04.456674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:04.457181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:04.457631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:04.489854 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c59831cd-db86-4fb9-b3f7-b033a3008717 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048755 Aug 23 11:43:04.490587 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3863/7779] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:04 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:43:04.501690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:04.502297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:04.509294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:04.509792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:04.510240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:04.510956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:04.511424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:04.511857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:04.589495 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] HTTP exception thrown: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 is not attached to volume f782b752-b323-4661-99de-3d206e8e33e3 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Request method failure captured: Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments/f782b752-b323-4661-99de-3d206e8e33e3 HTTP/1.1 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL0mj8FCVz-iBKIVvnu8GEU3mToxalJMJu85EguF12USkocnx7JyBc3tR1rvi5WQL_iV9FWAUqG7lbJC8OjXeMF825fKxnnSS1NsDzH5NI9gy8Sgk9A7YjHQAU8s0hl57FpQteKsMeH45uVUA-50bpTnukaGxxYO9ScMpl-Mr_8QKTg Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ed539d9930d4c779360d9b6bbe11dfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}] Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dae5e32b87c44e2e97be8e546ef930ab Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 is not attached to volume f782b752-b323-4661-99de-3d206e8e33e3 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': 'c300af56-110e-4054-b2cb-2bb4fde508e3', 'id': 'f782b752-b323-4661-99de-3d206e8e33e3'} Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f782b752-b323-4661-99de-3d206e8e33e3. Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 is not attached to volume f782b752-b323-4661-99de-3d206e8e33e3 Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:04.597502 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 is not attached to volume f782b752-b323-4661-99de-3d206e8e33e3 Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Returning 404 to user: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 is not attached to volume f782b752-b323-4661-99de-3d206e8e33e3 {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-20be2979-b296-45f3-9ad1-c4cfe67d3795 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments/f782b752-b323-4661-99de-3d206e8e33e3" status: 404 len: 154 microversion: 2.1 time: 0.102071 Aug 23 11:43:04.601985 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3917/7780] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:43:04 2022] DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3/os-volume_attachments/f782b752-b323-4661-99de-3d206e8e33e3 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:43:07.959115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:07.959655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:07.966124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:07.966638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:07.967138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:07.967862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:07.968343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:07.969449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:07.997875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:43:08.088417 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c4c378ef-27af-41cd-bd9a-11bf7c5d17f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 204 len: 0 microversion: 2.1 time: 0.132598 Aug 23 11:43:08.089360 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3864/7781] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:43:07 2022] DELETE /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:43:08.098311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:08.099208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:08.105783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:08.106339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:08.106871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:08.107637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:08.108162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:08.108654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:08.248882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:08.258041 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec18608a-9189-4ae0-a52b-42bae3a51999 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1561 microversion: 2.1 time: 0.164422 Aug 23 11:43:08.258616 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3918/7782] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:08 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:43:09.280340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:09.281038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:09.288445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:09.288999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:09.289465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:09.290189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:09.290669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:09.291122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:09.425004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:09.432928 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-22c3cf53-be84-4681-8202-6031433ace26 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1561 microversion: 2.1 time: 0.157000 Aug 23 11:43:09.433510 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3865/7783] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:09 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:10.324274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-cd213a78-d7ea-43cf-88bd-f289e8ba6bfb req-e53357b6-70d7-4969-8223-126367965c47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c300af56-110e-4054-b2cb-2bb4fde508e3", "name": "network-vif-deleted", "tag": "07ac349e-6b9b-48ff-8372-0cbeddcbf3d8"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:10.340801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cd213a78-d7ea-43cf-88bd-f289e8ba6bfb req-e53357b6-70d7-4969-8223-126367965c47 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:10.341289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cd213a78-d7ea-43cf-88bd-f289e8ba6bfb req-e53357b6-70d7-4969-8223-126367965c47 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:10.341953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-cd213a78-d7ea-43cf-88bd-f289e8ba6bfb req-e53357b6-70d7-4969-8223-126367965c47 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:10.355804 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-cd213a78-d7ea-43cf-88bd-f289e8ba6bfb req-e53357b6-70d7-4969-8223-126367965c47 service nova] Creating event network-vif-deleted:07ac349e-6b9b-48ff-8372-0cbeddcbf3d8 for instance c300af56-110e-4054-b2cb-2bb4fde508e3 on n-h2-847009-13 Aug 23 11:43:10.361683 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-cd213a78-d7ea-43cf-88bd-f289e8ba6bfb req-e53357b6-70d7-4969-8223-126367965c47 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042233 Aug 23 11:43:10.362300 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3919/7784] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:10.454537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:10.456366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:10.463580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:10.464169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:10.464701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:10.465459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:10.465944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:10.466392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:10.501166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:10.501678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:10.502143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:10.502619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lazy-loading 'fault' on Instance uuid c300af56-110e-4054-b2cb-2bb4fde508e3 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:43:10.548365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:10.556444 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9407e939-84ee-437a-930b-4fed7f73d981 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 200 len: 1352 microversion: 2.1 time: 0.105952 Aug 23 11:43:10.557066 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3866/7785] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:10 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:11.580166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:11.580957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: c300af56-110e-4054-b2cb-2bb4fde508e3] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:11.589173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:11.589617 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:11.590064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:11.590783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:11.591242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:11.591671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:11.607152 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] HTTP exception thrown: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 could not be found. Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Request method failure captured: Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 HTTP/1.1 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL0mj8FCVz-iBKIVvnu8GEU3mToxalJMJu85EguF12USkocnx7JyBc3tR1rvi5WQL_iV9FWAUqG7lbJC8OjXeMF825fKxnnSS1NsDzH5NI9gy8Sgk9A7YjHQAU8s0hl57FpQteKsMeH45uVUA-50bpTnukaGxxYO9ScMpl-Mr_8QKTg Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ed539d9930d4c779360d9b6bbe11dfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}] Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dae5e32b87c44e2e97be8e546ef930ab Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 could not be found. Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'c300af56-110e-4054-b2cb-2bb4fde508e3'} Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 could not be found. Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 could not be found. Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:11.608955 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 could not be found. Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Returning 404 to user: Instance c300af56-110e-4054-b2cb-2bb4fde508e3 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-76a02f22-d6e3-4a22-ba84-baf6f107cf3d tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3" status: 404 len: 111 microversion: 2.1 time: 0.036364 Aug 23 11:43:11.613995 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3920/7786] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:11 2022] GET /compute/v2.1/servers/c300af56-110e-4054-b2cb-2bb4fde508e3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 11:43:11.620121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-441595ce-510c-4bd8-957f-6c8da7f82895 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '.version_select at 0x7fdc9c4835e0>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:11.644491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-441595ce-510c-4bd8-957f-6c8da7f82895 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1920279287" status: 202 len: 0 microversion: 2.1 time: 0.028270 Aug 23 11:43:11.645109 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3867/7787] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Aug 23 11:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1920279287 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:43:11.661343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-899548f0-cde7-453e-8f10-6109f45b9199 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: .version_select at 0x7fdc9cb6ef70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2142431552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL45LZNMtlYLTURswskT2IBusBbqhT3IJsTDyrIKsiQyepAAVTElqQs3CvgRYuTsdbF729+Wn3Rz84nvgB/3uUJQULpjqgddjB27AIfTSpd9PdjOIYH9efVodUh/Yss+Cw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:11.676918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-899548f0-cde7-453e-8f10-6109f45b9199 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:43:11.683375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-899548f0-cde7-453e-8f10-6109f45b9199 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for user dae5e32b87c44e2e97be8e546ef930ab and project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:43:11.708429 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-899548f0-cde7-453e-8f10-6109f45b9199 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051047 Aug 23 11:43:11.709073 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3921/7788] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:43:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:11.759361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-328895145", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2142431552", "networks": [{"uuid": "1bac9124-ef90-4f6e-b847-3a923ea150e7"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:11.814216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] validate_networks() for [('1bac9124-ef90-4f6e-b847-3a923ea150e7', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:43:12.197285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:43:12.197737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:43:12.198235 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:43:12.198668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:43:12.199108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:43:12.209257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:12.210001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:12.210474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:12.211230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:12.211706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:12.212153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:12.229339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:43:12.235695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for user dae5e32b87c44e2e97be8e546ef930ab and project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:43:12.249550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:43:12.253146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:43:12.304655 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-049c6cba-d3bd-4623-8935-5c4e8b2f15e2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549184 Aug 23 11:43:12.305920 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3868/7789] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:43:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:43:12.317977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c4d7192d-9abe-4a93-beec-8562b80da856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:12.319304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c4d7192d-9abe-4a93-beec-8562b80da856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:12.394242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c4d7192d-9abe-4a93-beec-8562b80da856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:12.401731 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c4d7192d-9abe-4a93-beec-8562b80da856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1262 microversion: 2.1 time: 0.087652 Aug 23 11:43:12.402320 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3922/7790] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:12 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:13.423632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:13.424276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:13.430625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:13.431140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:13.431604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:13.432325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:13.432905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:13.433366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:13.805276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:13.813937 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fafa1c3-e03c-4a25-b101-74bf80ebba43 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1314 microversion: 2.1 time: 0.395200 Aug 23 11:43:13.814569 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3869/7791] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:13 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:14.835966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:14.836591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:14.844538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:14.845301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:14.845955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:14.846695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:14.847157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:14.847584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:14.985088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:14.992909 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fb5febec-5e10-4ca5-9bb1-e9b34748b01b tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1362 microversion: 2.1 time: 0.161172 Aug 23 11:43:14.993492 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3923/7792] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:14 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:15.079690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-32fe895b-5e62-4678-b07d-ecad6f5e8864 req-92820602-6e0f-4770-b1bb-4a0dc4d09256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49aa3d9-95fd-44ea-a4d1-37af6df996df", "tag": "08c481ec-7553-453e-bc89-cc8455aaed21"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:15.094325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-32fe895b-5e62-4678-b07d-ecad6f5e8864 req-92820602-6e0f-4770-b1bb-4a0dc4d09256 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:15.094926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-32fe895b-5e62-4678-b07d-ecad6f5e8864 req-92820602-6e0f-4770-b1bb-4a0dc4d09256 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:15.095622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-32fe895b-5e62-4678-b07d-ecad6f5e8864 req-92820602-6e0f-4770-b1bb-4a0dc4d09256 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:15.107234 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-32fe895b-5e62-4678-b07d-ecad6f5e8864 req-92820602-6e0f-4770-b1bb-4a0dc4d09256 service nova] Creating event network-changed:08c481ec-7553-453e-bc89-cc8455aaed21 for instance d49aa3d9-95fd-44ea-a4d1-37af6df996df on n-h1-847009-13 Aug 23 11:43:15.113667 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-32fe895b-5e62-4678-b07d-ecad6f5e8864 req-92820602-6e0f-4770-b1bb-4a0dc4d09256 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038442 Aug 23 11:43:15.114467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3870/7793] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:16.014026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:16.014637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:16.022353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:16.022839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:16.023275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:16.023966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:16.024429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:16.024883 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:16.161459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:16.169376 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-301f68fc-b7d7-4ee3-8fc9-7ca392c71c8e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1362 microversion: 2.1 time: 0.159271 Aug 23 11:43:16.169976 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3924/7794] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:16 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:17.191129 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:17.191846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:17.198044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:17.198545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:17.198997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:17.199704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:17.200176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:17.200623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:17.337257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:17.345561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-04c129b5-709c-4ede-8a89-4685b2a4cdb6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1362 microversion: 2.1 time: 0.160236 Aug 23 11:43:17.346144 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3871/7795] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:17 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:18.365983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:18.366602 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:18.373585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:18.374074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:18.374554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:18.375398 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:18.375861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:18.376298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:18.510372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:18.519062 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0211f4e9-7990-43db-8d00-96e86806ed22 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1362 microversion: 2.1 time: 0.156967 Aug 23 11:43:18.519643 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3925/7796] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:18 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:19.539637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:19.540295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:19.548025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:19.548524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:19.549005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:19.549710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:19.550178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:19.550639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:19.682057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:19.689955 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-86a9beb8-6212-46a4-96e8-56a7ff493193 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1362 microversion: 2.1 time: 0.154327 Aug 23 11:43:19.690525 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3872/7797] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:19 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:19.993265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5d093b16-d303-4d67-aab3-d6ab1ac3267c req-840c6c50-58be-4605-97f9-972f4e35d4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49aa3d9-95fd-44ea-a4d1-37af6df996df", "name": "network-vif-plugged", "status": "completed", "tag": "08c481ec-7553-453e-bc89-cc8455aaed21"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:20.004325 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5d093b16-d303-4d67-aab3-d6ab1ac3267c req-840c6c50-58be-4605-97f9-972f4e35d4b7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:20.004865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5d093b16-d303-4d67-aab3-d6ab1ac3267c req-840c6c50-58be-4605-97f9-972f4e35d4b7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:20.005313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5d093b16-d303-4d67-aab3-d6ab1ac3267c req-840c6c50-58be-4605-97f9-972f4e35d4b7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:20.017440 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5d093b16-d303-4d67-aab3-d6ab1ac3267c req-840c6c50-58be-4605-97f9-972f4e35d4b7 service nova] Creating event network-vif-plugged:08c481ec-7553-453e-bc89-cc8455aaed21 for instance d49aa3d9-95fd-44ea-a4d1-37af6df996df on n-h1-847009-13 Aug 23 11:43:20.022453 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5d093b16-d303-4d67-aab3-d6ab1ac3267c req-840c6c50-58be-4605-97f9-972f4e35d4b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Aug 23 11:43:20.023038 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3926/7798] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:20.710739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:20.711405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:20.718317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:20.718830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:20.719390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:20.720115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:20.720593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:20.721076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:20.849965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:20.857687 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a30449f0-0bcf-4632-a627-b42e2fbe3185 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1362 microversion: 2.1 time: 0.151190 Aug 23 11:43:20.858259 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3873/7799] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:20 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:21.880193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:21.880948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:21.887175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:21.887668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:21.888117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:21.888850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:21.889318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:21.889756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:22.029471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:22.037498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7070c577-93a1-4da6-958d-e947db486631 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1555 microversion: 2.1 time: 0.163184 Aug 23 11:43:22.038069 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3927/7800] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:21 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:22.057668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:22.058340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:22.065807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:22.066318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:22.066782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:22.067504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:22.067989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:22.068443 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:22.201144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:22.209012 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e807717b-3935-4fcf-b2e2-0a26a5f967dd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1555 microversion: 2.1 time: 0.155288 Aug 23 11:43:22.209582 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3874/7801] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:22 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:23.699240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6d4d070-77f3-497b-95a4-1e332a0ba84c"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:23.701690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:23.703778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:23.710633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:23.711069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:23.711507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:23.712209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:23.712667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:23.713121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:23.974742 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30f9eca3-84bd-4161-a73b-ce60b7c771c1 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279338 Aug 23 11:43:23.981261 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3928/7802] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:43:23 2022] POST /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:35.739164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:35.739700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:35.741670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:35.742561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:35.743125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:35.743819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:35.751135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:35.751646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:35.752104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:35.752858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:35.753338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:35.753785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:35.838861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lazy-loading 'services' on Instance uuid d49aa3d9-95fd-44ea-a4d1-37af6df996df {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:43:35.909817 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83df1ae2-3781-4d3a-ae12-63d2373df335 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments/b6d4d070-77f3-497b-95a4-1e332a0ba84c" status: 202 len: 0 microversion: 2.1 time: 0.174692 Aug 23 11:43:35.910412 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3875/7803] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:43:35 2022] DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments/b6d4d070-77f3-497b-95a4-1e332a0ba84c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:43:35.919221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:35.921790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:35.924720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:35.925532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:43:35.930860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:35.931361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:35.931890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:35.932601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:35.933096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:35.933528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:35.967961 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-98560d4c-2c5c-4202-9d72-a1391b3608d9 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052819 Aug 23 11:43:35.968907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3929/7804] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:35 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:36.982456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:36.986107 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:36.992449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:36.992993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:36.993453 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:36.994173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:36.994649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:36.995097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:37.026324 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-76427f18-4949-42a6-9af2-a42abfc75138 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049271 Aug 23 11:43:37.027136 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3876/7805] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:36 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:38.039189 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:38.041477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:38.049490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:38.050000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:38.050451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:38.051260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:38.051734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:38.052178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:38.092087 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-1f768031-9ec0-4c67-8f3f-57617f447d74 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057037 Aug 23 11:43:38.094700 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3930/7806] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:38 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:39.107876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:39.111022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:39.118734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:39.119210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:39.119682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:39.120559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:39.121069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:39.121524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:39.154333 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0049044-ee46-40ee-b320-5903d01bbdff tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050670 Aug 23 11:43:39.154902 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3877/7807] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:39 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:40.166274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:40.168448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:40.176062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:40.176558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:40.177030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:40.177742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:40.178212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:40.178644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:40.208920 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61c855c9-0e55-4dd9-b0a8-47dc9ba21992 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046644 Aug 23 11:43:40.209747 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3931/7808] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:40 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:41.221008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:41.223154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:41.230260 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:41.230772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:41.231240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:41.231965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:41.232448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:41.232940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:41.261944 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-254fd513-26bf-4982-b841-12031781e8b2 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045278 Aug 23 11:43:41.262504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3878/7809] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:43:41 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:43:41.273721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:41.274228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:41.281016 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:41.281495 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:41.281934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:41.282636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:41.283089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:41.283518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:41.358349 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] HTTP exception thrown: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df is not attached to volume b6d4d070-77f3-497b-95a4-1e332a0ba84c Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Request method failure captured: Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments/b6d4d070-77f3-497b-95a4-1e332a0ba84c HTTP/1.1 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL0mj8FCVz-iBKIVvnu8GEU3mToxalJMJu85EguF12USkocnx7JyBc3tR1rvi5WQL_iV9FWAUqG7lbJC8OjXeMF825fKxnnSS1NsDzH5NI9gy8Sgk9A7YjHQAU8s0hl57FpQteKsMeH45uVUA-50bpTnukaGxxYO9ScMpl-Mr_8QKTg Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ed539d9930d4c779360d9b6bbe11dfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}] Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dae5e32b87c44e2e97be8e546ef930ab Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df is not attached to volume b6d4d070-77f3-497b-95a4-1e332a0ba84c Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': 'd49aa3d9-95fd-44ea-a4d1-37af6df996df', 'id': 'b6d4d070-77f3-497b-95a4-1e332a0ba84c'} Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b6d4d070-77f3-497b-95a4-1e332a0ba84c. Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df is not attached to volume b6d4d070-77f3-497b-95a4-1e332a0ba84c Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:41.359964 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df is not attached to volume b6d4d070-77f3-497b-95a4-1e332a0ba84c Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Returning 404 to user: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df is not attached to volume b6d4d070-77f3-497b-95a4-1e332a0ba84c {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-56dc61ba-d82c-4c68-a7b9-74d4f759648a tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments/b6d4d070-77f3-497b-95a4-1e332a0ba84c" status: 404 len: 154 microversion: 2.1 time: 0.091837 Aug 23 11:43:41.364192 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3932/7810] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:43:41 2022] DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df/os-volume_attachments/b6d4d070-77f3-497b-95a4-1e332a0ba84c => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:43:44.711182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:44.711774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:44.719208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:44.719806 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:44.720343 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:44.721166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:44.721707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:44.722240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:44.754061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:43:44.833762 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5468f639-7441-4431-85d1-a1182cbaae6c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 204 len: 0 microversion: 2.1 time: 0.126641 Aug 23 11:43:44.834826 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3879/7811] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:43:44 2022] DELETE /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:43:44.843970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:44.844656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:44.852368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:44.852963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:44.853497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:44.854270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:44.854816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:44.855311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:44.994477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:45.003879 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2dd6d1f-5f07-4a65-9c28-81943a9a33ec tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1561 microversion: 2.1 time: 0.164565 Aug 23 11:43:45.004531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3933/7812] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:44 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:46.026093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:46.026815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:46.033856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:46.034353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:46.034804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:46.035510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:46.035981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:46.036421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:46.170158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:46.178121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3a1c0adb-952b-4cc8-a61d-6c2617fdac64 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1561 microversion: 2.1 time: 0.156365 Aug 23 11:43:46.178699 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3880/7813] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:46 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:47.025928 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e489e4b8-7bd0-4c74-8531-b6541f427639 req-e86b413b-2601-4f2d-a0c5-b1a038c1b00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49aa3d9-95fd-44ea-a4d1-37af6df996df", "name": "network-vif-deleted", "tag": "08c481ec-7553-453e-bc89-cc8455aaed21"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:47.037198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e489e4b8-7bd0-4c74-8531-b6541f427639 req-e86b413b-2601-4f2d-a0c5-b1a038c1b00a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:47.037692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e489e4b8-7bd0-4c74-8531-b6541f427639 req-e86b413b-2601-4f2d-a0c5-b1a038c1b00a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:47.038145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e489e4b8-7bd0-4c74-8531-b6541f427639 req-e86b413b-2601-4f2d-a0c5-b1a038c1b00a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:47.051537 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e489e4b8-7bd0-4c74-8531-b6541f427639 req-e86b413b-2601-4f2d-a0c5-b1a038c1b00a service nova] Creating event network-vif-deleted:08c481ec-7553-453e-bc89-cc8455aaed21 for instance d49aa3d9-95fd-44ea-a4d1-37af6df996df on n-h1-847009-13 Aug 23 11:43:47.058479 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e489e4b8-7bd0-4c74-8531-b6541f427639 req-e86b413b-2601-4f2d-a0c5-b1a038c1b00a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040002 Aug 23 11:43:47.059648 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3934/7814] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:43:47.199892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:47.200464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:47.208337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:47.208885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:47.209623 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:47.210358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:47.210838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:47.211298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:47.243822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:47.244291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:47.244988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:47.245470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lazy-loading 'fault' on Instance uuid d49aa3d9-95fd-44ea-a4d1-37af6df996df {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:43:47.287909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:47.296363 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d4f21f67-9e2c-4ffa-8fad-72a70d1a5376 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 200 len: 1352 microversion: 2.1 time: 0.100121 Aug 23 11:43:47.296974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3881/7815] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:47 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:48.318775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:48.319394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: d49aa3d9-95fd-44ea-a4d1-37af6df996df] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:48.326390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:48.326885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:48.327948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:48.328845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:48.329307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:48.329733 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:48.343380 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] HTTP exception thrown: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df could not be found. Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Request method failure captured: Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df HTTP/1.1 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL0mj8FCVz-iBKIVvnu8GEU3mToxalJMJu85EguF12USkocnx7JyBc3tR1rvi5WQL_iV9FWAUqG7lbJC8OjXeMF825fKxnnSS1NsDzH5NI9gy8Sgk9A7YjHQAU8s0hl57FpQteKsMeH45uVUA-50bpTnukaGxxYO9ScMpl-Mr_8QKTg Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ed539d9930d4c779360d9b6bbe11dfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}] Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dae5e32b87c44e2e97be8e546ef930ab Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df could not be found. Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'd49aa3d9-95fd-44ea-a4d1-37af6df996df'} Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df could not be found. Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df could not be found. Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:43:48.345025 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df could not be found. Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Returning 404 to user: Instance d49aa3d9-95fd-44ea-a4d1-37af6df996df could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-757e142d-1fff-403b-a08e-00e2f814f8e4 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df" status: 404 len: 111 microversion: 2.1 time: 0.032046 Aug 23 11:43:48.350662 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3935/7816] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:48 2022] GET /compute/v2.1/servers/d49aa3d9-95fd-44ea-a4d1-37af6df996df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:43:48.356076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33afd3ec-33a3-4bf2-86e1-4706c6b27735 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '.version_select at 0x7fdc8f6cc040>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:48.378508 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33afd3ec-33a3-4bf2-86e1-4706c6b27735 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2142431552" status: 202 len: 0 microversion: 2.1 time: 0.026374 Aug 23 11:43:48.379085 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3882/7817] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Aug 23 11:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2142431552 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:43:48.396798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a74ab018-a6c1-4f3a-9509-ee67d7d3c1bb tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: .version_select at 0x7fdc9d13e820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1738751545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8gge9wsyiinQPq4sOQ+POFHb+TTbwXKo04YBATXTTw2gdn/1tr29A717/gxdc4EVjAXKssNdNM2bf+3siwCoQJzTX1H3DJdnookKAWLCzm+8dGn76LFTwMhKMzoglEvA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:48.412188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a74ab018-a6c1-4f3a-9509-ee67d7d3c1bb tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:43:48.418063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-a74ab018-a6c1-4f3a-9509-ee67d7d3c1bb tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for user dae5e32b87c44e2e97be8e546ef930ab and project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:43:48.442033 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a74ab018-a6c1-4f3a-9509-ee67d7d3c1bb tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049320 Aug 23 11:43:48.442649 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3936/7818] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:43:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:48.494255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-37986991", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1738751545", "networks": [{"uuid": "1bac9124-ef90-4f6e-b847-3a923ea150e7"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:48.547355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] validate_networks() for [('1bac9124-ef90-4f6e-b847-3a923ea150e7', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:43:48.926249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:43:48.926701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:43:48.927203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:43:48.927643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:43:48.928081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:43:48.937038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:48.937545 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:48.938012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:48.938766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:48.939247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:48.939699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:48.957266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:43:48.963037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Getting quotas for user dae5e32b87c44e2e97be8e546ef930ab and project 8ed539d9930d4c779360d9b6bbe11dfd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:43:48.976475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:43:48.978871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:43:49.025069 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bdfe907e-1c1e-4a4d-bf1c-1576ab5d22bf tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534688 Aug 23 11:43:49.025736 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3883/7819] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:43:49.037058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-12b8862a-0950-498b-8aab-7f55f539a856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:49.037681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-12b8862a-0950-498b-8aab-7f55f539a856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:49.095328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-12b8862a-0950-498b-8aab-7f55f539a856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:49.102865 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-12b8862a-0950-498b-8aab-7f55f539a856 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1261 microversion: 2.1 time: 0.069784 Aug 23 11:43:49.103591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3937/7820] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:49 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:43:50.125480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:50.126065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:50.133337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:50.133845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:50.134303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:50.135017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:50.135487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:50.135963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:50.243975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:50.253595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-857e6d26-e01f-4c95-8511-25fa2ee99688 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1321 microversion: 2.1 time: 0.132910 Aug 23 11:43:50.267842 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3884/7821] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:50 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:51.275863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:51.276527 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:51.284407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:51.284958 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:51.287057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:51.287057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:51.287057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:51.287057 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:51.446732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:51.458170 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17538d43-edfc-4a9d-abb6-7135f59f33b6 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1361 microversion: 2.1 time: 0.186357 Aug 23 11:43:51.464943 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3938/7822] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:51 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:51.552449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-4e7daa3b-8d89-4be0-86c4-91e9f839d0fe req-0d5b81e4-9a35-4096-bd26-252abbacc5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9672743e-5b86-48da-8468-70f4be8ffd51", "tag": "3f8193ad-1b9f-49dc-bed6-6be6b74ce764"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:51.565922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4e7daa3b-8d89-4be0-86c4-91e9f839d0fe req-0d5b81e4-9a35-4096-bd26-252abbacc5a7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:51.566522 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4e7daa3b-8d89-4be0-86c4-91e9f839d0fe req-0d5b81e4-9a35-4096-bd26-252abbacc5a7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:51.567081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-4e7daa3b-8d89-4be0-86c4-91e9f839d0fe req-0d5b81e4-9a35-4096-bd26-252abbacc5a7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:51.592561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-4e7daa3b-8d89-4be0-86c4-91e9f839d0fe req-0d5b81e4-9a35-4096-bd26-252abbacc5a7 service nova] Creating event network-changed:3f8193ad-1b9f-49dc-bed6-6be6b74ce764 for instance 9672743e-5b86-48da-8468-70f4be8ffd51 on n-h1-847009-13 Aug 23 11:43:51.601656 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-4e7daa3b-8d89-4be0-86c4-91e9f839d0fe req-0d5b81e4-9a35-4096-bd26-252abbacc5a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050739 Aug 23 11:43:51.601656 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3885/7823] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:43:52.481194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:52.481816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:52.489909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:52.490407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:52.490865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:52.491594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:52.492083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:52.492516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:52.629485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:52.637320 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3f70b31-c0f1-45e9-aae5-c32ab6199b1f tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1361 microversion: 2.1 time: 0.160038 Aug 23 11:43:52.637912 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3939/7824] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:52 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:53.662505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:53.663239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:53.670597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:53.671640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:53.672102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:53.672861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:53.673340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:53.673790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:53.804198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:53.812136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0f4e8188-e282-4bee-a845-cde0bf2f23f0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1361 microversion: 2.1 time: 0.154768 Aug 23 11:43:53.812760 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3886/7825] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:53 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:43:54.833557 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:54.834578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:54.841494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:54.841988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:54.842840 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:54.843639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:54.844142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:54.844584 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:54.977498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:54.985412 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32aa2ed3-70dc-4681-8f63-5adc831c4998 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1361 microversion: 2.1 time: 0.155947 Aug 23 11:43:54.985988 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3940/7826] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:54 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:56.006417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:56.007132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:56.014084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:56.014808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:56.015099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:56.015828 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:56.016301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:56.016765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:56.156491 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:56.164447 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f2c5df4-9113-4a2f-8609-8d9a73bb3ed3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1361 microversion: 2.1 time: 0.162309 Aug 23 11:43:56.165057 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3887/7827] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:56 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:56.184323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-c1845ab3-53b3-4499-a377-2aaca5bfed77 req-bfc05317-bfbe-4cd7-b241-3645854571fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9672743e-5b86-48da-8468-70f4be8ffd51", "name": "network-vif-plugged", "status": "completed", "tag": "3f8193ad-1b9f-49dc-bed6-6be6b74ce764"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:43:56.195964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c1845ab3-53b3-4499-a377-2aaca5bfed77 req-bfc05317-bfbe-4cd7-b241-3645854571fb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:56.196463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c1845ab3-53b3-4499-a377-2aaca5bfed77 req-bfc05317-bfbe-4cd7-b241-3645854571fb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:56.196946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-c1845ab3-53b3-4499-a377-2aaca5bfed77 req-bfc05317-bfbe-4cd7-b241-3645854571fb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:56.210762 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-c1845ab3-53b3-4499-a377-2aaca5bfed77 req-bfc05317-bfbe-4cd7-b241-3645854571fb service nova] Creating event network-vif-plugged:3f8193ad-1b9f-49dc-bed6-6be6b74ce764 for instance 9672743e-5b86-48da-8468-70f4be8ffd51 on n-h1-847009-13 Aug 23 11:43:56.215814 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-c1845ab3-53b3-4499-a377-2aaca5bfed77 req-bfc05317-bfbe-4cd7-b241-3645854571fb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035177 Aug 23 11:43:56.216349 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3941/7828] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:43:57.185096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:57.185764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:57.193172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:57.193680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:57.194141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:57.194861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:57.195338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:57.195786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:57.331269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:57.339319 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f7640e1e-37db-4377-84b6-599ff6cd509e tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1361 microversion: 2.1 time: 0.158171 Aug 23 11:43:57.339891 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3888/7829] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:57 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:58.364066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:58.364814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:58.371652 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:58.372079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:58.372539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:58.373304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:58.374983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:58.375427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:58.512684 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:58.521086 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f2913a9f-4a45-4330-b5b5-d76db5575092 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1553 microversion: 2.1 time: 0.164222 Aug 23 11:43:58.521660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3942/7830] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:58 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:43:58.542059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:43:58.542702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:43:58.550169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:58.550678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:58.551140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:58.551859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:43:58.552339 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:43:58.552827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:43:58.682952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:43:58.691322 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23495023-4b27-4ca7-a46a-4f14d7cc4120 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1553 microversion: 2.1 time: 0.153167 Aug 23 11:43:58.691898 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3889/7831] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:43:58 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:00.196008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d41bb7-50f4-4875-8eba-b12d10a3450c"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:44:00.198475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:00.200438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:00.207316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:00.207793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:00.208241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:00.208982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:00.209709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:00.210144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:00.474690 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38661ac4-7c02-4609-ab59-d3651629f98c tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "POST /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282461 Aug 23 11:44:00.475259 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3943/7832] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:44:00 2022] POST /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:44:11.166360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:11.166881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:11.168933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:11.169653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:11.171393 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:11.172315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:11.180768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:11.181282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:11.181742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:11.182461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:11.182940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:11.183384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:11.269463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lazy-loading 'services' on Instance uuid 9672743e-5b86-48da-8468-70f4be8ffd51 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:44:11.344245 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70d84d72-2eb6-4564-ba88-fe93760cf581 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments/17d41bb7-50f4-4875-8eba-b12d10a3450c" status: 202 len: 0 microversion: 2.1 time: 0.181938 Aug 23 11:44:11.344907 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3890/7833] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:44:11 2022] DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments/17d41bb7-50f4-4875-8eba-b12d10a3450c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:44:11.353997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:11.356362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:11.359744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:11.360502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:11.368070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:11.368558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:11.369071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:11.369856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:11.370330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:11.370770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:11.403841 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-664fd5dc-2f06-44b4-ade7-15b084632ead tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054358 Aug 23 11:44:11.404915 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3944/7834] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:44:11 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:44:12.418261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:12.420949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:12.427471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:12.427988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:12.428448 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:12.429217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:12.429699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:12.430150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:12.461991 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac07efba-a761-4d3f-ba4c-5a20eddc90ae tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049162 Aug 23 11:44:12.462768 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3891/7835] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:44:12 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:44:13.477412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:13.479633 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:13.488093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:13.488604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:13.489113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:13.489892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:13.490361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:13.490820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:13.527382 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-188592bd-889d-4906-b9e9-dbb8bba357b8 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056373 Aug 23 11:44:13.527995 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3945/7836] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:44:13 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:44:14.540430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:14.542770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:14.550354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:14.550866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:14.551333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:14.552054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:14.552527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:14.552995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:14.583672 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a4dfa054-babf-48eb-8b44-aaad42da08f5 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Aug 23 11:44:14.584548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3892/7837] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:44:14 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:44:15.596518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:15.599823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:15.608909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:15.609703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:15.610134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:15.610849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:15.611307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:15.611735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:15.642990 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c15bbb05-26dc-4711-ab00-3bd4caa22408 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051175 Aug 23 11:44:15.643485 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3946/7838] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:44:15 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:44:16.655776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:16.658044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:16.664927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:16.665430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:16.665889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:16.666600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:16.667076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:16.667517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:16.697136 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d1785c4f-2c24-4609-8218-58b495ed4cf0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045877 Aug 23 11:44:16.698724 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3893/7839] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:44:16 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:44:16.708144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:16.708645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:16.715817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:16.716335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:16.717339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:16.718213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:16.718682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:16.719118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:16.793473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] HTTP exception thrown: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 is not attached to volume 17d41bb7-50f4-4875-8eba-b12d10a3450c Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Request method failure captured: Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments/17d41bb7-50f4-4875-8eba-b12d10a3450c HTTP/1.1 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL0mj8FCVz-iBKIVvnu8GEU3mToxalJMJu85EguF12USkocnx7JyBc3tR1rvi5WQL_iV9FWAUqG7lbJC8OjXeMF825fKxnnSS1NsDzH5NI9gy8Sgk9A7YjHQAU8s0hl57FpQteKsMeH45uVUA-50bpTnukaGxxYO9ScMpl-Mr_8QKTg Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ed539d9930d4c779360d9b6bbe11dfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}] Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dae5e32b87c44e2e97be8e546ef930ab Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 is not attached to volume 17d41bb7-50f4-4875-8eba-b12d10a3450c Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '9672743e-5b86-48da-8468-70f4be8ffd51', 'id': '17d41bb7-50f4-4875-8eba-b12d10a3450c'} Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 17d41bb7-50f4-4875-8eba-b12d10a3450c. Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 is not attached to volume 17d41bb7-50f4-4875-8eba-b12d10a3450c Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:44:16.795785 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 is not attached to volume 17d41bb7-50f4-4875-8eba-b12d10a3450c Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Returning 404 to user: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 is not attached to volume 17d41bb7-50f4-4875-8eba-b12d10a3450c {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-59bac248-1bc8-430c-97cc-3f5d34dc5f28 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments/17d41bb7-50f4-4875-8eba-b12d10a3450c" status: 404 len: 154 microversion: 2.1 time: 0.093223 Aug 23 11:44:16.800492 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3947/7840] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:44:16 2022] DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51/os-volume_attachments/17d41bb7-50f4-4875-8eba-b12d10a3450c => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:44:18.887993 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 23 11:44:20.323538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:20.324104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:20.331649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:20.332154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:20.332608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:20.333353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:20.333846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:20.334617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:20.360397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:44:20.439809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6bb9f9bf-40d2-4ea5-916f-62f3ef3a2ee0 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 204 len: 0 microversion: 2.1 time: 0.119750 Aug 23 11:44:20.440887 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3894/7841] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:44:20 2022] DELETE /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:44:20.450246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:20.450963 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:20.458713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:20.459539 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:20.460058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:20.461544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:20.462046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:20.462484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:20.595800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:20.603918 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-23d962d1-9c3d-4a8b-b482-f193759a03cd tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1559 microversion: 2.1 time: 0.158576 Aug 23 11:44:20.604486 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3948/7842] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:20 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:21.626284 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:21.627012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:21.634086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:21.634589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:21.635051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:21.635764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:21.636239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:21.636684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:21.772860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:21.781299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8c9cf72f-ab15-4c49-b4de-ecee6b3544d3 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1559 microversion: 2.1 time: 0.160475 Aug 23 11:44:21.781871 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3895/7843] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:21 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:22.802446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:22.803104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:22.810230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:22.811254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:22.811759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:22.812634 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:22.813123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:22.813562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:22.953224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae5e32b87c44e2e97be8e546ef930ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed539d9930d4c779360d9b6bbe11dfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:22.965223 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38b7fb1d-f24d-4324-a716-5a23b276ea71 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 200 len: 1559 microversion: 2.1 time: 0.166141 Aug 23 11:44:22.965324 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3949/7844] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:22 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:44:23.089502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f592d556-0ff1-43c9-b453-d5bab538b9b4 req-fc35a831-8464-4023-a891-1622b0aab440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9672743e-5b86-48da-8468-70f4be8ffd51", "name": "network-vif-deleted", "tag": "3f8193ad-1b9f-49dc-bed6-6be6b74ce764"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:44:23.103353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f592d556-0ff1-43c9-b453-d5bab538b9b4 req-fc35a831-8464-4023-a891-1622b0aab440 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:23.103918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f592d556-0ff1-43c9-b453-d5bab538b9b4 req-fc35a831-8464-4023-a891-1622b0aab440 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:23.104376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f592d556-0ff1-43c9-b453-d5bab538b9b4 req-fc35a831-8464-4023-a891-1622b0aab440 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:23.118000 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f592d556-0ff1-43c9-b453-d5bab538b9b4 req-fc35a831-8464-4023-a891-1622b0aab440 service nova] Creating event network-vif-deleted:3f8193ad-1b9f-49dc-bed6-6be6b74ce764 for instance 9672743e-5b86-48da-8468-70f4be8ffd51 on n-h1-847009-13 Aug 23 11:44:23.123726 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f592d556-0ff1-43c9-b453-d5bab538b9b4 req-fc35a831-8464-4023-a891-1622b0aab440 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037784 Aug 23 11:44:23.124347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3896/7845] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:44:23.986707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:23.987317 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] [instance: 9672743e-5b86-48da-8468-70f4be8ffd51] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:23.994533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:23.995027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:23.995472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:23.996175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:23.996642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:23.997119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:24.011900 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] HTTP exception thrown: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 could not be found. Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Request method failure captured: Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 HTTP/1.1 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL0mj8FCVz-iBKIVvnu8GEU3mToxalJMJu85EguF12USkocnx7JyBc3tR1rvi5WQL_iV9FWAUqG7lbJC8OjXeMF825fKxnnSS1NsDzH5NI9gy8Sgk9A7YjHQAU8s0hl57FpQteKsMeH45uVUA-50bpTnukaGxxYO9ScMpl-Mr_8QKTg Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ed539d9930d4c779360d9b6bbe11dfd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ed539d9930d4c779360d9b6bbe11dfd"}]}] Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 8ed539d9930d4c779360d9b6bbe11dfd Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-313147713 Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: dae5e32b87c44e2e97be8e546ef930ab Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestEncryptedCinderVolumes-313147713-project Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 could not be found. Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9672743e-5b86-48da-8468-70f4be8ffd51'} Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 could not be found. Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 could not be found. Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:44:24.014089 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 could not be found. Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Returning 404 to user: Instance 9672743e-5b86-48da-8468-70f4be8ffd51 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec87c9ec-ede3-43f3-8745-9e4099dc05dc tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51" status: 404 len: 111 microversion: 2.1 time: 0.033024 Aug 23 11:44:24.018463 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3950/7846] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:23 2022] GET /compute/v2.1/servers/9672743e-5b86-48da-8468-70f4be8ffd51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:44:24.025101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e89eacd7-feb2-497e-975c-9c662f847899 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] Calling method '.version_select at 0x7fdc9cebac10>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:24.044474 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e89eacd7-feb2-497e-975c-9c662f847899 tempest-TestEncryptedCinderVolumes-313147713 tempest-TestEncryptedCinderVolumes-313147713-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1738751545" status: 202 len: 0 microversion: 2.1 time: 0.023652 Aug 23 11:44:24.045258 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3897/7847] 10.222.0.78 () {58 vars in 1278 bytes} [Tue Aug 23 11:44:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1738751545 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:44:50.222296 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-621f48e9-de5d-4ab8-845c-2f6c8a486259 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'create', calling method: .version_select at 0x7fdc9d272160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1652451813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObEew8doAHxjJuE2hL5MLwu9RrwMC3wqiLHZtcQQTZZq4tQPP0gaWISBG9M2cco/WgRVvo6D+cCIjIEt7TEnki+cHBCwbhKkfDRByGmJPT0B6oX5vzsEdsN+wZnAplakw=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:44:50.228064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=14 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:50.228730 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=38 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:50.240585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-621f48e9-de5d-4ab8-845c-2f6c8a486259 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for project 4c6b5b4106f84220a5bb278de6287766. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:44:50.245859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-621f48e9-de5d-4ab8-845c-2f6c8a486259 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for user baf580571f7b48fb9aedcc0320054ad2 and project 4c6b5b4106f84220a5bb278de6287766. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:44:50.271970 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-621f48e9-de5d-4ab8-845c-2f6c8a486259 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053592 Aug 23 11:44:50.272574 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3951/7848] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:44:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:44:50.322610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:50.323462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:44:50.329104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-894716108", "imageRef": "e715076b-f9f8-485c-acec-c4cd8f8600a7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1652451813", "networks": [{"uuid": "d6e00ae0-722b-4425-80fb-6927c049e959"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:44:50.386670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] validate_networks() for [('d6e00ae0-722b-4425-80fb-6927c049e959', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:44:50.853045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:44:50.853499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:44:50.854033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:44:50.854473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:44:50.855021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:44:50.864483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:50.865141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:50.865603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:50.866359 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:50.866841 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:50.867290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:50.884243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for project 4c6b5b4106f84220a5bb278de6287766. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:44:50.890056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for user baf580571f7b48fb9aedcc0320054ad2 and project 4c6b5b4106f84220a5bb278de6287766. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:44:50.902412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:44:50.905341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e715076b-f9f8-485c-acec-c4cd8f8600a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:44:50.951800 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17897250-7242-4ce5-8af7-41587c9377d9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631627 Aug 23 11:44:50.952487 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3898/7849] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:44:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:44:50.963392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0b5f36a8-900f-4ea1-91e3-5c13a0fe2214 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:50.964020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0b5f36a8-900f-4ea1-91e3-5c13a0fe2214 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:51.025601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0b5f36a8-900f-4ea1-91e3-5c13a0fe2214 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:51.033661 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0b5f36a8-900f-4ea1-91e3-5c13a0fe2214 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1258 microversion: 2.1 time: 0.074416 Aug 23 11:44:51.034249 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3952/7850] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:50 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:52.054521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:52.061808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:52.069480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:52.069998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:52.070460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:52.071201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:52.071683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:52.073008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:52.146146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:52.156001 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40e5b622-4a9a-4cf9-8f5b-7cf6fac05f7c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1318 microversion: 2.1 time: 0.105366 Aug 23 11:44:52.157075 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3899/7851] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:52 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1318 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:53.186502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:53.187329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:53.196980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:53.197828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:53.198650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:53.199685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:53.200379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:53.201991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:53.386818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:53.401011 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7f2cc0c-38a7-4ecc-877b-49b1d76e840b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.221867 Aug 23 11:44:53.402367 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3953/7852] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:53 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:54.426805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:54.427550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:54.435262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:54.436314 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:54.436804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:54.437547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:54.438030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:54.438479 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:54.583064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:54.592167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1305814a-0146-4e64-8207-af70de00c87f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.169285 Aug 23 11:44:54.592855 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3900/7853] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:54 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:55.614309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:55.614854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:55.621880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:55.622599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:55.623054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:55.623748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:55.624207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:55.624940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:55.801300 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:55.812332 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6b53664a-26bd-4d13-935c-e3f2e41f3c1e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.201914 Aug 23 11:44:55.813872 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3954/7854] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:55 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:56.833624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:56.834515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:56.842173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:56.842690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:56.843158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:56.843892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:56.844375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:56.844853 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:56.994939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:57.005257 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ac54cda1-7d59-47de-8b3e-5fa1e1b7225d tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.175569 Aug 23 11:44:57.013779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3901/7855] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:56 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:58.027566 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:58.028245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:58.036187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:58.036690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:58.037167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:58.037894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:58.038366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:58.038794 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:58.181133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:58.189924 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06a25f95-9960-4c3f-8a1a-836106151547 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.166300 Aug 23 11:44:58.190510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3955/7856] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:58 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:44:59.212027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:44:59.212749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:44:59.221484 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:59.222144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:59.222796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:59.223602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:44:59.224152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:44:59.224916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:44:59.376074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:44:59.385985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2a1636e4-6e5a-497e-a954-78bc6e3cd7e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.178784 Aug 23 11:44:59.386806 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3902/7857] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:44:59 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:00.407666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:00.408248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:00.415549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:00.416049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:00.416500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:00.417253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:00.417718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:00.418153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:00.711747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:00.720804 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f188a8c-b2c3-487b-97c1-bc2b3a51e0a0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.317341 Aug 23 11:45:00.721410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3956/7858] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:00 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:01.092236 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-e3a2e05b-c97a-4c6f-b5b7-23acbd77886b req-90fc4c26-01fa-4f5e-b9c4-d8977634f352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:45:01.101110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:01.101891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:01.109145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e3a2e05b-c97a-4c6f-b5b7-23acbd77886b req-90fc4c26-01fa-4f5e-b9c4-d8977634f352 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:01.109660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e3a2e05b-c97a-4c6f-b5b7-23acbd77886b req-90fc4c26-01fa-4f5e-b9c4-d8977634f352 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:01.110220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-e3a2e05b-c97a-4c6f-b5b7-23acbd77886b req-90fc4c26-01fa-4f5e-b9c4-d8977634f352 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:01.122401 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-e3a2e05b-c97a-4c6f-b5b7-23acbd77886b req-90fc4c26-01fa-4f5e-b9c4-d8977634f352 service nova] Creating event network-changed:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:45:01.128094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-e3a2e05b-c97a-4c6f-b5b7-23acbd77886b req-90fc4c26-01fa-4f5e-b9c4-d8977634f352 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040331 Aug 23 11:45:01.129056 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3903/7859] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:45:01.742461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:01.743303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:01.744942 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:01.751892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:01.752377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:01.752841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:01.753549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:01.753994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:01.754503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:01.889537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:01.897089 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c2e03bcc-53bb-4cd4-b29f-ea74dd05c280 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.158616 Aug 23 11:45:01.897661 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3957/7860] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:01 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:02.918584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:02.919667 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:02.925951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:02.926460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:02.926914 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:02.927625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:02.928098 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:02.928540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:03.061601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:03.070579 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ad569713-9a70-4794-b8a3-4afd41da56af tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.157327 Aug 23 11:45:03.071150 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3904/7861] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:02 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:04.091720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:04.092346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:04.099326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:04.099821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:04.100270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:04.101018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:04.101486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:04.101924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:04.235053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:04.242942 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b488f1e-c708-4cd7-b1cd-3e737d22a0f6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.155269 Aug 23 11:45:04.243521 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3958/7862] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:04 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:04.874989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-26f57f32-44eb-4a42-a846-465f4e253de3 req-047477f5-e4d1-40c8-98ee-171478e69b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "name": "network-vif-plugged", "status": "completed", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:45:04.886275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-26f57f32-44eb-4a42-a846-465f4e253de3 req-047477f5-e4d1-40c8-98ee-171478e69b68 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:04.886792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-26f57f32-44eb-4a42-a846-465f4e253de3 req-047477f5-e4d1-40c8-98ee-171478e69b68 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:04.887243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-26f57f32-44eb-4a42-a846-465f4e253de3 req-047477f5-e4d1-40c8-98ee-171478e69b68 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:04.902173 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-26f57f32-44eb-4a42-a846-465f4e253de3 req-047477f5-e4d1-40c8-98ee-171478e69b68 service nova] Creating event network-vif-plugged:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:45:04.907566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-26f57f32-44eb-4a42-a846-465f4e253de3 req-047477f5-e4d1-40c8-98ee-171478e69b68 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037403 Aug 23 11:45:04.908354 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3905/7863] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:45:05.264338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:05.264922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:05.271818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:05.272311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:05.272784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:05.273501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:05.273967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:05.274404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:05.427107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:05.435562 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2925b547-0562-48c8-8797-d38e78e644e7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.176041 Aug 23 11:45:05.436143 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3959/7864] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:05 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:06.456390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:06.457306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:06.464704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:06.465238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:06.465948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:06.466749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:06.467271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:06.467719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:06.630081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:06.637955 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2a53dfe-badf-4f7b-8e0d-7f90954660f0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1358 microversion: 2.1 time: 0.185993 Aug 23 11:45:06.638623 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3906/7865] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:06 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:07.658666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:07.659285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:07.665381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:07.665877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:07.666324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:07.667026 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:07.667500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:07.667937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:07.807139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:07.815524 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38eb6d04-0d3c-4c59-b0c6-6ca270adfc55 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1549 microversion: 2.1 time: 0.161204 Aug 23 11:45:07.816100 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3960/7866] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:07 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:07.835681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:07.836306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:07.843690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:07.844220 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:07.844658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:07.845396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:07.845857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:07.846296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:07.991126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:07.999787 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-075c9237-57fc-423e-b7c6-2dcd728b3269 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1549 microversion: 2.1 time: 0.168381 Aug 23 11:45:08.000368 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3907/7867] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:07 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:08.022757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:08.027686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:08.028927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Searching by: {'deleted': False, 'project_id': '4c6b5b4106f84220a5bb278de6287766'} {{(pid=128859) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:45:08.035913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:08.036422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:08.037035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:08.037769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:08.038228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:08.038656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:08.065992 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.multi_cell_list [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:45:08.100726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-71f3f4d6-8df8-4404-a7ad-81299f84c2d2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.081812 Aug 23 11:45:08.101339 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3961/7868] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 11:45:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:45:08.113157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:08.113789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:08.119977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:08.120489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:08.120972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:08.122320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:08.123170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:08.123615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:08.252879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:08.260658 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-91b1bc7a-d5c9-47f5-96b7-44cdb7bdd572 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1549 microversion: 2.1 time: 0.151472 Aug 23 11:45:08.261263 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3908/7869] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:08 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:09.808371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d14d3abf-fc7a-4aec-b45a-98d82289d11b"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:45:09.811261 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:09.818289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:09.818780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:09.819221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:09.819924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:09.820386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:09.820854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:10.105389 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0369c0bf-18e2-4e9c-ad12-5fb27bd38177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300828 Aug 23 11:45:10.106565 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3962/7870] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:45:09 2022] POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:45:23.162133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:23.162781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:23.165812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:23.166534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=54 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:23.173810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:23.174324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:23.174789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:23.175516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:23.176000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:23.176449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:23.438394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:23.446737 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83a6937c-4064-4e0f-8ce3-dc1be1edfd43 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1595 microversion: 2.1 time: 0.288645 Aug 23 11:45:23.447343 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3909/7871] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:23 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1595 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:25.372972 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:25.378024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:25.378791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:45:25.383509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-309c2eae-c815-4b43-970d-519215c67cd8 req-2db2786d-6285-496b-b1a3-16f39e29343f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:45:25.404852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-309c2eae-c815-4b43-970d-519215c67cd8 req-2db2786d-6285-496b-b1a3-16f39e29343f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:25.405374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-309c2eae-c815-4b43-970d-519215c67cd8 req-2db2786d-6285-496b-b1a3-16f39e29343f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:25.405814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-309c2eae-c815-4b43-970d-519215c67cd8 req-2db2786d-6285-496b-b1a3-16f39e29343f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:25.420328 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-309c2eae-c815-4b43-970d-519215c67cd8 req-2db2786d-6285-496b-b1a3-16f39e29343f service nova] Creating event network-changed:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:45:25.426995 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-309c2eae-c815-4b43-970d-519215c67cd8 req-2db2786d-6285-496b-b1a3-16f39e29343f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055790 Aug 23 11:45:25.427918 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3963/7872] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:45:26.507663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1523555774"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:45:26.508219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:26.516662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:26.517249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:26.517720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:26.518459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:26.518943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:26.519400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:26.673749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.security_group_api [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Adding security group 9c063568-8e15-4a93-8378-f285c24f0f39 to port 20676d46-15e9-4dc4-9061-663b4e7dc591 Aug 23 11:45:27.008877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fa518c0d-231c-4712-ac8e-a126b209f065 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/action" status: 202 len: 0 microversion: 2.1 time: 0.505080 Aug 23 11:45:27.009471 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3910/7873] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:45:26 2022] POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:45:27.019400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:45:27.020109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:45:27.026658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:27.027155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:27.028387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:27.029285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:27.029754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:27.030194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:27.245553 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:45:27.255355 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e48bd09e-8300-4be3-96d0-1b27e405f087 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1761 microversion: 2.1 time: 0.241063 Aug 23 11:45:27.255959 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3964/7874] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:45:27 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1761 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:45:27.443406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b96f9549-10d6-4347-a565-cc3597414e35 req-ea5b172d-a124-4cd7-911f-bdd3a8c842a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:45:27.453596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b96f9549-10d6-4347-a565-cc3597414e35 req-ea5b172d-a124-4cd7-911f-bdd3a8c842a6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:45:27.454104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b96f9549-10d6-4347-a565-cc3597414e35 req-ea5b172d-a124-4cd7-911f-bdd3a8c842a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:45:27.454562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b96f9549-10d6-4347-a565-cc3597414e35 req-ea5b172d-a124-4cd7-911f-bdd3a8c842a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:45:27.467053 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b96f9549-10d6-4347-a565-cc3597414e35 req-ea5b172d-a124-4cd7-911f-bdd3a8c842a6 service nova] Creating event network-changed:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:45:27.473114 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b96f9549-10d6-4347-a565-cc3597414e35 req-ea5b172d-a124-4cd7-911f-bdd3a8c842a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032462 Aug 23 11:45:27.473114 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3911/7875] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:46:47.365563 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 23 11:46:47.366271 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:46:48.891928 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 23 11:46:48.892544 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:46:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:47:04.809259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:47:04.810031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:47:04.814421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:47:04.816631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:47:04.824201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:47:04.824696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:47:04.825190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:47:04.825875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:47:04.826343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:47:04.826783 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:47:04.899276 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f08cba55-19a1-41d3-82b8-9360e4b98596 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/action" status: 202 len: 0 microversion: 2.1 time: 0.091807 Aug 23 11:47:04.902458 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3965/7876] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:47:04 2022] POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:47:04.907433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:47:04.908214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:47:04.913462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:47:04.914198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:47:04.924303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:47:04.924848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:47:04.925312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:47:04.926038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:47:04.926515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:47:04.926963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:47:05.086799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:47:05.095244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24f92d34-a248-4b34-9df3-29786be881aa tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1763 microversion: 2.1 time: 0.190839 Aug 23 11:47:05.095823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3912/7877] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:47:04 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1763 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:47:06.121060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:47:06.121873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:47:06.128306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:47:06.128818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:47:06.129252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:47:06.129940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:47:06.130393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:47:06.130837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:47:06.282597 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:47:06.291796 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7822656b-6e72-4cc7-8d73-bbbac9df05c5 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1761 microversion: 2.1 time: 0.176912 Aug 23 11:47:06.292385 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3966/7878] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:47:06 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1761 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:48:20.275137 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:48:20.277520 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:48:20.277520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:20.278086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:20.282147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1523555774"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:20.282700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:20.289384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:20.289892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:20.290345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:20.291048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:20.291527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:20.292062 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:20.421275 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.network.security_group_api [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Removing security group 9c063568-8e15-4a93-8378-f285c24f0f39 from port 20676d46-15e9-4dc4-9061-663b4e7dc591 Aug 23 11:48:20.728164 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-11bc7fba-46d5-47ee-b5e8-d7a0bd24c3bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/action" status: 202 len: 0 microversion: 2.1 time: 0.454701 Aug 23 11:48:20.729667 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3913/7879] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:48:20 2022] POST /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:48:20.735107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:20.735910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:20.872713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b46d52e2-c3cc-438f-8864-aeeebf275213 req-ee852135-7849-4983-9a08-fc06f289fd30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:20.882576 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b46d52e2-c3cc-438f-8864-aeeebf275213 req-ee852135-7849-4983-9a08-fc06f289fd30 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:20.883276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b46d52e2-c3cc-438f-8864-aeeebf275213 req-ee852135-7849-4983-9a08-fc06f289fd30 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:20.883894 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b46d52e2-c3cc-438f-8864-aeeebf275213 req-ee852135-7849-4983-9a08-fc06f289fd30 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:20.896845 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b46d52e2-c3cc-438f-8864-aeeebf275213 req-ee852135-7849-4983-9a08-fc06f289fd30 service nova] Creating event network-changed:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:48:20.903407 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b46d52e2-c3cc-438f-8864-aeeebf275213 req-ee852135-7849-4983-9a08-fc06f289fd30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170113 Aug 23 11:48:20.904253 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3967/7880] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:48:21.913837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:21.914376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:21.923133 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 45964. Aug 23 11:48:21.925618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:21.926121 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:21.926576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:21.927295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:21.927765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:21.928208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:21.928839 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 45962. Aug 23 11:48:22.014054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lazy-loading 'services' on Instance uuid 78900006-8449-4b7b-a0b3-d07a34a62761 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:48:22.086387 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [9ef23931-b2d2-4aa9-b194-dc95e3c928b5] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:48:22.920019 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0e003e9b-435e-482f-9034-250a18656f8d req-7f55f9d4-8c33-4cf2-9749-eeb36b64c7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:22.929564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0e003e9b-435e-482f-9034-250a18656f8d req-7f55f9d4-8c33-4cf2-9749-eeb36b64c7a2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:22.929977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0e003e9b-435e-482f-9034-250a18656f8d req-7f55f9d4-8c33-4cf2-9749-eeb36b64c7a2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:22.930406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0e003e9b-435e-482f-9034-250a18656f8d req-7f55f9d4-8c33-4cf2-9749-eeb36b64c7a2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:22.942076 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0e003e9b-435e-482f-9034-250a18656f8d req-7f55f9d4-8c33-4cf2-9749-eeb36b64c7a2 service nova] Creating event network-changed:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:48:22.946937 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0e003e9b-435e-482f-9034-250a18656f8d req-7f55f9d4-8c33-4cf2-9749-eeb36b64c7a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 Aug 23 11:48:22.947599 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3968/7881] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:48:23.093206 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [9ef23931-b2d2-4aa9-b194-dc95e3c928b5] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 45972. Aug 23 11:48:23.096551 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9d420cbd-7541-4f3e-94fd-8e91a02395da tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments/d14d3abf-fc7a-4aec-b45a-98d82289d11b" status: 202 len: 0 microversion: 2.1 time: 1.188978 Aug 23 11:48:23.097276 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3914/7882] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:48:21 2022] DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments/d14d3abf-fc7a-4aec-b45a-98d82289d11b => generated 0 bytes in 1190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:48:23.106735 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:23.109120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:23.115459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:23.115953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:23.116392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:23.117131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:23.117588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:23.118007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:23.149236 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c209c12-1953-4919-b3b3-a3aee92c510c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 Aug 23 11:48:23.149810 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3969/7883] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:48:23 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:24.163979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:24.166978 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:24.174632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:24.175142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:24.175600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:24.176320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:24.176820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:24.177265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:24.208183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af4e0f4a-aa91-4528-b7ce-68ee27114319 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049641 Aug 23 11:48:24.208947 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3915/7884] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:48:24 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:25.221359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:25.223517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:25.231330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:25.231852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:25.232308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:25.233106 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:25.233573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:25.234006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:25.268480 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65cc3908-c45f-4663-b813-57e286ce666f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051244 Aug 23 11:48:25.269101 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3970/7885] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:48:25 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:26.281154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:26.283353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:26.290259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:26.290760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:26.291758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:26.292624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:26.293127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:26.293570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:26.323895 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-67c5ede0-2279-44eb-973d-1fa42cb16cd0 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Aug 23 11:48:26.324467 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3916/7886] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:48:26 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:27.336837 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:27.340185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:27.347195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:27.347689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:27.348142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:27.348911 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:27.349377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:27.349814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:27.380153 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-702f9d0c-7f16-418f-9741-3c7d8f5501a4 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047574 Aug 23 11:48:27.380726 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3971/7887] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:48:27 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:28.392472 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:28.394693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:28.402213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:28.402718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:28.403176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:28.403886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:28.404360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:28.404836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:28.432893 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bff0ef7f-5992-46f2-ab40-a2586c61bb0f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044470 Aug 23 11:48:28.433453 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3917/7888] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:48:28 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:48:28.443886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:28.444496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:28.452417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:28.452948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:28.453394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:28.454095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:28.454563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:28.454993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:28.530657 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] HTTP exception thrown: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 is not attached to volume d14d3abf-fc7a-4aec-b45a-98d82289d11b Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Request method failure captured: Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments/d14d3abf-fc7a-4aec-b45a-98d82289d11b HTTP/1.1 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL2j7WBIQHGyEue8KJrkCkCf2ZbEepmnL8xGJpqa8q6HQF62UdlwKjg-ucncwfZbe8x4kkjT5RL-ftVC0R9kVqf6uJPQVzkNB2C-OV166kKjKmFcrb6Tb24e4mMZWj7ZBhu5vA8F81GHfBKvQKPC75mCYbiHzyvDSSEI7GTphbj4kEA Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c6b5b4106f84220a5bb278de6287766", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}] Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: baf580571f7b48fb9aedcc0320054ad2 Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 is not attached to volume d14d3abf-fc7a-4aec-b45a-98d82289d11b Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '78900006-8449-4b7b-a0b3-d07a34a62761', 'id': 'd14d3abf-fc7a-4aec-b45a-98d82289d11b'} Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d14d3abf-fc7a-4aec-b45a-98d82289d11b. Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 is not attached to volume d14d3abf-fc7a-4aec-b45a-98d82289d11b Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:48:28.532280 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 is not attached to volume d14d3abf-fc7a-4aec-b45a-98d82289d11b Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Returning 404 to user: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 is not attached to volume d14d3abf-fc7a-4aec-b45a-98d82289d11b {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7c3cf434-810b-49bd-ade3-0bfc5c478bcf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments/d14d3abf-fc7a-4aec-b45a-98d82289d11b" status: 404 len: 154 microversion: 2.1 time: 0.093939 Aug 23 11:48:28.536891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3972/7889] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:48:28 2022] DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761/os-volume_attachments/d14d3abf-fc7a-4aec-b45a-98d82289d11b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:48:31.781932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:31.782458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:31.789480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:31.789992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:31.790462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:31.791318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:31.791924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:31.792373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:31.817721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:48:31.901287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-82b69318-0a82-4081-a3e7-d7b4e8742225 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 204 len: 0 microversion: 2.1 time: 0.122677 Aug 23 11:48:31.901901 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3918/7890] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:48:31 2022] DELETE /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:48:31.910511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:31.911152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:31.919424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:31.920075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:31.920521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:31.921267 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:31.921729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:31.922237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:32.064941 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:32.073470 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4b521aec-4dd0-4889-acfd-fe44beb10b86 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1555 microversion: 2.1 time: 0.166562 Aug 23 11:48:32.074048 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3973/7891] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:31 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:33.094817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:33.095549 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:33.103119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:33.104435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:33.105128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:33.105854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:33.106337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:33.106788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:33.243848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:33.255131 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b7a19fb1-3252-42be-bc5a-4660d3417c9f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1555 microversion: 2.1 time: 0.164663 Aug 23 11:48:33.255719 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3919/7892] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:33 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:34.234239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-28422a74-699e-428c-ba8b-b5d12e4f0d68 req-bb2fab85-d8db-46b4-9223-ef92fecbfceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78900006-8449-4b7b-a0b3-d07a34a62761", "name": "network-vif-deleted", "tag": "20676d46-15e9-4dc4-9061-663b4e7dc591"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:34.244111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-28422a74-699e-428c-ba8b-b5d12e4f0d68 req-bb2fab85-d8db-46b4-9223-ef92fecbfceb service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:34.244697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-28422a74-699e-428c-ba8b-b5d12e4f0d68 req-bb2fab85-d8db-46b4-9223-ef92fecbfceb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:34.245278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-28422a74-699e-428c-ba8b-b5d12e4f0d68 req-bb2fab85-d8db-46b4-9223-ef92fecbfceb service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:34.263114 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-28422a74-699e-428c-ba8b-b5d12e4f0d68 req-bb2fab85-d8db-46b4-9223-ef92fecbfceb service nova] Creating event network-vif-deleted:20676d46-15e9-4dc4-9061-663b4e7dc591 for instance 78900006-8449-4b7b-a0b3-d07a34a62761 on n-h2-847009-13 Aug 23 11:48:34.268178 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-28422a74-699e-428c-ba8b-b5d12e4f0d68 req-bb2fab85-d8db-46b4-9223-ef92fecbfceb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108537 Aug 23 11:48:34.268826 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3974/7893] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:34.275891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:34.276913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:34.284186 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:34.284687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:34.285163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:34.286616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:34.287188 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:34.287686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:34.321348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:34.321775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:34.322229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:34.323327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lazy-loading 'fault' on Instance uuid 78900006-8449-4b7b-a0b3-d07a34a62761 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:48:34.367315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:34.376291 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4c5ddea0-4438-4d92-9c8c-a64bc81f3967 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 200 len: 1348 microversion: 2.1 time: 0.104704 Aug 23 11:48:34.376824 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3920/7894] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:34 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:48:35.398471 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:35.399206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 78900006-8449-4b7b-a0b3-d07a34a62761] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:35.406304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:35.406793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:35.407241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:35.407950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:35.408416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:35.408888 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:35.422945 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] HTTP exception thrown: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 could not be found. Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Request method failure captured: Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 HTTP/1.1 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL2j7WBIQHGyEue8KJrkCkCf2ZbEepmnL8xGJpqa8q6HQF62UdlwKjg-ucncwfZbe8x4kkjT5RL-ftVC0R9kVqf6uJPQVzkNB2C-OV166kKjKmFcrb6Tb24e4mMZWj7ZBhu5vA8F81GHfBKvQKPC75mCYbiHzyvDSSEI7GTphbj4kEA Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c6b5b4106f84220a5bb278de6287766", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}] Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: baf580571f7b48fb9aedcc0320054ad2 Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 could not be found. Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '78900006-8449-4b7b-a0b3-d07a34a62761'} Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 could not be found. Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 could not be found. Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:48:35.424577 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 could not be found. Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Returning 404 to user: Instance 78900006-8449-4b7b-a0b3-d07a34a62761 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ea312ffd-a113-4792-8721-9b0490c30d11 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761" status: 404 len: 111 microversion: 2.1 time: 0.031959 Aug 23 11:48:35.429475 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3975/7895] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:35 2022] GET /compute/v2.1/servers/78900006-8449-4b7b-a0b3-d07a34a62761 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:48:35.435460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b5b1581-38ad-48fb-a035-c04646c87282 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '.version_select at 0x7fdc9caf5430>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:35.460333 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b5b1581-38ad-48fb-a035-c04646c87282 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1652451813" status: 202 len: 0 microversion: 2.1 time: 0.029335 Aug 23 11:48:35.460983 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3921/7896] 10.222.0.78 () {58 vars in 1272 bytes} [Tue Aug 23 11:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1652451813 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:48:44.394052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9cd1affc-9de8-4647-936f-faee8a587b8e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'create', calling method: .version_select at 0x7fdc9c5989d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-449893135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiwW4XTEeYAIyma1NluksvXbkEDrkWXoYmHJsXxanC79jFAtGZtN1lqqGL/LbBpcnGIEtHQ38FRM1HB/aiWtpZqj3Y+SocEJGBtZolc7C4UattJp4qyBsaqLkMP8NbmxA=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:44.411714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-9cd1affc-9de8-4647-936f-faee8a587b8e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for project 4c6b5b4106f84220a5bb278de6287766. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:48:44.417821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-9cd1affc-9de8-4647-936f-faee8a587b8e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for user baf580571f7b48fb9aedcc0320054ad2 and project 4c6b5b4106f84220a5bb278de6287766. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:48:44.430996 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9cd1affc-9de8-4647-936f-faee8a587b8e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:48:45.414085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=38 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:45.438475 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-9cd1affc-9de8-4647-936f-faee8a587b8e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [a1ae4342-906e-4f42-92f6-eb0a766361ed] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46100. Aug 23 11:48:45.453246 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9cd1affc-9de8-4647-936f-faee8a587b8e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.063663 Aug 23 11:48:45.453855 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3976/7897] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:48:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:48:45.502812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:45.503599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:45.507932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1572403527", "imageRef": "cfe41de9-af66-49d3-b84e-e8f20156df18", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-449893135", "networks": [{"uuid": "d6e00ae0-722b-4425-80fb-6927c049e959"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:45.563089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] validate_networks() for [('d6e00ae0-722b-4425-80fb-6927c049e959', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:48:45.936520 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:48:45.937017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:48:45.937519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:48:45.937952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:48:45.938387 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:48:45.947765 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:45.948276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:45.948753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:45.949521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:45.950002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:45.950451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:45.968089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for project 4c6b5b4106f84220a5bb278de6287766. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:48:45.973517 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Getting quotas for user baf580571f7b48fb9aedcc0320054ad2 and project 4c6b5b4106f84220a5bb278de6287766. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:48:45.987136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:48:45.989431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfe41de9-af66-49d3-b84e-e8f20156df18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:48:46.034825 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [f75758f0-8a4f-4ebe-852c-33ce9fc4ad2c] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:48:47.042591 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [f75758f0-8a4f-4ebe-852c-33ce9fc4ad2c] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46114. Aug 23 11:48:47.046693 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3c30f22b-c749-440a-899c-b4d98cdcd349 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545748 Aug 23 11:48:47.047520 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3922/7898] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:48:47.061455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2565e947-4127-44e6-af11-62df590899dd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:47.062350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2565e947-4127-44e6-af11-62df590899dd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:47.126864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2565e947-4127-44e6-af11-62df590899dd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:47.134233 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2565e947-4127-44e6-af11-62df590899dd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1258 microversion: 2.1 time: 0.079917 Aug 23 11:48:47.135459 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3977/7899] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:47 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:48.157420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:48.157983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:48.164482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:48.165034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:48.165498 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:48.166320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:48.166805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:48.167264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:48.233724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:48.241561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b0105b79-5b1a-4d40-836c-75b6c33008cd tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1310 microversion: 2.1 time: 0.089126 Aug 23 11:48:48.242144 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3923/7900] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:48 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:48:49.272500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:49.276609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:49.283275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:49.284053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:49.284669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:49.285596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:49.286225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:49.286822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:49.432964 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:49.441074 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-efc6d2e1-af33-46ad-a0f0-7e48c5762284 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.181599 Aug 23 11:48:49.441972 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3978/7901] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:49 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:50.466063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:50.466703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:50.482607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:50.484228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:50.484879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:50.486554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:50.487265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:50.488481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:50.664705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:50.678676 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-516b2486-63c7-4b0a-8572-5f58649d6883 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.217872 Aug 23 11:48:50.679536 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3924/7902] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:50 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:51.700542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:51.701518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:51.704644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:51.710830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:51.711331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:51.711795 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:51.712570 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:51.713186 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:51.713627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:51.855640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:51.864720 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-501b11f4-3703-409d-98b6-1471b7f1facb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.168882 Aug 23 11:48:51.865527 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3979/7903] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:51 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:52.887911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:52.888599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:52.897066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:52.897579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:52.898048 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:52.898786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:52.899268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:52.899721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:53.036692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:53.045931 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ced1d42c-4e02-49b4-a09e-9cb6b259b04c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.163544 Aug 23 11:48:53.046516 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3925/7904] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:52 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:54.067355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:54.068153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:54.075909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:54.076540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:54.077087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:54.077800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:54.078265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:54.078853 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:54.223305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:54.231915 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-354053d7-4d79-490f-84d4-ac1574e94fe1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.168616 Aug 23 11:48:54.232837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3980/7905] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:54 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:55.254904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:55.255762 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:55.263113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:55.263635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:55.264132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:55.264903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:55.265388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:55.265894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:55.414486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:55.424300 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-50d22374-22bd-4775-8bfa-3ba526b68ef2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.174075 Aug 23 11:48:55.425128 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3926/7906] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:55 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:56.447377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:56.448175 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:56.456870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:56.456870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:56.457312 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:56.458023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:56.458483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:56.458914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:56.627970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:56.640695 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3d716e8a-92ac-4981-89e0-690a48e61c26 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.197714 Aug 23 11:48:56.641414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3981/7907] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:56 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:57.663051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:57.663683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:57.665659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:57.666361 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:57.673194 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:57.673696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:57.674182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:57.674895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:57.675367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:57.675812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:57.808198 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:57.816094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4a535419-bbe1-4b24-ac0c-d442173a557a tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.156961 Aug 23 11:48:57.816686 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3927/7908] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:57 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:58.837590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:48:58.838183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:48:58.840215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:48:58.847098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:58.848357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:58.848593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:58.849372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:58.850221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:58.850360 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:59.003629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:48:59.021059 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a3964432-921c-487c-a667-ff9b5a0cd843 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.187475 Aug 23 11:48:59.022181 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3982/7909] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:48:58 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:48:59.218543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5369d63b-8bf8-4b89-b25b-85992112ec84 req-9b307a3d-134a-47e7-b996-09338f78b600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:48:59.230066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5369d63b-8bf8-4b89-b25b-85992112ec84 req-9b307a3d-134a-47e7-b996-09338f78b600 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:48:59.230683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5369d63b-8bf8-4b89-b25b-85992112ec84 req-9b307a3d-134a-47e7-b996-09338f78b600 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:48:59.231213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5369d63b-8bf8-4b89-b25b-85992112ec84 req-9b307a3d-134a-47e7-b996-09338f78b600 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:48:59.242699 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5369d63b-8bf8-4b89-b25b-85992112ec84 req-9b307a3d-134a-47e7-b996-09338f78b600 service nova] Creating event network-changed:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:48:59.248505 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5369d63b-8bf8-4b89-b25b-85992112ec84 req-9b307a3d-134a-47e7-b996-09338f78b600 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034097 Aug 23 11:48:59.249231 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3928/7910] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:49:00.042525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:00.043179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:00.050229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:00.050714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:00.051157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:00.051871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:00.052337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:00.052788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:00.189277 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:00.198652 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cf25f7d3-af10-4a27-9eeb-0f4950d6d7f7 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.160116 Aug 23 11:49:00.199279 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3983/7911] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:00 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:01.222227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:01.223344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:01.232682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:01.233365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:01.233916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:01.234724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:01.235200 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:01.235686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:01.374568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:01.382337 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cdbdb911-a639-4b48-8a03-8fc329178bd2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.165593 Aug 23 11:49:01.382911 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3929/7912] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:01 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:02.405156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:02.405967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:02.411862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:02.412381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:02.412850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:02.413555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:02.414011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:02.414435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:02.554989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:02.566415 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5ba5b2ba-a64c-4875-8f13-0a9d05c84a6c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.166759 Aug 23 11:49:02.567004 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3984/7913] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:02 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:03.588346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:03.588948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:03.595897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:03.596408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:03.596900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:03.597622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:03.598104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:03.598555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:03.733259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:03.741131 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-de8d0fbb-1174-4a2e-9dcd-e8ace7ba52b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.156915 Aug 23 11:49:03.741712 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3930/7914] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:03 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:04.762910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:04.763530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:04.770459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:04.770955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:04.771492 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:04.772195 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:04.772669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:04.773124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:04.909144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:04.917135 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38904543-8010-452f-8c66-d3ba82f6676f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.158950 Aug 23 11:49:04.917719 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3985/7915] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:04 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:05.938396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:05.939140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:05.946047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:05.947038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:05.947496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:05.948203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:05.948671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:05.949258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:06.083462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:06.092698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3b9f9116-877e-49b8-9348-28f72ab25174 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.158223 Aug 23 11:49:06.093311 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3931/7916] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:05 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:07.113405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:07.114022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:07.121817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:07.122327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:07.122782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:07.123512 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:07.123983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:07.124419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:07.256131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:07.264590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e7b145c0-7dfb-460b-a184-75f3484cffb1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.155108 Aug 23 11:49:07.265188 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3986/7917] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:07 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:07.543518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a0406272-2f3a-4da7-9211-8435ec52ca64 req-9bf59400-b4a1-4ce8-9254-c41751e66edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "name": "network-vif-plugged", "status": "completed", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:49:07.553834 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a0406272-2f3a-4da7-9211-8435ec52ca64 req-9bf59400-b4a1-4ce8-9254-c41751e66edc service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:07.554338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a0406272-2f3a-4da7-9211-8435ec52ca64 req-9bf59400-b4a1-4ce8-9254-c41751e66edc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:07.554792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a0406272-2f3a-4da7-9211-8435ec52ca64 req-9bf59400-b4a1-4ce8-9254-c41751e66edc service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:07.566748 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a0406272-2f3a-4da7-9211-8435ec52ca64 req-9bf59400-b4a1-4ce8-9254-c41751e66edc service nova] Creating event network-vif-plugged:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:49:07.572224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a0406272-2f3a-4da7-9211-8435ec52ca64 req-9bf59400-b4a1-4ce8-9254-c41751e66edc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096637 Aug 23 11:49:07.572888 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3932/7918] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:49:08.285636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:08.286209 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:08.293304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:08.293797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:08.294384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:08.295454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:08.296174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:08.296874 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:08.440521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:08.448855 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b74426db-a8d4-40e9-886e-87257d9ad692 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1358 microversion: 2.1 time: 0.167225 Aug 23 11:49:08.449420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3987/7919] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:08 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:09.471059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:09.471794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:09.479118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.479634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.480103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.480855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.481341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.481794 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.616335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:09.624706 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c58fc0b8-d1ad-48b1-b28a-c092e6e58bae tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1548 microversion: 2.1 time: 0.157967 Aug 23 11:49:09.625328 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3933/7920] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:09 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:09.645156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:09.645765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:09.652608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.653135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.653569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.654260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.654715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.655140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.799375 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:09.807927 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a06bfc9f-3f7e-4f58-87cf-f886a290ea2e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1548 microversion: 2.1 time: 0.166588 Aug 23 11:49:09.808510 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3988/7921] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:09 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:09.827560 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:09.832385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:09.833373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Searching by: {'deleted': False, 'project_id': '4c6b5b4106f84220a5bb278de6287766'} {{(pid=128860) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 11:49:09.839398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.839905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.840360 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.841146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.841660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.842105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.871916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.multi_cell_list [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 11:49:09.898967 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c0f230b2-bcc8-408c-a9f3-dde11a90e946 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075309 Aug 23 11:49:09.900175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3934/7922] 10.222.0.78 () {58 vars in 1125 bytes} [Tue Aug 23 11:49:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:49:09.910862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:09.911508 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:09.918536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.919025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.919466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:09.920161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:09.920627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:09.921088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:10.062501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:10.070317 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ceb8ec40-745a-4f88-acd9-5f07b623f0d3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1548 microversion: 2.1 time: 0.163353 Aug 23 11:49:10.070896 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3989/7923] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:09 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:11.577452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:49:11.579839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:11.587438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:11.588075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:11.588528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:11.589262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:11.589735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:11.590174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:11.851561 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1ad36eb1-4bae-46e5-b77b-ecce1023f85f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277905 Aug 23 11:49:11.852369 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3935/7924] 10.222.0.78 () {60 vars in 1323 bytes} [Tue Aug 23 11:49:11 2022] POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:49:22.607594 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:22.608210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:22.611463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=21 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:49:22.612157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=72 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:49:22.619218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:22.619750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:22.620322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:22.621403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:22.621922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:22.622343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:22.757748 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:22.766616 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-116d2b3c-592a-4137-af73-97a0e0697177 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1594 microversion: 2.1 time: 0.162861 Aug 23 11:49:22.767191 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3990/7925] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:22 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:49:24.366851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:49:24.367654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:49:24.369688 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:49:24.374466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-da7c8b72-5cf7-4e37-bfab-e11be5637059 req-83f0ec8c-2aa9-4c4e-96d0-ae321d1d5353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:49:24.386952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-da7c8b72-5cf7-4e37-bfab-e11be5637059 req-83f0ec8c-2aa9-4c4e-96d0-ae321d1d5353 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:24.387457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-da7c8b72-5cf7-4e37-bfab-e11be5637059 req-83f0ec8c-2aa9-4c4e-96d0-ae321d1d5353 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:24.388206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-da7c8b72-5cf7-4e37-bfab-e11be5637059 req-83f0ec8c-2aa9-4c4e-96d0-ae321d1d5353 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:24.401833 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-da7c8b72-5cf7-4e37-bfab-e11be5637059 req-83f0ec8c-2aa9-4c4e-96d0-ae321d1d5353 service nova] Creating event network-changed:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:49:24.408495 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-da7c8b72-5cf7-4e37-bfab-e11be5637059 req-83f0ec8c-2aa9-4c4e-96d0-ae321d1d5353 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043472 Aug 23 11:49:24.409150 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3936/7926] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:49:25.405330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1259077674"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:49:25.405885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:25.413600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:25.414095 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:25.414542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:25.416021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:25.416482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:25.416956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:25.552683 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.network.security_group_api [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Adding security group 32e64568-08be-4733-ae08-2416f6c9bbd8 to port c5626a34-a399-4dd5-a195-9d5f33df7ffa Aug 23 11:49:25.863927 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-094c96ab-67f0-4e02-b36d-8a3e3991dffb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/action" status: 202 len: 0 microversion: 2.1 time: 0.462653 Aug 23 11:49:25.864551 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3991/7927] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:49:25 2022] POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:49:25.874523 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:49:25.875258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:49:25.884064 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:25.884592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:25.885080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:25.885820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:25.886347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:25.886992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:25.902273 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-27053994-cba3-4eb9-9a15-207b2fef4237 req-08edf28b-599b-4d8e-851d-b6b3acc467d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:49:25.923141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27053994-cba3-4eb9-9a15-207b2fef4237 req-08edf28b-599b-4d8e-851d-b6b3acc467d2 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:49:25.923631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27053994-cba3-4eb9-9a15-207b2fef4237 req-08edf28b-599b-4d8e-851d-b6b3acc467d2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:49:25.924070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27053994-cba3-4eb9-9a15-207b2fef4237 req-08edf28b-599b-4d8e-851d-b6b3acc467d2 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:49:25.936956 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-27053994-cba3-4eb9-9a15-207b2fef4237 req-08edf28b-599b-4d8e-851d-b6b3acc467d2 service nova] Creating event network-changed:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:49:25.942277 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-27053994-cba3-4eb9-9a15-207b2fef4237 req-08edf28b-599b-4d8e-851d-b6b3acc467d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044205 Aug 23 11:49:25.943162 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3992/7928] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:49:26.125352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:49:26.136687 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9813e0a2-337e-4557-9c8b-bb6e929e143b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1760 microversion: 2.1 time: 0.267276 Aug 23 11:49:26.148761 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3937/7929] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:49:25 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1760 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:50:23.851263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:50:23.852064 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:50:23.908326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:50:23.910780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:23.916989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:23.918238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:23.918689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:23.919379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:23.919857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:23.920285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:23.994353 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8f64ff3e-6b16-403f-80b0-8b48d7f3fcd3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/action" status: 202 len: 0 microversion: 2.1 time: 0.144958 Aug 23 11:50:23.995039 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3993/7930] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:50:23 2022] POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:50:24.003837 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:24.004625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:24.007142 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:50:24.008417 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:50:24.014713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:24.015277 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:24.015736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:24.016464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:24.016961 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:24.017406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:24.308495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:24.317047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f724156d-9689-4629-8471-2100391454bb tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1752 microversion: 2.1 time: 0.317044 Aug 23 11:50:24.317621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3938/7931] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:23 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1752 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:25.340955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:25.341669 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:25.348501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:25.349151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:25.349690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:25.350404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:25.350873 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:25.351308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:25.501680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:25.509900 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-18cf72fa-8f4c-4805-9776-1def6158e235 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.174266 Aug 23 11:50:25.510469 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3994/7932] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:25 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:26.532764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:26.533405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:26.540466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:26.541015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:26.541474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:26.542292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:26.543371 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:26.543845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:26.709854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:26.718408 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f237c83-95ad-4c5d-993e-221528cc60e1 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.189662 Aug 23 11:50:26.718983 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3939/7933] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:26 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:27.739654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:27.740408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:27.748320 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:27.748828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:27.749269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:27.749961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:27.750416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:27.750842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:27.939168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:27.947441 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e123dd83-66f5-4099-b45f-9ad6206c62e9 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.211846 Aug 23 11:50:27.948019 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3995/7934] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:27 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:28.969192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:28.969839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:28.976801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:28.977316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:28.977778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:28.978503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:28.979016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:28.979465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:29.134153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:29.143129 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-393a2491-40ba-40f2-9922-1990b1803d85 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.177926 Aug 23 11:50:29.143700 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3940/7935] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:28 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:30.165154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:30.165787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:30.173549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:30.174043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:30.174496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:30.175203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:30.175671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:30.176143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:30.327394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:30.336067 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6a7235e7-2da2-4179-96db-c93ecc007793 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.175243 Aug 23 11:50:30.336655 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3996/7936] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:30 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:31.359264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:31.359897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:31.366798 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:31.367295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:31.367749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:31.368454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:31.368956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:31.369397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:31.512414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:31.521141 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bdf9362e-9a86-4134-bded-93782a7d51a6 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.166457 Aug 23 11:50:31.521721 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3941/7937] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:31 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:32.543253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:32.543895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:32.550742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:32.551226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:32.551657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:32.552343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:32.552826 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:32.553249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:32.695806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:32.704473 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dcff7419-0325-4847-86f4-b853d015824f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.165785 Aug 23 11:50:32.705102 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3997/7938] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:32 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:33.727036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:33.727683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:33.735437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:33.735971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:33.736435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:33.737187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:33.737804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:33.738257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:33.883874 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:33.892976 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5029861d-38ba-4830-be7d-f44d87f6300f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.169901 Aug 23 11:50:33.893546 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3942/7939] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:33 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:50:34.914240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:34.914861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:34.922696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:34.923190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:34.923639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:34.924345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:34.924850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:34.925290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:35.069797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:35.078232 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e73ba70f-20f1-405d-a528-b1dda58f12ba tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1757 microversion: 2.1 time: 0.167950 Aug 23 11:50:35.078812 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3998/7940] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:34 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:50:36.099066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:50:36.099714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:50:36.106892 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:36.107398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:36.107862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:36.108583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:50:36.109094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:50:36.109546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:50:36.252775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:50:36.261225 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-f8821937-6eef-4568-959d-f6925c1f6231 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1760 microversion: 2.1 time: 0.166195 Aug 23 11:50:36.261804 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3943/7941] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:50:36 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:51:39.578377 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:51:39.579289 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 11:51:39.580365 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=12 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:51:39.581160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:51:39.585656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1259077674"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:51:39.586190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:39.593494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:39.593978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:39.594411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:39.595097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:39.595549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:39.595970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:39.728572 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.network.security_group_api [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Removing security group 32e64568-08be-4733-ae08-2416f6c9bbd8 from port c5626a34-a399-4dd5-a195-9d5f33df7ffa Aug 23 11:51:40.038362 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0bad6eff-fbbb-4b82-808d-90f773bbff93 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/action" status: 202 len: 0 microversion: 2.1 time: 0.462107 Aug 23 11:51:40.038999 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 3999/7942] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:51:39 2022] POST /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:51:40.049439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b36fafde-0be6-4521-938d-b458eb195311 req-2efcf3ab-3740-4661-8d5f-1872b8aa0a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:51:40.058930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:51:40.059739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=36 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:51:40.062030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b36fafde-0be6-4521-938d-b458eb195311 req-2efcf3ab-3740-4661-8d5f-1872b8aa0a7c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:40.062660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b36fafde-0be6-4521-938d-b458eb195311 req-2efcf3ab-3740-4661-8d5f-1872b8aa0a7c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:40.063379 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b36fafde-0be6-4521-938d-b458eb195311 req-2efcf3ab-3740-4661-8d5f-1872b8aa0a7c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:40.076839 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b36fafde-0be6-4521-938d-b458eb195311 req-2efcf3ab-3740-4661-8d5f-1872b8aa0a7c service nova] Creating event network-changed:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:51:40.083334 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b36fafde-0be6-4521-938d-b458eb195311 req-2efcf3ab-3740-4661-8d5f-1872b8aa0a7c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040396 Aug 23 11:51:40.086358 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3944/7943] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:51:41.148940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:41.149502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:41.159720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:41.160287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:41.160814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:41.161598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:41.162123 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:41.162613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:41.166630 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46364. Aug 23 11:51:41.167409 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46366. Aug 23 11:51:41.248646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lazy-loading 'services' on Instance uuid 97173e80-9e8f-4b5d-aba7-6902e5672b50 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:51:41.325145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d71fa002-06d0-4cdc-af62-3bd768ef7fb2 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments/f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a" status: 202 len: 0 microversion: 2.1 time: 0.181356 Aug 23 11:51:41.325788 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4000/7944] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:51:41 2022] DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments/f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:51:41.335968 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:41.338713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:41.348458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:41.349335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:41.349997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:41.351431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:41.352427 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:41.353211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:41.397635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-95994350-b553-4459-8f2f-f69a36fbec39 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066039 Aug 23 11:51:41.398230 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3945/7945] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:51:41 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:51:42.104078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d4d4ae7b-2976-4c76-9a89-b779d9d70397 req-6f4777ca-66e3-4cf0-9cda-b1228d4d17f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:51:42.116022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4d4ae7b-2976-4c76-9a89-b779d9d70397 req-6f4777ca-66e3-4cf0-9cda-b1228d4d17f4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:42.116420 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4d4ae7b-2976-4c76-9a89-b779d9d70397 req-6f4777ca-66e3-4cf0-9cda-b1228d4d17f4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:42.116923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d4d4ae7b-2976-4c76-9a89-b779d9d70397 req-6f4777ca-66e3-4cf0-9cda-b1228d4d17f4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:42.130323 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d4d4ae7b-2976-4c76-9a89-b779d9d70397 req-6f4777ca-66e3-4cf0-9cda-b1228d4d17f4 service nova] Creating event network-changed:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:51:42.135218 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d4d4ae7b-2976-4c76-9a89-b779d9d70397 req-6f4777ca-66e3-4cf0-9cda-b1228d4d17f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Aug 23 11:51:42.135857 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4001/7946] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:51:42.410649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:42.413050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:42.420213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:42.421454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:42.422100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:42.422925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:42.423475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:42.424104 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:42.458282 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-96b41441-04d9-4a1b-b636-2da2e52b8654 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051689 Aug 23 11:51:42.458779 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3946/7947] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:51:42 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:51:43.472718 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:43.475636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:43.482763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:43.483265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:43.484240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:43.484991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:43.485456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:43.486042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:43.519275 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7d171fda-a896-4c8a-9004-d9d62a90740e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052360 Aug 23 11:51:43.519882 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4002/7948] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:51:43 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:51:44.531804 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:44.534298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:44.541264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:44.541764 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:44.542218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:44.542934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:44.543404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:44.543848 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:44.577422 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-794286ae-f8b2-42c3-894b-bbe72edec22f tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049488 Aug 23 11:51:44.578683 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3947/7949] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:51:44 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:51:45.591005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:45.593402 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:45.600183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:45.600662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:45.601131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:45.601827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:45.602287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:45.602714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:45.635944 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11e685ad-7d1c-47a2-9907-2236d14a3c45 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048813 Aug 23 11:51:45.636434 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4003/7950] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:51:45 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:51:46.648111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:46.650362 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:46.657706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:46.658209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:46.658668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:46.659378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:46.659851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:46.660296 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:46.689172 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-885b978f-2f7f-4094-ab40-f2c79dd033bf tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045098 Aug 23 11:51:46.689740 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3948/7951] 10.222.0.78 () {58 vars in 1302 bytes} [Tue Aug 23 11:51:46 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 11:51:46.700850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:46.701340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:46.708386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:46.708903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:46.709345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:46.710038 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:46.710540 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:46.710950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:46.786476 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] HTTP exception thrown: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 is not attached to volume f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Request method failure captured: Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: request: DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments/f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a HTTP/1.1 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL2j7WBIQHGyEue8KJrkCkCf2ZbEepmnL8xGJpqa8q6HQF62UdlwKjg-ucncwfZbe8x4kkjT5RL-ftVC0R9kVqf6uJPQVzkNB2C-OV166kKjKmFcrb6Tb24e4mMZWj7ZBhu5vA8F81GHfBKvQKPC75mCYbiHzyvDSSEI7GTphbj4kEA Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c6b5b4106f84220a5bb278de6287766", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}] Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: baf580571f7b48fb9aedcc0320054ad2 Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 is not attached to volume f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'server_id': '97173e80-9e8f-4b5d-aba7-6902e5672b50', 'id': 'f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a'} Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a. Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 is not attached to volume f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:51:46.788099 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 is not attached to volume f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Returning 404 to user: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 is not attached to volume f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5856378c-5e4f-4df8-bfae-6d91e5348605 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments/f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a" status: 404 len: 154 microversion: 2.1 time: 0.092831 Aug 23 11:51:46.792532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4004/7952] 10.222.0.78 () {58 vars in 1416 bytes} [Tue Aug 23 11:51:46 2022] DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50/os-volume_attachments/f8c5a0a8-9fab-4c57-92a3-08d7a1f3fe0a => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:51:47.373110 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:51:47.373268 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:51:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:51:47.432472 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:51:47.432679 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 11:51:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:51:48.815460 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:51:48.816001 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:51:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:51:48.899551 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 11:51:48.899811 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 11:51:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 11:51:50.037753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:50.038250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:50.046233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:50.047059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:50.047525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:50.048247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:50.048727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:50.049219 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:50.074133 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:51:50.161321 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b572274-5bc2-40f2-9d5e-c967cdbc5f1b tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 204 len: 0 microversion: 2.1 time: 0.126930 Aug 23 11:51:50.162134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3949/7953] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:51:50 2022] DELETE /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:51:50.171274 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:50.171848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:50.179724 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:50.180207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:50.180642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:50.181385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:50.181842 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:50.182270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:50.323809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:51:50.332149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da8b3c67-edb5-41a0-a446-1fddbe7b640e tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1554 microversion: 2.1 time: 0.165660 Aug 23 11:51:50.332721 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4005/7954] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:51:50 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:51:51.356957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:51.358138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:51.367866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:51.368414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:51.368956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:51.369735 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:51.370525 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:51.371160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:51.522187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:51:51.530208 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a04bcfd-7008-4cd3-b531-a78cf9fe881c tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1554 microversion: 2.1 time: 0.180398 Aug 23 11:51:51.530833 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3950/7955] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:51:51 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:51:52.552453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:52.553206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:52.560002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:52.560498 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:52.560971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:52.562372 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:52.562849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:52.563286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:52.583269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ea6b60f2-e8f6-49ca-bef5-d540ffcb2bcb req-a2f85054-7895-48ff-88ab-d2ce6c0ffcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97173e80-9e8f-4b5d-aba7-6902e5672b50", "name": "network-vif-deleted", "tag": "c5626a34-a399-4dd5-a195-9d5f33df7ffa"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:51:52.594245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ea6b60f2-e8f6-49ca-bef5-d540ffcb2bcb req-a2f85054-7895-48ff-88ab-d2ce6c0ffcd9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:52.594744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ea6b60f2-e8f6-49ca-bef5-d540ffcb2bcb req-a2f85054-7895-48ff-88ab-d2ce6c0ffcd9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:52.595228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ea6b60f2-e8f6-49ca-bef5-d540ffcb2bcb req-a2f85054-7895-48ff-88ab-d2ce6c0ffcd9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:52.610360 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ea6b60f2-e8f6-49ca-bef5-d540ffcb2bcb req-a2f85054-7895-48ff-88ab-d2ce6c0ffcd9 service nova] Creating event network-vif-deleted:c5626a34-a399-4dd5-a195-9d5f33df7ffa for instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 on n-h1-847009-13 Aug 23 11:51:52.616238 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ea6b60f2-e8f6-49ca-bef5-d540ffcb2bcb req-a2f85054-7895-48ff-88ab-d2ce6c0ffcd9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037498 Aug 23 11:51:52.616905 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3951/7956] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:51:52.632369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf580571f7b48fb9aedcc0320054ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c6b5b4106f84220a5bb278de6287766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:51:52.640791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f9c803ae-c1e1-408c-a1f5-ade0415ed497 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 200 len: 1512 microversion: 2.1 time: 0.092056 Aug 23 11:51:52.641386 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4006/7957] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:51:52 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 1512 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:51:53.664456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:53.665148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] [instance: 97173e80-9e8f-4b5d-aba7-6902e5672b50] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:51:53.671437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:53.671996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:53.672398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:53.673148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:51:53.673632 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:51:53.674085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:51:53.687985 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] HTTP exception thrown: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 could not be found. Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Request method failure captured: Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 HTTP/1.1 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBL2j7WBIQHGyEue8KJrkCkCf2ZbEepmnL8xGJpqa8q6HQF62UdlwKjg-ucncwfZbe8x4kkjT5RL-ftVC0R9kVqf6uJPQVzkNB2C-OV166kKjKmFcrb6Tb24e4mMZWj7ZBhu5vA8F81GHfBKvQKPC75mCYbiHzyvDSSEI7GTphbj4kEA Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4c6b5b4106f84220a5bb278de6287766", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4c6b5b4106f84220a5bb278de6287766"}]}] Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 4c6b5b4106f84220a5bb278de6287766 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1962549160 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: baf580571f7b48fb9aedcc0320054ad2 Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestMinimumBasicScenario-1962549160-project Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 could not be found. Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '97173e80-9e8f-4b5d-aba7-6902e5672b50'} Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 could not be found. Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 could not be found. Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:51:53.689739 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 could not be found. Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Returning 404 to user: Instance 97173e80-9e8f-4b5d-aba7-6902e5672b50 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0c46e581-4e6e-4fe7-b2ce-6cf9d45ecf19 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50" status: 404 len: 111 microversion: 2.1 time: 0.031995 Aug 23 11:51:53.694113 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3952/7958] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:51:53 2022] GET /compute/v2.1/servers/97173e80-9e8f-4b5d-aba7-6902e5672b50 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:51:53.699890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ef35b70d-5133-4404-bb97-bc427214d2b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] Calling method '.version_select at 0x7fdc9cbb9940>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:51:53.724705 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ef35b70d-5133-4404-bb97-bc427214d2b3 tempest-TestMinimumBasicScenario-1962549160 tempest-TestMinimumBasicScenario-1962549160-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-449893135" status: 202 len: 0 microversion: 2.1 time: 0.028590 Aug 23 11:51:53.725340 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4007/7959] 10.222.0.78 () {58 vars in 1269 bytes} [Tue Aug 23 11:51:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-449893135 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:52:03.035061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-825ed44b-5762-4584-80a5-d8319f89b598 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: .version_select at 0x7fdc9d0c21f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-929843796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwUs+YhfhSUlOEp6ufmKzZRCizwJoDXrlrChgcDENS+bB4UEhbsb2RdLP99FE5PLDhb2CvyVA3mrnHkxl8dXvqVn8JiFp2ENqyI0RDnqqFKLVQB++/ndjVklR3c30Lgzw=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:03.051890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-825ed44b-5762-4584-80a5-d8319f89b598 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:52:03.057066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-825ed44b-5762-4584-80a5-d8319f89b598 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:52:03.086396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-825ed44b-5762-4584-80a5-d8319f89b598 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.230767 Aug 23 11:52:03.086945 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3953/7960] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:52:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:52:09.246349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:09.249905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:09.255707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1376939603", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "91590a56-2ddc-4ade-b240-75d8b62e39ab"}], "key_name": "tempest-TestNetworkAdvancedServerOps-929843796", "security_groups": [{"name": "tempest-secgroup-smoke-1685821153"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:09.416142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] validate_networks() for [('91590a56-2ddc-4ade-b240-75d8b62e39ab', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:52:10.039861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:52:10.040293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:52:10.040801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:52:10.041215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:52:10.041917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:52:10.054089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:10.055115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:10.055870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:10.056776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:10.057224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:10.057897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:10.078040 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:52:10.083713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:52:10.103690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:52:10.106124 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:52:10.154621 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8a42f4a5-17a3-49fd-837c-21a970a23c35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.910454 Aug 23 11:52:10.156166 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4008/7961] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:52:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:52:10.166679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7630e401-c8c3-42aa-a31a-1c4fe6b79390 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:10.167315 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7630e401-c8c3-42aa-a31a-1c4fe6b79390 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:10.170683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:10.256049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7630e401-c8c3-42aa-a31a-1c4fe6b79390 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:10.264315 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7630e401-c8c3-42aa-a31a-1c4fe6b79390 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1266 microversion: 2.1 time: 0.101445 Aug 23 11:52:10.264974 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3954/7962] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:10 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:11.286473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:11.287230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:11.294511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:11.295039 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:11.295493 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:11.296542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:11.297188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:11.297642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:11.367318 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:11.377681 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28b1eb9d-4aac-4fec-a3d0-f724ff0bc15a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1318 microversion: 2.1 time: 0.096725 Aug 23 11:52:11.388806 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4009/7963] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:11 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:12.402079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:12.402721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:12.408178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:12.413948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:12.414669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:12.415327 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:12.416228 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:12.416886 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:12.417222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:12.596042 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:12.604289 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b2fd0e12-38d8-435c-9732-3dc27f5cd481 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.206196 Aug 23 11:52:12.606548 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3955/7964] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:12 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:13.246714 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a909aeba-cd2c-43a1-9a9f-feac78c16841 req-d1229c77-37f3-484b-9898-09ba182a8475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba831d1-f851-4fb3-b7dd-ad70209818af", "tag": "e56044f6-392c-4dcd-9c83-f1d38096c181"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:13.258204 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a909aeba-cd2c-43a1-9a9f-feac78c16841 req-d1229c77-37f3-484b-9898-09ba182a8475 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:13.258696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a909aeba-cd2c-43a1-9a9f-feac78c16841 req-d1229c77-37f3-484b-9898-09ba182a8475 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:13.259263 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a909aeba-cd2c-43a1-9a9f-feac78c16841 req-d1229c77-37f3-484b-9898-09ba182a8475 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:13.271720 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a909aeba-cd2c-43a1-9a9f-feac78c16841 req-d1229c77-37f3-484b-9898-09ba182a8475 service nova] Creating event network-changed:e56044f6-392c-4dcd-9c83-f1d38096c181 for instance 8ba831d1-f851-4fb3-b7dd-ad70209818af on n-h2-847009-13 Aug 23 11:52:13.276616 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a909aeba-cd2c-43a1-9a9f-feac78c16841 req-d1229c77-37f3-484b-9898-09ba182a8475 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033700 Aug 23 11:52:13.277252 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4010/7965] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:52:13.625908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:13.626636 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:13.633553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:13.634057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:13.634503 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:13.635213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:13.635686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:13.636159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:13.775347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:13.783877 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d7678f8-eb87-4a10-ab8d-3a38bd706581 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.162015 Aug 23 11:52:13.784465 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3956/7966] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:13 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:14.806112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:14.806843 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:14.814009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:14.814511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:14.814959 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:14.815683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:14.816152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:14.816587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:15.100984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:15.109251 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-40a98872-74b4-4cc6-b6d6-f48389d3c068 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.308392 Aug 23 11:52:15.109859 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4011/7967] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:14 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:16.130319 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:16.130962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:16.137852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:16.138367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:16.138823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:16.139675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:16.140166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:16.140621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:16.277535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:16.285918 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23d052ad-30c0-456d-bff7-39ef76b9acb0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.159575 Aug 23 11:52:16.286493 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3957/7968] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:16 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:17.307084 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:17.307705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:17.315156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:17.315649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:17.316087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:17.316823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:17.317286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:17.317716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:17.450934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:17.459619 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-490a3a82-aaaf-45a1-909b-71d044828ef9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.156488 Aug 23 11:52:17.460196 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4012/7969] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:17 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:18.480358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:18.481034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:18.489193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:18.489700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:18.490158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:18.490872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:18.491381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:18.491824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:18.626820 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:18.634994 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eff3d0b1-2438-4d41-8364-a16a4e2c218c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.158615 Aug 23 11:52:18.635823 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3958/7970] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:18 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:18.827023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-02e6881b-15c2-444f-aeb8-f1698e9cb2f8 req-233dcb5c-4169-46c0-b99d-3f4cd90148ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba831d1-f851-4fb3-b7dd-ad70209818af", "name": "network-vif-plugged", "status": "completed", "tag": "e56044f6-392c-4dcd-9c83-f1d38096c181"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:18.838509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-02e6881b-15c2-444f-aeb8-f1698e9cb2f8 req-233dcb5c-4169-46c0-b99d-3f4cd90148ad service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:18.839014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-02e6881b-15c2-444f-aeb8-f1698e9cb2f8 req-233dcb5c-4169-46c0-b99d-3f4cd90148ad service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:18.839454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-02e6881b-15c2-444f-aeb8-f1698e9cb2f8 req-233dcb5c-4169-46c0-b99d-3f4cd90148ad service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:18.850782 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-02e6881b-15c2-444f-aeb8-f1698e9cb2f8 req-233dcb5c-4169-46c0-b99d-3f4cd90148ad service nova] Creating event network-vif-plugged:e56044f6-392c-4dcd-9c83-f1d38096c181 for instance 8ba831d1-f851-4fb3-b7dd-ad70209818af on n-h2-847009-13 Aug 23 11:52:18.855819 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-02e6881b-15c2-444f-aeb8-f1698e9cb2f8 req-233dcb5c-4169-46c0-b99d-3f4cd90148ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Aug 23 11:52:18.856422 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4013/7971] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:52:19.656481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:19.657080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:19.663948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:19.664462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:19.664965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:19.665687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:19.666167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:19.666615 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:19.801557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:19.809442 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e98f429-d55f-42d3-98bb-35ca44bf3981 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1392 microversion: 2.1 time: 0.157137 Aug 23 11:52:19.810022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3959/7972] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:19 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:20.829446 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:20.830293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:20.834693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:20.835439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:20.842587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:20.843076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:20.843521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:20.844222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:20.844688 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:20.845156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:20.978434 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:20.986872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3bf7dab4-671d-4d7a-90a4-5b7d61651be6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1563 microversion: 2.1 time: 0.160206 Aug 23 11:52:20.987450 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4014/7973] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:20 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:21.007102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:21.007750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:21.009710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:21.016530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:21.017081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:21.017546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:21.018275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:21.018757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:21.019210 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:21.151937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:21.159840 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7538462a-ec98-41bd-b6dc-d152add0732f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1563 microversion: 2.1 time: 0.156643 Aug 23 11:52:21.160408 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3960/7974] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:21 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:22.766573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:22.767956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:22.769738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0bc09b88-b361-4859-b6aa-7824c43ac079 req-7ae8925f-3d40-488f-a313-5558e2ae5aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba831d1-f851-4fb3-b7dd-ad70209818af", "tag": "e56044f6-392c-4dcd-9c83-f1d38096c181"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:22.776860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:22.777454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:22.777965 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:22.778743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:22.779266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:22.780830 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:22.783263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0bc09b88-b361-4859-b6aa-7824c43ac079 req-7ae8925f-3d40-488f-a313-5558e2ae5aa9 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:22.783777 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0bc09b88-b361-4859-b6aa-7824c43ac079 req-7ae8925f-3d40-488f-a313-5558e2ae5aa9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:22.784238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0bc09b88-b361-4859-b6aa-7824c43ac079 req-7ae8925f-3d40-488f-a313-5558e2ae5aa9 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:22.796774 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0bc09b88-b361-4859-b6aa-7824c43ac079 req-7ae8925f-3d40-488f-a313-5558e2ae5aa9 service nova] Creating event network-changed:e56044f6-392c-4dcd-9c83-f1d38096c181 for instance 8ba831d1-f851-4fb3-b7dd-ad70209818af on n-h2-847009-13 Aug 23 11:52:22.802187 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0bc09b88-b361-4859-b6aa-7824c43ac079 req-7ae8925f-3d40-488f-a313-5558e2ae5aa9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037611 Aug 23 11:52:22.803064 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3961/7975] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:52:22.992743 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:23.002371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-eb5ed23b-2d16-4b7f-84a5-ea2d23e03e4f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1563 microversion: 2.1 time: 0.240158 Aug 23 11:52:23.003092 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4015/7976] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:22 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1563 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:46.247909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=13 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:46.248772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=38 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:46.254844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:46.257178 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:46.264192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:46.264701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:46.265299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:46.266921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:46.267612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:46.268065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:46.339925 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cb238af2-3edf-4f8b-88a4-a3e8335b542b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action" status: 200 len: 24558 microversion: 2.1 time: 0.094712 Aug 23 11:52:46.340730 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3962/7977] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:52:46 2022] POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action => generated 24558 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:52:52.768996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:52.769534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:52.771790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:52.772458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=36 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:52:52.778116 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:52.778607 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:52.779050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:52.779754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:52.780219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:52.780651 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:52.849947 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-acc10a6f-6995-4220-b9a9-0613abb860a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action" status: 202 len: 0 microversion: 2.1 time: 0.085467 Aug 23 11:52:52.850591 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4016/7978] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:52:52 2022] POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:52:52.860925 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:52.862169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:52.871266 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:52.871789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:52.872445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:52.873226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:52.873720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:52.874175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:53.024395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:53.032348 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-98173a7e-d3b6-4359-aa0f-9969f796e863 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1687 microversion: 2.1 time: 0.176467 Aug 23 11:52:53.033119 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3963/7979] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:52 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:54.056400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:54.057136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:54.063470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:54.063987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:54.064988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:54.065692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:54.066156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:54.066591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:54.204388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:54.212827 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8676561e-66a0-469f-b7a9-5cc85e11e59c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1667 microversion: 2.1 time: 0.161754 Aug 23 11:52:54.213463 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4017/7980] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:54 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:55.309836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:55.312032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:55.320723 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:55.321258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:55.321718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:55.322432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:55.322910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:55.323355 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:55.389284 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8afe0d2a-1331-4d85-bb1c-21f1e7fd3dcc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action" status: 200 len: 32633 microversion: 2.1 time: 0.083317 Aug 23 11:52:55.390954 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3964/7981] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:52:55 2022] POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action => generated 32633 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:52:55.402083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:55.402619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:55.409879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:55.410374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:55.410848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:55.411585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:55.412050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:55.412480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:55.476960 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2c41e711-c833-4b1b-a270-f1483273f0c2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action" status: 202 len: 0 microversion: 2.1 time: 0.078477 Aug 23 11:52:55.477666 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4018/7982] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:52:55 2022] POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 11:52:55.487239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:55.487987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:55.495736 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:55.496323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:55.496850 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:55.497570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:55.498045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:55.498487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:55.633635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:55.641635 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2cae08a9-11ce-485a-ba17-4336ab63aaa0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1674 microversion: 2.1 time: 0.159269 Aug 23 11:52:55.642101 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3965/7983] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:55 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:56.665630 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:56.666352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:56.672823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:56.673329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:56.673778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:56.675078 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:56.675545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:56.675982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:56.809005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:56.817193 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd723b9c-a7a4-4d60-b504-481f82ab7240 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1682 microversion: 2.1 time: 0.157120 Aug 23 11:52:56.817762 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4019/7984] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:56 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:56.915877 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:56.918358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:56.927126 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:56.927625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:56.928079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:56.929071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:56.929550 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:56.930009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:57.003152 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-835d3848-0271-4d19-8b25-ec2c3f3825bc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action" status: 200 len: 35794 microversion: 2.1 time: 0.090707 Aug 23 11:52:57.003809 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3966/7985] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:52:56 2022] POST /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af/action => generated 35794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:52:58.024322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:58.024954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:58.027551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-11c84efd-f02a-4234-a506-798f6fb71879 req-26f15ab6-0643-4a19-a2ea-9179db0c6bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba831d1-f851-4fb3-b7dd-ad70209818af", "tag": "e56044f6-392c-4dcd-9c83-f1d38096c181"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:52:58.031729 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:58.032456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:58.032937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:58.034197 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:58.034882 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:58.035313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:58.039984 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-11c84efd-f02a-4234-a506-798f6fb71879 req-26f15ab6-0643-4a19-a2ea-9179db0c6bf4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:58.040555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-11c84efd-f02a-4234-a506-798f6fb71879 req-26f15ab6-0643-4a19-a2ea-9179db0c6bf4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:58.041988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-11c84efd-f02a-4234-a506-798f6fb71879 req-26f15ab6-0643-4a19-a2ea-9179db0c6bf4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:58.055646 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-11c84efd-f02a-4234-a506-798f6fb71879 req-26f15ab6-0643-4a19-a2ea-9179db0c6bf4 service nova] Creating event network-changed:e56044f6-392c-4dcd-9c83-f1d38096c181 for instance 8ba831d1-f851-4fb3-b7dd-ad70209818af on n-h2-847009-13 Aug 23 11:52:58.061532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-11c84efd-f02a-4234-a506-798f6fb71879 req-26f15ab6-0643-4a19-a2ea-9179db0c6bf4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038214 Aug 23 11:52:58.062686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:52:58.063035 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3967/7986] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:52:58.153902 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9df8ab2d-fb9e-4584-ab54-32e934e81e33 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 204 len: 0 microversion: 2.1 time: 0.132985 Aug 23 11:52:58.154381 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4020/7987] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:52:58 2022] DELETE /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:52:58.170609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:58.174781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:58.181951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:58.182541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:58.183083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:58.183872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:58.184418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:58.185087 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:58.324578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:58.334396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f567450-1100-49ad-ba99-8eefc2a86bed tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1688 microversion: 2.1 time: 0.174681 Aug 23 11:52:58.334994 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3968/7988] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:58 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:52:59.357245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:52:59.357868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:52:59.369427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:59.370336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:59.371043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:59.371777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:52:59.372246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:52:59.372674 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:52:59.543689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:52:59.553065 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f5145767-c510-436b-8dbd-dd82d0839c8f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1688 microversion: 2.1 time: 0.200113 Aug 23 11:52:59.554213 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4021/7989] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:52:59 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1688 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:00.576124 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:00.576708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:00.584437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:00.584975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:00.585430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:00.586155 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:00.586626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:00.587085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:00.852092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:00.861151 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-916ae665-19ad-4ac4-8e04-61ed87e74799 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 200 len: 1501 microversion: 2.1 time: 0.289147 Aug 23 11:53:00.861800 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3969/7990] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:00 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 1501 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:00.886991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-81249c8b-f698-4721-bca8-e15c025d950a req-adb506bc-fe2a-4464-87cd-6f0cbe5a3478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba831d1-f851-4fb3-b7dd-ad70209818af", "name": "network-vif-deleted", "tag": "e56044f6-392c-4dcd-9c83-f1d38096c181"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:00.898330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-81249c8b-f698-4721-bca8-e15c025d950a req-adb506bc-fe2a-4464-87cd-6f0cbe5a3478 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:00.898819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-81249c8b-f698-4721-bca8-e15c025d950a req-adb506bc-fe2a-4464-87cd-6f0cbe5a3478 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:00.899259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-81249c8b-f698-4721-bca8-e15c025d950a req-adb506bc-fe2a-4464-87cd-6f0cbe5a3478 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:00.911221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-81249c8b-f698-4721-bca8-e15c025d950a req-adb506bc-fe2a-4464-87cd-6f0cbe5a3478 service nova] Creating event network-vif-deleted:e56044f6-392c-4dcd-9c83-f1d38096c181 for instance 8ba831d1-f851-4fb3-b7dd-ad70209818af on n-h2-847009-13 Aug 23 11:53:00.916497 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-81249c8b-f698-4721-bca8-e15c025d950a req-adb506bc-fe2a-4464-87cd-6f0cbe5a3478 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 Aug 23 11:53:00.917280 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4022/7991] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:53:01.882348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:01.883001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 8ba831d1-f851-4fb3-b7dd-ad70209818af] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:01.889867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:01.890372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:01.890832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:01.891541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:01.892019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:01.892467 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:01.906053 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] HTTP exception thrown: Instance 8ba831d1-f851-4fb3-b7dd-ad70209818af could not be found. Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Request method failure captured: Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af HTTP/1.1 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBL9i98IsNBLME7tC3kD4X5woB81wSQj03hv9tZ8czsC0mq2JLCQz1IU_DZlej4pWXYSLBjWiFbpiczh6KSR-eePhfg22uGnUgHwMPsv4qOH9IiuXCgORcHn4kbZrr_MIOpuRyTPpWB7-Xc4C_nAmNlSdy2bUIswdskxO5XaQ8A2MWNQ Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a84c0307fdab42c6873ef9bfb9db2cdd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}] Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 909392ee039245bbb849528dcd9755b0 Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 8ba831d1-f851-4fb3-b7dd-ad70209818af could not be found. Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '8ba831d1-f851-4fb3-b7dd-ad70209818af'} Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba831d1-f851-4fb3-b7dd-ad70209818af could not be found. Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba831d1-f851-4fb3-b7dd-ad70209818af could not be found. Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:53:01.907728 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba831d1-f851-4fb3-b7dd-ad70209818af could not be found. Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Returning 404 to user: Instance 8ba831d1-f851-4fb3-b7dd-ad70209818af could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d10c3041-4f92-40e6-a259-bf4ed7518f25 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af" status: 404 len: 111 microversion: 2.1 time: 0.031449 Aug 23 11:53:01.913233 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3970/7992] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:01 2022] GET /compute/v2.1/servers/8ba831d1-f851-4fb3-b7dd-ad70209818af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:53:04.916041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a100423c-fc68-440e-9ffd-314fcb5a6ef3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '.version_select at 0x7fdc9c1e68b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:04.941019 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a100423c-fc68-440e-9ffd-314fcb5a6ef3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-929843796" status: 202 len: 0 microversion: 2.1 time: 0.029911 Aug 23 11:53:04.941783 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4023/7993] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 11:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-929843796 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:53:04.971776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-35054555-ae4c-439d-b5a6-c99f4f0a6e5f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: .version_select at 0x7fdc9cb2f430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1618365780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjKEUhFMPOHSMrv6CzdFgVLzmGlVXjK6q9A6btOHg74pcW7oOFab5kxe90ve6hfWxsgYcJyFOl9fRKuTayLsDsgNv9sKKoRR1lXOjyeDWHzH6VPxqmB1h3k0LlJUFeWvQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:04.989012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-35054555-ae4c-439d-b5a6-c99f4f0a6e5f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:53:04.995384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-35054555-ae4c-439d-b5a6-c99f4f0a6e5f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:53:05.022473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-35054555-ae4c-439d-b5a6-c99f4f0a6e5f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055305 Aug 23 11:53:05.023115 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3971/7994] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:53:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:53:10.722177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1665279061", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "b398ed24-14c5-4675-8380-c79c95c02e71"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1618365780", "security_groups": [{"name": "tempest-secgroup-smoke-781131066"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:10.844278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] validate_networks() for [('b398ed24-14c5-4675-8380-c79c95c02e71', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:53:10.904093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:11.265657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:53:11.266094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:53:11.266580 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:53:11.267000 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:53:11.267454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:53:11.276443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:11.276998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:11.277445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:11.278190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:11.278660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:11.279093 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:11.300255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:53:11.305814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:53:11.318879 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:53:11.321335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:53:11.371439 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-99f07c16-adb6-4bd3-94ec-4e1d20d2c226 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.654531 Aug 23 11:53:11.372719 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4024/7995] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:53:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:53:11.384215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9bfec883-fdf4-42e6-9bd0-56c009a9b92b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:11.385692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9bfec883-fdf4-42e6-9bd0-56c009a9b92b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:11.450684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9bfec883-fdf4-42e6-9bd0-56c009a9b92b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:11.465630 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9bfec883-fdf4-42e6-9bd0-56c009a9b92b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1267 microversion: 2.1 time: 0.085250 Aug 23 11:53:11.466919 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3972/7996] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:11 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:12.492562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:12.494503 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:12.503012 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:12.503779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:12.504394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:12.505393 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:12.506253 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:12.506847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:12.603829 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:12.613939 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fcb2c509-33f4-4a2d-b2b0-1cb86e427b13 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1319 microversion: 2.1 time: 0.129872 Aug 23 11:53:12.627837 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4025/7997] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:12 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:13.649524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:13.650183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:13.652439 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=40 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:13.665309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:13.666095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:13.666738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:13.667717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:13.668368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:13.669259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:13.928431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:13.936330 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a6aab932-3708-4795-9587-dc1420629466 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1392 microversion: 2.1 time: 0.290817 Aug 23 11:53:13.948762 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3973/7998] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:13 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1392 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:14.225530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-97c1d334-bcbb-42c2-96a2-4be48a68906b req-b26a3488-a2ca-4c31-9a75-0df682e525c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68aa7257-902d-41f5-8b40-4f9668fbf0bf", "tag": "03549e8b-bbe5-4d25-bf28-deb99df6c4e0"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:14.239240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-97c1d334-bcbb-42c2-96a2-4be48a68906b req-b26a3488-a2ca-4c31-9a75-0df682e525c7 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:14.239819 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-97c1d334-bcbb-42c2-96a2-4be48a68906b req-b26a3488-a2ca-4c31-9a75-0df682e525c7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:14.240329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-97c1d334-bcbb-42c2-96a2-4be48a68906b req-b26a3488-a2ca-4c31-9a75-0df682e525c7 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:14.251905 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-97c1d334-bcbb-42c2-96a2-4be48a68906b req-b26a3488-a2ca-4c31-9a75-0df682e525c7 service nova] Creating event network-changed:03549e8b-bbe5-4d25-bf28-deb99df6c4e0 for instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf on n-h2-847009-13 Aug 23 11:53:14.259031 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-97c1d334-bcbb-42c2-96a2-4be48a68906b req-b26a3488-a2ca-4c31-9a75-0df682e525c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039337 Aug 23 11:53:14.260085 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4026/7999] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:53:14.959461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:14.960131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:14.967221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:14.967730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:14.968196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:14.969135 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:14.969801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:14.971082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:15.106161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:15.114166 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc86eeb7-b409-4a7e-b91c-cfd8795db39f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1392 microversion: 2.1 time: 0.159855 Aug 23 11:53:15.114745 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3974/8000] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:14 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:53:16.135169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:16.135866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:16.143425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:16.143922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:16.144353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:16.145075 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:16.145534 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:16.145961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:16.284517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:16.293149 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-aabe3ba4-979b-48ad-905b-0b4e1f387e54 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1392 microversion: 2.1 time: 0.162169 Aug 23 11:53:16.293744 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4027/8001] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:16 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:17.315051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:17.315679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:17.318444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:17.324114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:17.324908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:17.325375 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:17.326140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:17.326625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:17.327080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:17.465565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:17.473746 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8f588a14-4049-4b7a-8d2c-2a6516f5ce72 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1392 microversion: 2.1 time: 0.162805 Aug 23 11:53:17.474320 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3975/8002] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:17 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:18.494753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:18.495374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:18.502400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:18.502893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:18.503340 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:18.504048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:18.504513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:18.504979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:18.641996 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:18.649847 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3bd83d4-b219-468e-8fcc-738a93fc69af tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1392 microversion: 2.1 time: 0.159117 Aug 23 11:53:18.650418 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4028/8003] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:18 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:19.218482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ca016112-228f-4c42-bf57-9dfeece15dbc req-7b430ae3-4642-4b6a-acac-2e23d5a00fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68aa7257-902d-41f5-8b40-4f9668fbf0bf", "name": "network-vif-plugged", "status": "completed", "tag": "03549e8b-bbe5-4d25-bf28-deb99df6c4e0"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:19.231209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca016112-228f-4c42-bf57-9dfeece15dbc req-7b430ae3-4642-4b6a-acac-2e23d5a00fae service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:19.231726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca016112-228f-4c42-bf57-9dfeece15dbc req-7b430ae3-4642-4b6a-acac-2e23d5a00fae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:19.232177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ca016112-228f-4c42-bf57-9dfeece15dbc req-7b430ae3-4642-4b6a-acac-2e23d5a00fae service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:19.243809 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ca016112-228f-4c42-bf57-9dfeece15dbc req-7b430ae3-4642-4b6a-acac-2e23d5a00fae service nova] Creating event network-vif-plugged:03549e8b-bbe5-4d25-bf28-deb99df6c4e0 for instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf on n-h2-847009-13 Aug 23 11:53:19.249108 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ca016112-228f-4c42-bf57-9dfeece15dbc req-7b430ae3-4642-4b6a-acac-2e23d5a00fae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034428 Aug 23 11:53:19.249922 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3976/8004] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:53:19.671045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:19.671654 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:19.679215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:19.679699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:19.680140 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:19.680871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:19.681334 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:19.681760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:19.814059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:19.822015 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2a38f201-697d-46ec-97eb-7c13542c9b5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1392 microversion: 2.1 time: 0.154870 Aug 23 11:53:19.822592 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4029/8005] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:19 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:20.843501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:20.844227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:20.852044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:20.852546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:20.853029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:20.853742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:20.854214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:20.854655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:20.996691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:21.005224 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ac448fe-d305-49fe-a3e2-c4d388ad3762 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1562 microversion: 2.1 time: 0.166119 Aug 23 11:53:21.005813 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3977/8006] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:20 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:21.027044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:21.027666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:21.035298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:21.035900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:21.036356 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:21.037100 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:21.037569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:21.038005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:21.170951 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:21.179251 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-89fd8bdc-4525-455d-9f27-3ebcfcf5aeb3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1562 microversion: 2.1 time: 0.156121 Aug 23 11:53:21.179825 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4030/8007] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:21 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:23.048101 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:23.049649 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:23.051545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-49abdb05-6b76-4a8b-a042-253fa41b11d3 req-10c5b96c-b120-4217-b637-01d8589549ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68aa7257-902d-41f5-8b40-4f9668fbf0bf", "tag": "03549e8b-bbe5-4d25-bf28-deb99df6c4e0"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:23.053411 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:23.057225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:23.058166 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:23.058362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:23.058751 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:23.059282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:23.060014 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:23.060152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:23.060714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:23.061389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:23.072586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49abdb05-6b76-4a8b-a042-253fa41b11d3 req-10c5b96c-b120-4217-b637-01d8589549ef service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:23.073109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49abdb05-6b76-4a8b-a042-253fa41b11d3 req-10c5b96c-b120-4217-b637-01d8589549ef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:23.073545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-49abdb05-6b76-4a8b-a042-253fa41b11d3 req-10c5b96c-b120-4217-b637-01d8589549ef service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:23.087460 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-49abdb05-6b76-4a8b-a042-253fa41b11d3 req-10c5b96c-b120-4217-b637-01d8589549ef service nova] Creating event network-changed:03549e8b-bbe5-4d25-bf28-deb99df6c4e0 for instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf on n-h2-847009-13 Aug 23 11:53:23.092598 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-49abdb05-6b76-4a8b-a042-253fa41b11d3 req-10c5b96c-b120-4217-b637-01d8589549ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045206 Aug 23 11:53:23.093653 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4031/8008] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:53:23.251019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:23.260554 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b3710725-78f4-47c9-b0a9-cf2f3b9b6b46 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1562 microversion: 2.1 time: 0.216730 Aug 23 11:53:23.269327 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3978/8009] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:23 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:44.509286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=36 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:44.513732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:44.516063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:44.524287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:44.525103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:44.525552 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:44.526289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:44.526761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:44.527196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:44.595087 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfefb5a4-5e98-41ad-8b2e-44de72e722dd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf/action" status: 200 len: 24569 microversion: 2.1 time: 0.088256 Aug 23 11:53:44.596224 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4032/8010] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:53:44 2022] POST /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf/action => generated 24569 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:53:55.622017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:53:55.624301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:55.626528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=7 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:55.627433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=32 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:55.633400 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:55.633943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:55.634406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:55.635132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:55.635616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:55.636070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:55.710167 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b21ecc5d-2166-42fe-8158-5d08741a18b8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf/action" status: 202 len: 0 microversion: 2.1 time: 0.092143 Aug 23 11:53:55.710814 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3979/8011] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:53:55 2022] POST /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:53:55.719616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:55.720562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:55.725384 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:55.726059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:53:55.730638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:55.731155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:55.731590 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:55.732307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:55.732806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:55.733236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:55.872638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:55.881884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06a39aff-23e4-42ba-9426-88d5a0ba7b04 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1673 microversion: 2.1 time: 0.166439 Aug 23 11:53:55.882480 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4033/8012] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:55 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:56.906231 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:56.906867 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:56.913921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:56.914438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:56.914905 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:56.915634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:56.916116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:56.916569 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:57.053585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:57.061416 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2312806-ff47-4c94-9fa2-94a8121bc4cb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.160493 Aug 23 11:53:57.061987 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3980/8013] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:56 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:58.082848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:58.083464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:58.091313 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:58.091800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:58.092241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:58.092973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:58.093433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:58.093859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:58.234572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:58.243723 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-64789290-25bf-40ce-b094-426108d93d22 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.165452 Aug 23 11:53:58.244297 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4034/8014] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:58 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:53:59.264416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:53:59.264988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:53:59.273028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:59.273537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:59.273999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:59.274711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:53:59.275191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:53:59.275635 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:53:59.408127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:53:59.417092 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bb8232c4-af5f-45e2-892d-fdb081ec4a0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.156751 Aug 23 11:53:59.417665 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3981/8015] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:53:59 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:00.438521 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:00.439268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:00.446775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:00.447262 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:00.447699 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:00.448389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:00.448885 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:00.449311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:00.585050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:00.592680 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f55230c7-2a8c-43e9-8c92-d35d1e308017 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.158175 Aug 23 11:54:00.593284 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4035/8016] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:00 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:01.614768 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:01.615408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:01.622533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:01.623046 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:01.623510 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:01.624244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:01.624729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:01.625430 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:01.776810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:01.787798 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-390943f5-ee1a-499e-9fcd-3dc0d0c81a99 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.177803 Aug 23 11:54:01.788688 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3982/8017] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:01 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:02.808956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:02.809551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:02.816359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:02.816875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:02.818113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:02.818650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:02.819114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:02.819541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:02.950787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:02.958933 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-60a6dbf7-fde6-4fb3-9be7-75d5ec7ad9b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.153862 Aug 23 11:54:02.959514 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4036/8018] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:02 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:03.980095 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:03.980767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:03.987717 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:03.988232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:03.988694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:03.989449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:03.989931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:03.990384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:04.126852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:04.135316 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-87cd6d77-f572-405b-8205-8d1a80541876 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.159140 Aug 23 11:54:04.135895 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3983/8019] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:03 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:05.158502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:05.159032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:05.166543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:05.167036 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:05.167484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:05.168196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:05.168691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:05.169156 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:05.305993 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:05.313697 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fe33cb2e-aa2e-4c91-b458-1f8e8e141669 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.159199 Aug 23 11:54:05.314269 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4037/8020] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:05 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:06.335169 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:06.335763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:06.342753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:06.343251 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:06.343703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:06.344405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:06.344912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:06.345350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:06.477634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:06.485329 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-39feb3d1-d9d8-4243-81d0-187e68aa026c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.154543 Aug 23 11:54:06.485897 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3984/8021] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:06 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:07.508104 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:07.508799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:07.515989 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:07.516483 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:07.516966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:07.517673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:07.518139 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:07.518578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:07.652396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:07.660145 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d80a5df-f85b-432d-9030-8132dbbcd73c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.156916 Aug 23 11:54:07.661124 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4038/8022] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:07 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:08.681423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:08.682154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:08.689555 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:08.690072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:08.690540 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:08.691262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:08.692253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:08.692709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:08.836422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:08.844393 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-85e7b98a-6b1c-4fa3-9686-61203aca1bfb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.166944 Aug 23 11:54:08.845055 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3985/8023] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:08 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:09.866211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:09.866957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:09.873807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:09.874387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:09.874852 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:09.875526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:09.875986 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:09.876413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:10.015167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:10.023567 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-852037f3-4ba1-4890-a632-b2c2820ec18d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.162164 Aug 23 11:54:10.024137 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4039/8024] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:09 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:11.044624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:11.045291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:11.052119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:11.052650 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:11.053176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:11.053871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:11.054345 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:11.054786 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:11.186859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:11.195213 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-59ce1116-5f59-4c5e-a298-d5a34193a902 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1678 microversion: 2.1 time: 0.154587 Aug 23 11:54:11.195801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3986/8025] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:11 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:12.216851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:12.217376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:12.223880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:12.224561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:12.226059 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:12.226765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:12.227234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:12.227667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:12.380341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:12.389123 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53f3e3f5-050c-4461-a5a1-aa2f8d7d311e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1681 microversion: 2.1 time: 0.176454 Aug 23 11:54:12.389711 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4040/8026] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:12 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:38.588895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:54:38.591076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:38.593539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:54:38.594232 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:54:38.602153 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:38.602671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:38.603137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:38.603858 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:38.604342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:38.604815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:38.678150 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-362ee2e7-e8dd-409a-aa39-56a663fc9c09 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf/action" status: 200 len: 68971 microversion: 2.1 time: 0.094063 Aug 23 11:54:38.680003 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3987/8027] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:54:38 2022] POST /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf/action => generated 68971 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:54:45.833130 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:45.833681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:45.836121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=16 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:54:45.836949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=48 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:54:45.846067 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:45.846538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:45.846988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:45.847739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:45.848205 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:45.848636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:45.875299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:54:45.895859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-d748ef6f-15b2-4864-ac26-f71b22656b80 req-fb17b6f5-d85c-4e38-860c-d97b04a02b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68aa7257-902d-41f5-8b40-4f9668fbf0bf", "tag": "03549e8b-bbe5-4d25-bf28-deb99df6c4e0"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:54:45.907775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d748ef6f-15b2-4864-ac26-f71b22656b80 req-fb17b6f5-d85c-4e38-860c-d97b04a02b5c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:45.908282 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d748ef6f-15b2-4864-ac26-f71b22656b80 req-fb17b6f5-d85c-4e38-860c-d97b04a02b5c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:45.908730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-d748ef6f-15b2-4864-ac26-f71b22656b80 req-fb17b6f5-d85c-4e38-860c-d97b04a02b5c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:45.921116 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-d748ef6f-15b2-4864-ac26-f71b22656b80 req-fb17b6f5-d85c-4e38-860c-d97b04a02b5c service nova] Creating event network-changed:03549e8b-bbe5-4d25-bf28-deb99df6c4e0 for instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf on n-h2-847009-13 Aug 23 11:54:45.926222 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-d748ef6f-15b2-4864-ac26-f71b22656b80 req-fb17b6f5-d85c-4e38-860c-d97b04a02b5c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094670 Aug 23 11:54:45.927028 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3988/8028] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:54:45.958632 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32611e7d-886f-4204-a5d5-9509d0b117f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 204 len: 0 microversion: 2.1 time: 0.129405 Aug 23 11:54:45.962979 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4041/8029] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:54:45 2022] DELETE /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:54:45.968997 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:45.969722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:45.977911 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:45.978422 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:45.978878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:45.979602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:45.980459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:45.981196 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:46.154306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:46.162184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-677fcc2b-039c-4517-8e98-ead7079a92cc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1687 microversion: 2.1 time: 0.197545 Aug 23 11:54:46.164131 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3989/8030] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:45 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1687 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:47.185754 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:47.186496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:47.193803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:47.194337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:47.194785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:47.195490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:47.195956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:47.196392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:47.331898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:47.340491 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-61e2d4c4-3803-4f28-a719-ae57e20e57dc tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1687 microversion: 2.1 time: 0.159183 Aug 23 11:54:47.341092 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4042/8031] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:47 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:48.185394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-736fa8fe-f636-42cb-bc01-84bc0fe908c5 req-05b40cb8-dd18-41e4-a1c5-853d00e96c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68aa7257-902d-41f5-8b40-4f9668fbf0bf", "name": "network-vif-deleted", "tag": "03549e8b-bbe5-4d25-bf28-deb99df6c4e0"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:54:48.195918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-736fa8fe-f636-42cb-bc01-84bc0fe908c5 req-05b40cb8-dd18-41e4-a1c5-853d00e96c81 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:48.196419 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-736fa8fe-f636-42cb-bc01-84bc0fe908c5 req-05b40cb8-dd18-41e4-a1c5-853d00e96c81 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:48.196934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-736fa8fe-f636-42cb-bc01-84bc0fe908c5 req-05b40cb8-dd18-41e4-a1c5-853d00e96c81 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:48.208876 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-736fa8fe-f636-42cb-bc01-84bc0fe908c5 req-05b40cb8-dd18-41e4-a1c5-853d00e96c81 service nova] Creating event network-vif-deleted:03549e8b-bbe5-4d25-bf28-deb99df6c4e0 for instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf on n-h2-847009-13 Aug 23 11:54:48.214546 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-736fa8fe-f636-42cb-bc01-84bc0fe908c5 req-05b40cb8-dd18-41e4-a1c5-853d00e96c81 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089323 Aug 23 11:54:48.215395 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3990/8032] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:54:48.362549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:48.363166 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:48.370264 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:48.370814 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:48.371327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:48.372025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:48.372548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:48.372947 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:48.405015 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:48.405513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:48.405953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:48.406409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lazy-loading 'fault' on Instance uuid 68aa7257-902d-41f5-8b40-4f9668fbf0bf {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:54:48.450595 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:48.458789 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a858d0b3-187d-4ba6-94f1-c7da552c89d8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 200 len: 1357 microversion: 2.1 time: 0.100112 Aug 23 11:54:48.460686 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4043/8033] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:48 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:54:49.482504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:49.483258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 68aa7257-902d-41f5-8b40-4f9668fbf0bf] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:49.489571 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:49.490077 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:49.491027 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:49.491749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:49.492230 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:49.492681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:49.509737 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] HTTP exception thrown: Instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf could not be found. Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Request method failure captured: Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf HTTP/1.1 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBL9i98IsNBLME7tC3kD4X5woB81wSQj03hv9tZ8czsC0mq2JLCQz1IU_DZlej4pWXYSLBjWiFbpiczh6KSR-eePhfg22uGnUgHwMPsv4qOH9IiuXCgORcHn4kbZrr_MIOpuRyTPpWB7-Xc4C_nAmNlSdy2bUIswdskxO5XaQ8A2MWNQ Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a84c0307fdab42c6873ef9bfb9db2cdd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}] Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 909392ee039245bbb849528dcd9755b0 Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf could not be found. Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '68aa7257-902d-41f5-8b40-4f9668fbf0bf'} Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf could not be found. Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf could not be found. Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:54:49.511401 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf could not be found. Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Returning 404 to user: Instance 68aa7257-902d-41f5-8b40-4f9668fbf0bf could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-23d5dc2a-2ac1-4436-aeea-6b54f4c0d0b5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf" status: 404 len: 111 microversion: 2.1 time: 0.035878 Aug 23 11:54:49.516358 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3991/8034] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:49 2022] GET /compute/v2.1/servers/68aa7257-902d-41f5-8b40-4f9668fbf0bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:54:52.873867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7058639e-261e-4ce0-ac89-1c32449f9335 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '.version_select at 0x7fdc9c21bca0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:52.895850 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7058639e-261e-4ce0-ac89-1c32449f9335 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618365780" status: 202 len: 0 microversion: 2.1 time: 0.025915 Aug 23 11:54:52.897372 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4044/8035] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Aug 23 11:54:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618365780 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:54:52.926631 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3e4b3a64-0c8e-42f6-905d-ca7d9d4861e4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: .version_select at 0x7fdca1de8dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-814539169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHPxJEA//3/x4vZfi33P9NlJCw8j0fDycXlZ5Lyik2cIWXorePwbnpLlg5kZuilX54mwrpuBqs4iHAm+Yysp05+Cj2RZ2hxqUFfGtNYGFu70msYV/iLQddojswFoQcwuQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:54:52.944301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3e4b3a64-0c8e-42f6-905d-ca7d9d4861e4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:54:52.949307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-3e4b3a64-0c8e-42f6-905d-ca7d9d4861e4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:54:52.975862 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3e4b3a64-0c8e-42f6-905d-ca7d9d4861e4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053285 Aug 23 11:54:52.976646 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3992/8036] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:54:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:54:58.873169 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1424461856", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "3ace772a-7697-4957-8066-adb711af9853"}], "key_name": "tempest-TestNetworkAdvancedServerOps-814539169", "security_groups": [{"name": "tempest-secgroup-smoke-685270733"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:54:58.886712 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:54:59.014424 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] validate_networks() for [('3ace772a-7697-4957-8066-adb711af9853', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:54:59.472903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:54:59.473479 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:54:59.474147 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:54:59.475453 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:54:59.475979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:54:59.493290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:59.493776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:59.494221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:59.494962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:54:59.495428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:54:59.495862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:54:59.514046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:54:59.530816 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:54:59.544701 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:54:59.547367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:54:59.601500 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-85e35f6d-92c1-47f2-a59f-1d5740130f45 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732234 Aug 23 11:54:59.602164 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4045/8037] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:54:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:54:59.611238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:54:59.623297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-642e50f6-feda-49f2-b204-d5451b588b74 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:54:59.624017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-642e50f6-feda-49f2-b204-d5451b588b74 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:54:59.692438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-642e50f6-feda-49f2-b204-d5451b588b74 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:54:59.704320 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-642e50f6-feda-49f2-b204-d5451b588b74 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1266 microversion: 2.1 time: 0.093968 Aug 23 11:54:59.705252 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3993/8038] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:54:59 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:00.734199 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:00.735472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:00.745811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:00.746659 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:00.747109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:00.747823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:00.749046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:00.749671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:00.838859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:00.847606 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a26fc695-2a01-4fda-93a4-fa176987e286 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1326 microversion: 2.1 time: 0.125717 Aug 23 11:55:00.848761 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4046/8039] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:00 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:01.880144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:01.881990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:01.889368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:01.890075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:01.890734 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:01.891459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:01.891934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:01.892382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:02.139785 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:02.148301 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-7b2a4e00-7e0b-40ee-abc6-09f23b642b0f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.272722 Aug 23 11:55:02.148924 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3994/8040] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:01 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:02.557255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d722a10e-e385-4e39-9b67-ff3b66d4237d req-384dc3a3-877e-4445-93c0-e62f3ac21d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:55:02.568037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d722a10e-e385-4e39-9b67-ff3b66d4237d req-384dc3a3-877e-4445-93c0-e62f3ac21d9d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:02.568426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d722a10e-e385-4e39-9b67-ff3b66d4237d req-384dc3a3-877e-4445-93c0-e62f3ac21d9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:02.570664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d722a10e-e385-4e39-9b67-ff3b66d4237d req-384dc3a3-877e-4445-93c0-e62f3ac21d9d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:02.581726 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d722a10e-e385-4e39-9b67-ff3b66d4237d req-384dc3a3-877e-4445-93c0-e62f3ac21d9d service nova] Creating event network-changed:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h1-847009-13 Aug 23 11:55:02.587708 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d722a10e-e385-4e39-9b67-ff3b66d4237d req-384dc3a3-877e-4445-93c0-e62f3ac21d9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035263 Aug 23 11:55:02.588332 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4047/8041] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:55:03.169329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:03.169920 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:03.180724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:03.181290 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:03.181755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:03.182707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:03.183373 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:03.183916 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:03.319279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:03.327403 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-64428fd2-852c-4b01-85d6-3c4004e5975b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.162104 Aug 23 11:55:03.327980 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3995/8042] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:03 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:04.349727 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:04.350543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:04.356765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:04.357272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:04.357737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:04.358425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:04.358892 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:04.359328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:04.492574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:04.500303 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8d3777ad-0d33-4b9f-ac3e-4c4270b5fd35 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.156230 Aug 23 11:55:04.500906 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4048/8043] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:04 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:05.522202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:05.522792 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:05.529707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:05.530212 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:05.530666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:05.531382 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:05.531860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:05.532306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:05.668882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:05.677011 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-83be6848-e920-44e6-a114-3009a1a2925d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.159504 Aug 23 11:55:05.677598 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3996/8044] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:05 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:06.698080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:06.698760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:06.706738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:06.707231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:06.707679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:06.709183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:06.709731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:06.710449 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:06.846287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:06.854216 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a129980c-aa6d-4b59-903c-72a41bdd2ec6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.160101 Aug 23 11:55:06.854791 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4049/8045] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:06 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:07.875533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:07.876131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:07.883604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:07.884111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:07.884570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:07.885318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:07.885797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:07.886247 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:08.025329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:08.033511 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6fa099ad-7fed-4763-b953-0fd4c39f31b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.162017 Aug 23 11:55:08.034095 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3997/8046] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:07 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:09.055343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:09.056058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:09.063844 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:09.064349 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:09.064854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:09.065575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:09.066044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:09.066538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:09.223191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:09.232235 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1459572-c62c-407d-a16a-64d7878e7bd2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.181384 Aug 23 11:55:09.237297 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4050/8047] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:09 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:09.260950 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2287fed6-23dd-4113-b70a-776ec69fd712 req-61553005-01e8-434b-9792-ae7093473090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "name": "network-vif-plugged", "status": "completed", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:55:09.265915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:55:09.273120 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2287fed6-23dd-4113-b70a-776ec69fd712 req-61553005-01e8-434b-9792-ae7093473090 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:09.273624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2287fed6-23dd-4113-b70a-776ec69fd712 req-61553005-01e8-434b-9792-ae7093473090 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:09.274076 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2287fed6-23dd-4113-b70a-776ec69fd712 req-61553005-01e8-434b-9792-ae7093473090 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:09.285473 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2287fed6-23dd-4113-b70a-776ec69fd712 req-61553005-01e8-434b-9792-ae7093473090 service nova] Creating event network-vif-plugged:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h1-847009-13 Aug 23 11:55:09.291299 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2287fed6-23dd-4113-b70a-776ec69fd712 req-61553005-01e8-434b-9792-ae7093473090 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097114 Aug 23 11:55:09.291929 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3998/8048] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:55:10.254172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:10.254786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:10.257676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:55:10.258364 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:55:10.265741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:10.266236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:10.266680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:10.267391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:10.267858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:10.268293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:10.406462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:10.414353 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc11ecaa-b5d1-403d-8085-2daeb059d8c9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1391 microversion: 2.1 time: 0.164131 Aug 23 11:55:10.414930 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4051/8049] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:10 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:11.433694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:55:11.438924 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:11.439659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:11.446726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:11.447239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:11.447705 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:11.448423 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:11.448938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:11.449392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:11.595814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:11.604276 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b62a9d9d-b6a2-4c6e-8ffe-1a5790df1438 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1564 microversion: 2.1 time: 0.171615 Aug 23 11:55:11.605036 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 3999/8050] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:11 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:11.624781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:11.625404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:11.632266 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:11.632770 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:11.633219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:11.633922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:11.634391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:11.634825 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:11.784321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:11.794888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b9777799-0d7e-4b90-b7c3-e6740f17e726 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1564 microversion: 2.1 time: 0.174058 Aug 23 11:55:11.796784 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4052/8051] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:11 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:55:13.394813 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:55:13.395461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:13.401476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-27fd0565-01dc-4f55-abb3-8be1723015e3 req-fa3bf01f-4184-4d68-8326-36f9aac1fd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:55:13.403728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:13.404244 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:13.404711 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:13.405514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:13.406165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:13.406682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:13.414370 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27fd0565-01dc-4f55-abb3-8be1723015e3 req-fa3bf01f-4184-4d68-8326-36f9aac1fd21 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:13.414782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27fd0565-01dc-4f55-abb3-8be1723015e3 req-fa3bf01f-4184-4d68-8326-36f9aac1fd21 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:13.415270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-27fd0565-01dc-4f55-abb3-8be1723015e3 req-fa3bf01f-4184-4d68-8326-36f9aac1fd21 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:13.427142 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-27fd0565-01dc-4f55-abb3-8be1723015e3 req-fa3bf01f-4184-4d68-8326-36f9aac1fd21 service nova] Creating event network-changed:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h1-847009-13 Aug 23 11:55:13.432685 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-27fd0565-01dc-4f55-abb3-8be1723015e3 req-fa3bf01f-4184-4d68-8326-36f9aac1fd21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035299 Aug 23 11:55:13.433416 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4053/8052] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:55:13.620275 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:55:13.637860 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6dfe831a-3bc4-4dea-b5d2-156e501e9859 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1564 microversion: 2.1 time: 0.246910 Aug 23 11:55:13.638457 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4000/8053] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:55:13 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1564 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:55:46.925683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:55:46.926447 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=42 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:55:46.931241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:55:46.933517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:55:46.940650 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:46.941238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:46.941713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:46.942405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:55:46.942867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:55:46.943298 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:55:47.012703 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7a467ea2-38ab-4210-aaf0-53858da2deeb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action" status: 200 len: 24573 microversion: 2.1 time: 0.088787 Aug 23 11:55:47.013393 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4054/8054] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:55:46 2022] POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action => generated 24573 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 11:56:17.424114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=5 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:56:17.425029 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=38 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:56:17.429885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:56:17.432246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:17.438994 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:17.439505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:17.439962 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:17.440679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:17.441191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:17.441639 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:17.533749 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:17.540893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Old instance type m1.heat2, new instance type m1.heat {{(pid=128860) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 11:56:17.547384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:56:17.547827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:56:17.548324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:56:17.548766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:56:17.549207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:56:17.611035 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [f75758f0-8a4f-4ebe-852c-33ce9fc4ad2c] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 11:56:18.618815 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [f75758f0-8a4f-4ebe-852c-33ce9fc4ad2c] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 47028. Aug 23 11:56:18.622192 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3043338f-e9ca-42ec-a67a-5632a388fd97 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action" status: 202 len: 0 microversion: 2.1 time: 1.200004 Aug 23 11:56:18.622820 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4001/8055] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:56:17 2022] POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:56:18.631787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:18.632510 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:18.635598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:56:18.636153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=4 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:56:18.642500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:18.642994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:18.643427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:18.644278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:18.644818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:18.645254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:18.855926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:18.863903 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-575a57e9-4ba1-4a83-9005-c2e5c566a0fb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1692 microversion: 2.1 time: 0.236650 Aug 23 11:56:18.864787 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4055/8056] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:18 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1692 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:56:19.887990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:19.888532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:19.895767 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:19.896976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:19.897562 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:19.898285 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:19.898769 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:19.899221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:20.082489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:20.090419 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2ea879e3-091d-4957-b2e4-be01e3534450 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1692 microversion: 2.1 time: 0.207313 Aug 23 11:56:20.090997 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4002/8057] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:19 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:21.112382 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:21.113032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:21.123136 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:21.123655 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:21.124107 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:21.124865 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:21.125344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:21.125781 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:21.259113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:21.267307 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c255e033-c6ea-4e9c-b6dd-2e9bc133d368 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1692 microversion: 2.1 time: 0.158844 Aug 23 11:56:21.267893 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4056/8058] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:21 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:22.290036 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:22.290579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:22.296672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:22.297213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:22.297679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:22.298401 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:22.298885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:22.299338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:22.436963 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:22.445512 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-74c33917-4e94-4d31-b901-0be3a9f461b4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1692 microversion: 2.1 time: 0.159832 Aug 23 11:56:22.446077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4003/8059] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:22 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:23.467647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:23.468272 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:23.475975 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:23.476474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:23.476953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:23.477661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:23.478127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:23.478564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:23.610229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:23.619468 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2ef014e-3f6e-43b4-a032-581c456a324a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1692 microversion: 2.1 time: 0.155675 Aug 23 11:56:23.620322 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4057/8060] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:23 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:24.641710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:24.642457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:24.649932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:24.650466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:24.650931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:24.651658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:24.652138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:24.652589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:24.875583 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:24.884094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e653f7bc-e4d7-4d7d-8762-6368d04e450b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1692 microversion: 2.1 time: 0.246327 Aug 23 11:56:24.884669 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4004/8061] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:24 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1692 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:25.905889 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:25.906433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:25.913997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:25.914536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:25.914982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:25.915686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:25.916151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:25.916585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:26.052440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:26.060512 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4e093935-c258-4e88-b6d5-2b5ce4cfeed7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.158666 Aug 23 11:56:26.061143 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4058/8062] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:25 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:27.082922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:27.083675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:27.090795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:27.091311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:27.091778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:27.092502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:27.093021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:27.093473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:27.235856 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:27.244427 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c8e487b7-292a-41d0-bb2d-c7951b127c6c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.165482 Aug 23 11:56:27.245052 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4005/8063] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:27 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:28.266400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:28.266950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:28.274321 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:28.274810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:28.275255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:28.275950 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:28.276411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:28.276870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:28.413138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:28.420936 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1aafd55-4756-4333-be6a-2e04e72ab9f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.158565 Aug 23 11:56:28.421531 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4059/8064] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:28 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:29.442845 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:29.443465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:29.450738 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:29.451243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:29.451700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:29.452414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:29.452954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:29.453399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:29.588951 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:29.596891 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1020243a-5c9e-4590-bf7d-242a41b1ef49 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.157993 Aug 23 11:56:29.597473 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4006/8065] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:29 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:30.618954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:30.619496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:30.626505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:30.626997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:30.627439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:30.628146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:30.628610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:30.629066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:30.766502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:30.775171 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36e037f2-93b4-419c-9348-0fa2214db3e0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.161030 Aug 23 11:56:30.775748 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4060/8066] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:30 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:31.797156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:31.797742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:31.804937 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:31.805452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:31.805917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:31.806638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:31.807118 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:31.807568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:31.945005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:31.953118 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-282651bd-fd3e-42af-b554-b0eaeea218d5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.160066 Aug 23 11:56:31.953699 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4007/8067] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:31 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:32.975248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:32.975902 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:32.982807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:32.983292 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:32.983731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:32.984429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:32.984922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:32.985354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:33.124803 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:33.132686 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b19a990e-e7e9-44f2-ae9f-a2750b8d3613 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.161672 Aug 23 11:56:33.133296 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4061/8068] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:32 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:34.153868 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:34.154505 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:34.161907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:34.162504 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:34.162965 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:34.163680 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:34.164157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:34.164607 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:34.296640 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:34.305118 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-001381ff-aef6-480f-990f-c577e7078e3b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.155164 Aug 23 11:56:34.305699 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4008/8069] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:34 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:35.327927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:35.328466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:35.336276 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:35.336798 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:35.337250 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:35.337955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:35.338423 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:35.338867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:35.473133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:35.481401 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3e1e75a-735c-4478-82f1-f171a752150b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.157568 Aug 23 11:56:35.481980 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4062/8070] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:35 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:36.503227 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:36.503872 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:36.511691 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:36.512204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:36.512668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:36.513428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:36.513912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:36.514398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:36.653264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:36.662507 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fda57085-0959-43a1-8d84-39d05c92165a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1697 microversion: 2.1 time: 0.162789 Aug 23 11:56:36.663710 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4009/8071] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:36 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:37.683573 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:37.684178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:37.691058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:37.691561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:37.692009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:37.693256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:37.693824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:37.694248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:37.786822 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "name": "network-vif-unplugged", "status": "completed", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:56:37.797763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:37.798269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:37.798724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:37.813478 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] Creating event network-vif-unplugged:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h2-847009-13 Aug 23 11:56:37.819572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] Instance 9020e400-29e4-4b19-9e32-337617733959 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128860) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:56:37.831371 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8bb12404-35cc-4120-9d51-37c223d774ba req-18904f53-708d-49a7-9a0a-467cedaec905 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048895 Aug 23 11:56:37.832209 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4010/8072] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:56:37.957236 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:37.966163 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-da34d24e-574c-4021-b7dd-0448dd5b32e9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1696 microversion: 2.1 time: 0.286465 Aug 23 11:56:37.966830 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4063/8073] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:37 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1696 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:38.990386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:38.991292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:38.999404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:38.999915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:39.000372 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:39.001193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:39.001670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:39.002122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:39.140733 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:39.148725 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a35f30c9-d56e-4495-9c03-c04808e82694 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1694 microversion: 2.1 time: 0.163531 Aug 23 11:56:39.149409 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4011/8074] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:38 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:39.860457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:56:39.875324 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:39.876055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:39.876716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:39.890546 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] Creating event network-changed:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h2-847009-13 Aug 23 11:56:39.897188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] Instance 9020e400-29e4-4b19-9e32-337617733959 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-847009-13', 'n-h2-847009-13'} {{(pid=128859) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 11:56:39.908125 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8b587751-3b9a-47f8-bca8-15808b7f7d9b req-712e10ac-be03-4c84-96cf-fb0ece65a94c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051674 Aug 23 11:56:39.908724 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4064/8075] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:56:40.170928 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:40.171564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:40.178392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:40.178903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:40.179363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:40.180088 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:40.180565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:40.181057 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:40.417184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:40.425157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-aa7a75c9-1fc7-46d4-a6ab-397b03dac3d3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1694 microversion: 2.1 time: 0.258136 Aug 23 11:56:40.425749 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4012/8076] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:40 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1694 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:41.449161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:41.449893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:41.456007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.456489 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.456957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.458388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.458851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.459271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.596244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:41.604156 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-87de2a61-f171-485e-a453-7a3546150179 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1691 microversion: 2.1 time: 0.160633 Aug 23 11:56:41.604773 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4065/8077] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:41 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:41.624539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:56:41.625167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:41.632658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.633204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.633671 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.634389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.634896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.635349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.693912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-01686768-e2a9-4c0a-81aa-2d5a399ff353 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action" status: 204 len: 0 microversion: 2.1 time: 0.073146 Aug 23 11:56:41.694590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4013/8078] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:56:41 2022] POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:56:41.703190 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:41.703739 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:41.710496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.710991 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.711429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.712134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.712644 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.713187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.858896 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:41.866946 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec697431-3d02-47b6-85fc-a542fc688558 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1691 microversion: 2.1 time: 0.167677 Aug 23 11:56:41.867699 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4066/8079] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:41 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:41.888249 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:41.889012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:41.895742 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.896366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.896851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:41.897578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:41.898053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:41.898500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:42.136131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:42.146037 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0021d03a-1ace-44c9-b159-afe8437df5fd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1691 microversion: 2.1 time: 0.261424 Aug 23 11:56:42.149331 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4014/8080] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:41 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:43.167690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:56:43.168287 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:56:43.175909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:43.175909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:43.176208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:43.176690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:43.177550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:43.177697 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:43.316702 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:56:43.325693 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4fd88bd3-b5ba-4475-992e-0e67cc84808e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1683 microversion: 2.1 time: 0.161904 Aug 23 11:56:43.326312 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4067/8081] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:56:43 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:56:44.148873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-85ed8d83-cac5-45c8-aa0a-079543b054f9 req-f576c1bb-97a0-4777-a4ea-d20a86585128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "name": "network-vif-plugged", "status": "completed", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:56:44.159999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-85ed8d83-cac5-45c8-aa0a-079543b054f9 req-f576c1bb-97a0-4777-a4ea-d20a86585128 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:56:44.160509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-85ed8d83-cac5-45c8-aa0a-079543b054f9 req-f576c1bb-97a0-4777-a4ea-d20a86585128 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:56:44.161049 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-85ed8d83-cac5-45c8-aa0a-079543b054f9 req-f576c1bb-97a0-4777-a4ea-d20a86585128 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:56:44.172601 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-85ed8d83-cac5-45c8-aa0a-079543b054f9 req-f576c1bb-97a0-4777-a4ea-d20a86585128 service nova] Creating event network-vif-plugged:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h2-847009-13 Aug 23 11:56:44.178183 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-85ed8d83-cac5-45c8-aa0a-079543b054f9 req-f576c1bb-97a0-4777-a4ea-d20a86585128 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033399 Aug 23 11:56:44.178795 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4015/8082] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:05.512056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=26 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:05.512848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=76 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:05.564444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:05.566838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:05.573703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:05.574194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:05.574628 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:05.575332 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:05.575786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:05.576213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:05.645442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8dbb3fec-b0ae-4faa-9a2d-909d3815063e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action" status: 200 len: 24574 microversion: 2.1 time: 0.138928 Aug 23 11:57:05.646065 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4068/8083] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:57:05 2022] POST /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959/action => generated 24574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:57:12.687720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=34 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:12.689261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:12.691757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-479300f1-ec1d-492f-b08a-c39ae0d740cb req-91704535-0036-4700-a436-4a7ecff9098f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:12.694752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:12.696676 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:12.704685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-479300f1-ec1d-492f-b08a-c39ae0d740cb req-91704535-0036-4700-a436-4a7ecff9098f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:12.705416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-479300f1-ec1d-492f-b08a-c39ae0d740cb req-91704535-0036-4700-a436-4a7ecff9098f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:12.705850 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-479300f1-ec1d-492f-b08a-c39ae0d740cb req-91704535-0036-4700-a436-4a7ecff9098f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:12.709988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:12.710791 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:12.711536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:12.712527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:12.713261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:12.713936 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:12.719986 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-479300f1-ec1d-492f-b08a-c39ae0d740cb req-91704535-0036-4700-a436-4a7ecff9098f service nova] Creating event network-changed:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h2-847009-13 Aug 23 11:57:12.726402 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-479300f1-ec1d-492f-b08a-c39ae0d740cb req-91704535-0036-4700-a436-4a7ecff9098f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038736 Aug 23 11:57:12.728323 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4069/8084] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:12.749759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:57:12.857233 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cd3de321-2c06-40be-a109-92e445816616 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 204 len: 0 microversion: 2.1 time: 0.171196 Aug 23 11:57:12.859502 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4016/8085] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:57:12 2022] DELETE /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:57:12.867759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:12.868577 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:12.875288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:12.875861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:12.876369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:12.877188 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:12.877710 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:12.878405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:13.035821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:13.044498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-7be7b91b-7854-46ec-b3c7-1a659c930ef5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1689 microversion: 2.1 time: 0.181885 Aug 23 11:57:13.045031 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4070/8086] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:12 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:14.067204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:14.067917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:14.075014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:14.075515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:14.075971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:14.076681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:14.077176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:14.077618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:14.222970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:14.231693 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f5a4767-9844-40ba-8d3d-e55509758ba5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 200 len: 1689 microversion: 2.1 time: 0.168792 Aug 23 11:57:14.232276 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4017/8087] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:14 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:14.828777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-8bf8f03a-fbd2-41d8-bb91-fe5661c58dc3 req-1fb08185-3ab4-45e6-8244-78998d41fe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9020e400-29e4-4b19-9e32-337617733959", "name": "network-vif-deleted", "tag": "68249206-cc2f-46d6-a031-7f30e9498fb1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:14.845473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8bf8f03a-fbd2-41d8-bb91-fe5661c58dc3 req-1fb08185-3ab4-45e6-8244-78998d41fe7d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:14.846003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8bf8f03a-fbd2-41d8-bb91-fe5661c58dc3 req-1fb08185-3ab4-45e6-8244-78998d41fe7d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:14.846611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-8bf8f03a-fbd2-41d8-bb91-fe5661c58dc3 req-1fb08185-3ab4-45e6-8244-78998d41fe7d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:14.861645 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-8bf8f03a-fbd2-41d8-bb91-fe5661c58dc3 req-1fb08185-3ab4-45e6-8244-78998d41fe7d service nova] Creating event network-vif-deleted:68249206-cc2f-46d6-a031-7f30e9498fb1 for instance 9020e400-29e4-4b19-9e32-337617733959 on n-h2-847009-13 Aug 23 11:57:14.868293 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-8bf8f03a-fbd2-41d8-bb91-fe5661c58dc3 req-1fb08185-3ab4-45e6-8244-78998d41fe7d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043683 Aug 23 11:57:14.869105 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4071/8088] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:15.253654 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:15.254103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 9020e400-29e4-4b19-9e32-337617733959] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:15.261830 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:15.262398 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:15.262814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:15.263539 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:15.264025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:15.264473 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:15.278231 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] HTTP exception thrown: Instance 9020e400-29e4-4b19-9e32-337617733959 could not be found. Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Request method failure captured: Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 HTTP/1.1 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBL9i98IsNBLME7tC3kD4X5woB81wSQj03hv9tZ8czsC0mq2JLCQz1IU_DZlej4pWXYSLBjWiFbpiczh6KSR-eePhfg22uGnUgHwMPsv4qOH9IiuXCgORcHn4kbZrr_MIOpuRyTPpWB7-Xc4C_nAmNlSdy2bUIswdskxO5XaQ8A2MWNQ Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a84c0307fdab42c6873ef9bfb9db2cdd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}] Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 909392ee039245bbb849528dcd9755b0 Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 9020e400-29e4-4b19-9e32-337617733959 could not be found. Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '9020e400-29e4-4b19-9e32-337617733959'} Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9020e400-29e4-4b19-9e32-337617733959 could not be found. Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9020e400-29e4-4b19-9e32-337617733959 could not be found. Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:57:15.279917 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9020e400-29e4-4b19-9e32-337617733959 could not be found. Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Returning 404 to user: Instance 9020e400-29e4-4b19-9e32-337617733959 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c37d4253-60e2-4ca8-a923-fceda92556df tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959" status: 404 len: 111 microversion: 2.1 time: 0.032139 Aug 23 11:57:15.284672 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4018/8089] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:15 2022] GET /compute/v2.1/servers/9020e400-29e4-4b19-9e32-337617733959 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:57:18.290111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-42aec4c6-9559-4597-8a67-858963cd4f98 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '.version_select at 0x7fdc9c1e63a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:18.319631 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-42aec4c6-9559-4597-8a67-858963cd4f98 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-814539169" status: 202 len: 0 microversion: 2.1 time: 0.035106 Aug 23 11:57:18.320977 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4072/8090] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 11:57:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-814539169 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:57:18.348783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e2efee8d-52c7-4051-959b-538669b65a48 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: .version_select at 0x7fdca1e96a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-868213100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEepmwf75twFIVw6RLePzAPoJB3ZYakvOusFNL9Kor6Ibk2WFINhXZViwtw+H1J30dpxgEmBBLF1E75rOydPHtq+3BQU7LFp6tQEH38+rrAUjz9+kj6vcPsa6DQcxVwgA=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:18.365788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e2efee8d-52c7-4051-959b-538669b65a48 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:57:18.372548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e2efee8d-52c7-4051-959b-538669b65a48 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:57:18.401503 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e2efee8d-52c7-4051-959b-538669b65a48 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056623 Aug 23 11:57:18.402206 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4019/8091] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:57:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:24.075352 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1769052254", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "848c64ef-6e7d-4da1-b85f-9db6ed383867"}], "key_name": "tempest-TestNetworkAdvancedServerOps-868213100", "security_groups": [{"name": "tempest-secgroup-smoke-2118281028"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:24.207404 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] validate_networks() for [('848c64ef-6e7d-4da1-b85f-9db6ed383867', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:57:24.705737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:57:24.705737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:57:24.706122 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:57:24.706728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:57:24.707294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:57:24.717661 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:24.718248 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:24.718790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:24.719608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:24.720315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:24.720864 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:24.742696 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:57:24.749344 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:57:24.773635 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:57:24.777070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:57:24.827883 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fbe2e6cc-64ef-4ac9-a1ad-4e4e4d5562c6 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758590 Aug 23 11:57:24.829267 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4073/8092] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:57:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:57:24.842021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-b97ee114-cff0-49e6-b4a8-40cbf70937cd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:24.842729 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-b97ee114-cff0-49e6-b4a8-40cbf70937cd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:24.909050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-b97ee114-cff0-49e6-b4a8-40cbf70937cd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:24.921683 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-b97ee114-cff0-49e6-b4a8-40cbf70937cd tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1266 microversion: 2.1 time: 0.085395 Aug 23 11:57:24.922427 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4020/8093] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:24 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:25.945914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:25.947549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:25.954890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:25.955380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:25.955815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:25.956520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:25.957031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:25.957456 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:26.054520 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:26.065680 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9fd642a5-54e3-49d5-a81e-6bb3885fd83a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1318 microversion: 2.1 time: 0.125296 Aug 23 11:57:26.067863 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4074/8094] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:25 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1318 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:27.089369 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:27.090016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:27.092593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:27.100754 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:27.101335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:27.101800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:27.102955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:27.103595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:27.104050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:27.623542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:27.632184 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dde2f87-9e4b-4c77-b652-ab4ff8f7a15e tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1392 microversion: 2.1 time: 0.548450 Aug 23 11:57:27.633068 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4021/8095] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:27 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1392 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:27.974857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-e64cf805-0d92-49ca-b165-fc39ca6a2df5 req-0716ebda-ba95-4b92-a15c-2d3f71429f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59070b5-7a22-440b-8d1e-6d932a926af5", "tag": "d02f640f-449b-4bc7-8063-9c7d857f5091"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:27.987301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e64cf805-0d92-49ca-b165-fc39ca6a2df5 req-0716ebda-ba95-4b92-a15c-2d3f71429f4c service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:27.987791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e64cf805-0d92-49ca-b165-fc39ca6a2df5 req-0716ebda-ba95-4b92-a15c-2d3f71429f4c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:27.988234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-e64cf805-0d92-49ca-b165-fc39ca6a2df5 req-0716ebda-ba95-4b92-a15c-2d3f71429f4c service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:28.002893 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-e64cf805-0d92-49ca-b165-fc39ca6a2df5 req-0716ebda-ba95-4b92-a15c-2d3f71429f4c service nova] Creating event network-changed:d02f640f-449b-4bc7-8063-9c7d857f5091 for instance a59070b5-7a22-440b-8d1e-6d932a926af5 on n-h2-847009-13 Aug 23 11:57:28.008412 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-e64cf805-0d92-49ca-b165-fc39ca6a2df5 req-0716ebda-ba95-4b92-a15c-2d3f71429f4c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038792 Aug 23 11:57:28.009276 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4075/8096] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:28.655566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:28.656207 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:28.662392 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:28.662890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:28.663344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:28.664051 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:28.664524 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:28.665125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:28.797630 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:28.806047 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54da96d8-c530-4e11-b7f2-6cc7479f1e5c tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1392 microversion: 2.1 time: 0.156280 Aug 23 11:57:28.806621 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4022/8097] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:28 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:29.829127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:29.829835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:29.836225 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:29.837021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:29.837530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:29.838239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:29.838703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:29.839134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:29.979397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:29.987230 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6590df36-f51c-4666-99c2-13a312cc7280 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1392 microversion: 2.1 time: 0.163424 Aug 23 11:57:29.987803 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4076/8098] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:29 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:31.009295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:31.009944 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:31.016902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:31.017486 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:31.017889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:31.018627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:31.019108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:31.019557 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:31.155140 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:31.162829 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fd3561c-a52a-4c17-9919-d8372c57ffc4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1392 microversion: 2.1 time: 0.157697 Aug 23 11:57:31.163399 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4023/8099] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:31 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:32.184472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:32.185218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:32.192032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:32.192518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:32.192982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:32.193680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:32.194135 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:32.194560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:32.332565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:32.341010 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a098bf1d-a256-4904-b066-6f854ff0123f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1392 microversion: 2.1 time: 0.160870 Aug 23 11:57:32.341612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4077/8100] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:32 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:32.569609 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-6fe173c6-4a01-4643-a364-ecea947ed509 req-da198155-357f-418a-b7b0-9a8734821c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59070b5-7a22-440b-8d1e-6d932a926af5", "name": "network-vif-plugged", "status": "completed", "tag": "d02f640f-449b-4bc7-8063-9c7d857f5091"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:32.580610 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6fe173c6-4a01-4643-a364-ecea947ed509 req-da198155-357f-418a-b7b0-9a8734821c1d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:32.581217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6fe173c6-4a01-4643-a364-ecea947ed509 req-da198155-357f-418a-b7b0-9a8734821c1d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:32.581715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-6fe173c6-4a01-4643-a364-ecea947ed509 req-da198155-357f-418a-b7b0-9a8734821c1d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:32.593207 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-6fe173c6-4a01-4643-a364-ecea947ed509 req-da198155-357f-418a-b7b0-9a8734821c1d service nova] Creating event network-vif-plugged:d02f640f-449b-4bc7-8063-9c7d857f5091 for instance a59070b5-7a22-440b-8d1e-6d932a926af5 on n-h2-847009-13 Aug 23 11:57:32.598410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-6fe173c6-4a01-4643-a364-ecea947ed509 req-da198155-357f-418a-b7b0-9a8734821c1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 Aug 23 11:57:32.599058 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4024/8101] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:33.362786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:33.363407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:33.370433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:33.370926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:33.371376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:33.372079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:33.372551 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:33.373011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:33.502623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:33.512397 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-19c0df66-936f-47e9-8324-0840bab70ea2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1392 microversion: 2.1 time: 0.153250 Aug 23 11:57:33.513146 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4078/8102] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:33 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:34.536170 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:34.536935 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:34.544021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:34.544531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:34.545030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:34.545753 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:34.546234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:34.546686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:34.678827 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:34.687402 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-333c5cb7-8a3b-4b7c-91e7-e4732f13c045 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1563 microversion: 2.1 time: 0.156455 Aug 23 11:57:34.687985 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4025/8103] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:34 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:34.708750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:34.709400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:34.716763 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:34.717297 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:34.717742 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:34.718460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:34.720060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:34.720060 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:34.735127 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:34.768252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:34.858238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:34.865981 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9f647702-5d12-4e92-8f85-ef5af3b57650 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1563 microversion: 2.1 time: 0.161281 Aug 23 11:57:34.866546 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4079/8104] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:34 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:57:36.756004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:57:36.757074 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-4e7b0777-5cb4-4d15-acbb-831ae67e7f6f req-2cbc14fa-b040-40be-8317-cc8cf0e33841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59070b5-7a22-440b-8d1e-6d932a926af5", "tag": "d02f640f-449b-4bc7-8063-9c7d857f5091"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:57:36.757526 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:57:36.759955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:36.765082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:36.767287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:36.767983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:36.768661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:36.769307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4e7b0777-5cb4-4d15-acbb-831ae67e7f6f req-2cbc14fa-b040-40be-8317-cc8cf0e33841 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:36.769634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:57:36.769797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4e7b0777-5cb4-4d15-acbb-831ae67e7f6f req-2cbc14fa-b040-40be-8317-cc8cf0e33841 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:36.770112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:57:36.770418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-4e7b0777-5cb4-4d15-acbb-831ae67e7f6f req-2cbc14fa-b040-40be-8317-cc8cf0e33841 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:36.770556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:57:36.775346 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=49 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:57:36.785246 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-4e7b0777-5cb4-4d15-acbb-831ae67e7f6f req-2cbc14fa-b040-40be-8317-cc8cf0e33841 service nova] Creating event network-changed:d02f640f-449b-4bc7-8063-9c7d857f5091 for instance a59070b5-7a22-440b-8d1e-6d932a926af5 on n-h2-847009-13 Aug 23 11:57:36.790462 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-4e7b0777-5cb4-4d15-acbb-831ae67e7f6f req-2cbc14fa-b040-40be-8317-cc8cf0e33841 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037552 Aug 23 11:57:36.791274 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4080/8105] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:57:37.005595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:57:37.015025 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3f4851d6-b9be-492c-912f-072565c35f01 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1563 microversion: 2.1 time: 0.264039 Aug 23 11:57:37.015739 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4026/8106] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:57:36 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1563 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:00.268201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:00.270440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:00.279665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:00.280155 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:00.280600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:00.281330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:00.281796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:00.282222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:00.348780 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3a195c60-1428-4a76-93b7-2f31794c9bf5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action" status: 200 len: 24566 microversion: 2.1 time: 0.084777 Aug 23 11:58:00.349419 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4081/8107] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:58:00 2022] POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action => generated 24566 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:58:06.689183 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d99e5f9e-0d1f-4a54-b450-5350373115bb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:06.691271 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:58:06.692037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=32 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:58:06.699432 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99e5f9e-0d1f-4a54-b450-5350373115bb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:06.699946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99e5f9e-0d1f-4a54-b450-5350373115bb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:06.700405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d99e5f9e-0d1f-4a54-b450-5350373115bb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:06.723932 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d99e5f9e-0d1f-4a54-b450-5350373115bb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Going to try to stop instance {{(pid=128860) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 11:58:06.766247 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d99e5f9e-0d1f-4a54-b450-5350373115bb tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action" status: 202 len: 0 microversion: 2.1 time: 0.081187 Aug 23 11:58:06.766869 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4027/8108] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:58:06 2022] POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:58:06.776901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:06.777671 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:06.785426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:06.785914 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:06.786354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:06.787085 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:06.787544 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:06.787971 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:06.926687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:06.935081 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3ca7ea07-8bc6-4bc7-a201-b8a65ffdf679 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.163266 Aug 23 11:58:06.935660 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4082/8109] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:06 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:58:07.959131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:07.959862 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:07.967459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:07.967969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:07.968428 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:07.969179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:07.969658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:07.970106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:08.106880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:08.114724 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d522686b-639a-4f2b-884a-0c675d643925 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.160704 Aug 23 11:58:08.115309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4028/8110] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:07 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:09.137377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:09.137978 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:09.144880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:09.145374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:09.145815 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:09.146514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:09.146980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:09.147409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:09.283350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:09.291701 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d39eb956-a68e-4399-8987-85714f9218a2 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.158354 Aug 23 11:58:09.292285 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4083/8111] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:09 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:10.314939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:10.315511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:10.322634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:10.323147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:10.323612 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:10.324334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:10.324849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:10.325302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:10.457568 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:10.466286 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5696170f-d254-46c9-bfba-18f8391bb2cf tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.155435 Aug 23 11:58:10.466874 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4029/8112] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:10 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:11.487306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:11.487918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:11.495180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:11.495662 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:11.496101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:11.496810 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:11.497269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:11.497695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:11.636832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:11.645888 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3809f358-d3cd-46db-a0e8-71d36057a1f5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.162689 Aug 23 11:58:11.646477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4084/8113] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:11 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:12.668622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:12.669257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:12.677054 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:12.677977 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:12.678863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:12.680663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:12.681179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:12.681642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:12.814478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:12.822678 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-152a57f4-a0ae-4287-bf23-20b6727f23b9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.158986 Aug 23 11:58:12.823261 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4030/8114] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:12 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:13.843572 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:13.844112 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:13.851627 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:13.852415 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:13.852898 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:13.853609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:13.854076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:13.854515 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:13.987490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:13.997369 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cc36fe22-f965-4a5d-a9c8-05bab3a6db38 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.157792 Aug 23 11:58:13.997951 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4085/8115] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:13 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:15.019004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:15.019637 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:15.026645 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:15.027145 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:15.027597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:15.028303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:15.028796 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:15.029240 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:15.166815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:15.174557 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-574d8ae5-1d77-422b-832f-388b28e74341 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.159466 Aug 23 11:58:15.175130 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4031/8116] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:15 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:16.197062 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:16.197681 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:16.204574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:16.205091 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:16.205528 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:16.206237 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:16.206680 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:16.207102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:16.343890 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:16.351845 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-47220d9f-363a-435f-a8a5-1b9d6283d8e8 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1691 microversion: 2.1 time: 0.159377 Aug 23 11:58:16.352412 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4086/8117] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:16 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:17.375547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:17.376090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:17.383617 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:17.384134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:17.384601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:17.385363 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:17.385876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:17.386437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:17.525059 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:17.532923 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-824b3a08-8062-490c-9dd6-bd89c59da096 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1668 microversion: 2.1 time: 0.161479 Aug 23 11:58:17.533509 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4032/8118] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:17 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:18.630915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:18.633472 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:18.640231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:18.640715 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:18.641179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:18.641872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:18.642328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:18.642749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:18.704874 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8b9e7292-7859-493e-98df-41d54bb10ba9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action" status: 200 len: 35420 microversion: 2.1 time: 0.077708 Aug 23 11:58:18.705519 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4087/8119] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:58:18 2022] POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action => generated 35420 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:58:18.718168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5fdbd50f-79b4-48d9-afe6-10e1b39aef18 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:18.725146 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fdbd50f-79b4-48d9-afe6-10e1b39aef18 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:18.725694 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fdbd50f-79b4-48d9-afe6-10e1b39aef18 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:18.726193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5fdbd50f-79b4-48d9-afe6-10e1b39aef18 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:18.748214 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5fdbd50f-79b4-48d9-afe6-10e1b39aef18 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Going to try to start instance {{(pid=128860) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 11:58:18.793739 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5fdbd50f-79b4-48d9-afe6-10e1b39aef18 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action" status: 202 len: 0 microversion: 2.1 time: 0.079328 Aug 23 11:58:18.794348 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4033/8120] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:58:18 2022] POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:58:18.803339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:18.804148 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:18.813525 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:18.814021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:18.814464 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:18.815347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:18.815817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:18.816252 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:18.963625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:18.971806 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-49125954-1665-446c-8b59-9a2432b0486b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1677 microversion: 2.1 time: 0.172644 Aug 23 11:58:18.972675 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4088/8121] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:18 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:19.996108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:19.996973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:20.004703 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:20.005248 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:20.005714 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:20.006446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:20.006993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:20.008093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:20.140695 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:20.148847 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ef5d91c7-51ea-46db-9628-f983d0f26ba0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1681 microversion: 2.1 time: 0.157761 Aug 23 11:58:20.149424 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4034/8122] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:19 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:44.342642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:44.344797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:44.347441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=17 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:58:44.348118 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=45 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:58:44.354523 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:44.355021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:44.355467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:44.356173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:44.356637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:44.357094 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:44.429074 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9ecafdf8-d188-4fe3-949c-616a951ee3be tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action" status: 200 len: 59975 microversion: 2.1 time: 0.090413 Aug 23 11:58:44.429756 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4089/8123] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:58:44 2022] POST /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5/action => generated 59975 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 11:58:51.451500 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:51.452038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:51.454196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-74ad4e7a-bf10-4c9f-9252-60a1b13fb974 req-957d86e7-92fc-4a84-929d-52454804914f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59070b5-7a22-440b-8d1e-6d932a926af5", "tag": "d02f640f-449b-4bc7-8063-9c7d857f5091"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:51.454614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=16 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:58:51.455598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:58:51.462066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:51.462655 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:51.463380 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:51.464112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:51.464781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:51.465435 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:51.466201 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-74ad4e7a-bf10-4c9f-9252-60a1b13fb974 req-957d86e7-92fc-4a84-929d-52454804914f service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:51.466693 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-74ad4e7a-bf10-4c9f-9252-60a1b13fb974 req-957d86e7-92fc-4a84-929d-52454804914f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:51.467280 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-74ad4e7a-bf10-4c9f-9252-60a1b13fb974 req-957d86e7-92fc-4a84-929d-52454804914f service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:51.480084 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-74ad4e7a-bf10-4c9f-9252-60a1b13fb974 req-957d86e7-92fc-4a84-929d-52454804914f service nova] Creating event network-changed:d02f640f-449b-4bc7-8063-9c7d857f5091 for instance a59070b5-7a22-440b-8d1e-6d932a926af5 on n-h2-847009-13 Aug 23 11:58:51.485743 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-74ad4e7a-bf10-4c9f-9252-60a1b13fb974 req-957d86e7-92fc-4a84-929d-52454804914f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035098 Aug 23 11:58:51.487046 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4090/8124] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:58:51.496007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 11:58:51.588461 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24e63213-c928-4bbb-94b1-1053e8405c1a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 204 len: 0 microversion: 2.1 time: 0.140943 Aug 23 11:58:51.592446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4035/8125] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 11:58:51 2022] DELETE /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 11:58:51.599050 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:51.600165 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:51.607548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:51.607962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:51.608409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:51.609184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:51.609649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:51.610490 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:51.759716 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:51.767717 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82372d7d-462c-4bb0-bd31-ec1afaafe4f3 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1687 microversion: 2.1 time: 0.173440 Aug 23 11:58:51.768477 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4091/8126] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:51 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:52.791253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:52.792172 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:52.798955 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:52.799675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:52.800923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:52.801808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:52.802494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:52.803985 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:52.997288 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:53.007537 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-2e47bad9-9d1e-405a-906e-1f9682ffd182 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1687 microversion: 2.1 time: 0.220410 Aug 23 11:58:53.008801 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4036/8127] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:52 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1687 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:53.735787 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-3a66b953-acfc-4dff-b3e1-1e26f11ef8d1 req-648dd5b3-6ba4-43f0-97e9-be0df51d41c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59070b5-7a22-440b-8d1e-6d932a926af5", "name": "network-vif-deleted", "tag": "d02f640f-449b-4bc7-8063-9c7d857f5091"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:53.746737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3a66b953-acfc-4dff-b3e1-1e26f11ef8d1 req-648dd5b3-6ba4-43f0-97e9-be0df51d41c4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:53.747229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3a66b953-acfc-4dff-b3e1-1e26f11ef8d1 req-648dd5b3-6ba4-43f0-97e9-be0df51d41c4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:53.747670 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-3a66b953-acfc-4dff-b3e1-1e26f11ef8d1 req-648dd5b3-6ba4-43f0-97e9-be0df51d41c4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:53.759650 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-3a66b953-acfc-4dff-b3e1-1e26f11ef8d1 req-648dd5b3-6ba4-43f0-97e9-be0df51d41c4 service nova] Creating event network-vif-deleted:d02f640f-449b-4bc7-8063-9c7d857f5091 for instance a59070b5-7a22-440b-8d1e-6d932a926af5 on n-h2-847009-13 Aug 23 11:58:53.764806 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-3a66b953-acfc-4dff-b3e1-1e26f11ef8d1 req-648dd5b3-6ba4-43f0-97e9-be0df51d41c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032700 Aug 23 11:58:53.765355 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4092/8128] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:58:54.029663 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:54.030300 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:54.038385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:54.038906 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:54.039374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:54.040110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:54.040597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:54.041085 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:54.075613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:54.076119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:54.076580 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:54.077090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lazy-loading 'fault' on Instance uuid a59070b5-7a22-440b-8d1e-6d932a926af5 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 11:58:54.121007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:58:54.129189 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bf142858-d84b-4786-8bee-c05d135b4767 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 200 len: 1356 microversion: 2.1 time: 0.103366 Aug 23 11:58:54.134353 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4037/8129] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:54 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:58:55.153831 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:55.154529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: a59070b5-7a22-440b-8d1e-6d932a926af5] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:58:55.161108 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:55.161596 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:55.162245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:55.163437 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:58:55.163939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:58:55.164585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:58:55.181581 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] HTTP exception thrown: Instance a59070b5-7a22-440b-8d1e-6d932a926af5 could not be found. Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Request method failure captured: Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 HTTP/1.1 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBL9i98IsNBLME7tC3kD4X5woB81wSQj03hv9tZ8czsC0mq2JLCQz1IU_DZlej4pWXYSLBjWiFbpiczh6KSR-eePhfg22uGnUgHwMPsv4qOH9IiuXCgORcHn4kbZrr_MIOpuRyTPpWB7-Xc4C_nAmNlSdy2bUIswdskxO5XaQ8A2MWNQ Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a84c0307fdab42c6873ef9bfb9db2cdd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}] Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 909392ee039245bbb849528dcd9755b0 Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance a59070b5-7a22-440b-8d1e-6d932a926af5 could not be found. Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': 'a59070b5-7a22-440b-8d1e-6d932a926af5'} Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59070b5-7a22-440b-8d1e-6d932a926af5 could not be found. Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59070b5-7a22-440b-8d1e-6d932a926af5 could not be found. Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:58:55.184380 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59070b5-7a22-440b-8d1e-6d932a926af5 could not be found. Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Returning 404 to user: Instance a59070b5-7a22-440b-8d1e-6d932a926af5 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2f00be43-fe94-4048-b05b-048c88c4d2b0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5" status: 404 len: 111 microversion: 2.1 time: 0.038614 Aug 23 11:58:55.189488 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4093/8130] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:58:55 2022] GET /compute/v2.1/servers/a59070b5-7a22-440b-8d1e-6d932a926af5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 11:58:58.514110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-26814bf5-cf7a-4ec4-8a62-c2fa59dd177d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '.version_select at 0x7fdc8f6cc790>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:58:58.545463 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-26814bf5-cf7a-4ec4-8a62-c2fa59dd177d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-868213100" status: 202 len: 0 microversion: 2.1 time: 0.035980 Aug 23 11:58:58.546010 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4038/8131] 10.222.0.78 () {58 vars in 1281 bytes} [Tue Aug 23 11:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-868213100 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 11:58:58.584371 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6ae8dc5b-e951-4dcb-8f70-5900e9c50a2f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: .version_select at 0x7fdc8ffcd1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1936995080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJyvSgsgVzEU0F/LNE30I06RNDmwhv/s1QXTFPw88tpCcHpggfwuNyrc94CqbOBRGRJP48z5x2baLHyjFXqfkKcIxZd8G3Sqx6xqW38N2vzPlOmTJKj7yhvIKp3oH8F3A=="}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:58:58.606895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6ae8dc5b-e951-4dcb-8f70-5900e9c50a2f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:58:58.614152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-6ae8dc5b-e951-4dcb-8f70-5900e9c50a2f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'key_pairs'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:58:58.639066 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6ae8dc5b-e951-4dcb-8f70-5900e9c50a2f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060500 Aug 23 11:58:58.639734 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4094/8132] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 11:58:58 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:59:04.439192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:04.444595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1191192676", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "networks": [{"uuid": "990fbd3c-9414-4d40-a5b9-0fa46f3f1898"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1936995080", "security_groups": [{"name": "tempest-secgroup-smoke-1130911164"}]}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:59:04.559389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.network.neutron [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] validate_networks() for [('990fbd3c-9414-4d40-a5b9-0fa46f3f1898', None, None, None, None, None)] {{(pid=128860) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 11:59:05.011283 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 11:59:05.013464 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image limits 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 11:59:05.014063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Flavor pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 11:59:05.015065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Image pref 0:0:0 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 11:59:05.015730 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.virt.hardware [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 11:59:05.029258 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:05.030034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:05.030575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:05.031438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:05.031993 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:05.032518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:05.057323 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 11:59:05.063755 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Getting quotas for user 909392ee039245bbb849528dcd9755b0 and project a84c0307fdab42c6873ef9bfb9db2cdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 11:59:05.082014 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Going to run 1 instances... {{(pid=128860) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 11:59:05.084349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 11:59:05.190121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0052b0ca-ed14-43bf-a40e-76822e2dc273 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751703 Aug 23 11:59:05.202480 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4039/8133] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 11:59:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 11:59:05.209957 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-11af385c-3058-4557-89bc-fd50ed00b4ea tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:05.211254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-11af385c-3058-4557-89bc-fd50ed00b4ea tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:05.229429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=16 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:05.307191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-11af385c-3058-4557-89bc-fd50ed00b4ea tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:05.315912 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-11af385c-3058-4557-89bc-fd50ed00b4ea tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1267 microversion: 2.1 time: 0.110906 Aug 23 11:59:05.317042 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4095/8134] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:05 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1267 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:06.338681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:06.339321 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:06.348501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:06.349699 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:06.350171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:06.350943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:06.351429 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:06.351882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:06.419811 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:06.430253 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0dc56116-353b-4c5b-92d4-e39e3944566f tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1319 microversion: 2.1 time: 0.095276 Aug 23 11:59:06.430854 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4040/8135] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:06 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:07.457117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:07.458363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:07.468193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:07.468827 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:07.469343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:07.470137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:07.470679 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:07.471350 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:07.644354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:07.654261 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01c49f9c-63c3-4877-9bca-930bf82bb659 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.206528 Aug 23 11:59:07.654860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4096/8136] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:07 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:08.006273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-0c746be3-d7f4-4b7a-9669-ff8e4344f8cf req-56cb317b-7647-460d-94d7-d2081601aa2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adb1895-9fbf-4826-ba11-009f3acf1c91", "tag": "40a2a511-d0f6-45a5-808a-ad3adaa8829a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:59:08.017310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c746be3-d7f4-4b7a-9669-ff8e4344f8cf req-56cb317b-7647-460d-94d7-d2081601aa2d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:08.018007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c746be3-d7f4-4b7a-9669-ff8e4344f8cf req-56cb317b-7647-460d-94d7-d2081601aa2d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:08.018616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-0c746be3-d7f4-4b7a-9669-ff8e4344f8cf req-56cb317b-7647-460d-94d7-d2081601aa2d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:08.033700 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-0c746be3-d7f4-4b7a-9669-ff8e4344f8cf req-56cb317b-7647-460d-94d7-d2081601aa2d service nova] Creating event network-changed:40a2a511-d0f6-45a5-808a-ad3adaa8829a for instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 on n-h1-847009-13 Aug 23 11:59:08.039941 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-0c746be3-d7f4-4b7a-9669-ff8e4344f8cf req-56cb317b-7647-460d-94d7-d2081601aa2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038524 Aug 23 11:59:08.040565 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4041/8137] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:59:08.676692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:08.677841 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:08.684588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:08.685120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:08.685563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:08.686265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:08.686728 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:08.687158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:08.827973 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:08.836413 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-37c273c6-8894-41d0-9050-bb85f06ead5a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.163675 Aug 23 11:59:08.837033 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4097/8138] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:08 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 11:59:09.858347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:09.858989 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:09.867177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:09.867678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:09.868132 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:09.868876 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:09.869350 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:09.869790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:10.011388 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:10.020476 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-153c78da-620c-4a61-8801-2c374ab1ab93 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.166367 Aug 23 11:59:10.021523 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4042/8139] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:09 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:11.041637 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:11.042283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:11.049184 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:11.049677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:11.050129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:11.050834 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:11.051303 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:11.051734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:11.190559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:11.198754 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84dbc8c4-cbbb-429b-8886-9ac8d78c3e05 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.161180 Aug 23 11:59:11.199275 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4098/8140] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:11 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:12.219441 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:12.220180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:12.228322 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:12.228871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:12.229335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:12.230093 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:12.230579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:12.231028 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:12.376075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:12.386713 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-17aefcdc-cb52-4943-9607-6e94a391c9c4 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.171358 Aug 23 11:59:12.387309 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4043/8141] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:12 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:13.408213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:13.408956 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:13.416182 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:13.416666 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:13.417133 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:13.417851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:13.418308 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:13.418737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:13.551222 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:13.559383 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c9bd003a-c589-431f-9457-111480dd5285 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.155365 Aug 23 11:59:13.559959 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4099/8142] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:13 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:14.328530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-80e3ddfb-67d9-420a-963a-2750ffb006f9 req-419fa24f-983e-4ef3-aa29-b47cc1d1c8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adb1895-9fbf-4826-ba11-009f3acf1c91", "name": "network-vif-plugged", "status": "completed", "tag": "40a2a511-d0f6-45a5-808a-ad3adaa8829a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:59:14.339719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-80e3ddfb-67d9-420a-963a-2750ffb006f9 req-419fa24f-983e-4ef3-aa29-b47cc1d1c8dd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:14.340222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-80e3ddfb-67d9-420a-963a-2750ffb006f9 req-419fa24f-983e-4ef3-aa29-b47cc1d1c8dd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:14.340679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-80e3ddfb-67d9-420a-963a-2750ffb006f9 req-419fa24f-983e-4ef3-aa29-b47cc1d1c8dd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:14.352576 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-80e3ddfb-67d9-420a-963a-2750ffb006f9 req-419fa24f-983e-4ef3-aa29-b47cc1d1c8dd service nova] Creating event network-vif-plugged:40a2a511-d0f6-45a5-808a-ad3adaa8829a for instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 on n-h1-847009-13 Aug 23 11:59:14.357582 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-80e3ddfb-67d9-420a-963a-2750ffb006f9 req-419fa24f-983e-4ef3-aa29-b47cc1d1c8dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Aug 23 11:59:14.358208 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4044/8143] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 11:59:14.580536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:14.581185 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:14.584419 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:14.591088 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:14.591586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:14.592030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:14.592752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:14.593229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:14.593667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:14.727663 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:14.735336 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-045dfb73-2506-49df-90c5-7ee385ae2442 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.158690 Aug 23 11:59:14.735901 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4100/8144] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:14 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:15.754291 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:15.755217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:15.761102 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:15.761838 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:15.769009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:15.769528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:15.769990 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:15.770718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:15.771879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:15.772341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:15.910302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:15.919156 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6033b80a-67e0-40b1-8214-59d4250d69a0 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1393 microversion: 2.1 time: 0.165952 Aug 23 11:59:15.919754 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4045/8145] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:15 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:16.939497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:16.940111 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:16.942077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:16.948432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:16.948966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:16.949416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:16.950120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:16.950588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:16.951027 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:17.088631 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:17.096366 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-787404d0-6c5a-4b8e-8f09-7a0fc2361c24 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1565 microversion: 2.1 time: 0.160831 Aug 23 11:59:17.096988 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4101/8146] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:16 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:17.117164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:17.117793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:17.124634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:17.125160 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:17.125618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:17.126328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:17.126805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:17.127250 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:17.263897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:17.272244 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e21b137b-f11c-48c4-ae7a-3edea2516119 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1565 microversion: 2.1 time: 0.159583 Aug 23 11:59:17.272845 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4046/8147] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:17 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:19.176209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5a118277-d883-4700-82ad-ca13661f551e req-f94608c3-bc38-4a06-92ad-e03660bb7c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adb1895-9fbf-4826-ba11-009f3acf1c91", "tag": "40a2a511-d0f6-45a5-808a-ad3adaa8829a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:59:19.179275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 11:59:19.179933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:19.186940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:19.187433 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:19.187875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:19.188229 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a118277-d883-4700-82ad-ca13661f551e req-f94608c3-bc38-4a06-92ad-e03660bb7c6a service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:19.188585 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:19.188752 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a118277-d883-4700-82ad-ca13661f551e req-f94608c3-bc38-4a06-92ad-e03660bb7c6a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:19.189152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:19.189481 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5a118277-d883-4700-82ad-ca13661f551e req-f94608c3-bc38-4a06-92ad-e03660bb7c6a service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:19.189603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:19.203121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5a118277-d883-4700-82ad-ca13661f551e req-f94608c3-bc38-4a06-92ad-e03660bb7c6a service nova] Creating event network-changed:40a2a511-d0f6-45a5-808a-ad3adaa8829a for instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 on n-h1-847009-13 Aug 23 11:59:19.208309 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5a118277-d883-4700-82ad-ca13661f551e req-f94608c3-bc38-4a06-92ad-e03660bb7c6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036486 Aug 23 11:59:19.209282 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4047/8148] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 11:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 11:59:19.354226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 11:59:19.367484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc7db5f0-ac4b-44a5-b47c-2cfb793d6e61 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1565 microversion: 2.1 time: 0.200585 Aug 23 11:59:19.368649 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4102/8149] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 11:59:19 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1565 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 11:59:50.650253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:50.651038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=38 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 11:59:50.655226 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 11:59:50.657537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 11:59:50.665468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:50.665974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:50.666434 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:50.667150 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 11:59:50.667626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 11:59:50.668070 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 11:59:50.736069 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e7e18c1e-8f9d-4f4f-b688-88b2a8ab44f9 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action" status: 200 len: 24571 microversion: 2.1 time: 0.088212 Aug 23 11:59:50.736793 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4048/8150] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 11:59:50 2022] POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 12:00:29.794994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:29.795685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=42 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:29.799953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:29.800514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:29.807293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:29.807784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:29.808238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:29.808977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:29.809443 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:29.809877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:29.832799 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lazy-loading 'flavor' on Instance uuid 7adb1895-9fbf-4826-ba11-009f3acf1c91 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 12:00:29.899714 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53b00dad-189b-4d73-8d83-45938e5f42a1 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action" status: 202 len: 0 microversion: 2.1 time: 0.105834 Aug 23 12:00:29.900442 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4103/8151] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:00:29 2022] POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:00:29.909726 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:29.910483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:29.913047 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:29.913718 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:29.921182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:29.921701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:29.922161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:29.922888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:29.923364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:29.923810 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:30.060536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:30.068769 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0e4e07c7-dd68-4eb2-9f53-b953d0eedd3a tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1692 microversion: 2.1 time: 0.163634 Aug 23 12:00:30.069341 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4049/8152] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:29 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:31.093113 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:31.093835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:31.101003 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:31.101507 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:31.101954 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:31.102745 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:31.103214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:31.103645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:31.246501 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:31.254310 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d41cc73-d531-4c2e-8994-85a7d43fb84b tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1692 microversion: 2.1 time: 0.166735 Aug 23 12:00:31.254884 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4104/8153] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:31 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:32.276789 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:32.277335 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:32.285084 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:32.285584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:32.286035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:32.286743 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:32.287217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:32.287661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:32.426148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:32.433946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a740927e-afec-4d97-a166-361317815d28 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1675 microversion: 2.1 time: 0.161855 Aug 23 12:00:32.434514 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4050/8154] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:32 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:33.527101 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:33.529330 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:33.536171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:33.536660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:33.537154 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:33.537859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:33.538327 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:33.538760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:33.600457 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-720e02a0-66d3-43b0-a9f8-85ebabcc2681 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action" status: 200 len: 38372 microversion: 2.1 time: 0.077236 Aug 23 12:00:33.601152 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4105/8155] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:00:33 2022] POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action => generated 38372 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 12:00:33.613511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:33.614100 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:33.621882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:33.622390 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:33.622849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:33.623592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:33.624071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:33.624516 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:33.693020 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8eda9417-5bf8-42c0-93ef-6eb2b5cf8f12 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action" status: 202 len: 0 microversion: 2.1 time: 0.082979 Aug 23 12:00:33.693661 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4051/8156] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:00:33 2022] POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:00:33.702509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:33.703537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:33.710709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:33.711207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:33.711711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:33.712511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:33.713071 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:33.713516 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:33.850848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:33.859075 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6d0c8ca4-d28d-4695-9bad-635dba676dc7 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1681 microversion: 2.1 time: 0.160766 Aug 23 12:00:33.859694 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4106/8157] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:33 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:34.881661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:34.882381 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:34.889071 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:34.889576 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:34.890034 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:34.890744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:34.891222 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:34.891670 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:35.036551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:35.044433 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5dd0d120-2a08-4059-96ad-dfffe8ddc529 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1681 microversion: 2.1 time: 0.167951 Aug 23 12:00:35.045146 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4052/8158] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:34 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:36.066018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:36.066641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:36.073797 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:36.074289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:36.074737 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:36.075439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:36.075905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:36.076339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:36.207886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:36.216375 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-40c8c341-c11e-4127-b651-d96c1d7d3a29 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1684 microversion: 2.1 time: 0.154256 Aug 23 12:00:36.216918 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4107/8159] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:36 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:36.313013 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:36.315704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:36.326351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:36.326795 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:36.327255 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:36.328019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:36.328496 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:36.329001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:36.400778 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d05c019b-7fce-44bd-a514-5d5a4b0bf095 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action" status: 200 len: 38372 microversion: 2.1 time: 0.091409 Aug 23 12:00:36.401446 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4053/8160] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:00:36 2022] POST /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91/action => generated 38372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 12:00:37.417096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:37.417611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:37.424969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:37.425457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:37.425895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:37.426599 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:37.427056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:37.427686 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:37.456011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 12:00:37.480859 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a6ba5956-2ca0-4b71-ae67-775e7434ec8c req-7c634c1e-c8e4-43bf-bf7f-3e4683019c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adb1895-9fbf-4826-ba11-009f3acf1c91", "tag": "40a2a511-d0f6-45a5-808a-ad3adaa8829a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:37.494940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a6ba5956-2ca0-4b71-ae67-775e7434ec8c req-7c634c1e-c8e4-43bf-bf7f-3e4683019c09 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:37.495641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a6ba5956-2ca0-4b71-ae67-775e7434ec8c req-7c634c1e-c8e4-43bf-bf7f-3e4683019c09 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:37.496204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a6ba5956-2ca0-4b71-ae67-775e7434ec8c req-7c634c1e-c8e4-43bf-bf7f-3e4683019c09 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:37.508021 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a6ba5956-2ca0-4b71-ae67-775e7434ec8c req-7c634c1e-c8e4-43bf-bf7f-3e4683019c09 service nova] Creating event network-changed:40a2a511-d0f6-45a5-808a-ad3adaa8829a for instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 on n-h1-847009-13 Aug 23 12:00:37.514698 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a6ba5956-2ca0-4b71-ae67-775e7434ec8c req-7c634c1e-c8e4-43bf-bf7f-3e4683019c09 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098967 Aug 23 12:00:37.516098 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4054/8161] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:00:37.548212 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b4b5e8fa-1886-46c6-acb8-9d7b2ff4b241 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 204 len: 0 microversion: 2.1 time: 0.135415 Aug 23 12:00:37.549146 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4108/8162] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 12:00:37 2022] DELETE /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 12:00:37.561903 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:37.562646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:37.571446 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:37.571956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:37.572420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:37.573180 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:37.573659 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:37.574106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:37.720782 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:37.729560 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-af48debd-d1cd-420b-9824-e751f1a70936 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1690 microversion: 2.1 time: 0.175110 Aug 23 12:00:37.730155 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4055/8163] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:37 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:38.752157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:38.752924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:38.759895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:38.760383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:38.760858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:38.761568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:38.762055 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:38.762473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:38.908319 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:38.916816 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2893960d-03a0-46e4-a0bb-d2e5d5387059 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1690 microversion: 2.1 time: 0.168963 Aug 23 12:00:38.917489 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4109/8164] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:38 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:39.939181 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:39.939784 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:39.947374 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-c8e43046-d391-4231-bbb0-41ed6c8360a5 req-215aa5df-a3a6-4ac7-894e-c2dd4d02ae10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adb1895-9fbf-4826-ba11-009f3acf1c91", "name": "network-vif-deleted", "tag": "40a2a511-d0f6-45a5-808a-ad3adaa8829a"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:39.948246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:39.948773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:39.949217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:39.950196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:39.950899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:39.951550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:39.958292 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8e43046-d391-4231-bbb0-41ed6c8360a5 req-215aa5df-a3a6-4ac7-894e-c2dd4d02ae10 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:39.958948 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8e43046-d391-4231-bbb0-41ed6c8360a5 req-215aa5df-a3a6-4ac7-894e-c2dd4d02ae10 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:39.959413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-c8e43046-d391-4231-bbb0-41ed6c8360a5 req-215aa5df-a3a6-4ac7-894e-c2dd4d02ae10 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:39.972202 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-c8e43046-d391-4231-bbb0-41ed6c8360a5 req-215aa5df-a3a6-4ac7-894e-c2dd4d02ae10 service nova] Creating event network-vif-deleted:40a2a511-d0f6-45a5-808a-ad3adaa8829a for instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 on n-h1-847009-13 Aug 23 12:00:39.977333 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-c8e43046-d391-4231-bbb0-41ed6c8360a5 req-215aa5df-a3a6-4ac7-894e-c2dd4d02ae10 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095201 Aug 23 12:00:39.977945 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4056/8165] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:00:40.035017 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '909392ee039245bbb849528dcd9755b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84c0307fdab42c6873ef9bfb9db2cdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:40.044055 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a567b67e-aca9-42ba-9b9c-d62db20425e5 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 200 len: 1352 microversion: 2.1 time: 0.108725 Aug 23 12:00:40.044632 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4110/8166] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:39 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:41.067541 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:41.068259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] [instance: 7adb1895-9fbf-4826-ba11-009f3acf1c91] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:41.074664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:41.075201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:41.075656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:41.076365 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:41.076879 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:41.077308 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:41.090450 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] HTTP exception thrown: Instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 could not be found. Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Request method failure captured: Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 HTTP/1.1 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBL9i98IsNBLME7tC3kD4X5woB81wSQj03hv9tZ8czsC0mq2JLCQz1IU_DZlej4pWXYSLBjWiFbpiczh6KSR-eePhfg22uGnUgHwMPsv4qOH9IiuXCgORcHn4kbZrr_MIOpuRyTPpWB7-Xc4C_nAmNlSdy2bUIswdskxO5XaQ8A2MWNQ Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a84c0307fdab42c6873ef9bfb9db2cdd", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a84c0307fdab42c6873ef9bfb9db2cdd"}]}] Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: a84c0307fdab42c6873ef9bfb9db2cdd Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1625592510 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 909392ee039245bbb849528dcd9755b0 Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1625592510-project Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 could not be found. Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '7adb1895-9fbf-4826-ba11-009f3acf1c91'} Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 could not be found. Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 could not be found. Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:00:41.092134 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 could not be found. Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Returning 404 to user: Instance 7adb1895-9fbf-4826-ba11-009f3acf1c91 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e73dfea4-4bc1-424a-8560-054cbcc0432d tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91" status: 404 len: 111 microversion: 2.1 time: 0.031464 Aug 23 12:00:41.097532 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4057/8167] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:41 2022] GET /compute/v2.1/servers/7adb1895-9fbf-4826-ba11-009f3acf1c91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 12:00:44.462619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-86190dc9-2f6f-4a17-85ac-78062bc24567 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] Calling method '.version_select at 0x7fdca1e91ee0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:44.482829 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-86190dc9-2f6f-4a17-85ac-78062bc24567 tempest-TestNetworkAdvancedServerOps-1625592510 tempest-TestNetworkAdvancedServerOps-1625592510-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1936995080" status: 202 len: 0 microversion: 2.1 time: 0.024802 Aug 23 12:00:44.483420 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4111/8168] 10.222.0.78 () {58 vars in 1284 bytes} [Tue Aug 23 12:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1936995080 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:00:55.573620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=18 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:55.574408 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:55.781808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-24a04f4f-b274-4bd4-a4f0-d1a96825ffe4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'create', calling method: .version_select at 0x7fdca1e0a310>, body: {"keypair": {"name": "tempest-TestShelveInstance-905297829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf6B5HNu1uNTn8BuJioWai4ZMvSb2NUVBt2z340r7Aim5frQD9r2gmWei/FJ8qVFdMF+KYjy/xJ4cj/lOG42Ahe9vPQf63mAPnunRtlv33jBDeMoMVBFix5g+dVCC0ufQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:55.811533 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-24a04f4f-b274-4bd4-a4f0-d1a96825ffe4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for project 82da471a2dbc498885307cd2bdc673e2. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:00:55.819836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-24a04f4f-b274-4bd4-a4f0-d1a96825ffe4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for user f8947b4fd42c472a89d6484cc945f5a6 and project 82da471a2dbc498885307cd2bdc673e2. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:00:55.855933 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-24a04f4f-b274-4bd4-a4f0-d1a96825ffe4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.288816 Aug 23 12:00:55.856923 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4058/8169] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 12:00:55 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:00:56.900408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:56.901224 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:00:56.905612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-455640719", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-905297829", "security_groups": [{"name": "tempest-secgroup-smoke-1881358406"}], "networks": [{"uuid": "2606d342-15b8-4312-91ca-576251ba4bb7"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:00:57.018087 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] validate_networks() for [('2606d342-15b8-4312-91ca-576251ba4bb7', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 12:00:57.405979 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 12:00:57.406411 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 12:00:57.406969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 12:00:57.407558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 12:00:57.407857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 12:00:57.418203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:57.418703 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:57.419150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:57.419927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:00:57.420390 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:00:57.420855 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:00:57.437905 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for project 82da471a2dbc498885307cd2bdc673e2. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:00:57.443565 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for user f8947b4fd42c472a89d6484cc945f5a6 and project 82da471a2dbc498885307cd2bdc673e2. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:00:57.456466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 12:00:57.458845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 12:00:57.504599 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:00:58.529445 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 47656. Aug 23 12:00:58.535764 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ffb04cdc-e429-43b8-905d-018a974740e1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.637270 Aug 23 12:00:58.536795 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4112/8170] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 12:00:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 12:00:58.548618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5bde0c2c-39b1-43cc-844c-419fba0042e0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:58.549310 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5bde0c2c-39b1-43cc-844c-419fba0042e0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:58.613276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5bde0c2c-39b1-43cc-844c-419fba0042e0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:58.620908 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5bde0c2c-39b1-43cc-844c-419fba0042e0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1245 microversion: 2.1 time: 0.076996 Aug 23 12:00:58.621590 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4059/8171] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:58 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:00:59.643918 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-17b37e64-e24f-4f96-905c-a64a43fccc40 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:00:59.644545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-17b37e64-e24f-4f96-905c-a64a43fccc40 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:00:59.702193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-17b37e64-e24f-4f96-905c-a64a43fccc40 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:00:59.709687 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-17b37e64-e24f-4f96-905c-a64a43fccc40 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1245 microversion: 2.1 time: 0.071232 Aug 23 12:00:59.710094 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4113/8172] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:00:59 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:00.731316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c064e502-aa20-4ac1-89d4-87df1180d73b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:00.731863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c064e502-aa20-4ac1-89d4-87df1180d73b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:00.787949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c064e502-aa20-4ac1-89d4-87df1180d73b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:00.796268 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c064e502-aa20-4ac1-89d4-87df1180d73b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1245 microversion: 2.1 time: 0.069660 Aug 23 12:01:00.796878 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4060/8173] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:00 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:01.817257 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:01.817899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:01.826488 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:01.826977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:01.827426 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:01.828126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:01.828587 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:01.829046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:01.893619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:01.902367 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2ad5af53-1efa-44cc-b544-eb5cc894ad42 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1249 microversion: 2.1 time: 0.089223 Aug 23 12:01:01.902975 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4114/8174] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:01 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:02.923815 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:02.924485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:02.931701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:02.932543 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:02.933038 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:02.933842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:02.934324 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:02.934775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:03.005783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:03.017104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-48cafca4-7fdb-4ddd-b552-1353302c6d52 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1303 microversion: 2.1 time: 0.097304 Aug 23 12:01:03.017865 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4061/8175] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:02 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:04.040442 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:04.043629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-88498b5d-81d0-49c0-8d4d-c5f039ff71b3 req-dd5fa652-dce0-48e9-83f5-bcc84dd71854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:01:04.047800 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:04.056164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:04.056773 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:04.057307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:04.058251 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:04.058881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-88498b5d-81d0-49c0-8d4d-c5f039ff71b3 req-dd5fa652-dce0-48e9-83f5-bcc84dd71854 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:04.059028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:04.059868 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:04.059988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-88498b5d-81d0-49c0-8d4d-c5f039ff71b3 req-dd5fa652-dce0-48e9-83f5-bcc84dd71854 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:04.060370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-88498b5d-81d0-49c0-8d4d-c5f039ff71b3 req-dd5fa652-dce0-48e9-83f5-bcc84dd71854 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:04.073595 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-88498b5d-81d0-49c0-8d4d-c5f039ff71b3 req-dd5fa652-dce0-48e9-83f5-bcc84dd71854 service nova] Creating event network-changed:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h2-847009-13 Aug 23 12:01:04.080186 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-88498b5d-81d0-49c0-8d4d-c5f039ff71b3 req-dd5fa652-dce0-48e9-83f5-bcc84dd71854 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041888 Aug 23 12:01:04.082054 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4062/8176] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:01:04.588361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:04.596700 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dfbf1fd8-2bab-4fd5-9b83-9faf9a89da4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1371 microversion: 2.1 time: 0.560516 Aug 23 12:01:04.597312 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4115/8177] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:04 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1371 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:05.618970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:05.619719 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:05.626855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:05.627351 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:05.627802 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:05.628511 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:05.629010 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:05.629451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:05.772861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:05.781448 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d8dbc5c7-b4bd-44d9-ae0f-039d128016e8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1371 microversion: 2.1 time: 0.166811 Aug 23 12:01:05.782338 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4063/8178] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:05 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:06.801969 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:06.802582 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:06.809934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:06.810407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:06.810887 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:06.811591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:06.812052 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:06.812487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:06.950861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:06.958746 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d50a8db7-0041-4c20-b9c8-a7d3aacefb9f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1371 microversion: 2.1 time: 0.160685 Aug 23 12:01:06.959332 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4116/8179] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:06 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:07.980817 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:07.981396 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:07.988241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:07.988758 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:07.989221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:07.989930 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:07.990405 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:07.990847 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:08.130919 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:08.139066 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adfc346e-cc9b-4b5e-91be-217d004b95f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1371 microversion: 2.1 time: 0.163487 Aug 23 12:01:08.139651 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4064/8180] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:07 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:09.160245 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:09.160818 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:09.162706 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:01:09.170070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:09.170564 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:09.171048 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:09.171746 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:09.172210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:09.172709 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:09.325878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:09.334733 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84fbfec9-3da7-45fc-8d73-c8615f1d79dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1371 microversion: 2.1 time: 0.178698 Aug 23 12:01:09.336930 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4117/8181] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:09 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:09.529476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-2f3e62ab-8650-4113-8ce8-7cc28a27cf7f req-428d2f60-82df-4de7-8abb-351090272841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "name": "network-vif-plugged", "status": "completed", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:01:09.548050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2f3e62ab-8650-4113-8ce8-7cc28a27cf7f req-428d2f60-82df-4de7-8abb-351090272841 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:09.551519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2f3e62ab-8650-4113-8ce8-7cc28a27cf7f req-428d2f60-82df-4de7-8abb-351090272841 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:09.551519 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-2f3e62ab-8650-4113-8ce8-7cc28a27cf7f req-428d2f60-82df-4de7-8abb-351090272841 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:09.567024 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-2f3e62ab-8650-4113-8ce8-7cc28a27cf7f req-428d2f60-82df-4de7-8abb-351090272841 service nova] Creating event network-vif-plugged:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h2-847009-13 Aug 23 12:01:09.574708 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-2f3e62ab-8650-4113-8ce8-7cc28a27cf7f req-428d2f60-82df-4de7-8abb-351090272841 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125975 Aug 23 12:01:09.575405 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4065/8182] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:01:10.356234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:10.356809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:10.358793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=8 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:01:10.365682 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:10.366178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:10.366625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:10.368021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:10.369174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:10.369174 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:10.512556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:10.520662 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ff4bdc90-6489-4f6c-9b66-ecf4a2b97578 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1371 microversion: 2.1 time: 0.169049 Aug 23 12:01:10.521332 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4118/8183] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:10 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:11.543603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:11.544333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:11.547317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=8 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:01:11.553110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:11.553622 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:11.554082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:11.555333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:11.555819 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:11.556265 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:11.696303 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:11.704709 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-546df695-c68e-40e2-aac3-51dffa6c7e3b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1555 microversion: 2.1 time: 0.165920 Aug 23 12:01:11.705333 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4066/8184] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:11 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:11.733369 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:01:11.733987 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:01:11.740179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:11.740672 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:11.741153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:11.741859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:11.742435 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:11.743083 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:11.878766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:01:11.887950 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-115276be-ff8d-4c09-bcbf-55295b844b41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1555 microversion: 2.1 time: 0.158852 Aug 23 12:01:11.888532 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4119/8185] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:01:11 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:01:13.724204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8a917448-1100-4f78-a1b5-768b72405533 req-bfe1c897-b346-4930-8748-0a6e5be8ce33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:01:13.735565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a917448-1100-4f78-a1b5-768b72405533 req-bfe1c897-b346-4930-8748-0a6e5be8ce33 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:01:13.736065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a917448-1100-4f78-a1b5-768b72405533 req-bfe1c897-b346-4930-8748-0a6e5be8ce33 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:01:13.736538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8a917448-1100-4f78-a1b5-768b72405533 req-bfe1c897-b346-4930-8748-0a6e5be8ce33 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:01:13.749009 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8a917448-1100-4f78-a1b5-768b72405533 req-bfe1c897-b346-4930-8748-0a6e5be8ce33 service nova] Creating event network-changed:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h2-847009-13 Aug 23 12:01:13.754454 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8a917448-1100-4f78-a1b5-768b72405533 req-bfe1c897-b346-4930-8748-0a6e5be8ce33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034022 Aug 23 12:01:13.755176 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4067/8186] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:01:47.445924 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:01:47.446596 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:03:08.916259 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 12:03:08.917189 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 12:03:08.917984 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:08.918738 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=38 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:08.923839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:03:08.924368 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:08.933228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:08.933720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:08.934164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:08.934866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:08.935328 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:08.935756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:08.962713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lazy-loading 'flavor' on Instance uuid 4041316c-55d2-47f9-ad3f-9ed523192155 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 12:03:09.287661 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5b42d7ab-7e43-4d81-9982-e1d1a7380c7b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155/action" status: 202 len: 0 microversion: 2.1 time: 0.373833 Aug 23 12:03:09.288955 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4120/8187] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:03:08 2022] POST /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:03:09.295807 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:09.296593 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=30 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:09.300898 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:09.301641 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:09.309406 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:09.310009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:09.310471 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:09.311193 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:09.311675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:09.312125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:09.498385 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:09.506160 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ae10096c-67c9-414b-8023-34aa4cfdca6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.212662 Aug 23 12:03:09.506721 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4068/8188] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:09 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:10.529129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:10.529836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:10.539476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:10.539976 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:10.540417 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:10.541150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:10.541614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:10.542044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:10.546885 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 47774. Aug 23 12:03:10.549960 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 47776. Aug 23 12:03:10.687117 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:10.696098 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-dc7d4b14-500a-4556-80c2-c995aa42f170 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.172199 Aug 23 12:03:10.696715 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4121/8189] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:10 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:11.724693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:11.724693 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:11.733499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:11.734011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:11.734466 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:11.735192 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:11.735668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:11.736115 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:11.877089 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:11.885782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-287bb609-3f06-437c-a567-847754e4dadf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.170651 Aug 23 12:03:11.886363 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4069/8190] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:11 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:12.906469 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:12.907098 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:12.914903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:12.915397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:12.915847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:12.916558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:12.917053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:12.917484 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:13.057353 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:13.065806 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-36c76bb4-c289-4ead-9317-1bfa79cc8846 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.163300 Aug 23 12:03:13.066409 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4122/8191] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:12 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:03:14.087664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:14.088241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:14.095218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:14.095724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:14.096182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:14.096921 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:14.097399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:14.097844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:14.234996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:14.243668 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-cacede6e-09d8-4ce1-95c3-b1b9556f1889 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.160443 Aug 23 12:03:14.244241 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4070/8192] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:14 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:15.265047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:15.265667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:15.272556 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:15.273568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:15.274558 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:15.275269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:15.275734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:15.276168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:15.410502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:15.419442 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-32bc1dc3-44a9-4ee8-9e19-aed7e4d2f71a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.158423 Aug 23 12:03:15.420018 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4123/8193] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:15 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:16.441425 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:16.442060 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:16.449442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:16.449972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:16.450431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:16.451139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:16.451620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:16.452063 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:16.583584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:16.591946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-62c2c3db-5cbb-4e02-a0fc-3c2f8020ebe3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.154842 Aug 23 12:03:16.592529 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4071/8194] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:16 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:03:17.622550 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:17.623694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:17.634096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:17.634586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:17.635028 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:17.635734 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:17.636193 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:17.636620 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:17.772178 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:17.781274 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-73d95d39-73e5-4c01-9a94-0c1e727e0156 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.166663 Aug 23 12:03:17.781860 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4124/8195] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:17 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:18.802487 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:18.803451 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:18.810808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:18.811318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:18.811780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:18.812501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:18.813007 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:18.813457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:18.950864 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:18.958729 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c1eca114-211b-4e9f-8aac-f17b5d4b4258 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.160244 Aug 23 12:03:18.959414 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4072/8196] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:18 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:19.981998 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:19.982613 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:19.988677 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:19.989206 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:19.989676 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:19.990357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:19.990824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:19.991260 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:20.125293 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:20.134055 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f4b70fdd-1ade-42a3-a631-84362109edb7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1700 microversion: 2.1 time: 0.157659 Aug 23 12:03:20.134642 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4125/8197] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:19 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:21.155413 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:21.156074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:21.163008 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:21.163509 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:21.163958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:21.164878 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:21.165352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:21.165790 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:21.298159 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:21.306738 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0725ff8a-e5f6-4303-b454-1eef29f6d1f0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1700 microversion: 2.1 time: 0.155300 Aug 23 12:03:21.307518 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4073/8198] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:21 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:22.332586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:22.333246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:22.341215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:22.341913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:22.342518 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:22.343388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:22.344159 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:22.345255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:22.499695 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:22.508295 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-00b34136-189a-4c53-8d56-36e29a12a60f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.179616 Aug 23 12:03:22.509154 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4126/8199] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:22 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:23.530660 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:23.531986 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:23.540494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:23.541311 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:23.541772 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:23.542700 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:23.543437 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:23.543953 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:23.703891 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:23.713882 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e3147be1-61e9-438a-b84b-bbe3845a8547 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.187143 Aug 23 12:03:23.714841 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4074/8200] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:23 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:24.194509 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-a82efcb9-3161-4c68-9182-463285e2cf10 req-e775c189-8912-49c4-b449-2af430f601a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "name": "network-vif-plugged", "status": "completed", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:03:24.209757 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a82efcb9-3161-4c68-9182-463285e2cf10 req-e775c189-8912-49c4-b449-2af430f601a8 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:24.211191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a82efcb9-3161-4c68-9182-463285e2cf10 req-e775c189-8912-49c4-b449-2af430f601a8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:24.211870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-a82efcb9-3161-4c68-9182-463285e2cf10 req-e775c189-8912-49c4-b449-2af430f601a8 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:24.232129 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-a82efcb9-3161-4c68-9182-463285e2cf10 req-e775c189-8912-49c4-b449-2af430f601a8 service nova] Creating event network-vif-plugged:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h2-847009-13 Aug 23 12:03:24.237498 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-a82efcb9-3161-4c68-9182-463285e2cf10 req-e775c189-8912-49c4-b449-2af430f601a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046713 Aug 23 12:03:24.238520 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4127/8201] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:03:24.737927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:24.738572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:24.745938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:24.746457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:24.746915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:24.747652 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:24.748123 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:24.748570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:24.899021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:24.907806 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8cf8d7ad-237d-4290-85ae-7c6c30736be1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.173856 Aug 23 12:03:24.908406 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4075/8202] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:24 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:25.931215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:25.931939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:25.939563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:25.940289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:25.940934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:25.941909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:25.942575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:25.943809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:26.099173 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:26.108409 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a1ccbbae-966e-4194-9451-4ce9930558a4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.182887 Aug 23 12:03:26.109414 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4128/8203] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:25 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:27.132001 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:27.133564 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:27.141305 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:27.141907 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:27.142600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:27.143537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:27.144238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:27.144781 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:27.293996 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:27.303406 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-708719e4-fee1-4f18-989a-feba5439570f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.175454 Aug 23 12:03:27.316765 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4076/8204] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:27 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:28.328103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:28.328962 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:28.337164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:28.338033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:28.338877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:28.339860 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:28.340388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:28.340949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:28.513244 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:28.522702 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b88ba484-63d0-4d34-8e64-649e73e2ab41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.199037 Aug 23 12:03:28.524063 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4129/8205] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:28 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:29.545818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:29.546454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:29.556347 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:29.556897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:29.557352 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:29.558377 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:29.558918 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:29.559575 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:29.721295 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:29.733901 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-ca7583a0-d4fe-4fec-ae39-e3a0ca0870b0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.191914 Aug 23 12:03:29.746236 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4077/8206] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:29 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:30.755876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:30.757771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:30.766198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:30.767167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:30.767618 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:30.768341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:30.768833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:30.769279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:30.941198 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:30.950431 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-29dd5bd4-71c5-4728-877e-3080a7577490 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1695 microversion: 2.1 time: 0.198503 Aug 23 12:03:30.951040 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4130/8207] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:30 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:31.973424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:31.974128 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:31.982317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:31.982824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:31.983299 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:31.984006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:31.984497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:31.984966 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:32.132006 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:32.140119 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3143dafd-a188-4577-a1d0-7d84546bf36e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1677 microversion: 2.1 time: 0.170712 Aug 23 12:03:32.140711 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4078/8208] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:31 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:33.161828 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:33.162445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:33.170157 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:33.170648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:33.171096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:33.171802 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:33.172275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:33.172707 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:33.307162 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:33.315434 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a219f4f3-90c7-4c29-897e-aa90c074b33d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1677 microversion: 2.1 time: 0.157567 Aug 23 12:03:33.316012 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4131/8209] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:33 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:34.336354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:34.337017 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:34.343973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:34.344485 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:34.344976 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:34.345696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:34.346177 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:34.346626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:34.487019 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:34.497157 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4006013a-9bda-4bd2-92c6-6e0b5292c26a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1680 microversion: 2.1 time: 0.164729 Aug 23 12:03:34.497946 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4079/8210] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:34 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:34.518235 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:03:34.518854 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:34.525804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:34.526299 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:34.526933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:34.527653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:34.528119 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:34.528554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:34.632913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128859) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 12:03:34.703483 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a211dc62-bbb2-4b8b-8233-997e4a3a7d38 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155/action" status: 202 len: 0 microversion: 2.1 time: 0.189291 Aug 23 12:03:34.704111 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4132/8211] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:03:34 2022] POST /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:03:34.714273 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:34.716074 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:34.722992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:34.724940 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:34.726697 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:34.727852 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:34.728620 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:34.729366 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:34.872797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:34.881033 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6e0e309c-77d2-4de8-9896-a3dc11d553cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1628 microversion: 2.1 time: 0.172586 Aug 23 12:03:34.881608 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4080/8212] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:34 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1628 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:35.904022 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:35.904640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:35.911538 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:35.912021 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:35.912465 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:35.913212 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:35.913692 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:35.914080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:36.049096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:36.059556 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ec967f70-6305-4f34-8f87-a8c62c0900d2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.159422 Aug 23 12:03:36.060142 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4133/8213] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:35 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:03:36.142218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "name": "network-vif-unplugged", "status": "completed", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:03:36.155066 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:36.155844 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:36.156306 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:36.168460 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] Creating event network-vif-unplugged:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h1-847009-13 Aug 23 12:03:36.172347 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] [9ef23931-b2d2-4aa9-b194-dc95e3c928b5] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:03:36.835002 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ffbf6f7b-776b-4ddf-993e-97343d611ba8 req-61ad03da-779d-4fce-94d4-407925cb3c53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:03:36.844494 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ffbf6f7b-776b-4ddf-993e-97343d611ba8 req-61ad03da-779d-4fce-94d4-407925cb3c53 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:36.845008 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ffbf6f7b-776b-4ddf-993e-97343d611ba8 req-61ad03da-779d-4fce-94d4-407925cb3c53 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:36.845432 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ffbf6f7b-776b-4ddf-993e-97343d611ba8 req-61ad03da-779d-4fce-94d4-407925cb3c53 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:36.849625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:36.858349 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-ffbf6f7b-776b-4ddf-993e-97343d611ba8 req-61ad03da-779d-4fce-94d4-407925cb3c53 service nova] Creating event network-changed:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h1-847009-13 Aug 23 12:03:36.863700 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ffbf6f7b-776b-4ddf-993e-97343d611ba8 req-61ad03da-779d-4fce-94d4-407925cb3c53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032308 Aug 23 12:03:36.864290 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4134/8214] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 12:03:37.083656 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:37.084388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:37.092780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:37.093255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:37.093713 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:37.094430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:37.094900 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:37.095335 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:37.182653 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] [9ef23931-b2d2-4aa9-b194-dc95e3c928b5] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 47910. Aug 23 12:03:37.186104 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b72518c5-315e-4314-a578-68eea467698f req-dfcd7e72-1095-4ea0-8fd1-bdc2ca5b2b57 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.048335 Aug 23 12:03:37.186731 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4081/8215] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:03:37.275216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:37.283314 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-28ceae57-6a8b-4780-90e2-615cc05ecbf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.205063 Aug 23 12:03:37.283899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4135/8216] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:37 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:03:38.307474 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:38.308883 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:38.316206 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:38.317024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:38.317664 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:38.318602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:38.319080 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:38.320110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:38.481970 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:38.492522 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d66e7f0-cb38-4914-9bc6-a9738c352925 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.189430 Aug 23 12:03:38.493634 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4082/8217] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:38 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:03:39.514246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:39.515665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:39.519337 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:39.529020 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:39.529611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:39.530121 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:39.530912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:39.531497 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:39.531930 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:39.677949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:39.687331 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cbd319ea-f661-4efb-8f8b-248eaaeb42ed tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.176924 Aug 23 12:03:39.688640 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4136/8218] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:39 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:40.712589 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:40.714072 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:40.717367 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=31 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:40.723224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:40.723833 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:40.724368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:40.725215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:40.725866 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:40.727050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:40.730553 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=87 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:03:40.896750 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:40.905490 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d78d21f0-4c21-478d-acb8-6c5f17c08145 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.197478 Aug 23 12:03:40.906083 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4083/8219] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:40 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:41.928161 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:41.928943 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:41.936275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:41.936861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:41.937316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:41.938097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:41.938808 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:41.939309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:42.125315 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:42.134490 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cadd1b34-94c2-4eb5-b8b2-70e718c55bd1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.210681 Aug 23 12:03:42.140014 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4137/8220] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:41 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:43.161547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:43.162182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:43.169973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:43.170501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:43.170952 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:43.171687 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:43.172171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:43.174696 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:43.343130 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:43.352491 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-512b0a59-83db-4e90-839f-2b5e84d23175 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.194485 Aug 23 12:03:43.353382 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4084/8221] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:43 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:44.373231 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:44.374361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:44.381377 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:44.381867 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:44.382985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:44.383765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:44.384229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:44.384908 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:44.531589 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:44.540791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b57cc74f-f57e-4cc2-b973-eb199d82d406 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.171330 Aug 23 12:03:44.541392 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4138/8222] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:44 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:45.562668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:45.563552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:45.570739 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:45.571233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:45.571692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:45.572404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:45.572909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:45.573354 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:45.704414 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:45.712522 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3adbd251-ab35-43f7-823d-563480af79aa tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.153865 Aug 23 12:03:45.713185 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4085/8223] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:45 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:46.734163 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:46.734793 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:46.741807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:46.742396 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:46.742912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:46.743622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:46.744096 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:46.744533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:46.886355 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:46.894347 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c64c1fcb-1001-4809-b313-1b9ba31e459b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.164099 Aug 23 12:03:46.894934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4139/8224] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:46 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:47.917131 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:47.917779 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:47.924885 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:47.925397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:47.925857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:47.926572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:47.927081 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:47.927527 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:48.064176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:48.072302 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-faa32c3b-2368-4cc6-b1da-37b6949365dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.159620 Aug 23 12:03:48.072885 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4086/8225] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:47 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:49.093776 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:49.094386 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:49.101444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:49.101923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:49.102358 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:49.103053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:49.103513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:49.103937 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:49.238338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:49.246800 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-3b5f3793-b5bb-486a-ab22-c6fc2f95029f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.157013 Aug 23 12:03:49.247379 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4140/8226] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:49 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:50.267582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:50.268386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:50.276619 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:50.277465 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:50.277624 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:50.278331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:50.278801 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:50.279241 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:50.727546 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:50.735410 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1dbe228b-9714-4c3b-b757-ea6b20b5a106 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.471819 Aug 23 12:03:50.735989 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4087/8227] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:50 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:51.741137 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-eaca2c54-7133-41c3-8f8a-b950b3ea96bb req-24bcf546-ad94-4e6d-86b0-c469944a1074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "name": "network-vif-plugged", "status": "completed", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:03:51.754381 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eaca2c54-7133-41c3-8f8a-b950b3ea96bb req-24bcf546-ad94-4e6d-86b0-c469944a1074 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:51.754923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eaca2c54-7133-41c3-8f8a-b950b3ea96bb req-24bcf546-ad94-4e6d-86b0-c469944a1074 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:51.755323 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-eaca2c54-7133-41c3-8f8a-b950b3ea96bb req-24bcf546-ad94-4e6d-86b0-c469944a1074 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:51.761147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:51.761147 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:51.768705 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-eaca2c54-7133-41c3-8f8a-b950b3ea96bb req-24bcf546-ad94-4e6d-86b0-c469944a1074 service nova] Creating event network-vif-plugged:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h1-847009-13 Aug 23 12:03:51.770157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:51.770690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:51.771152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:51.772445 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:51.772708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:51.774165 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:51.775343 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-eaca2c54-7133-41c3-8f8a-b950b3ea96bb req-24bcf546-ad94-4e6d-86b0-c469944a1074 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037848 Aug 23 12:03:51.775961 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4141/8228] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:03:51.912106 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:51.921611 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5a47b66c-ff9d-4e88-b166-1b31ee100d41 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.168674 Aug 23 12:03:51.922248 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4088/8229] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:51 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:52.946168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:52.946875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:52.953146 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:52.953639 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:52.954079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:52.954777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:52.955239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:52.955673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:53.090129 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:53.097791 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fba7ff67-0a71-425d-a665-fe911ad784ef tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1686 microversion: 2.1 time: 0.157002 Aug 23 12:03:53.098363 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4142/8230] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:52 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:03:54.119724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:03:54.120386 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:03:54.126682 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:54.127136 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:54.127600 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:54.128328 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:03:54.128840 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:03:54.129297 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:03:54.268199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:03:54.276051 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-8deb5665-e7be-4acf-966e-9e7fee0dad4b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1673 microversion: 2.1 time: 0.161605 Aug 23 12:03:54.276624 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4089/8231] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:03:54 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:04:17.387368 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:04:17.388084 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:04:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:04:18.829602 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:04:18.830186 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:05:39.413402 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 12:05:39.419004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:05:39.419514 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:05:39.421640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=13 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:05:39.422696 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 12:05:39.423272 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=13 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:05:39.424068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=41 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:05:39.428517 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=44 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:05:39.434179 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-b38a0dd2-efe6-4fa7-ba89-4c7837276344 req-5e67374e-ad02-4aa8-b57c-66574e3a6725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:05:39.444775 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b38a0dd2-efe6-4fa7-ba89-4c7837276344 req-5e67374e-ad02-4aa8-b57c-66574e3a6725 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:39.448049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:39.448559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:39.449037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:39.449753 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:39.450221 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:39.450657 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:39.455389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b38a0dd2-efe6-4fa7-ba89-4c7837276344 req-5e67374e-ad02-4aa8-b57c-66574e3a6725 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:39.455998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-b38a0dd2-efe6-4fa7-ba89-4c7837276344 req-5e67374e-ad02-4aa8-b57c-66574e3a6725 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:39.469311 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-b38a0dd2-efe6-4fa7-ba89-4c7837276344 req-5e67374e-ad02-4aa8-b57c-66574e3a6725 service nova] Creating event network-changed:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h1-847009-13 Aug 23 12:05:39.474749 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-b38a0dd2-efe6-4fa7-ba89-4c7837276344 req-5e67374e-ad02-4aa8-b57c-66574e3a6725 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063268 Aug 23 12:05:39.475559 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4090/8232] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:05:39.478466 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 12:05:39.575744 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f1cfd8f2-a21e-491e-a0a3-9168a150fd82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 204 len: 0 microversion: 2.1 time: 0.165999 Aug 23 12:05:39.577354 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4143/8233] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 12:05:39 2022] DELETE /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 12:05:39.588174 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:05:39.589176 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:05:39.595958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:39.596460 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:39.597309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:39.598215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:39.598692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:39.599301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:39.738625 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:05:39.747123 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d628fc28-5917-4103-9842-b193265ff03f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.165112 Aug 23 12:05:39.747714 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4091/8234] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:05:39 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:05:40.770756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:05:40.771482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:05:40.778796 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:40.779290 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:40.779731 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:40.780440 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:40.780934 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:40.781367 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:40.953548 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:05:40.962590 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-41f4293f-348e-4a08-9578-38c456d81606 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1679 microversion: 2.1 time: 0.195498 Aug 23 12:05:40.963565 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4144/8235] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:05:40 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:05:41.766239 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48060. Aug 23 12:05:41.776400 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48058. Aug 23 12:05:41.814552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-cdcbaeb8-1582-41d3-b290-b0be7778031b req-b7265595-b9bf-4d2f-8eee-b0daf5c0b4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4041316c-55d2-47f9-ad3f-9ed523192155", "name": "network-vif-deleted", "tag": "241eea3c-10c2-4bc5-8b1f-116615cbc085"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:05:41.825276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cdcbaeb8-1582-41d3-b290-b0be7778031b req-b7265595-b9bf-4d2f-8eee-b0daf5c0b4ab service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:41.825780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cdcbaeb8-1582-41d3-b290-b0be7778031b req-b7265595-b9bf-4d2f-8eee-b0daf5c0b4ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:41.826238 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-cdcbaeb8-1582-41d3-b290-b0be7778031b req-b7265595-b9bf-4d2f-8eee-b0daf5c0b4ab service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:41.838144 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-cdcbaeb8-1582-41d3-b290-b0be7778031b req-b7265595-b9bf-4d2f-8eee-b0daf5c0b4ab service nova] Creating event network-vif-deleted:241eea3c-10c2-4bc5-8b1f-116615cbc085 for instance 4041316c-55d2-47f9-ad3f-9ed523192155 on n-h1-847009-13 Aug 23 12:05:41.843185 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-cdcbaeb8-1582-41d3-b290-b0be7778031b req-b7265595-b9bf-4d2f-8eee-b0daf5c0b4ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092179 Aug 23 12:05:41.844199 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4092/8236] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:05:41.984441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:05:41.985080 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:05:41.992242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:41.992759 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:41.993215 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:41.993909 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:41.994366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:41.994786 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:42.026537 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:42.027025 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:42.027460 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:42.027907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lazy-loading 'fault' on Instance uuid 4041316c-55d2-47f9-ad3f-9ed523192155 {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 12:05:42.075120 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:05:42.083107 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-08ac9e0d-fec0-44d4-ac39-00e73aa630d5 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 200 len: 1335 microversion: 2.1 time: 0.102561 Aug 23 12:05:42.083685 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4145/8237] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:05:41 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:05:43.107197 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:05:43.107923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 4041316c-55d2-47f9-ad3f-9ed523192155] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:05:43.114162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:43.114665 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:43.115119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:43.115832 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:05:43.116307 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:05:43.117534 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:05:43.130892 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] HTTP exception thrown: Instance 4041316c-55d2-47f9-ad3f-9ed523192155 could not be found. Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Request method failure captured: Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 HTTP/1.1 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBMFyJKMZENK4E91eyvDbnG6wGUUpgnHADA1UaNERFhIit2HpxwU01O3AggIRGfqRyHKcMHveK2mz-s488oaiVKzgWiyphJ348VojdSsuuqLo43DYJL93YDIHrxGIumDAFQB_JfLpGshH4Cha4Q_ijM16AykOUZeNMnAjwV9CSeyIfiY Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 82da471a2dbc498885307cd2bdc673e2 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestShelveInstance-553734229 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/82da471a2dbc498885307cd2bdc673e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_82da471a2dbc498885307cd2bdc673e2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/82da471a2dbc498885307cd2bdc673e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/82da471a2dbc498885307cd2bdc673e2"}]}] Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestShelveInstance-553734229 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 82da471a2dbc498885307cd2bdc673e2 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestShelveInstance-553734229 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestShelveInstance-553734229-project Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: f8947b4fd42c472a89d6484cc945f5a6 Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestShelveInstance-553734229-project Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 4041316c-55d2-47f9-ad3f-9ed523192155 could not be found. Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '4041316c-55d2-47f9-ad3f-9ed523192155'} Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4041316c-55d2-47f9-ad3f-9ed523192155 could not be found. Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4041316c-55d2-47f9-ad3f-9ed523192155 could not be found. Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:05:43.132675 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4041316c-55d2-47f9-ad3f-9ed523192155 could not be found. Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Returning 404 to user: Instance 4041316c-55d2-47f9-ad3f-9ed523192155 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-54a6cc3e-ad1f-4c6b-8e93-fe3ddcbbfb44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155" status: 404 len: 111 microversion: 2.1 time: 0.032157 Aug 23 12:05:43.137998 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4093/8238] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:05:43 2022] GET /compute/v2.1/servers/4041316c-55d2-47f9-ad3f-9ed523192155 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 12:05:43.306171 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-b0351e68-87b4-4b3c-971c-ef26f8a1056b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '.version_select at 0x7fdc9c0f88b0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:05:43.331930 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-b0351e68-87b4-4b3c-971c-ef26f8a1056b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-905297829" status: 202 len: 0 microversion: 2.1 time: 0.030422 Aug 23 12:05:43.332522 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4146/8239] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 12:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-905297829 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:05:43.360068 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e6e99040-8709-49e9-9095-a634c108907b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'create', calling method: .version_select at 0x7fdc9c4a75e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-790532023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs4TcNKEI3mWVJ4ZUpTEMnQfz3BbIz+DSGGQ6+w7QeddBjNS3Rt38XiHZ7jPfvEhDnrsaZ3ufkCAPkEF6BceK3BSu8+IWZJc62U8Iq4JyZW64iRqAXhnOQBJaUGYXoG+A=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:05:43.375706 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e6e99040-8709-49e9-9095-a634c108907b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for project 82da471a2dbc498885307cd2bdc673e2. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:05:43.380851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-e6e99040-8709-49e9-9095-a634c108907b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for user f8947b4fd42c472a89d6484cc945f5a6 and project 82da471a2dbc498885307cd2bdc673e2. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:05:43.408270 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e6e99040-8709-49e9-9095-a634c108907b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.052158 Aug 23 12:05:43.408953 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4094/8240] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 12:05:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:05:59.741856 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:05:59.742619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:05:59.747150 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-54344724", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-790532023", "security_groups": [{"name": "tempest-secgroup-smoke-1620134659"}], "networks": [{"uuid": "2606d342-15b8-4312-91ca-576251ba4bb7"}], "block_device_mapping_v2": [{"uuid": "c0ca8d44-5eb0-4032-bcd6-180fc7eb4417", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:05:59.867270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] validate_networks() for [('2606d342-15b8-4312-91ca-576251ba4bb7', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 12:06:00.247610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 12:06:00.248043 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 12:06:00.248526 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 12:06:00.248983 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 12:06:00.249407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 12:06:00.258967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:00.259454 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:00.259897 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:00.260638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:00.261134 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:00.261568 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:00.278997 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for project 82da471a2dbc498885307cd2bdc673e2. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:06:00.284218 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Getting quotas for user f8947b4fd42c472a89d6484cc945f5a6 and project 82da471a2dbc498885307cd2bdc673e2. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:06:00.343569 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 12:06:00.345744 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0ca8d44-5eb0-4032-bcd6-180fc7eb4417',volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 12:06:00.474764 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:06:01.482818 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [99c61500-b0c2-4283-8ebd-2d554aa7dd99] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48228. Aug 23 12:06:01.486880 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e1040186-82a1-4901-b77a-e26d387e0952 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.747289 Aug 23 12:06:01.487629 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4147/8241] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 12:05:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 12:06:01.499348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c6a31fdd-4be3-4c10-bfd3-22c289eb469c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:01.499983 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c6a31fdd-4be3-4c10-bfd3-22c289eb469c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:01.503012 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:06:01.504954 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=4 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:06:01.505570 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:06:01.563661 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c6a31fdd-4be3-4c10-bfd3-22c289eb469c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:01.572463 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c6a31fdd-4be3-4c10-bfd3-22c289eb469c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1086 microversion: 2.1 time: 0.077075 Aug 23 12:06:01.573985 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4095/8242] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:01 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1086 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:02.595239 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:02.595901 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:02.603138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:02.603643 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:02.604138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:02.605004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:02.605481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:02.605922 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:02.721961 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:02.731533 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-646d0d4b-5b50-4089-9506-4c5ab597052f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1192 microversion: 2.1 time: 0.141064 Aug 23 12:06:02.732132 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4148/8243] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:02 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1192 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:03.753972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:03.754788 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:03.762203 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:03.762814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:03.763668 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:03.764499 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:03.765092 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:03.765614 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:03.915221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:03.924191 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4010a1f5-7a0f-441d-91f7-2dd88ab9ff00 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1270 microversion: 2.1 time: 0.174603 Aug 23 12:06:03.924797 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4096/8244] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:03 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:04.066234 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-039afe9e-dafc-4d98-9a5d-e39e31c32b6a req-f1dfb8a6-a03f-4c99-8fea-9994ab5b99d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:06:04.078790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-039afe9e-dafc-4d98-9a5d-e39e31c32b6a req-f1dfb8a6-a03f-4c99-8fea-9994ab5b99d4 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:04.080203 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-039afe9e-dafc-4d98-9a5d-e39e31c32b6a req-f1dfb8a6-a03f-4c99-8fea-9994ab5b99d4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:04.080717 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-039afe9e-dafc-4d98-9a5d-e39e31c32b6a req-f1dfb8a6-a03f-4c99-8fea-9994ab5b99d4 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:04.094452 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-039afe9e-dafc-4d98-9a5d-e39e31c32b6a req-f1dfb8a6-a03f-4c99-8fea-9994ab5b99d4 service nova] Creating event network-changed:f0c435c8-7243-40f1-8dee-66c9ffdd104e for instance 96067b97-ccf2-481d-b675-700857d5c13f on n-h2-847009-13 Aug 23 12:06:04.100291 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-039afe9e-dafc-4d98-9a5d-e39e31c32b6a req-f1dfb8a6-a03f-4c99-8fea-9994ab5b99d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038399 Aug 23 12:06:04.101987 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4149/8245] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:06:04.946506 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:04.947154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:04.954204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:04.954721 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:04.955175 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:04.955902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:04.956531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:04.957021 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:05.106842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:05.115038 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9ab40f12-6d29-45dd-916f-9ee87fabc78e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1270 microversion: 2.1 time: 0.172767 Aug 23 12:06:05.115623 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4097/8246] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:04 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:06.137383 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:06.137988 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:06.144461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:06.144994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:06.145470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:06.146179 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:06.146646 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:06.147082 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:06.287265 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:06.295865 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-881db444-a3d1-4fda-9074-fe5dc29e3845 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1270 microversion: 2.1 time: 0.163942 Aug 23 12:06:06.296450 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4150/8247] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:06 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:07.317899 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:07.318605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:07.326221 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:07.326737 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:07.327201 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:07.327927 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:07.328456 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:07.328969 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:07.473766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:07.482372 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-34ffbeb0-ba16-46ef-8e60-01889da2a90b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1270 microversion: 2.1 time: 0.168585 Aug 23 12:06:07.483182 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4098/8248] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:07 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:08.502760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:08.503379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:08.510939 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:08.511431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:08.511880 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:08.512606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:08.513152 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:08.513535 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:08.650559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:08.658290 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-79b9da39-73fd-4389-84b4-1b103819e1af tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.159433 Aug 23 12:06:08.658865 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4151/8249] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:08 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:09.678946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:09.679554 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:09.686803 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:09.687298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:09.687746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:09.688447 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:09.688943 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:09.689384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:09.829067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:09.836846 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f3c608b-47b1-448d-848d-1f1a54d6617d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.161869 Aug 23 12:06:09.837411 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4099/8250] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:09 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:10.858995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:10.859612 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:10.861915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:06:10.862574 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:06:10.869406 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:10.870249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:10.870775 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:10.871532 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:10.872049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:10.872542 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:11.008916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:11.016878 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6264b0d2-c76f-4622-913e-98efcdc645b8 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.161794 Aug 23 12:06:11.017457 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4152/8251] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:10 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:12.038270 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:12.038823 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:12.040860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:06:12.047225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:12.047728 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:12.048182 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:12.048926 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:12.049404 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:12.049843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:12.186158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:12.194307 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0abb8744-bb5a-44de-a3d8-ea8ceaa0ab0d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.160381 Aug 23 12:06:12.194877 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4100/8252] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:12 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:13.216379 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:13.217035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:13.224223 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:13.224720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:13.225194 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:13.225907 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:13.226373 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:13.226836 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:13.363151 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:13.371122 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4f834296-3e43-422f-977e-2ff928cfd4b9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.160674 Aug 23 12:06:13.371695 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4153/8253] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:13 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:14.392269 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:14.392895 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:14.399683 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:14.400184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:14.401279 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:14.401987 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:14.402457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:14.402896 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:14.537528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:14.545555 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-adf43c78-5b80-45ce-9ce0-2e1122402c82 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.157356 Aug 23 12:06:14.546134 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4101/8254] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:14 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:15.566563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:15.567217 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:15.574288 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:15.574782 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:15.575227 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:15.575927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:15.576395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:15.576858 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:15.709690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:15.718437 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0ffbdb59-1408-4979-9c73-f43fdccec42f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.155849 Aug 23 12:06:15.719017 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4154/8255] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:15 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:16.738939 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:16.739566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:16.747376 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:16.747890 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:16.748353 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:16.749112 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:16.749596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:16.750052 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:16.883724 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:16.891871 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4f2cf422-1eeb-4cba-9c53-7e9d38e93ecc tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.156826 Aug 23 12:06:16.892465 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4102/8256] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:16 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:17.913461 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:17.914035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:17.921522 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:17.922007 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:17.922448 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:17.923142 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:17.923604 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:17.924030 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:18.055664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:18.063629 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c852f88e-2629-4218-b835-f77df6579173 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.154163 Aug 23 12:06:18.064201 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4155/8257] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:17 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:19.005759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-217ae09b-c031-4846-9a70-21c0e7c9aafd req-21a9025c-48bb-4a7e-beec-38e11e0bded0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "name": "network-vif-plugged", "status": "completed", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:06:19.016452 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-217ae09b-c031-4846-9a70-21c0e7c9aafd req-21a9025c-48bb-4a7e-beec-38e11e0bded0 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:19.016988 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-217ae09b-c031-4846-9a70-21c0e7c9aafd req-21a9025c-48bb-4a7e-beec-38e11e0bded0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:19.017438 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-217ae09b-c031-4846-9a70-21c0e7c9aafd req-21a9025c-48bb-4a7e-beec-38e11e0bded0 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:19.029574 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-217ae09b-c031-4846-9a70-21c0e7c9aafd req-21a9025c-48bb-4a7e-beec-38e11e0bded0 service nova] Creating event network-vif-plugged:f0c435c8-7243-40f1-8dee-66c9ffdd104e for instance 96067b97-ccf2-481d-b675-700857d5c13f on n-h2-847009-13 Aug 23 12:06:19.034951 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-217ae09b-c031-4846-9a70-21c0e7c9aafd req-21a9025c-48bb-4a7e-beec-38e11e0bded0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097819 Aug 23 12:06:19.035722 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4103/8258] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:06:19.089278 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:19.091683 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:19.103455 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:19.104306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:19.105872 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:19.107524 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:19.108047 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:19.108529 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:19.623603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:19.631324 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-10ace164-ad77-4c6c-9c09-6296a17142a9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.550254 Aug 23 12:06:19.631905 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4156/8259] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:19 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:20.654596 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:20.655320 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:20.661573 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:20.662075 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:20.662528 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:20.663233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:20.663701 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:20.664141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:20.801633 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:20.810125 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-63c0b022-8a22-456e-9317-125eca7f94f2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1258 microversion: 2.1 time: 0.161320 Aug 23 12:06:20.810968 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4104/8260] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:20 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:21.831610 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:21.832229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:21.839413 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:21.840578 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:21.841053 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:21.841758 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:21.842219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:21.842649 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:21.981401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:21.989368 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-c557501b-b431-4ba8-b607-a72ca0b806df tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1442 microversion: 2.1 time: 0.161704 Aug 23 12:06:21.989972 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4157/8261] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:21 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:22.010267 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:06:22.011058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:06:22.018502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:22.019015 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:22.019475 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:22.020202 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:22.020684 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:22.021164 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:22.158268 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:06:22.166081 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6cdb4d1a-9449-4787-8767-6197974c0f6b tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1442 microversion: 2.1 time: 0.159761 Aug 23 12:06:22.166664 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4105/8262] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:06:22 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:06:23.879601 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-d48f24be-e457-45e7-89e9-f174e05095f9 req-fd5261b4-e097-40b5-bb54-eb336d6aae48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:06:23.889981 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d48f24be-e457-45e7-89e9-f174e05095f9 req-fd5261b4-e097-40b5-bb54-eb336d6aae48 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:06:23.890457 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d48f24be-e457-45e7-89e9-f174e05095f9 req-fd5261b4-e097-40b5-bb54-eb336d6aae48 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:06:23.890899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-d48f24be-e457-45e7-89e9-f174e05095f9 req-fd5261b4-e097-40b5-bb54-eb336d6aae48 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:06:23.902593 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-d48f24be-e457-45e7-89e9-f174e05095f9 req-fd5261b4-e097-40b5-bb54-eb336d6aae48 service nova] Creating event network-changed:f0c435c8-7243-40f1-8dee-66c9ffdd104e for instance 96067b97-ccf2-481d-b675-700857d5c13f on n-h2-847009-13 Aug 23 12:06:23.908081 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-d48f24be-e457-45e7-89e9-f174e05095f9 req-fd5261b4-e097-40b5-bb54-eb336d6aae48 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102917 Aug 23 12:06:23.908821 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4158/8263] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:06:47.455534 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:06:47.456499 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:06:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:08:18.968061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=24 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:18.968972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=56 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:18.973594 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:08:18.974931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:18.981839 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:18.982344 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:18.982800 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:18.983515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:18.983992 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:18.984442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:19.013263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lazy-loading 'flavor' on Instance uuid 96067b97-ccf2-481d-b675-700857d5c13f {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 12:08:19.102806 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4d12d5db-32f2-4ca1-9946-cf8fcb78ee3c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f/action" status: 202 len: 0 microversion: 2.1 time: 0.136382 Aug 23 12:08:19.103420 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4106/8264] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:08:18 2022] POST /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:08:19.109795 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:08:19.110624 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:08:19.111230 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:19.112125 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=60 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:19.116689 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:19.117427 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:19.124845 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:19.125339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:19.125778 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:19.126481 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:19.126945 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:19.127374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:19.342875 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:19.351566 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e3f86a0f-d932-4bcd-aca5-9334790a42e7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.243555 Aug 23 12:08:19.352154 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4159/8265] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:19 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:20.383096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:20.383727 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:20.389908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:20.390407 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:20.390857 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:20.391561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:20.392030 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:20.392490 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:20.575942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:20.584333 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-70f0027c-4fe8-41df-ac08-e727a97980ac tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.207266 Aug 23 12:08:20.584992 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4107/8266] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:20 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:21.605458 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:21.606347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:21.620255 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:21.620766 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:21.621216 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:21.621932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:21.622401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:21.622835 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:21.626175 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48346. Aug 23 12:08:21.634216 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48348. Aug 23 12:08:21.763401 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:21.771221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-8633d05d-9b48-4392-a41c-8d3207e0c29d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.169634 Aug 23 12:08:21.771800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4160/8267] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:21 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:22.792415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:22.793262 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:22.800224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:22.800783 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:22.801243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:22.801959 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:22.802449 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:22.802995 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:22.934999 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:22.942991 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-eb7634fa-d62e-48c2-a51a-df185fd095e3 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.154577 Aug 23 12:08:22.944176 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4108/8268] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:22 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:23.964256 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:23.964932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:23.971741 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:23.972213 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:23.972807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:23.973389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:23.973849 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:23.974347 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:24.109839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:24.118273 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-62b78e1c-f185-415e-922c-599e10b91565 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.158274 Aug 23 12:08:24.118842 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4161/8269] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:23 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:25.140058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:25.140725 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:25.148507 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:25.149053 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:25.149518 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:25.151011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:25.151497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:25.151949 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:25.297005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:25.305929 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9849cd47-ee6e-495d-99e8-15754d69962f tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.169846 Aug 23 12:08:25.306504 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4109/8270] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:25 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:26.328046 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:26.328608 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:26.336305 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:26.336817 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:26.337254 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:26.337953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:26.338407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:26.338832 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:26.472878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:26.481236 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-82be2c6c-b17e-4bfc-a6f3-a6a4f8f924c2 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.157186 Aug 23 12:08:26.481818 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4162/8271] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:26 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:27.502004 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:27.502643 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:27.509590 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:27.510103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:27.510566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:27.511653 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:27.512139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:27.512592 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:27.645187 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:27.653625 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-083160fa-195b-495c-abaa-45d3fbba369c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.155532 Aug 23 12:08:27.654205 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4110/8272] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:27 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:28.674363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:28.675005 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:28.683037 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:28.683777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:28.684219 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:28.684946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:28.685441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:28.685871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:28.819809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:28.827778 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc65f05f-6f31-4030-a173-55d8b9611de0 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.157347 Aug 23 12:08:28.828352 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4163/8273] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:28 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:29.851119 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:29.851748 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:29.858679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:29.859181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:29.859629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:29.860342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:29.860836 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:29.861276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:29.997863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:30.005880 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d72c26b0-7109-456e-98d7-e61202c4b83a tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.159419 Aug 23 12:08:30.006463 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4111/8274] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:29 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:31.027878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:31.028476 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:31.035482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:31.035967 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:31.036407 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:31.037667 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:31.038131 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:31.038560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:31.178824 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:31.187288 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-0bfef7c0-69a5-4bde-9d8f-3782c83da0ba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.163301 Aug 23 12:08:31.187856 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4164/8275] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:31 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:32.209690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:32.210338 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:32.217974 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:32.218421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:32.218901 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:32.219629 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:32.220105 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:32.220552 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:32.365814 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:32.373991 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09593a55-8a16-4471-a272-1bf3cdb81407 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.168874 Aug 23 12:08:32.374949 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4112/8276] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:32 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:33.395721 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:33.396543 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:33.403619 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:33.404115 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:33.404559 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:33.405294 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:33.405762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:33.406196 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:33.540241 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:33.548199 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-38c498be-924a-4768-bfa3-ae3d6db0edf7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1568 microversion: 2.1 time: 0.156454 Aug 23 12:08:33.548784 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4165/8277] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:33 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:33.568910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:08:33.569558 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:33.576384 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:33.576922 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:33.577378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:33.578086 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:33.578559 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:33.579000 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:33.663708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128860) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 12:08:33.736760 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-66689521-3e89-4dae-b730-32ec77ab2b9d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "POST /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f/action" status: 202 len: 0 microversion: 2.1 time: 0.171426 Aug 23 12:08:33.737409 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4113/8278] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:08:33 2022] POST /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:08:33.747024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:33.747024 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:33.753641 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:33.754143 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:33.754598 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:33.755938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:33.756414 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:33.756877 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:33.934926 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:33.943529 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7e186ad-910c-4a3b-93c7-44b52efbdff1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1516 microversion: 2.1 time: 0.200618 Aug 23 12:08:33.944101 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4166/8279] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:33 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:08:34.965880 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:34.966512 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:34.972875 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:34.973454 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:34.973946 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:34.975209 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:34.975709 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:34.976189 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:35.118483 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:35.126782 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5e5b4988-1d95-4bd3-802d-08b8ffb63a3d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1518 microversion: 2.1 time: 0.165614 Aug 23 12:08:35.127382 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4114/8280] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:34 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:35.648563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-ec314262-cc50-4f16-a8b9-321a034df627 req-d302047f-0043-462a-a8bb-fb64e8cfb436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "name": "network-vif-unplugged", "status": "completed", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:08:35.659756 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ec314262-cc50-4f16-a8b9-321a034df627 req-d302047f-0043-462a-a8bb-fb64e8cfb436 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:35.660238 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ec314262-cc50-4f16-a8b9-321a034df627 req-d302047f-0043-462a-a8bb-fb64e8cfb436 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:35.660665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-ec314262-cc50-4f16-a8b9-321a034df627 req-d302047f-0043-462a-a8bb-fb64e8cfb436 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:35.672665 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.compute.server_external_events [req-ec314262-cc50-4f16-a8b9-321a034df627 req-d302047f-0043-462a-a8bb-fb64e8cfb436 service nova] Unable to find a host for instance 96067b97-ccf2-481d-b675-700857d5c13f. Dropping event network-vif-unplugged {{(pid=128859) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 12:08:35.673593 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-ec314262-cc50-4f16-a8b9-321a034df627 req-d302047f-0043-462a-a8bb-fb64e8cfb436 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029647 Aug 23 12:08:35.674381 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4167/8281] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 23 12:08:36.148358 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:36.148931 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:36.155960 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:36.156458 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:36.156956 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:36.157669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:36.158139 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:36.158579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:36.292678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:36.300558 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a8235c16-d2a4-41b7-9415-311305cace9c tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1518 microversion: 2.1 time: 0.156889 Aug 23 12:08:36.301151 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4115/8282] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:36 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:08:37.322341 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:37.322948 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:37.330270 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:37.330771 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:37.331214 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:37.331940 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:37.332403 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:37.332863 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:37.475482 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:37.483571 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-34da2e31-dcb8-4af0-bc53-f3d4296be361 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1518 microversion: 2.1 time: 0.165469 Aug 23 12:08:37.484151 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4168/8283] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:37 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:38.506855 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:38.508158 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:38.515426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:38.516097 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:38.516561 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:38.517348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:38.517882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:38.518333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:38.650638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:38.658776 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9f48a6a9-267f-4b06-9fd0-1924b26e3447 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1518 microversion: 2.1 time: 0.156630 Aug 23 12:08:38.659358 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4116/8284] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:38 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:39.680187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:39.680806 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:39.687903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:39.688388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:39.688848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:39.689927 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:39.690032 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:39.690400 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:39.912145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:39.920465 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f3859f3f-db14-4f5f-baa1-b79a013a3169 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.244821 Aug 23 12:08:39.921274 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4169/8285] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:39 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:40.943998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:40.944710 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:40.951746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:40.952256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:40.952715 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:40.953461 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:40.953971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:40.954420 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:41.107239 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:41.115902 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-494c808c-f1d3-4ea4-9f56-7d343123bd47 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.176823 Aug 23 12:08:41.116501 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4117/8286] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:40 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:42.137229 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:42.137847 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:42.144761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:42.145268 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:42.146924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:42.147636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:42.148103 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:42.148536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:42.286668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:42.294530 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-69cb524c-a5d5-4d79-91d2-aeffcc8f489d tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.161411 Aug 23 12:08:42.295127 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4170/8287] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:42 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:43.315975 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:43.316605 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:43.323915 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:43.324421 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:43.324913 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:43.325662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:43.326138 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:43.326608 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:43.463168 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:43.471324 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e0521d5a-7dfd-4ecc-8a21-b743042287b4 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.159268 Aug 23 12:08:43.471887 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4118/8288] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:43 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:44.492893 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:44.493511 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:44.500342 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:44.500857 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:44.501301 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:44.501999 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:44.502462 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:44.502912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:44.636673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:44.644458 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-a2f64687-c27d-430d-a69e-330d98137124 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.156318 Aug 23 12:08:44.645064 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4171/8289] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:44 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:45.665598 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:45.666224 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:45.673094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:45.673591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:45.674044 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:45.674744 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:45.675217 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:45.675679 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:45.695582 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:45.812982 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:45.821504 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40d0a891-ff9a-4b0e-82cd-fd19b45ce381 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.159894 Aug 23 12:08:45.822069 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4119/8290] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:45 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:46.842768 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:46.843391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:46.850933 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:46.851429 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:46.851903 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:46.852614 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:46.853114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:46.853555 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:46.983068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:46.991028 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f772f730-f3f0-4f76-8bda-5004e5797033 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.152252 Aug 23 12:08:46.991604 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4172/8291] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:46 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:48.012442 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:48.013127 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:48.019897 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:48.020394 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:48.020881 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:48.022108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:48.022873 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:48.023325 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:48.153278 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:48.161070 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3bc12f23-0fcb-4bd5-9a72-65b4e485a9e9 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.152486 Aug 23 12:08:48.161647 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4120/8292] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:48 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:49.182622 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:49.183513 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:49.186302 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=29 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:49.191705 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:49.192187 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:49.192623 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:49.193339 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:49.194049 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:49.194207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:49.198226 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=81 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:49.330114 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:49.339221 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-01573d08-f282-4688-b486-8c9b85374161 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.160552 Aug 23 12:08:49.339800 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4173/8293] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:49 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:50.361584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:50.362137 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:50.367476 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:08:50.371584 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:50.372094 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:50.372551 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:50.373301 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:50.373780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:50.374242 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:50.508173 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:50.516080 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-e35b292c-80fa-403f-a4c4-3f930c418fe7 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.158598 Aug 23 12:08:50.516658 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4121/8294] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:50 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:51.538441 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:51.539066 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:51.546416 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:51.546906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:51.547345 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:51.548044 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:51.548505 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:51.548970 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:51.680431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:51.688715 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-84dd4997-0191-4129-bae0-0ab810144812 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.154644 Aug 23 12:08:51.689334 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4174/8295] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:51 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:08:51.836276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-8338bcd8-d132-4f83-9d0e-78c96d1ae65a req-1053ee34-e5f8-4479-abb6-3ef7376e92c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "name": "network-vif-plugged", "status": "completed", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:08:51.848463 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8338bcd8-d132-4f83-9d0e-78c96d1ae65a req-1053ee34-e5f8-4479-abb6-3ef7376e92c5 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:51.849111 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8338bcd8-d132-4f83-9d0e-78c96d1ae65a req-1053ee34-e5f8-4479-abb6-3ef7376e92c5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:51.850642 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-8338bcd8-d132-4f83-9d0e-78c96d1ae65a req-1053ee34-e5f8-4479-abb6-3ef7376e92c5 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:51.862593 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-8338bcd8-d132-4f83-9d0e-78c96d1ae65a req-1053ee34-e5f8-4479-abb6-3ef7376e92c5 service nova] Creating event network-vif-plugged:f0c435c8-7243-40f1-8dee-66c9ffdd104e for instance 96067b97-ccf2-481d-b675-700857d5c13f on n-h2-847009-13 Aug 23 12:08:51.869287 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-8338bcd8-d132-4f83-9d0e-78c96d1ae65a req-1053ee34-e5f8-4479-abb6-3ef7376e92c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037089 Aug 23 12:08:51.870041 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4122/8296] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:08:52.710785 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:52.711394 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:52.718388 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:52.718870 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:52.719304 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:52.719995 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:52.720463 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:52.720913 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:52.852904 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:52.860872 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-5f15afb5-0782-4e70-b6f0-cbde605a4b44 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1574 microversion: 2.1 time: 0.154632 Aug 23 12:08:52.861464 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4175/8297] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:52 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:08:53.883938 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:08:53.884698 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:08:53.891799 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:53.892333 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:53.892818 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:53.893535 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:08:53.894016 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:08:53.894462 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:08:54.032773 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:08:54.041439 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-16a8ef3c-6373-48aa-89f2-5df65ce1b3cf tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1561 microversion: 2.1 time: 0.161872 Aug 23 12:08:54.042025 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4123/8298] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:08:53 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:09:17.395416 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:09:17.396083 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:09:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:09:18.837589 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:09:18.838255 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:09:18.916530 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:09:18.916787 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:09:59.079210 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:09:59.079907 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:10:10.641638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=5 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:10.642485 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=17 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:10.646215 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=5 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:10.647037 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=22 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:10.653779 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:10.654295 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:10.659763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-9dbf731b-1360-4e00-9d6c-5f2fa4ad243a req-248c37b5-cb61-43ef-af1b-3f7498aca469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:10.673011 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:10.673949 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:10.674122 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9dbf731b-1360-4e00-9d6c-5f2fa4ad243a req-248c37b5-cb61-43ef-af1b-3f7498aca469 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:10.674497 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9dbf731b-1360-4e00-9d6c-5f2fa4ad243a req-248c37b5-cb61-43ef-af1b-3f7498aca469 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:10.674736 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:10.675478 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-9dbf731b-1360-4e00-9d6c-5f2fa4ad243a req-248c37b5-cb61-43ef-af1b-3f7498aca469 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:10.675625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:10.676089 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:10.677042 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:10.690810 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-9dbf731b-1360-4e00-9d6c-5f2fa4ad243a req-248c37b5-cb61-43ef-af1b-3f7498aca469 service nova] Creating event network-changed:f0c435c8-7243-40f1-8dee-66c9ffdd104e for instance 96067b97-ccf2-481d-b675-700857d5c13f on n-h2-847009-13 Aug 23 12:10:10.697062 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-9dbf731b-1360-4e00-9d6c-5f2fa4ad243a req-248c37b5-cb61-43ef-af1b-3f7498aca469 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052593 Aug 23 12:10:10.697802 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4124/8299] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 12:10:10.712982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Going to try to terminate instance {{(pid=128859) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 12:10:10.816898 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-4bbb6d84-d66a-47cb-b7c1-611565ec2113 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "DELETE /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 204 len: 0 microversion: 2.1 time: 0.177042 Aug 23 12:10:10.820576 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4176/8300] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 12:10:10 2022] DELETE /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 12:10:10.830842 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:10.832805 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:10.840399 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:10.841096 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:10.841556 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:10.842746 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:10.843808 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:10.844264 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:10.991286 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:10.999526 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1f7bd5b8-c41a-4fd6-a666-e4c2de8acc55 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.176323 Aug 23 12:10:11.000113 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4125/8301] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:10 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:12.021822 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:12.022767 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:12.030982 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:12.031470 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:12.031910 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:12.032658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:12.033145 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:12.033567 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:12.171600 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:12.179860 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-06bc4542-ad13-4133-ae36-5899a455d472 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1567 microversion: 2.1 time: 0.162331 Aug 23 12:10:12.180573 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4177/8302] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:12 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:13.153011 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-ea35fe29-4714-4af8-b1dc-131ba7929000 req-a764e6b0-6e08-49c3-a0e6-ddd7c4bce0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96067b97-ccf2-481d-b675-700857d5c13f", "name": "network-vif-deleted", "tag": "f0c435c8-7243-40f1-8dee-66c9ffdd104e"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:13.163468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ea35fe29-4714-4af8-b1dc-131ba7929000 req-a764e6b0-6e08-49c3-a0e6-ddd7c4bce0db service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:13.164005 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ea35fe29-4714-4af8-b1dc-131ba7929000 req-a764e6b0-6e08-49c3-a0e6-ddd7c4bce0db service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:13.164457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-ea35fe29-4714-4af8-b1dc-131ba7929000 req-a764e6b0-6e08-49c3-a0e6-ddd7c4bce0db service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:13.178094 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-ea35fe29-4714-4af8-b1dc-131ba7929000 req-a764e6b0-6e08-49c3-a0e6-ddd7c4bce0db service nova] Creating event network-vif-deleted:f0c435c8-7243-40f1-8dee-66c9ffdd104e for instance 96067b97-ccf2-481d-b675-700857d5c13f on n-h2-847009-13 Aug 23 12:10:13.184685 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-ea35fe29-4714-4af8-b1dc-131ba7929000 req-a764e6b0-6e08-49c3-a0e6-ddd7c4bce0db service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036493 Aug 23 12:10:13.185460 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4126/8303] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:10:13.202077 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:13.202691 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:13.210065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:13.210562 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:13.211029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:13.211762 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:13.212228 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:13.212752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:13.289069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:13.302494 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cd1e6147-f59a-40a2-9b5a-45e28b554db1 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1217 microversion: 2.1 time: 0.103924 Aug 23 12:10:13.303371 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4178/8304] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:13 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:14.327204 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:14.327849 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:14.334261 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:14.334763 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:14.335218 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:14.335933 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:14.336415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:14.336893 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:14.403613 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:14.411686 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-d7b8bb52-d0ea-4069-9fec-c269e0dc7557 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1217 microversion: 2.1 time: 0.091589 Aug 23 12:10:14.412347 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4127/8305] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:14 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:15.434480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:15.435079 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:15.442031 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:15.442530 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:15.442977 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:15.443685 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:15.444153 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:15.444586 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:15.508063 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:15.517201 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-2b1c9a31-23e6-4300-85f8-51c4b0ecdd6e tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1217 microversion: 2.1 time: 0.087042 Aug 23 12:10:15.517961 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4179/8306] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:15 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:16.539470 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:16.540110 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:16.547033 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:16.547537 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:16.547998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:16.548713 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:16.549213 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:16.549658 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:16.612690 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:16.621946 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-4789dd86-1517-4c2d-ac48-c3dc71daebba tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1217 microversion: 2.1 time: 0.086498 Aug 23 12:10:16.622755 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4128/8307] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:16 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:17.646385 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:17.647004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:17.654645 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:17.655138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:17.655616 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:17.656326 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:17.656809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:17.657243 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:17.689823 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:17.690311 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:17.690752 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:17.691202 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.objects.instance [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lazy-loading 'fault' on Instance uuid 96067b97-ccf2-481d-b675-700857d5c13f {{(pid=128859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 12:10:17.732421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8947b4fd42c472a89d6484cc945f5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82da471a2dbc498885307cd2bdc673e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:17.740309 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-65c115d5-576e-4c7e-b44d-e1f8feda90dd tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 200 len: 1222 microversion: 2.1 time: 0.097853 Aug 23 12:10:17.740907 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4180/8308] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:17 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:18.762626 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:18.763259 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] [instance: 96067b97-ccf2-481d-b675-700857d5c13f] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:18.770103 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:18.770601 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:18.771058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:18.771761 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:18.772233 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:18.772674 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:18.787366 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] HTTP exception thrown: Instance 96067b97-ccf2-481d-b675-700857d5c13f could not be found. Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Request method failure captured: Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f HTTP/1.1 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBMFyJKMZENK4E91eyvDbnG6wGUUpgnHADA1UaNERFhIit2HpxwU01O3AggIRGfqRyHKcMHveK2mz-s488oaiVKzgWiyphJ348VojdSsuuqLo43DYJL93YDIHrxGIumDAFQB_JfLpGshH4Cha4Q_ijM16AykOUZeNMnAjwV9CSeyIfiY Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 82da471a2dbc498885307cd2bdc673e2 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestShelveInstance-553734229 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/82da471a2dbc498885307cd2bdc673e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_82da471a2dbc498885307cd2bdc673e2", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/82da471a2dbc498885307cd2bdc673e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/82da471a2dbc498885307cd2bdc673e2"}]}] Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestShelveInstance-553734229 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 82da471a2dbc498885307cd2bdc673e2 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestShelveInstance-553734229 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestShelveInstance-553734229-project Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: f8947b4fd42c472a89d6484cc945f5a6 Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestShelveInstance-553734229-project Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance 96067b97-ccf2-481d-b675-700857d5c13f could not be found. Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': '96067b97-ccf2-481d-b675-700857d5c13f'} Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96067b97-ccf2-481d-b675-700857d5c13f could not be found. Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96067b97-ccf2-481d-b675-700857d5c13f could not be found. Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:10:18.789225 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96067b97-ccf2-481d-b675-700857d5c13f could not be found. Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Returning 404 to user: Instance 96067b97-ccf2-481d-b675-700857d5c13f could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fbc131fc-7bcd-476e-b386-c25fbc43fbdb tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f" status: 404 len: 111 microversion: 2.1 time: 0.032780 Aug 23 12:10:18.794707 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4129/8309] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:18 2022] GET /compute/v2.1/servers/96067b97-ccf2-481d-b675-700857d5c13f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 12:10:18.967211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-558d6b22-512f-4ac2-8e34-dec911bd3324 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] Calling method '.version_select at 0x7fdc8f64f160>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:18.993620 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-558d6b22-512f-4ac2-8e34-dec911bd3324 tempest-TestShelveInstance-553734229 tempest-TestShelveInstance-553734229-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-790532023" status: 202 len: 0 microversion: 2.1 time: 0.031746 Aug 23 12:10:18.994214 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4181/8310] 10.222.0.78 () {58 vars in 1251 bytes} [Tue Aug 23 12:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-790532023 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:10:37.009157 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=12 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:37.010595 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=24 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:37.187578 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-bed58478-9e92-42b6-b71d-a607bf74c326 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Action: 'create', calling method: .version_select at 0x7fdc8fc9c790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1971156804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNOf4f0KMHPw9gUmMhYqROsTcA1vQUsoxJeU2wT5Q1KmD0wJTvA5sCRetEdtrwUHMNOM1QoWD7Zt+sjFDQvKmsAhW8VNzgUZCS2Aor3/p/D+7PiQBENxRke4qs5wogWYQ=="}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:37.204035 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-bed58478-9e92-42b6-b71d-a607bf74c326 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Getting quotas for project 0fc16fa7bf5d46be862d7020bd129187. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:10:37.211797 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.quota [None req-bed58478-9e92-42b6-b71d-a607bf74c326 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Getting quotas for user 9028c0baf81b4054b06c5055105b1554 and project 0fc16fa7bf5d46be862d7020bd129187. Resources: {'key_pairs'} {{(pid=128860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:10:37.248132 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-bed58478-9e92-42b6-b71d-a607bf74c326 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.244530 Aug 23 12:10:37.248781 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4130/8311] 10.222.0.78 () {60 vars in 1159 bytes} [Tue Aug 23 12:10:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:10:38.256609 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:38.257966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:38.264045 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2081627571", "imageRef": "b4ffccc2-7c96-4941-8a42-0d5d5e6236b8", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1971156804", "security_groups": [{"name": "tempest-secgroup-smoke-833071045"}], "networks": [{"uuid": "b5f66300-b3a8-4800-8643-d631fb59a0f8"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:38.391451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] validate_networks() for [('b5f66300-b3a8-4800-8643-d631fb59a0f8', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 12:10:38.907848 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 12:10:38.908285 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 12:10:38.908788 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 12:10:38.909211 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 12:10:38.909629 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 12:10:38.919177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:38.919804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:38.920259 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:38.921023 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:38.921487 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:38.921920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:38.940920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Getting quotas for project 0fc16fa7bf5d46be862d7020bd129187. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:10:38.946374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Getting quotas for user 9028c0baf81b4054b06c5055105b1554 and project 0fc16fa7bf5d46be862d7020bd129187. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:10:38.959719 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 12:10:38.962086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b4ffccc2-7c96-4941-8a42-0d5d5e6236b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 12:10:39.014768 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d9d0ad8f-ea8c-42ea-9443-3341024f7c8c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760058 Aug 23 12:10:39.015605 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4182/8312] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 12:10:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 12:10:39.027395 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-618516d8-1f82-47c5-8d77-7820ddd6269f tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:39.028050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-618516d8-1f82-47c5-8d77-7820ddd6269f tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:39.090572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-618516d8-1f82-47c5-8d77-7820ddd6269f tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:39.101768 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-618516d8-1f82-47c5-8d77-7820ddd6269f tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1249 microversion: 2.1 time: 0.078659 Aug 23 12:10:39.109884 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4131/8313] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:39 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:10:40.136054 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:40.138862 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:40.151648 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:40.152167 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:40.152605 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:40.153363 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:40.153833 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:40.154269 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:40.241306 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:40.256271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-e2b2e563-0159-4af5-a3b4-b3bbe47923b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1309 microversion: 2.1 time: 0.135811 Aug 23 12:10:40.256891 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4183/8314] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:40 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:41.279980 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:41.280774 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:41.288566 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:41.289184 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:41.289722 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:41.291181 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:41.292304 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:41.292882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:41.495599 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:41.503502 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0d210192-985e-4e64-9abd-d91b23816b10 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1374 microversion: 2.1 time: 0.228873 Aug 23 12:10:41.504318 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4132/8315] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:41 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1374 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:41.720009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-15d83bfa-2183-4f8a-b204-dde5d641b608 req-92c32b8b-96af-460d-aa1d-5a8193ef6c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:41.732004 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15d83bfa-2183-4f8a-b204-dde5d641b608 req-92c32b8b-96af-460d-aa1d-5a8193ef6c0b service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:41.732502 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15d83bfa-2183-4f8a-b204-dde5d641b608 req-92c32b8b-96af-460d-aa1d-5a8193ef6c0b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:41.732994 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-15d83bfa-2183-4f8a-b204-dde5d641b608 req-92c32b8b-96af-460d-aa1d-5a8193ef6c0b service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:41.744645 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-15d83bfa-2183-4f8a-b204-dde5d641b608 req-92c32b8b-96af-460d-aa1d-5a8193ef6c0b service nova] Creating event network-changed:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:10:41.750038 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-15d83bfa-2183-4f8a-b204-dde5d641b608 req-92c32b8b-96af-460d-aa1d-5a8193ef6c0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033784 Aug 23 12:10:41.750641 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4184/8316] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:10:42.525468 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:42.526163 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:42.533477 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:42.533981 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:42.534431 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:42.535148 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:42.535618 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:42.536065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:42.680402 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:42.689704 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-1077a40a-7d9d-4386-84c1-36944a255fc7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1374 microversion: 2.1 time: 0.168530 Aug 23 12:10:42.690296 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4133/8317] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:42 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:43.711899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:43.713357 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:43.719664 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:43.720144 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:43.720581 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:43.721307 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:43.721765 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:43.722191 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:43.860615 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:43.868253 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-babd1724-f8ff-4262-a3e3-b0bae634142b tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1374 microversion: 2.1 time: 0.161466 Aug 23 12:10:43.869329 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4185/8318] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:43 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:44.889508 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:44.890195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:44.897009 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:44.897514 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:44.897972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:44.898686 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:44.899161 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:44.899603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:45.053331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:45.061722 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-fdd0eef9-0829-461f-bf26-cb97e4055fba tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1374 microversion: 2.1 time: 0.176141 Aug 23 12:10:45.062312 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4134/8319] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:44 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:46.082560 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:46.083086 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:46.090790 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:46.091282 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:46.091725 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:46.092421 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:46.092923 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:46.093354 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:46.226391 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:46.234184 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-53b58b00-c02c-4bca-9dd1-2add3c62acb7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1374 microversion: 2.1 time: 0.155649 Aug 23 12:10:46.234751 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4186/8320] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:46 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:46.510480 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-5aa8baa1-cd19-438a-af4b-eece42ac2b9b req-b344a34e-e1ec-4416-8491-8b0e61b2af17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "name": "network-vif-plugged", "status": "completed", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:46.521416 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5aa8baa1-cd19-438a-af4b-eece42ac2b9b req-b344a34e-e1ec-4416-8491-8b0e61b2af17 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:46.522002 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5aa8baa1-cd19-438a-af4b-eece42ac2b9b req-b344a34e-e1ec-4416-8491-8b0e61b2af17 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:46.522457 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-5aa8baa1-cd19-438a-af4b-eece42ac2b9b req-b344a34e-e1ec-4416-8491-8b0e61b2af17 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:46.534219 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-5aa8baa1-cd19-438a-af4b-eece42ac2b9b req-b344a34e-e1ec-4416-8491-8b0e61b2af17 service nova] Creating event network-vif-plugged:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:10:46.539261 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-5aa8baa1-cd19-438a-af4b-eece42ac2b9b req-b344a34e-e1ec-4416-8491-8b0e61b2af17 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Aug 23 12:10:46.539856 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4135/8321] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:10:47.253593 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:47.254172 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:47.261636 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:47.262128 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:47.262575 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:47.263279 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:47.263747 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:47.264183 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:47.411343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:47.419833 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f6b83f1c-be07-4b3f-a488-310fcac19e24 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1374 microversion: 2.1 time: 0.170223 Aug 23 12:10:47.420410 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4187/8322] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:47 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:48.442731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:48.443489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:48.450195 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:48.450692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:48.451141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:48.451843 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:48.452312 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:48.452778 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:48.589941 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:48.597770 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-52543ae7-58dd-4fd0-9ac4-cd8b560ff211 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1559 microversion: 2.1 time: 0.160184 Aug 23 12:10:48.598351 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4136/8323] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:48 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:48.617760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:10:48.618861 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:10:48.625985 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:48.626475 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:48.626920 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:48.627801 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:48.628275 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:48.628708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:48.764029 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:10:48.771734 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-94605136-5b83-4924-8f4a-e88363607baf tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1559 microversion: 2.1 time: 0.157820 Aug 23 12:10:48.772302 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4188/8324] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:10:48 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:10:50.725058 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-f319630b-c065-4232-a7b6-2ced0d290238 req-7ae280f2-779c-492a-91fc-040e1dcd8702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:10:50.730144 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=6 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:10:50.736591 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f319630b-c065-4232-a7b6-2ced0d290238 req-7ae280f2-779c-492a-91fc-040e1dcd8702 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:10:50.737099 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f319630b-c065-4232-a7b6-2ced0d290238 req-7ae280f2-779c-492a-91fc-040e1dcd8702 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:10:50.737547 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-f319630b-c065-4232-a7b6-2ced0d290238 req-7ae280f2-779c-492a-91fc-040e1dcd8702 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:10:50.749253 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-f319630b-c065-4232-a7b6-2ced0d290238 req-7ae280f2-779c-492a-91fc-040e1dcd8702 service nova] Creating event network-changed:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:10:50.754554 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-f319630b-c065-4232-a7b6-2ced0d290238 req-7ae280f2-779c-492a-91fc-040e1dcd8702 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033200 Aug 23 12:10:50.755173 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4137/8325] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:11:47.465644 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:11:47.466425 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:12:45.871669 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 12:12:45.872795 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 12:12:45.873158 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:45.873916 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:45.874660 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:45.875289 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=34 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:45.879859 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-765960582"}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:12:45.883708 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:12:45.895208 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:12:45.895700 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:12:45.896138 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:12:45.896878 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:12:45.897336 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:12:45.897761 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:12:46.094484 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-72edd07a-e200-4567-87fa-81064deed9f4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "POST /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6/action" status: 202 len: 0 microversion: 2.1 time: 0.225214 Aug 23 12:12:46.095322 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4189/8326] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:12:45 2022] POST /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 12:12:51.152760 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:12:51.154673 n-d-847009-13 devstack@n-api.service[128860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 12:12:51.155334 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:51.156340 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=28 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:51.234069 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-3b31a3e9-cf86-43b0-96c4-29734e84dffa req-7d18f3b0-84cd-4886-945e-8a01f9a2b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "name": "network-vif-plugged", "status": "completed", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:12:51.251934 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3b31a3e9-cf86-43b0-96c4-29734e84dffa req-7d18f3b0-84cd-4886-945e-8a01f9a2b104 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:12:51.252433 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3b31a3e9-cf86-43b0-96c4-29734e84dffa req-7d18f3b0-84cd-4886-945e-8a01f9a2b104 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:12:51.252904 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-3b31a3e9-cf86-43b0-96c4-29734e84dffa req-7d18f3b0-84cd-4886-945e-8a01f9a2b104 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:12:51.266297 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-3b31a3e9-cf86-43b0-96c4-29734e84dffa req-7d18f3b0-84cd-4886-945e-8a01f9a2b104 service nova] Creating event network-vif-plugged:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:12:51.273396 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-3b31a3e9-cf86-43b0-96c4-29734e84dffa req-7d18f3b0-84cd-4886-945e-8a01f9a2b104 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122392 Aug 23 12:12:51.274101 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4138/8327] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:12:59.658452 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1225444927", "imageRef": "1bcc3fe0-53c7-4a17-978d-4b51eb935208", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1971156804", "security_groups": [{"name": "tempest-secgroup-smoke-833071045"}], "networks": [{"uuid": "b5f66300-b3a8-4800-8643-d631fb59a0f8"}]}} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:12:59.668210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:59.669058 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:12:59.686388 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48842. Aug 23 12:12:59.687772 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48844. Aug 23 12:12:59.774749 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.network.neutron [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] validate_networks() for [('b5f66300-b3a8-4800-8643-d631fb59a0f8', None, None, None, None, None)] {{(pid=128859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 12:13:00.148430 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Flavor limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 12:13:00.148895 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Image limits 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 12:13:00.149376 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Flavor pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 12:13:00.149792 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Image pref 0:0:0 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 12:13:00.150207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.virt.hardware [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 12:13:00.159496 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:00.159980 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:00.160418 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:00.161180 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:00.161640 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:00.162070 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:00.180694 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Getting quotas for project 0fc16fa7bf5d46be862d7020bd129187. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 12:13:00.187283 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.quota [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Getting quotas for user 9028c0baf81b4054b06c5055105b1554 and project 0fc16fa7bf5d46be862d7020bd129187. Resources: {'ram', 'instances', 'cores'} {{(pid=128859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 12:13:00.200006 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Going to run 1 instances... {{(pid=128859) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 12:13:00.202536 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1bcc3fe0-53c7-4a17-978d-4b51eb935208',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 12:13:00.249789 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-cfb52a4b-12d9-4aa0-ad75-ccaa18ccb895 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.595523 Aug 23 12:13:00.250472 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4190/8328] 10.222.0.78 () {60 vars in 1147 bytes} [Tue Aug 23 12:12:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 12:13:00.263816 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9a547e23-4b49-4b86-a6f3-099ab5ba546c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:00.264548 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9a547e23-4b49-4b86-a6f3-099ab5ba546c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:00.278723 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [1d5dadbc-24e0-4a87-a9b9-bd21146f68a4] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48858. Aug 23 12:13:00.279823 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] [a845f931-f0d9-41aa-9de0-c0b085425d3f] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48860. Aug 23 12:13:00.333776 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9a547e23-4b49-4b86-a6f3-099ab5ba546c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:00.341505 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9a547e23-4b49-4b86-a6f3-099ab5ba546c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1249 microversion: 2.1 time: 0.083805 Aug 23 12:13:00.342077 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4139/8329] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:00 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:01.363876 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:01.364438 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:01.372780 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:01.373271 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:01.373720 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:01.374445 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:01.374906 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:01.375338 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:01.452851 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:01.461329 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-ddab3722-ffac-4342-8eca-4a1ddd1b3ad7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1301 microversion: 2.1 time: 0.102019 Aug 23 12:13:01.461906 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4191/8330] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:01 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:02.485316 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:02.486125 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:02.488731 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:13:02.497364 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:02.498418 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:02.499090 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:02.507337 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:02.508245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:02.509263 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:02.709331 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:02.718965 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-dc86cef5-728a-4438-9f4e-f63acb8b433a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.238361 Aug 23 12:13:02.729737 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4140/8331] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:02 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:13:03.120690 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-1140d885-a46f-47ad-97ea-a530ee4b587f req-4f9d651a-6cb6-46df-8048-421fae45bbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "name": "network-vif-unplugged", "status": "completed", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:13:03.137606 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1140d885-a46f-47ad-97ea-a530ee4b587f req-4f9d651a-6cb6-46df-8048-421fae45bbbd service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:03.138480 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1140d885-a46f-47ad-97ea-a530ee4b587f req-4f9d651a-6cb6-46df-8048-421fae45bbbd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:03.139160 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-1140d885-a46f-47ad-97ea-a530ee4b587f req-4f9d651a-6cb6-46df-8048-421fae45bbbd service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:03.155301 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-1140d885-a46f-47ad-97ea-a530ee4b587f req-4f9d651a-6cb6-46df-8048-421fae45bbbd service nova] Creating event network-vif-unplugged:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:13:03.161406 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-1140d885-a46f-47ad-97ea-a530ee4b587f req-4f9d651a-6cb6-46df-8048-421fae45bbbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044804 Aug 23 12:13:03.162292 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4192/8332] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:13:03.740646 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:03.741317 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:03.748909 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:03.749415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:03.749882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:03.750588 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:03.751067 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:03.751515 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:03.901152 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:03.909265 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6a083556-27e6-4317-83ea-8f82c10d794a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.172454 Aug 23 12:13:03.909863 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4141/8333] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:03 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:04.931207 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:04.932549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:04.939805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:04.940309 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:04.940809 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:04.941554 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:04.942018 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:04.942450 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:05.099777 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:05.109864 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9fb1a4cc-3113-4cfb-96da-df04350f50c6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.183043 Aug 23 12:13:05.120899 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4193/8334] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:04 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:06.131208 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:06.131882 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:06.140958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:06.141482 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:06.141942 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:06.142678 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:06.143156 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:06.143603 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:06.290666 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:06.299229 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-3d0dc5e9-8f26-4efe-b3c2-650f6e182c61 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.171875 Aug 23 12:13:06.300153 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4142/8335] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:06 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:07.323409 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:07.324177 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:07.332076 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:07.332571 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:07.333041 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:07.333760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:07.334249 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:07.334711 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:07.488061 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:07.496823 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-bc933cc5-4b86-466d-b391-e1d39d320665 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.178704 Aug 23 12:13:07.497419 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4194/8336] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:07 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:13:08.517604 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:08.518538 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:08.526489 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:08.526869 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:08.527378 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:08.528450 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:08.529032 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:08.529426 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:08.672079 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:08.680954 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-0df441dd-c43f-4df4-9d83-df52bb909a79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.167386 Aug 23 12:13:08.681527 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4143/8337] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:08 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:09.703168 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:09.703791 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:09.710750 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:09.711242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:09.711687 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:09.712395 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:09.713397 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:09.713838 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:09.844899 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:09.852647 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d6d6f70d-6128-4122-a1ab-98042e2018be tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.153335 Aug 23 12:13:09.853257 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4195/8338] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:09 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:10.872256 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell0:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:13:10.876656 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:10.877341 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:10.883638 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:10.884143 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:10.884602 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:10.885348 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:10.885854 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:10.886302 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:11.021389 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:11.030124 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c472b032-b753-465a-ac30-e12f161ae9e9 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.160070 Aug 23 12:13:11.030697 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4144/8339] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:10 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:12.051322 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:12.051866 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:12.054132 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:13:12.054811 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell0:SELECT=6 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:13:12.068769 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:12.069286 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:12.069732 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:12.070451 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:12.070924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:12.071359 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:12.223955 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:12.233001 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-9e97d94d-9e92-45d3-b32a-ab61010dd84e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.185601 Aug 23 12:13:12.233584 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4196/8340] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:12 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:13.163760 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [req-a8e23e7a-b2b7-4afd-a60f-3a2283352846 req-72fc9873-9c00-4432-bce8-c8751f46007d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194", "tag": "f3af73fc-4d51-43e2-8475-c775b8dfcefa"}]} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:13:13.174199 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a8e23e7a-b2b7-4afd-a60f-3a2283352846 req-72fc9873-9c00-4432-bce8-c8751f46007d service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:13.174708 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a8e23e7a-b2b7-4afd-a60f-3a2283352846 req-72fc9873-9c00-4432-bce8-c8751f46007d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:13.175162 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [req-a8e23e7a-b2b7-4afd-a60f-3a2283352846 req-72fc9873-9c00-4432-bce8-c8751f46007d service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:13.187566 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.compute.server_external_events [req-a8e23e7a-b2b7-4afd-a60f-3a2283352846 req-72fc9873-9c00-4432-bce8-c8751f46007d service nova] Creating event network-changed:f3af73fc-4d51-43e2-8475-c775b8dfcefa for instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 on n-h1-847009-13 Aug 23 12:13:13.192571 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [req-a8e23e7a-b2b7-4afd-a60f-3a2283352846 req-72fc9873-9c00-4432-bce8-c8751f46007d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107615 Aug 23 12:13:13.193300 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4145/8341] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:13:13.254009 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:13.254638 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:13.262246 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:13.262820 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:13.263242 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:13.264033 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:13.264563 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:13.265081 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:13.498387 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:13.506050 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-207c18db-c541-4c1a-ba25-15a780bc43f7 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.256036 Aug 23 12:13:13.506633 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4197/8342] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:13 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:14.528759 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:14.529494 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:14.536627 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:14.537114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:14.537585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:14.538309 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:14.538793 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:14.539245 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:14.674704 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:14.682975 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-566e83f3-f745-41b3-8453-126da2d30758 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.159175 Aug 23 12:13:14.683572 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4146/8343] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:14 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:15.703673 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:15.704428 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:15.711422 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:15.711912 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:15.712362 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:15.713097 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:15.714102 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:15.714545 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:15.920105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:15.927793 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-6bf18d63-bf7f-4a9f-8461-c66dda49a9b5 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.228136 Aug 23 12:13:15.928368 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4198/8344] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:15 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:16.949243 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:16.949871 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:16.956957 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:16.957459 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:16.957912 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:16.958621 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:16.959091 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:16.959530 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:17.100391 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:17.108325 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dfab385-cc47-48e9-a636-6ff8b79f4927 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.163677 Aug 23 12:13:17.108943 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4147/8345] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:16 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:18.129805 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:18.130425 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:18.137946 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:18.138331 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:18.138807 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:18.139591 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:18.140065 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:18.140500 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:18.275343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:18.284271 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f7cd9d42-f80c-4b73-88df-88d91eab57b4 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.158340 Aug 23 12:13:18.284870 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4199/8346] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:18 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:19.305536 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:19.306356 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:19.313403 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:19.313894 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:19.314349 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:19.315065 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:19.315542 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:19.316171 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:19.448923 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:19.456727 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-94782283-8e78-42e1-84eb-9e3e1f299375 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.155555 Aug 23 12:13:19.457332 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4148/8347] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:19 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:20.125361 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-b18cbd61-6087-466c-8c27-a42f261aefcb req-1117c469-1fb6-403e-9850-f8c548837a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194", "name": "network-vif-plugged", "status": "completed", "tag": "f3af73fc-4d51-43e2-8475-c775b8dfcefa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:13:20.136886 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b18cbd61-6087-466c-8c27-a42f261aefcb req-1117c469-1fb6-403e-9850-f8c548837a90 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:20.137412 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b18cbd61-6087-466c-8c27-a42f261aefcb req-1117c469-1fb6-403e-9850-f8c548837a90 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:20.138069 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-b18cbd61-6087-466c-8c27-a42f261aefcb req-1117c469-1fb6-403e-9850-f8c548837a90 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:20.149347 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-b18cbd61-6087-466c-8c27-a42f261aefcb req-1117c469-1fb6-403e-9850-f8c548837a90 service nova] Creating event network-vif-plugged:f3af73fc-4d51-43e2-8475-c775b8dfcefa for instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 on n-h1-847009-13 Aug 23 12:13:20.154371 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-b18cbd61-6087-466c-8c27-a42f261aefcb req-1117c469-1fb6-403e-9850-f8c548837a90 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Aug 23 12:13:20.154979 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4200/8348] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:13:20.479958 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:20.480662 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:20.487606 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:20.488114 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:20.488572 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:20.489346 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:20.489829 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:20.490293 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:20.678191 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:20.686748 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-5f00c96a-b92c-4d00-b1ee-199fcade278a tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1374 microversion: 2.1 time: 0.211287 Aug 23 12:13:20.687337 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4149/8349] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:20 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:21.708668 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:21.709549 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:21.716392 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:21.716917 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:21.717366 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:21.718068 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:21.718533 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:21.718966 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:21.904813 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:21.912820 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-d3cc2650-3b8c-4e01-8177-b388a80f5521 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1560 microversion: 2.1 time: 0.209209 Aug 23 12:13:21.913394 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4201/8350] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:21 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 12:13:21.934616 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:13:21.935257 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:13:21.939061 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=27 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:13:21.946851 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:21.947368 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:21.947863 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:21.948597 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:21.949108 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:21.949579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:22.091971 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:13:22.099826 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-a7d20c63-5f87-4dde-b7ed-67b29414b802 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1560 microversion: 2.1 time: 0.170164 Aug 23 12:13:22.100414 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4150/8351] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:13:21 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:13:24.081952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-5ac99793-ec1b-4ef6-a912-fa33e9c166bb req-8724c643-0f25-4081-8673-093ae9007bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194", "tag": "f3af73fc-4d51-43e2-8475-c775b8dfcefa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:13:24.092316 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5ac99793-ec1b-4ef6-a912-fa33e9c166bb req-8724c643-0f25-4081-8673-093ae9007bb3 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:13:24.092932 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5ac99793-ec1b-4ef6-a912-fa33e9c166bb req-8724c643-0f25-4081-8673-093ae9007bb3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:13:24.093653 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-5ac99793-ec1b-4ef6-a912-fa33e9c166bb req-8724c643-0f25-4081-8673-093ae9007bb3 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:13:24.105783 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-5ac99793-ec1b-4ef6-a912-fa33e9c166bb req-8724c643-0f25-4081-8673-093ae9007bb3 service nova] Creating event network-changed:f3af73fc-4d51-43e2-8475-c775b8dfcefa for instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 on n-h1-847009-13 Aug 23 12:13:24.111044 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-5ac99793-ec1b-4ef6-a912-fa33e9c166bb req-8724c643-0f25-4081-8673-093ae9007bb3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097282 Aug 23 12:13:24.111897 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4202/8352] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 12:14:17.404483 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:14:17.405141 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:14:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:14:18.846291 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:14:18.846873 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:14:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:15:22.882116 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:22.882889 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=62 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:22.887056 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-948994857"}} {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:15:22.889521 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:22.896812 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:22.897318 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:22.897784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:22.898495 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:22.898973 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:22.899412 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:23.094853 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-09682197-0d72-4e75-80b0-45371008a57d tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "POST /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194/action" status: 202 len: 0 microversion: 2.1 time: 0.214401 Aug 23 12:15:23.095594 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4151/8353] 10.222.0.78 () {60 vars in 1278 bytes} [Tue Aug 23 12:15:22 2022] POST /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 12:15:30.771307 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 12:15:30.772438 n-d-847009-13 devstack@n-api.service[128859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 12:15:30.773109 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:30.775210 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=62 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:30.780938 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-060576c6-f6ec-4a84-b9f5-d34b173d5714 req-f00bc8de-76e1-4256-ba9f-5a4485a01c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194", "name": "network-vif-plugged", "status": "completed", "tag": "f3af73fc-4d51-43e2-8475-c775b8dfcefa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:15:30.799486 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-060576c6-f6ec-4a84-b9f5-d34b173d5714 req-f00bc8de-76e1-4256-ba9f-5a4485a01c53 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:30.800329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-060576c6-f6ec-4a84-b9f5-d34b173d5714 req-f00bc8de-76e1-4256-ba9f-5a4485a01c53 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:30.800915 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-060576c6-f6ec-4a84-b9f5-d34b173d5714 req-f00bc8de-76e1-4256-ba9f-5a4485a01c53 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:30.821070 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-060576c6-f6ec-4a84-b9f5-d34b173d5714 req-f00bc8de-76e1-4256-ba9f-5a4485a01c53 service nova] Creating event network-vif-plugged:f3af73fc-4d51-43e2-8475-c775b8dfcefa for instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 on n-h1-847009-13 Aug 23 12:15:30.828838 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-060576c6-f6ec-4a84-b9f5-d34b173d5714 req-f00bc8de-76e1-4256-ba9f-5a4485a01c53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059167 Aug 23 12:15:30.829449 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4203/8354] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:15:41.062234 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_api:SELECT=2 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:41.063253 n-d-847009-13 devstack@n-api.service[128860]: DEBUG dbcounter [-] [128860] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:41.065541 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_cell1:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:41.066603 n-d-847009-13 devstack@n-api.service[128859]: DEBUG dbcounter [-] [128859] Writing DB stats nova_api:SELECT=2 {{(pid=128859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 12:15:41.068888 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:41.070050 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:41.070871 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-0df429c7-9126-462b-ba40-aa6616038135 req-b5f0930f-125a-4613-b381-cf80ecd49dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194", "tag": "f3af73fc-4d51-43e2-8475-c775b8dfcefa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:15:41.078824 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:41.079998 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:41.080681 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:41.081720 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:41.082370 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:41.083024 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:41.088611 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0df429c7-9126-462b-ba40-aa6616038135 req-b5f0930f-125a-4613-b381-cf80ecd49dbe service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:41.089431 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0df429c7-9126-462b-ba40-aa6616038135 req-b5f0930f-125a-4613-b381-cf80ecd49dbe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:41.089952 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-0df429c7-9126-462b-ba40-aa6616038135 req-b5f0930f-125a-4613-b381-cf80ecd49dbe service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:41.101794 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [5b32458f-2b22-42c6-a4aa-34a1c5af29c0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 49190. Aug 23 12:15:41.102892 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] [2c9fd351-974e-4fc4-a477-7859821dcf31] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 49192. Aug 23 12:15:41.105215 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-0df429c7-9126-462b-ba40-aa6616038135 req-b5f0930f-125a-4613-b381-cf80ecd49dbe service nova] Creating event network-changed:f3af73fc-4d51-43e2-8475-c775b8dfcefa for instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 on n-h1-847009-13 Aug 23 12:15:41.110388 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-0df429c7-9126-462b-ba40-aa6616038135 req-b5f0930f-125a-4613-b381-cf80ecd49dbe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047645 Aug 23 12:15:41.111352 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4204/8355] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 12:15:41.113579 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 12:15:41.202912 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-312096ca-c4d0-4604-bfc9-dfc78dbf1e39 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 204 len: 0 microversion: 2.1 time: 0.141880 Aug 23 12:15:41.208175 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4152/8356] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 12:15:41 2022] DELETE /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 12:15:41.214459 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:41.215105 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:41.221821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:41.222477 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:41.222924 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:41.223722 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:41.224220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:41.224625 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:41.378444 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:15:41.386515 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-13500e1b-ff3f-4346-97fd-f7ed22a9447c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1684 microversion: 2.1 time: 0.176522 Aug 23 12:15:41.387101 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4205/8357] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:41 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:15:42.408702 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:42.409444 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:42.416167 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:42.416669 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:42.417154 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:42.417861 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:42.418329 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:42.418766 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:42.562585 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:15:42.570575 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-33c4f573-d281-4b1e-a82b-631d18f42043 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1684 microversion: 2.1 time: 0.166763 Aug 23 12:15:42.571470 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4153/8358] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:42 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:15:43.497126 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-6971d588-3610-4cdd-94cf-3fce882bd7d5 req-4a9b7024-2922-427c-9d80-1414d228b4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194", "name": "network-vif-deleted", "tag": "f3af73fc-4d51-43e2-8475-c775b8dfcefa"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:15:43.509473 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6971d588-3610-4cdd-94cf-3fce882bd7d5 req-4a9b7024-2922-427c-9d80-1414d228b4a6 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:43.509953 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6971d588-3610-4cdd-94cf-3fce882bd7d5 req-4a9b7024-2922-427c-9d80-1414d228b4a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:43.510389 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-6971d588-3610-4cdd-94cf-3fce882bd7d5 req-4a9b7024-2922-427c-9d80-1414d228b4a6 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:43.521762 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-6971d588-3610-4cdd-94cf-3fce882bd7d5 req-4a9b7024-2922-427c-9d80-1414d228b4a6 service nova] Creating event network-vif-deleted:f3af73fc-4d51-43e2-8475-c775b8dfcefa for instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 on n-h1-847009-13 Aug 23 12:15:43.526658 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-6971d588-3610-4cdd-94cf-3fce882bd7d5 req-4a9b7024-2922-427c-9d80-1414d228b4a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Aug 23 12:15:43.527644 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4206/8359] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:15:43.592216 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:43.592908 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:43.600141 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:43.600651 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:43.601151 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:43.601910 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:43.602397 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:43.602846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:43.639692 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:43.640276 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:43.640757 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:43.641237 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.objects.instance [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lazy-loading 'fault' on Instance uuid 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 {{(pid=128860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 12:15:43.689747 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:15:43.697904 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-40c6d13b-6e87-44d3-af11-dcc8a41cfda6 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 200 len: 1339 microversion: 2.1 time: 0.109744 Aug 23 12:15:43.698593 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4154/8360] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:43 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 1339 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:15:44.720760 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:44.721474 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:44.727642 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:44.728141 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:44.728588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:44.729329 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:44.729804 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:44.730240 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:44.743974 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.wsgi [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] HTTP exception thrown: Instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 could not be found. Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Request method failure captured: Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: request: GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 HTTP/1.1 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Accept: application/json Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Accept-Encoding: identity Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Connection: close Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Content-Length: 0 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Content-Type: application/json Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Host: 10.222.0.78 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: Openstack-System-Scope: None Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: User-Agent: python-urllib3/1.26.11 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Auth-Token: gAAAAABjBMO3CmJDoY9pZxOA7ZWsbc4g9zoSBrSAWJn-oFncNhXLfZU0bSMMqrR4HAIsRG4FLNuRfo2CdGTZMcAMbr4Fq9ILUOjjf_wMTUr2XMpEO-IizFhtsa-xAJFAN2A6rN2Cuopuv6ADFSPLguPTJPX5aOs1Rk202kNuMfAvFN-c66t2Dwk Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Id: None Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Domain-Name: None Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Identity-Status: Confirmed Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Is-Admin-Project: True Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Id: default Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Domain-Name: Default Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Id: 0fc16fa7bf5d46be862d7020bd129187 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Project-Name: tempest-TestSnapshotPattern-2009181705 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Role: member,reader Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Roles: member,reader Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0fc16fa7bf5d46be862d7020bd129187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0fc16fa7bf5d46be862d7020bd129187", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc16fa7bf5d46be862d7020bd129187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc16fa7bf5d46be862d7020bd129187"}]}] Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant: tempest-TestSnapshotPattern-2009181705 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Id: 0fc16fa7bf5d46be862d7020bd129187 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-Tenant-Name: tempest-TestSnapshotPattern-2009181705 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-User: tempest-TestSnapshotPattern-2009181705-project Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Id: default Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-User-Domain-Name: Default Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-User-Id: 9028c0baf81b4054b06c5055105b1554 Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: X-User-Name: tempest-TestSnapshotPattern-2009181705-project Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: method: > Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: exception: Instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 could not be found. Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: action_args: {'id': '9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194'} Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 could not be found. Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 could not be found. Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:15:44.745723 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 could not be found. Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: ERROR nova.api.openstack.wsgi Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Returning 404 to user: Instance 9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 could not be found. {{(pid=128859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-f1d1bcf1-16d7-41a1-937c-a4c942ad0e79 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194" status: 404 len: 111 microversion: 2.1 time: 0.031466 Aug 23 12:15:44.752374 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4207/8361] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:44 2022] GET /compute/v2.1/servers/9f55c708-2b75-4ac3-8c3c-ce7f4e8f5194 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 12:15:46.103415 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:46.103945 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:46.105839 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-11954604-8db4-43cc-bd03-a0435e5c4272 req-efd4c326-2589-4774-adc1-144e9b181218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:15:46.112502 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:46.113083 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:46.113501 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:46.114424 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:46.114900 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:46.115342 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:46.117531 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-11954604-8db4-43cc-bd03-a0435e5c4272 req-efd4c326-2589-4774-adc1-144e9b181218 service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:46.118220 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-11954604-8db4-43cc-bd03-a0435e5c4272 req-efd4c326-2589-4774-adc1-144e9b181218 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:46.118658 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-11954604-8db4-43cc-bd03-a0435e5c4272 req-efd4c326-2589-4774-adc1-144e9b181218 service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:46.131884 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-11954604-8db4-43cc-bd03-a0435e5c4272 req-efd4c326-2589-4774-adc1-144e9b181218 service nova] Creating event network-changed:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:15:46.137128 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-11954604-8db4-43cc-bd03-a0435e5c4272 req-efd4c326-2589-4774-adc1-144e9b181218 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 Aug 23 12:15:46.138093 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4208/8362] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:15:46.142025 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Going to try to terminate instance {{(pid=128860) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 12:15:46.231455 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-6b157304-e018-42c5-93c2-5cc7a9acb206 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 204 len: 0 microversion: 2.1 time: 0.129733 Aug 23 12:15:46.232648 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4155/8363] 10.222.0.78 () {58 vars in 1239 bytes} [Tue Aug 23 12:15:46 2022] DELETE /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 12:15:46.242405 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:46.243343 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.compute.api [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128859) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:46.251439 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:46.251960 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:46.252408 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:46.253164 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:46.253647 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:46.254056 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:46.404588 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.policy [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:15:46.413040 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-fc4c3177-2dec-4628-88f3-634262c5fa51 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1684 microversion: 2.1 time: 0.175000 Aug 23 12:15:46.413612 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4209/8364] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:46 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:15:47.436770 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:47.437531 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:47.444979 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:47.445780 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:47.446246 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:47.446972 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:47.447634 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:47.448082 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:47.662287 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.policy [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9028c0baf81b4054b06c5055105b1554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc16fa7bf5d46be862d7020bd129187', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128860) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 12:15:47.670737 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-9dce776f-3f8a-4bac-bdff-bbc0ab58fee8 tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 200 len: 1684 microversion: 2.1 time: 0.238953 Aug 23 12:15:47.671327 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4156/8365] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:47 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 1684 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 12:15:47.869821 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [req-fdfae3bf-4bf7-4212-9bb7-c7f95a3f1830 req-6b014f58-6b2a-4dce-80c7-20de75ce9abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a3efe0-8d4d-4912-a730-6ba35a4761d6", "name": "network-vif-deleted", "tag": "020af7ac-74ff-4221-bff1-630d399865f1"}]} {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 12:15:47.881561 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fdfae3bf-4bf7-4212-9bb7-c7f95a3f1830 req-6b014f58-6b2a-4dce-80c7-20de75ce9abf service nova] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:47.882035 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fdfae3bf-4bf7-4212-9bb7-c7f95a3f1830 req-6b014f58-6b2a-4dce-80c7-20de75ce9abf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:47.882467 n-d-847009-13 devstack@n-api.service[128859]: DEBUG oslo_concurrency.lockutils [req-fdfae3bf-4bf7-4212-9bb7-c7f95a3f1830 req-6b014f58-6b2a-4dce-80c7-20de75ce9abf service nova] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:47.895675 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.compute.server_external_events [req-fdfae3bf-4bf7-4212-9bb7-c7f95a3f1830 req-6b014f58-6b2a-4dce-80c7-20de75ce9abf service nova] Creating event network-vif-deleted:020af7ac-74ff-4221-bff1-630d399865f1 for instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 on n-h2-847009-13 Aug 23 12:15:47.901857 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [req-fdfae3bf-4bf7-4212-9bb7-c7f95a3f1830 req-6b014f58-6b2a-4dce-80c7-20de75ce9abf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Aug 23 12:15:47.902454 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4210/8366] 10.222.0.78 () {64 vars in 1317 bytes} [Tue Aug 23 12:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 12:15:48.693211 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '>' {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:48.693860 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.compute.api [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] [instance: f1a3efe0-8d4d-4912-a730-6ba35a4761d6] Fetching instance by UUID {{(pid=128860) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 12:15:48.700784 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:48.701298 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:48.701846 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:48.702565 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Acquiring lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 12:15:48.703045 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 12:15:48.703493 n-d-847009-13 devstack@n-api.service[128860]: DEBUG oslo_concurrency.lockutils [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Lock "b4651072-3bad-40e5-b8b2-6cbc5d12f544" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 12:15:48.717121 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.wsgi [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] HTTP exception thrown: Instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 could not be found. Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Request method failure captured: Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: request: GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 HTTP/1.1 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Accept: application/json Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Accept-Encoding: identity Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Connection: close Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Content-Length: 0 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Content-Type: application/json Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Host: 10.222.0.78 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: Openstack-System-Scope: None Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: User-Agent: python-urllib3/1.26.11 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Auth-Token: gAAAAABjBMO3CmJDoY9pZxOA7ZWsbc4g9zoSBrSAWJn-oFncNhXLfZU0bSMMqrR4HAIsRG4FLNuRfo2CdGTZMcAMbr4Fq9ILUOjjf_wMTUr2XMpEO-IizFhtsa-xAJFAN2A6rN2Cuopuv6ADFSPLguPTJPX5aOs1Rk202kNuMfAvFN-c66t2Dwk Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Id: None Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Domain-Name: None Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Identity-Status: Confirmed Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Is-Admin-Project: True Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Id: default Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Domain-Name: Default Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Id: 0fc16fa7bf5d46be862d7020bd129187 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Project-Name: tempest-TestSnapshotPattern-2009181705 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Role: member,reader Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Roles: member,reader Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0fc16fa7bf5d46be862d7020bd129187"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0fc16fa7bf5d46be862d7020bd129187", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc16fa7bf5d46be862d7020bd129187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0fc16fa7bf5d46be862d7020bd129187"}]}] Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant: tempest-TestSnapshotPattern-2009181705 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Id: 0fc16fa7bf5d46be862d7020bd129187 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-Tenant-Name: tempest-TestSnapshotPattern-2009181705 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-User: tempest-TestSnapshotPattern-2009181705-project Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Id: default Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-User-Domain-Name: Default Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-User-Id: 9028c0baf81b4054b06c5055105b1554 Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: X-User-Name: tempest-TestSnapshotPattern-2009181705-project Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: method: > Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: exception: Instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 could not be found. Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: action_args: {'id': 'f1a3efe0-8d4d-4912-a730-6ba35a4761d6'} Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: {{(pid=128860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 could not be found. Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 could not be found. Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 12:15:48.718902 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 could not be found. Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: ERROR nova.api.openstack.wsgi Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: DEBUG nova.api.openstack.wsgi [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Returning 404 to user: Instance f1a3efe0-8d4d-4912-a730-6ba35a4761d6 could not be found. {{(pid=128860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: INFO nova.api.openstack.requestlog [None req-c06c45ef-7374-4972-b8fd-9e319087414c tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6" status: 404 len: 111 microversion: 2.1 time: 0.031296 Aug 23 12:15:48.725022 n-d-847009-13 devstack@n-api.service[128860]: [pid: 128860|app: 0|req: 4157/8367] 10.222.0.78 () {58 vars in 1236 bytes} [Tue Aug 23 12:15:48 2022] GET /compute/v2.1/servers/f1a3efe0-8d4d-4912-a730-6ba35a4761d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 12:15:48.881968 n-d-847009-13 devstack@n-api.service[128859]: DEBUG nova.api.openstack.wsgi [None req-30a0a50e-6e5c-4db5-b373-696d69849d3e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] Calling method '.version_select at 0x7fdc8f6083a0>' {{(pid=128859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 12:15:48.907309 n-d-847009-13 devstack@n-api.service[128859]: INFO nova.api.openstack.requestlog [None req-30a0a50e-6e5c-4db5-b373-696d69849d3e tempest-TestSnapshotPattern-2009181705 tempest-TestSnapshotPattern-2009181705-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1971156804" status: 202 len: 0 microversion: 2.1 time: 0.029268 Aug 23 12:15:48.908934 n-d-847009-13 devstack@n-api.service[128859]: [pid: 128859|app: 0|req: 4211/8368] 10.222.0.78 () {58 vars in 1257 bytes} [Tue Aug 23 12:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1971156804 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 12:16:47.474688 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:16:47.475299 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:16:48.927640 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:16:48.928265 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:19:17.413106 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:19:17.413739 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:19:18.855249 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:19:18.855811 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:19:37.315676 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:19:37.316246 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:19:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:19:59.091569 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:19:59.092114 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:19:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:21:47.482468 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:21:47.483117 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:21:48.936346 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:21:48.936961 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:24:17.422491 n-d-847009-13 devstack@n-api.service[128860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:24:17.423108 n-d-847009-13 devstack@n-api.service[128860]: Tue Aug 23 12:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 12:24:18.863368 n-d-847009-13 devstack@n-api.service[128859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 12:24:18.863943 n-d-847009-13 devstack@n-api.service[128859]: Tue Aug 23 12:24:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!